INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:55876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:37:32,479 - lava_callback - INFO - Received callback for node 6a0194d097995df55c487f94 2026-05-11 08:37:32,486 - lava_callback - INFO - Starting async job submit for node 6a0194d097995df55c487f94 INFO: 172.21.0.1:51770 - "POST /node/6a0194d097995df55c487f94 HTTP/1.0" 202 Accepted 2026-05-11 08:37:32,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:37:32,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0194d097995df55c487f94 HTTP/1.1" 200 None 2026-05-11 08:37:32,549 - lava_callback - DEBUG - Processing node 6a0194d097995df55c487f94: baseline-arm 2026-05-11 08:37:32,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:37:32,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:37:32,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a0194d097995df55c487f94/log.txt.gz 2026-05-11 08:37:33,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:37:33,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:37:33,190 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a0194d097995df55c487f94/lava-logs.yaml 2026-05-11 08:37:33,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:37:33,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:37:33,310 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a0194d097995df55c487f94/lava_callback.json.gz 2026-05-11 08:37:33,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:37:33,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0194d097995df55c487f94 HTTP/1.1" 200 None 2026-05-11 08:37:33,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:37:33,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912c97995df55c487f3d HTTP/1.1" 200 None 2026-05-11 08:37:33,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:37:33,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0194d097995df55c487f94 HTTP/1.1" 200 None 2026-05-11 08:37:33,391 - lava_callback - INFO - Completed processing callback for node 6a0194d097995df55c487f94 INFO: 172.21.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33906 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:38:03,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:03,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:38:28,999 - lava_callback - INFO - Received callback for node 69fef27e254d3291e98deff1 INFO: 172.21.0.1:44926 - "POST /node/69fef27e254d3291e98deff1 HTTP/1.0" 202 Accepted 2026-05-11 08:38:29,006 - lava_callback - INFO - Starting async job submit for node 69fef27e254d3291e98deff1 2026-05-11 08:38:29,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:29,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef27e254d3291e98deff1 HTTP/1.1" 200 None 2026-05-11 08:38:29,026 - lava_callback - DEBUG - Processing node 69fef27e254d3291e98deff1: baseline-arm-clabbe 2026-05-11 08:38:29,026 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef27e254d3291e98deff1 2026-05-11 08:38:29,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:29,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef27e254d3291e98deff1 HTTP/1.1" 200 None 2026-05-11 08:38:29,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:29,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-11 08:38:29,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:29,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef27e254d3291e98deff1 HTTP/1.1" 200 None 2026-05-11 08:38:29,107 - lava_callback - ERROR - Error processing callback for node 69fef27e254d3291e98deff1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42748 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:38:40,372 - lava_callback - INFO - Received callback for node 69fef289254d3291e98df01f INFO: 172.21.0.1:34020 - "POST /node/69fef289254d3291e98df01f HTTP/1.0" 202 Accepted 2026-05-11 08:38:40,381 - lava_callback - INFO - Starting async job submit for node 69fef289254d3291e98df01f 2026-05-11 08:38:40,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:40,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef289254d3291e98df01f HTTP/1.1" 200 None 2026-05-11 08:38:40,405 - lava_callback - DEBUG - Processing node 69fef289254d3291e98df01f: baseline-arm-baylibre 2026-05-11 08:38:40,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef289254d3291e98df01f 2026-05-11 08:38:40,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:40,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef289254d3291e98df01f HTTP/1.1" 200 None 2026-05-11 08:38:40,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:40,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-11 08:38:40,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:40,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef289254d3291e98df01f HTTP/1.1" 200 None 2026-05-11 08:38:40,485 - lava_callback - ERROR - Error processing callback for node 69fef289254d3291e98df01f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34030 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:38:48,885 - lava_callback - INFO - Received callback for node 69fef293254d3291e98df03c INFO: 172.21.0.1:34038 - "POST /node/69fef293254d3291e98df03c HTTP/1.0" 202 Accepted 2026-05-11 08:38:48,891 - lava_callback - INFO - Starting async job submit for node 69fef293254d3291e98df03c 2026-05-11 08:38:48,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:48,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef293254d3291e98df03c HTTP/1.1" 200 None 2026-05-11 08:38:48,906 - lava_callback - DEBUG - Processing node 69fef293254d3291e98df03c: baseline-arm-clabbe 2026-05-11 08:38:48,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef293254d3291e98df03c 2026-05-11 08:38:48,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:48,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef293254d3291e98df03c HTTP/1.1" 200 None 2026-05-11 08:38:48,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:48,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-11 08:38:48,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:48,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef293254d3291e98df03c HTTP/1.1" 200 None 2026-05-11 08:38:48,955 - lava_callback - ERROR - Error processing callback for node 69fef293254d3291e98df03c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:38:49,550 - lava_callback - INFO - Received callback for node 69fef297254d3291e98df049 INFO: 172.21.0.1:34048 - "POST /node/69fef297254d3291e98df049 HTTP/1.0" 202 Accepted 2026-05-11 08:38:49,556 - lava_callback - INFO - Starting async job submit for node 69fef297254d3291e98df049 2026-05-11 08:38:49,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:49,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef297254d3291e98df049 HTTP/1.1" 200 None 2026-05-11 08:38:49,571 - lava_callback - DEBUG - Processing node 69fef297254d3291e98df049: baseline-arm-clabbe 2026-05-11 08:38:49,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef297254d3291e98df049 2026-05-11 08:38:49,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:49,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef297254d3291e98df049 HTTP/1.1" 200 None 2026-05-11 08:38:49,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:49,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-11 08:38:49,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:38:49,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef297254d3291e98df049 HTTP/1.1" 200 None 2026-05-11 08:38:49,634 - lava_callback - ERROR - Error processing callback for node 69fef297254d3291e98df049: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54150 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:39:08,875 - lava_callback - INFO - Received callback for node 69fef298254d3291e98df04c INFO: 172.21.0.1:54166 - "POST /node/69fef298254d3291e98df04c HTTP/1.0" 202 Accepted 2026-05-11 08:39:08,884 - lava_callback - INFO - Starting async job submit for node 69fef298254d3291e98df04c 2026-05-11 08:39:08,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:08,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef298254d3291e98df04c HTTP/1.1" 200 None 2026-05-11 08:39:08,899 - lava_callback - DEBUG - Processing node 69fef298254d3291e98df04c: baseline-arm-clabbe 2026-05-11 08:39:08,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef298254d3291e98df04c 2026-05-11 08:39:08,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:08,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef298254d3291e98df04c HTTP/1.1" 200 None 2026-05-11 08:39:08,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:08,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-11 08:39:08,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:08,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef298254d3291e98df04c HTTP/1.1" 200 None 2026-05-11 08:39:08,953 - lava_callback - ERROR - Error processing callback for node 69fef298254d3291e98df04c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:39:09,570 - lava_callback - INFO - Received callback for node 69fef298254d3291e98df04f INFO: 172.21.0.1:54170 - "POST /node/69fef298254d3291e98df04f HTTP/1.0" 202 Accepted 2026-05-11 08:39:09,577 - lava_callback - INFO - Starting async job submit for node 69fef298254d3291e98df04f 2026-05-11 08:39:09,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:09,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef298254d3291e98df04f HTTP/1.1" 200 None 2026-05-11 08:39:09,592 - lava_callback - DEBUG - Processing node 69fef298254d3291e98df04f: baseline-arm-clabbe 2026-05-11 08:39:09,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef298254d3291e98df04f 2026-05-11 08:39:09,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:09,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef298254d3291e98df04f HTTP/1.1" 200 None 2026-05-11 08:39:09,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:09,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-11 08:39:09,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:09,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef298254d3291e98df04f HTTP/1.1" 200 None 2026-05-11 08:39:09,646 - lava_callback - ERROR - Error processing callback for node 69fef298254d3291e98df04f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:39:10,303 - lava_callback - INFO - Received callback for node 69fef299254d3291e98df052 INFO: 172.21.0.1:48890 - "POST /node/69fef299254d3291e98df052 HTTP/1.0" 202 Accepted 2026-05-11 08:39:10,310 - lava_callback - INFO - Starting async job submit for node 69fef299254d3291e98df052 2026-05-11 08:39:10,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:10,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef299254d3291e98df052 HTTP/1.1" 200 None 2026-05-11 08:39:10,331 - lava_callback - DEBUG - Processing node 69fef299254d3291e98df052: baseline-arm-clabbe 2026-05-11 08:39:10,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef299254d3291e98df052 2026-05-11 08:39:10,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:10,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef299254d3291e98df052 HTTP/1.1" 200 None 2026-05-11 08:39:10,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:10,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-11 08:39:10,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:10,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef299254d3291e98df052 HTTP/1.1" 200 None 2026-05-11 08:39:10,383 - lava_callback - ERROR - Error processing callback for node 69fef299254d3291e98df052: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:39:10,983 - lava_callback - INFO - Received callback for node 69fef29b254d3291e98df058 INFO: 172.21.0.1:48904 - "POST /node/69fef29b254d3291e98df058 HTTP/1.0" 202 Accepted 2026-05-11 08:39:10,991 - lava_callback - INFO - Starting async job submit for node 69fef29b254d3291e98df058 2026-05-11 08:39:10,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:11,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef29b254d3291e98df058 HTTP/1.1" 200 None 2026-05-11 08:39:11,009 - lava_callback - DEBUG - Processing node 69fef29b254d3291e98df058: baseline-arm-clabbe 2026-05-11 08:39:11,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef29b254d3291e98df058 2026-05-11 08:39:11,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:11,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef29b254d3291e98df058 HTTP/1.1" 200 None 2026-05-11 08:39:11,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:11,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-11 08:39:11,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:11,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef29b254d3291e98df058 HTTP/1.1" 200 None 2026-05-11 08:39:11,053 - lava_callback - ERROR - Error processing callback for node 69fef29b254d3291e98df058: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:39:25,445 - lava_callback - INFO - Received callback for node 6a0195b297995df55c487ff6 INFO: 172.21.0.1:33692 - "POST /node/6a0195b297995df55c487ff6 HTTP/1.0" 202 Accepted 2026-05-11 08:39:25,455 - lava_callback - INFO - Starting async job submit for node 6a0195b297995df55c487ff6 2026-05-11 08:39:25,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:25,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195b297995df55c487ff6 HTTP/1.1" 200 None 2026-05-11 08:39:25,473 - lava_callback - DEBUG - Processing node 6a0195b297995df55c487ff6: baseline-arm 2026-05-11 08:39:25,480 - lava_callback - WARNING - Failed to upload log 2026-05-11 08:39:25,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:39:25,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:39:25,621 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b297995df55c487ff6/lava-logs.yaml 2026-05-11 08:39:25,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:39:25,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:39:25,735 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b297995df55c487ff6/lava_callback.json.gz 2026-05-11 08:39:25,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:25,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195b297995df55c487ff6 HTTP/1.1" 200 None 2026-05-11 08:39:25,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:25,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:39:25,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:25,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195b297995df55c487ff6 HTTP/1.1" 200 None 2026-05-11 08:39:25,861 - lava_callback - INFO - Completed processing callback for node 6a0195b297995df55c487ff6 2026-05-11 08:39:26,505 - lava_callback - INFO - Received callback for node 6a0195a897995df55c487fc2 INFO: 172.21.0.1:33708 - "POST /node/6a0195a897995df55c487fc2 HTTP/1.0" 202 Accepted 2026-05-11 08:39:26,516 - lava_callback - INFO - Starting async job submit for node 6a0195a897995df55c487fc2 INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:39:26,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:26,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195a897995df55c487fc2 HTTP/1.1" 200 None 2026-05-11 08:39:26,553 - lava_callback - DEBUG - Processing node 6a0195a897995df55c487fc2: baseline-x86 2026-05-11 08:39:26,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:39:26,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:39:26,912 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-6a0195a897995df55c487fc2/log.txt.gz 2026-05-11 08:39:27,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:39:27,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:39:27,226 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-6a0195a897995df55c487fc2/lava-logs.yaml 2026-05-11 08:39:27,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:39:27,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:39:27,354 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-6a0195a897995df55c487fc2/lava_callback.json.gz 2026-05-11 08:39:27,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:27,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195a897995df55c487fc2 HTTP/1.1" 200 None 2026-05-11 08:39:27,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:27,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01914b97995df55c487f67 HTTP/1.1" 200 None 2026-05-11 08:39:27,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:27,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195a897995df55c487fc2 HTTP/1.1" 200 None 2026-05-11 08:39:27,427 - lava_callback - INFO - Completed processing callback for node 6a0195a897995df55c487fc2 2026-05-11 08:39:33,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:33,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:39:46,992 - lava_callback - INFO - Received callback for node 6a0195b597995df55c488002 INFO: 172.21.0.1:36478 - "POST /node/6a0195b597995df55c488002 HTTP/1.0" 202 Accepted 2026-05-11 08:39:47,046 - lava_callback - INFO - Starting async job submit for node 6a0195b597995df55c488002 2026-05-11 08:39:47,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:47,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195b597995df55c488002 HTTP/1.1" 200 None 2026-05-11 08:39:47,119 - lava_callback - DEBUG - Processing node 6a0195b597995df55c488002: baseline-arm 2026-05-11 08:39:47,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:39:47,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:39:47,457 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b597995df55c488002/log.txt.gz 2026-05-11 08:39:47,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:39:47,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:39:47,672 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b597995df55c488002/lava-logs.yaml 2026-05-11 08:39:47,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:39:47,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:39:47,812 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b597995df55c488002/lava_callback.json.gz 2026-05-11 08:39:47,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:47,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195b597995df55c488002 HTTP/1.1" 200 None 2026-05-11 08:39:47,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:47,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:39:47,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:47,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195b597995df55c488002 HTTP/1.1" 200 None 2026-05-11 08:39:47,892 - lava_callback - INFO - Completed processing callback for node 6a0195b597995df55c488002 INFO: 172.21.0.1:42368 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:39:50,982 - lava_callback - INFO - Received callback for node 6a0195aa97995df55c487fcb INFO: 172.21.0.1:42376 - "POST /node/6a0195aa97995df55c487fcb HTTP/1.0" 202 Accepted 2026-05-11 08:39:50,988 - lava_callback - INFO - Starting async job submit for node 6a0195aa97995df55c487fcb 2026-05-11 08:39:51,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:51,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195aa97995df55c487fcb HTTP/1.1" 200 None 2026-05-11 08:39:51,020 - lava_callback - DEBUG - Processing node 6a0195aa97995df55c487fcb: baseline-x86 2026-05-11 08:39:51,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:39:51,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:39:51,354 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-6a0195aa97995df55c487fcb/log.txt.gz 2026-05-11 08:39:51,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:39:51,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:39:51,682 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-6a0195aa97995df55c487fcb/lava-logs.yaml 2026-05-11 08:39:51,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:39:51,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:39:51,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-6a0195aa97995df55c487fcb/lava_callback.json.gz 2026-05-11 08:39:51,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:51,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195aa97995df55c487fcb HTTP/1.1" 200 None 2026-05-11 08:39:51,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:51,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01914b97995df55c487f67 HTTP/1.1" 200 None 2026-05-11 08:39:51,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:51,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195aa97995df55c487fcb HTTP/1.1" 200 None 2026-05-11 08:39:51,901 - lava_callback - INFO - Completed processing callback for node 6a0195aa97995df55c487fcb INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:39:59,689 - lava_callback - INFO - Received callback for node 6a0195b297995df55c487ff9 INFO: 172.21.0.1:42394 - "POST /node/6a0195b297995df55c487ff9 HTTP/1.0" 202 Accepted 2026-05-11 08:39:59,742 - lava_callback - INFO - Starting async job submit for node 6a0195b297995df55c487ff9 2026-05-11 08:39:59,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:39:59,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195b297995df55c487ff9 HTTP/1.1" 200 None 2026-05-11 08:39:59,792 - lava_callback - DEBUG - Processing node 6a0195b297995df55c487ff9: baseline-arm 2026-05-11 08:39:59,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:00,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:00,110 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b297995df55c487ff9/log.txt.gz 2026-05-11 08:40:00,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:00,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:00,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b297995df55c487ff9/lava-logs.yaml 2026-05-11 08:40:00,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:00,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:00,411 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b297995df55c487ff9/lava_callback.json.gz 2026-05-11 08:40:00,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:00,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195b297995df55c487ff9 HTTP/1.1" 200 None 2026-05-11 08:40:00,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:00,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:40:00,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:00,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195b297995df55c487ff9 HTTP/1.1" 200 None 2026-05-11 08:40:00,487 - lava_callback - INFO - Completed processing callback for node 6a0195b297995df55c487ff9 2026-05-11 08:40:03,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:03,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41494 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:40:33,106 - lava_callback - INFO - Received callback for node 6a0195a897995df55c487fc5 INFO: 172.21.0.1:43042 - "POST /node/6a0195a897995df55c487fc5 HTTP/1.0" 202 Accepted 2026-05-11 08:40:33,116 - lava_callback - INFO - Starting async job submit for node 6a0195a897995df55c487fc5 2026-05-11 08:40:33,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:33,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195a897995df55c487fc5 HTTP/1.1" 200 None 2026-05-11 08:40:33,151 - lava_callback - DEBUG - Processing node 6a0195a897995df55c487fc5: baseline-x86 2026-05-11 08:40:33,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:33,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:33,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-6a0195a897995df55c487fc5/log.txt.gz 2026-05-11 08:40:33,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:33,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:33,829 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-6a0195a897995df55c487fc5/lava-logs.yaml 2026-05-11 08:40:33,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:33,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:33,954 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-6a0195a897995df55c487fc5/lava_callback.json.gz 2026-05-11 08:40:33,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:34,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195a897995df55c487fc5 HTTP/1.1" 200 None 2026-05-11 08:40:34,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:34,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01914b97995df55c487f67 HTTP/1.1" 200 None 2026-05-11 08:40:34,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:34,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195a897995df55c487fc5 HTTP/1.1" 200 None 2026-05-11 08:40:34,053 - lava_callback - INFO - Completed processing callback for node 6a0195a897995df55c487fc5 INFO: 172.21.0.1:43050 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:40:46,025 - lava_callback - INFO - Received callback for node 6a0195b197995df55c487ff3 INFO: 172.21.0.1:47702 - "POST /node/6a0195b197995df55c487ff3 HTTP/1.0" 202 Accepted 2026-05-11 08:40:46,035 - lava_callback - INFO - Starting async job submit for node 6a0195b197995df55c487ff3 2026-05-11 08:40:46,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:46,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195b197995df55c487ff3 HTTP/1.1" 200 None 2026-05-11 08:40:46,082 - lava_callback - DEBUG - Processing node 6a0195b197995df55c487ff3: baseline-arm 2026-05-11 08:40:46,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47714 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:40:46,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:46,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b197995df55c487ff3/log.txt.gz 2026-05-11 08:40:46,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:46,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:46,998 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b197995df55c487ff3/lava-logs.yaml 2026-05-11 08:40:47,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:47,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:47,118 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b197995df55c487ff3/lava_callback.json.gz 2026-05-11 08:40:47,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:47,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195b197995df55c487ff3 HTTP/1.1" 200 None 2026-05-11 08:40:47,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:47,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:40:47,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:47,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195b197995df55c487ff3 HTTP/1.1" 200 None 2026-05-11 08:40:47,197 - lava_callback - INFO - Completed processing callback for node 6a0195b197995df55c487ff3 INFO: 172.21.0.1:58038 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:40:52,625 - lava_callback - INFO - Received callback for node 6a0195c397995df55c48802e INFO: 172.21.0.1:58050 - "POST /node/6a0195c397995df55c48802e HTTP/1.0" 202 Accepted 2026-05-11 08:40:52,632 - lava_callback - INFO - Starting async job submit for node 6a0195c397995df55c48802e 2026-05-11 08:40:52,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:52,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195c397995df55c48802e HTTP/1.1" 200 None 2026-05-11 08:40:52,701 - lava_callback - DEBUG - Processing node 6a0195c397995df55c48802e: baseline-arm-broonie 2026-05-11 08:40:52,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:53,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:53,070 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a0195c397995df55c48802e/log.txt.gz 2026-05-11 08:40:53,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:53,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:53,436 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a0195c397995df55c48802e/lava-logs.yaml 2026-05-11 08:40:53,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:53,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:53,580 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a0195c397995df55c48802e/lava_callback.json.gz 2026-05-11 08:40:53,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:53,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195c397995df55c48802e HTTP/1.1" 200 None 2026-05-11 08:40:53,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:53,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:40:53,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:53,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195c397995df55c48802e HTTP/1.1" 200 None 2026-05-11 08:40:53,689 - lava_callback - INFO - Completed processing callback for node 6a0195c397995df55c48802e INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:40:57,023 - lava_callback - INFO - Received callback for node 6a0195d797995df55c4880a2 INFO: 172.21.0.1:58074 - "POST /node/6a0195d797995df55c4880a2 HTTP/1.0" 202 Accepted 2026-05-11 08:40:57,073 - lava_callback - INFO - Starting async job submit for node 6a0195d797995df55c4880a2 2026-05-11 08:40:57,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:57,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195d797995df55c4880a2 HTTP/1.1" 200 None 2026-05-11 08:40:57,114 - lava_callback - DEBUG - Processing node 6a0195d797995df55c4880a2: baseline-arm-pengutronix 2026-05-11 08:40:57,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:57,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:57,359 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a0195d797995df55c4880a2/log.txt.gz 2026-05-11 08:40:57,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:57,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:57,564 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a0195d797995df55c4880a2/lava-logs.yaml 2026-05-11 08:40:57,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:40:57,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:40:57,655 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a0195d797995df55c4880a2/lava_callback.json.gz 2026-05-11 08:40:57,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:57,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195d797995df55c4880a2 HTTP/1.1" 200 None 2026-05-11 08:40:57,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:57,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:40:57,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:40:57,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195d797995df55c4880a2 HTTP/1.1" 200 None 2026-05-11 08:40:57,749 - lava_callback - INFO - Completed processing callback for node 6a0195d797995df55c4880a2 2026-05-11 08:41:01,447 - lava_callback - INFO - Received callback for node 6a0195d397995df55c488095 INFO: 172.21.0.1:60016 - "POST /node/6a0195d397995df55c488095 HTTP/1.0" 202 Accepted 2026-05-11 08:41:01,456 - lava_callback - INFO - Starting async job submit for node 6a0195d397995df55c488095 2026-05-11 08:41:01,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:01,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195d397995df55c488095 HTTP/1.1" 200 None 2026-05-11 08:41:01,511 - lava_callback - DEBUG - Processing node 6a0195d397995df55c488095: baseline-arm-pengutronix 2026-05-11 08:41:01,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:01,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:01,827 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a0195d397995df55c488095/log.txt.gz 2026-05-11 08:41:01,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:02,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:02,079 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a0195d397995df55c488095/lava-logs.yaml 2026-05-11 08:41:02,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:02,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:02,185 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a0195d397995df55c488095/lava_callback.json.gz 2026-05-11 08:41:02,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:02,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195d397995df55c488095 HTTP/1.1" 200 None 2026-05-11 08:41:02,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:02,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:41:02,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:02,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195d397995df55c488095 HTTP/1.1" 200 None 2026-05-11 08:41:02,278 - lava_callback - INFO - Completed processing callback for node 6a0195d397995df55c488095 2026-05-11 08:41:02,636 - lava_callback - INFO - Received callback for node 6a0195d497995df55c48809c INFO: 172.21.0.1:60020 - "POST /node/6a0195d497995df55c48809c HTTP/1.0" 202 Accepted 2026-05-11 08:41:02,646 - lava_callback - INFO - Starting async job submit for node 6a0195d497995df55c48809c 2026-05-11 08:41:02,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:02,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195d497995df55c48809c HTTP/1.1" 200 None 2026-05-11 08:41:02,688 - lava_callback - DEBUG - Processing node 6a0195d497995df55c48809c: baseline-arm-pengutronix 2026-05-11 08:41:02,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:02,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:02,978 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a0195d497995df55c48809c/log.txt.gz 2026-05-11 08:41:03,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:03,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:03,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a0195d497995df55c48809c/lava-logs.yaml 2026-05-11 08:41:03,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:03,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:03,361 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a0195d497995df55c48809c/lava_callback.json.gz 2026-05-11 08:41:03,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:03,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195d497995df55c48809c HTTP/1.1" 200 None 2026-05-11 08:41:03,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:03,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:41:03,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:03,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:03,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195d497995df55c48809c HTTP/1.1" 200 None 2026-05-11 08:41:03,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-11 08:41:03,533 - lava_callback - INFO - Completed processing callback for node 6a0195d497995df55c48809c INFO: 172.21.0.1:60026 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:41:11,000 - lava_callback - INFO - Received callback for node 6a0195c597995df55c488031 INFO: 172.21.0.1:53194 - "POST /node/6a0195c597995df55c488031 HTTP/1.0" 202 Accepted 2026-05-11 08:41:11,007 - lava_callback - INFO - Starting async job submit for node 6a0195c597995df55c488031 2026-05-11 08:41:11,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:11,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195c597995df55c488031 HTTP/1.1" 200 None 2026-05-11 08:41:11,068 - lava_callback - DEBUG - Processing node 6a0195c597995df55c488031: baseline-arm-broonie 2026-05-11 08:41:11,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:11,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:11,458 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a0195c597995df55c488031/log.txt.gz 2026-05-11 08:41:11,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:11,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:11,919 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a0195c597995df55c488031/lava-logs.yaml 2026-05-11 08:41:11,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:12,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:12,059 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a0195c597995df55c488031/lava_callback.json.gz 2026-05-11 08:41:12,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:12,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195c597995df55c488031 HTTP/1.1" 200 None 2026-05-11 08:41:12,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:12,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:41:12,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:12,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195c597995df55c488031 HTTP/1.1" 200 None 2026-05-11 08:41:12,159 - lava_callback - INFO - Completed processing callback for node 6a0195c597995df55c488031 2026-05-11 08:41:12,734 - lava_callback - INFO - Received callback for node 6a0195c297995df55c48802b INFO: 172.21.0.1:53196 - "POST /node/6a0195c297995df55c48802b HTTP/1.0" 202 Accepted 2026-05-11 08:41:12,743 - lava_callback - INFO - Starting async job submit for node 6a0195c297995df55c48802b 2026-05-11 08:41:12,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:12,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195c297995df55c48802b HTTP/1.1" 200 None 2026-05-11 08:41:12,801 - lava_callback - DEBUG - Processing node 6a0195c297995df55c48802b: baseline-arm-broonie 2026-05-11 08:41:13,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:13,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:13,214 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a0195c297995df55c48802b/log.txt.gz 2026-05-11 08:41:13,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:13,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:13,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a0195c297995df55c48802b/lava-logs.yaml 2026-05-11 08:41:13,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:13,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:13,641 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a0195c297995df55c48802b/lava_callback.json.gz 2026-05-11 08:41:13,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:13,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195c297995df55c48802b HTTP/1.1" 200 None 2026-05-11 08:41:13,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:13,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:41:13,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:13,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195c297995df55c48802b HTTP/1.1" 200 None 2026-05-11 08:41:13,735 - lava_callback - INFO - Completed processing callback for node 6a0195c297995df55c48802b INFO: 172.21.0.1:53208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50224 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:41:32,565 - lava_callback - INFO - Received callback for node 6a0195c197995df55c488027 INFO: 172.21.0.1:42632 - "POST /node/6a0195c197995df55c488027 HTTP/1.0" 202 Accepted 2026-05-11 08:41:32,575 - lava_callback - INFO - Starting async job submit for node 6a0195c197995df55c488027 2026-05-11 08:41:32,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:32,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195c197995df55c488027 HTTP/1.1" 200 None 2026-05-11 08:41:32,643 - lava_callback - DEBUG - Processing node 6a0195c197995df55c488027: baseline-arm-broonie 2026-05-11 08:41:32,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:33,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:33,036 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a0195c197995df55c488027/log.txt.gz 2026-05-11 08:41:33,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:33,334 - lava_callback - INFO - Received callback for node 6a0195a997995df55c487fc8 2026-05-11 08:41:33,340 - lava_callback - INFO - Starting async job submit for node 6a0195a997995df55c487fc8 INFO: 172.21.0.1:42648 - "POST /node/6a0195a997995df55c487fc8 HTTP/1.0" 202 Accepted 2026-05-11 08:41:33,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:33,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:33,366 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a0195c197995df55c488027/lava-logs.yaml 2026-05-11 08:41:33,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:33,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195a997995df55c487fc8 HTTP/1.1" 200 None 2026-05-11 08:41:33,397 - lava_callback - DEBUG - Processing node 6a0195a997995df55c487fc8: baseline-x86 2026-05-11 08:41:33,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:33,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-11 08:41:33,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:33,701 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-6a0195c197995df55c488027/lava_callback.json.gz 2026-05-11 08:41:33,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:33,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:33,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195c197995df55c488027 HTTP/1.1" 200 None 2026-05-11 08:41:33,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:33,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:41:33,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:33,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195c197995df55c488027 HTTP/1.1" 200 None 2026-05-11 08:41:33,890 - lava_callback - INFO - Completed processing callback for node 6a0195c197995df55c488027 2026-05-11 08:41:34,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:34,028 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-6a0195a997995df55c487fc8/log.txt.gz 2026-05-11 08:41:34,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:34,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:34,446 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-6a0195a997995df55c487fc8/lava-logs.yaml 2026-05-11 08:41:34,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:34,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:34,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-6a0195a997995df55c487fc8/lava_callback.json.gz 2026-05-11 08:41:34,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:34,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195a997995df55c487fc8 HTTP/1.1" 200 None 2026-05-11 08:41:34,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:34,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01914b97995df55c487f67 HTTP/1.1" 200 None 2026-05-11 08:41:34,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:34,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195a997995df55c487fc8 HTTP/1.1" 200 None 2026-05-11 08:41:34,692 - lava_callback - INFO - Completed processing callback for node 6a0195a997995df55c487fc8 INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:41:37,387 - lava_callback - INFO - Received callback for node 6a0195cf97995df55c488087 INFO: 172.21.0.1:42656 - "POST /node/6a0195cf97995df55c488087 HTTP/1.0" 202 Accepted 2026-05-11 08:41:37,393 - lava_callback - INFO - Starting async job submit for node 6a0195cf97995df55c488087 2026-05-11 08:41:37,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:37,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195cf97995df55c488087 HTTP/1.1" 200 None 2026-05-11 08:41:37,454 - lava_callback - DEBUG - Processing node 6a0195cf97995df55c488087: baseline-arm-kontron 2026-05-11 08:41:37,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:37,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:37,736 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-6a0195cf97995df55c488087/log.txt.gz 2026-05-11 08:41:37,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:37,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:37,994 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-6a0195cf97995df55c488087/lava-logs.yaml 2026-05-11 08:41:37,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:38,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:38,092 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-6a0195cf97995df55c488087/lava_callback.json.gz 2026-05-11 08:41:38,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:38,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195cf97995df55c488087 HTTP/1.1" 200 None 2026-05-11 08:41:38,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:38,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:41:38,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:38,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195cf97995df55c488087 HTTP/1.1" 200 None 2026-05-11 08:41:38,167 - lava_callback - INFO - Completed processing callback for node 6a0195cf97995df55c488087 2026-05-11 08:41:38,584 - lava_callback - INFO - Received callback for node 6a0195d197995df55c48808a INFO: 172.21.0.1:42670 - "POST /node/6a0195d197995df55c48808a HTTP/1.0" 202 Accepted 2026-05-11 08:41:38,590 - lava_callback - INFO - Starting async job submit for node 6a0195d197995df55c48808a 2026-05-11 08:41:38,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:38,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195d197995df55c48808a HTTP/1.1" 200 None 2026-05-11 08:41:38,633 - lava_callback - DEBUG - Processing node 6a0195d197995df55c48808a: baseline-arm-kontron 2026-05-11 08:41:38,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:38,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:38,907 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-6a0195d197995df55c48808a/log.txt.gz 2026-05-11 08:41:39,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:39,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:39,132 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-6a0195d197995df55c48808a/lava-logs.yaml 2026-05-11 08:41:39,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:39,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:39,246 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-6a0195d197995df55c48808a/lava_callback.json.gz 2026-05-11 08:41:39,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:39,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195d197995df55c48808a HTTP/1.1" 200 None 2026-05-11 08:41:39,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:39,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:41:39,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:39,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195d197995df55c48808a HTTP/1.1" 200 None 2026-05-11 08:41:39,321 - lava_callback - INFO - Completed processing callback for node 6a0195d197995df55c48808a 2026-05-11 08:41:41,359 - lava_callback - INFO - Received callback for node 6a0195c897995df55c488044 INFO: 172.21.0.1:42764 - "POST /node/6a0195c897995df55c488044 HTTP/1.0" 202 Accepted 2026-05-11 08:41:41,365 - lava_callback - INFO - Starting async job submit for node 6a0195c897995df55c488044 2026-05-11 08:41:41,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:41,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195c897995df55c488044 HTTP/1.1" 200 None 2026-05-11 08:41:41,410 - lava_callback - DEBUG - Processing node 6a0195c897995df55c488044: baseline-arm-clabbe 2026-05-11 08:41:41,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:41,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:41,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a0195c897995df55c488044/log.txt.gz 2026-05-11 08:41:41,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:41,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:41,971 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a0195c897995df55c488044/lava-logs.yaml 2026-05-11 08:41:41,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:41:42,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:41:42,067 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a0195c897995df55c488044/lava_callback.json.gz 2026-05-11 08:41:42,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:42,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195c897995df55c488044 HTTP/1.1" 200 None 2026-05-11 08:41:42,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:42,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:41:42,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:42,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195c897995df55c488044 HTTP/1.1" 200 None 2026-05-11 08:41:42,173 - lava_callback - INFO - Completed processing callback for node 6a0195c897995df55c488044 INFO: 172.21.0.1:42770 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:41:49,386 - lava_callback - INFO - Received callback for node 69fef338254d3291e98df1b6 INFO: 172.21.0.1:42782 - "POST /node/69fef338254d3291e98df1b6 HTTP/1.0" 202 Accepted 2026-05-11 08:41:49,392 - lava_callback - INFO - Starting async job submit for node 69fef338254d3291e98df1b6 2026-05-11 08:41:49,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:49,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef338254d3291e98df1b6 HTTP/1.1" 200 None 2026-05-11 08:41:49,407 - lava_callback - DEBUG - Processing node 69fef338254d3291e98df1b6: baseline-arm-clabbe 2026-05-11 08:41:49,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef338254d3291e98df1b6 2026-05-11 08:41:49,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:49,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef338254d3291e98df1b6 HTTP/1.1" 200 None 2026-05-11 08:41:49,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:49,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-11 08:41:49,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:41:49,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef338254d3291e98df1b6 HTTP/1.1" 200 None 2026-05-11 08:41:49,455 - lava_callback - ERROR - Error processing callback for node 69fef338254d3291e98df1b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:42:03,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:42:03,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39438 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:42:30,903 - lava_callback - INFO - Received callback for node 6a0195c997995df55c488048 INFO: 172.21.0.1:56150 - "POST /node/6a0195c997995df55c488048 HTTP/1.0" 202 Accepted 2026-05-11 08:42:30,909 - lava_callback - INFO - Starting async job submit for node 6a0195c997995df55c488048 2026-05-11 08:42:30,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:42:30,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195c997995df55c488048 HTTP/1.1" 200 None 2026-05-11 08:42:30,944 - lava_callback - DEBUG - Processing node 6a0195c997995df55c488048: baseline-arm-clabbe 2026-05-11 08:42:31,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:42:31,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:42:31,225 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a0195c997995df55c488048/log.txt.gz 2026-05-11 08:42:31,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:42:31,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:42:31,484 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a0195c997995df55c488048/lava-logs.yaml 2026-05-11 08:42:31,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:42:31,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:42:31,587 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a0195c997995df55c488048/lava_callback.json.gz 2026-05-11 08:42:31,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:42:31,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195c997995df55c488048 HTTP/1.1" 200 None 2026-05-11 08:42:31,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:42:31,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:42:31,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:42:31,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195c997995df55c488048 HTTP/1.1" 200 None 2026-05-11 08:42:31,677 - lava_callback - INFO - Completed processing callback for node 6a0195c997995df55c488048 2026-05-11 08:42:33,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:42:33,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59962 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:43:33,032 - lava_callback - INFO - Received callback for node 6a0195cd97995df55c488081 INFO: 172.21.0.1:52452 - "POST /node/6a0195cd97995df55c488081 HTTP/1.0" 202 Accepted 2026-05-11 08:43:33,038 - lava_callback - INFO - Starting async job submit for node 6a0195cd97995df55c488081 2026-05-11 08:43:33,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:43:33,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195cd97995df55c488081 HTTP/1.1" 200 None 2026-05-11 08:43:33,086 - lava_callback - DEBUG - Processing node 6a0195cd97995df55c488081: baseline-arm-clabbe 2026-05-11 08:43:33,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:43:33,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:43:33,403 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a0195cd97995df55c488081/log.txt.gz 2026-05-11 08:43:33,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:43:33,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:43:33,698 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a0195cd97995df55c488081/lava-logs.yaml 2026-05-11 08:43:33,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:43:33,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:43:33,835 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-6a0195cd97995df55c488081/lava_callback.json.gz 2026-05-11 08:43:33,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:43:33,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195cd97995df55c488081 HTTP/1.1" 200 None 2026-05-11 08:43:33,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:43:33,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:43:33,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:43:33,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195cd97995df55c488081 HTTP/1.1" 200 None 2026-05-11 08:43:33,910 - lava_callback - INFO - Completed processing callback for node 6a0195cd97995df55c488081 INFO: 172.21.0.1:52460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:44:03,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:03,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55678 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:44:11,329 - lava_callback - INFO - Received callback for node 6a0195e797995df55c4880bc INFO: 172.21.0.1:36490 - "POST /node/6a0195e797995df55c4880bc HTTP/1.0" 202 Accepted 2026-05-11 08:44:11,337 - lava_callback - INFO - Starting async job submit for node 6a0195e797995df55c4880bc 2026-05-11 08:44:11,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:11,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195e797995df55c4880bc HTTP/1.1" 200 None 2026-05-11 08:44:11,387 - lava_callback - DEBUG - Processing node 6a0195e797995df55c4880bc: ltp-cap_bounds 2026-05-11 08:44:11,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:44:11,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:44:11,964 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-6a0195e797995df55c4880bc/log.txt.gz 2026-05-11 08:44:12,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:44:12,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:44:12,559 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-6a0195e797995df55c4880bc/lava-logs.yaml 2026-05-11 08:44:12,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:44:12,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:44:12,725 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-6a0195e797995df55c4880bc/lava_callback.json.gz 2026-05-11 08:44:12,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:12,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195e797995df55c4880bc HTTP/1.1" 200 None 2026-05-11 08:44:12,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:12,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:44:12,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:12,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195e797995df55c4880bc HTTP/1.1" 200 None 2026-05-11 08:44:12,821 - lava_callback - INFO - Completed processing callback for node 6a0195e797995df55c4880bc 2026-05-11 08:44:12,967 - lava_callback - INFO - Received callback for node 6a0195ec97995df55c4880de INFO: 172.21.0.1:36492 - "POST /node/6a0195ec97995df55c4880de HTTP/1.0" 202 Accepted 2026-05-11 08:44:12,978 - lava_callback - INFO - Starting async job submit for node 6a0195ec97995df55c4880de 2026-05-11 08:44:13,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:13,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195ec97995df55c4880de HTTP/1.1" 200 None 2026-05-11 08:44:13,050 - lava_callback - DEBUG - Processing node 6a0195ec97995df55c4880de: ltp-cve 2026-05-11 08:44:13,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:44:13,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:44:13,668 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-6a0195ec97995df55c4880de/log.txt.gz 2026-05-11 08:44:13,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:44:14,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:44:14,095 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-6a0195ec97995df55c4880de/lava-logs.yaml 2026-05-11 08:44:14,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:44:14,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:44:14,237 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-6a0195ec97995df55c4880de/lava_callback.json.gz 2026-05-11 08:44:14,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:14,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195ec97995df55c4880de HTTP/1.1" 200 None 2026-05-11 08:44:14,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:14,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:44:14,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:14,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195ec97995df55c4880de HTTP/1.1" 200 None 2026-05-11 08:44:14,316 - lava_callback - INFO - Completed processing callback for node 6a0195ec97995df55c4880de INFO: 172.21.0.1:36506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:44:31,722 - lava_callback - INFO - Received callback for node 6a0195e897995df55c4880bf INFO: 172.21.0.1:55336 - "POST /node/6a0195e897995df55c4880bf HTTP/1.0" 202 Accepted 2026-05-11 08:44:31,730 - lava_callback - INFO - Starting async job submit for node 6a0195e897995df55c4880bf 2026-05-11 08:44:31,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:31,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195e897995df55c4880bf HTTP/1.1" 200 None 2026-05-11 08:44:31,783 - lava_callback - DEBUG - Processing node 6a0195e897995df55c4880bf: ltp-containers 2026-05-11 08:44:32,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:44:32,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:44:32,529 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-6a0195e897995df55c4880bf/log.txt.gz 2026-05-11 08:44:32,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:44:32,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:44:32,941 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-6a0195e897995df55c4880bf/lava-logs.yaml 2026-05-11 08:44:32,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:44:33,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:44:33,079 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-6a0195e897995df55c4880bf/lava_callback.json.gz 2026-05-11 08:44:33,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:33,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195e897995df55c4880bf HTTP/1.1" 200 None 2026-05-11 08:44:33,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:33,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:44:33,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:33,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195e897995df55c4880bf HTTP/1.1" 200 None 2026-05-11 08:44:33,164 - lava_callback - INFO - Completed processing callback for node 6a0195e897995df55c4880bf 2026-05-11 08:44:33,323 - lava_callback - INFO - Received callback for node 6a0195f997995df55c4880f9 INFO: 172.21.0.1:55342 - "POST /node/6a0195f997995df55c4880f9 HTTP/1.0" 202 Accepted 2026-05-11 08:44:33,336 - lava_callback - INFO - Starting async job submit for node 6a0195f997995df55c4880f9 2026-05-11 08:44:33,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:33,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f997995df55c4880f9 HTTP/1.1" 200 None 2026-05-11 08:44:33,431 - lava_callback - DEBUG - Processing node 6a0195f997995df55c4880f9: ltp-syscalls 2026-05-11 08:44:33,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:33,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-11 08:44:34,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:44:34,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:44:34,524 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-6a0195f997995df55c4880f9/log.txt.gz 2026-05-11 08:44:35,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:44:35,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:44:35,226 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-6a0195f997995df55c4880f9/lava-logs.yaml 2026-05-11 08:44:35,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:44:35,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:44:35,362 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-6a0195f997995df55c4880f9/lava_callback.json.gz 2026-05-11 08:44:35,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:35,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f997995df55c4880f9 HTTP/1.1" 200 None 2026-05-11 08:44:35,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:35,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:44:35,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:35,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195f997995df55c4880f9 HTTP/1.1" 200 None 2026-05-11 08:44:35,470 - lava_callback - INFO - Completed processing callback for node 6a0195f997995df55c4880f9 INFO: 172.21.0.1:55348 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:44:40,687 - lava_callback - INFO - Received callback for node 69fef3eb254d3291e98df245 INFO: 172.21.0.1:40628 - "POST /node/69fef3eb254d3291e98df245 HTTP/1.0" 202 Accepted 2026-05-11 08:44:40,694 - lava_callback - INFO - Starting async job submit for node 69fef3eb254d3291e98df245 2026-05-11 08:44:40,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:40,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef3eb254d3291e98df245 HTTP/1.1" 200 None 2026-05-11 08:44:40,711 - lava_callback - DEBUG - Processing node 69fef3eb254d3291e98df245: baseline-arm-baylibre 2026-05-11 08:44:40,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef3eb254d3291e98df245 2026-05-11 08:44:40,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:40,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef3eb254d3291e98df245 HTTP/1.1" 200 None 2026-05-11 08:44:40,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:40,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-11 08:44:40,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:44:40,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef3eb254d3291e98df245 HTTP/1.1" 200 None 2026-05-11 08:44:40,789 - lava_callback - ERROR - Error processing callback for node 69fef3eb254d3291e98df245: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:45:03,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:03,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57332 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:45:07,976 - lava_callback - INFO - Received callback for node 6a01970997995df55c4881e5 INFO: 172.21.0.1:57342 - "POST /node/6a01970997995df55c4881e5 HTTP/1.0" 202 Accepted 2026-05-11 08:45:07,985 - lava_callback - INFO - Starting async job submit for node 6a01970997995df55c4881e5 2026-05-11 08:45:07,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:08,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01970997995df55c4881e5 HTTP/1.1" 200 None 2026-05-11 08:45:08,013 - lava_callback - DEBUG - Processing node 6a01970997995df55c4881e5: baseline-arm 2026-05-11 08:45:08,022 - lava_callback - WARNING - Failed to upload log 2026-05-11 08:45:08,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:45:08,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:45:08,234 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a01970997995df55c4881e5/lava-logs.yaml 2026-05-11 08:45:08,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:45:08,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:45:08,407 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a01970997995df55c4881e5/lava_callback.json.gz 2026-05-11 08:45:08,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:08,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01970997995df55c4881e5 HTTP/1.1" 200 None 2026-05-11 08:45:08,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:08,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:45:08,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:08,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01970997995df55c4881e5 HTTP/1.1" 200 None 2026-05-11 08:45:08,520 - lava_callback - INFO - Completed processing callback for node 6a01970997995df55c4881e5 INFO: 172.21.0.1:60440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:45:20,682 - lava_callback - INFO - Received callback for node 69fef410254d3291e98df256 INFO: 172.21.0.1:56818 - "POST /node/69fef410254d3291e98df256 HTTP/1.0" 202 Accepted 2026-05-11 08:45:20,693 - lava_callback - INFO - Starting async job submit for node 69fef410254d3291e98df256 2026-05-11 08:45:20,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:20,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef410254d3291e98df256 HTTP/1.1" 200 None 2026-05-11 08:45:20,725 - lava_callback - DEBUG - Processing node 69fef410254d3291e98df256: baseline-arm-baylibre 2026-05-11 08:45:20,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef410254d3291e98df256 2026-05-11 08:45:20,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:20,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef410254d3291e98df256 HTTP/1.1" 200 None 2026-05-11 08:45:20,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:20,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-11 08:45:20,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:20,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef410254d3291e98df256 HTTP/1.1" 200 None 2026-05-11 08:45:20,828 - lava_callback - ERROR - Error processing callback for node 69fef410254d3291e98df256: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:45:32,946 - lava_callback - INFO - Received callback for node 6a0195ef97995df55c4880e4 INFO: 172.21.0.1:56834 - "POST /node/6a0195ef97995df55c4880e4 HTTP/1.0" 202 Accepted 2026-05-11 08:45:32,955 - lava_callback - INFO - Starting async job submit for node 6a0195ef97995df55c4880e4 2026-05-11 08:45:32,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:32,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195ef97995df55c4880e4 HTTP/1.1" 200 None 2026-05-11 08:45:33,000 - lava_callback - DEBUG - Processing node 6a0195ef97995df55c4880e4: ltp-fs_bind 2026-05-11 08:45:33,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:45:33,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:45:33,534 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-6a0195ef97995df55c4880e4/log.txt.gz 2026-05-11 08:45:33,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:45:33,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:33,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-11 08:45:33,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:45:33,988 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-6a0195ef97995df55c4880e4/lava-logs.yaml 2026-05-11 08:45:33,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:45:34,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:45:34,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-6a0195ef97995df55c4880e4/lava_callback.json.gz 2026-05-11 08:45:34,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:34,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195ef97995df55c4880e4 HTTP/1.1" 200 None 2026-05-11 08:45:34,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:34,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:45:34,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:45:34,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195ef97995df55c4880e4 HTTP/1.1" 200 None 2026-05-11 08:45:34,390 - lava_callback - INFO - Completed processing callback for node 6a0195ef97995df55c4880e4 INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43782 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:46:00,766 - lava_callback - INFO - Received callback for node 69fef435254d3291e98df265 INFO: 172.21.0.1:58396 - "POST /node/69fef435254d3291e98df265 HTTP/1.0" 202 Accepted 2026-05-11 08:46:00,772 - lava_callback - INFO - Starting async job submit for node 69fef435254d3291e98df265 2026-05-11 08:46:00,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:00,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef435254d3291e98df265 HTTP/1.1" 200 None 2026-05-11 08:46:00,787 - lava_callback - DEBUG - Processing node 69fef435254d3291e98df265: baseline-arm-baylibre 2026-05-11 08:46:00,787 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef435254d3291e98df265 2026-05-11 08:46:00,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:00,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef435254d3291e98df265 HTTP/1.1" 200 None 2026-05-11 08:46:00,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:00,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-11 08:46:00,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:00,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef435254d3291e98df265 HTTP/1.1" 200 None 2026-05-11 08:46:00,832 - lava_callback - ERROR - Error processing callback for node 69fef435254d3291e98df265: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:46:03,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:03,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58410 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:46:11,333 - lava_callback - INFO - Received callback for node 6a0195ea97995df55c4880c3 INFO: 172.21.0.1:51382 - "POST /node/6a0195ea97995df55c4880c3 HTTP/1.0" 202 Accepted 2026-05-11 08:46:11,341 - lava_callback - INFO - Starting async job submit for node 6a0195ea97995df55c4880c3 2026-05-11 08:46:11,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:11,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195ea97995df55c4880c3 HTTP/1.1" 200 None 2026-05-11 08:46:11,381 - lava_callback - DEBUG - Processing node 6a0195ea97995df55c4880c3: ltp-controllers 2026-05-11 08:46:11,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:46:12,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:46:12,002 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-6a0195ea97995df55c4880c3/log.txt.gz 2026-05-11 08:46:12,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:46:12,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:46:12,696 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-6a0195ea97995df55c4880c3/lava-logs.yaml 2026-05-11 08:46:12,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:46:12,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:46:12,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-6a0195ea97995df55c4880c3/lava_callback.json.gz 2026-05-11 08:46:12,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:12,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195ea97995df55c4880c3 HTTP/1.1" 200 None 2026-05-11 08:46:12,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:12,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:46:12,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:12,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195ea97995df55c4880c3 HTTP/1.1" 200 None 2026-05-11 08:46:12,923 - lava_callback - INFO - Completed processing callback for node 6a0195ea97995df55c4880c3 INFO: 172.21.0.1:51386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51400 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:46:20,716 - lava_callback - INFO - Received callback for node 69fef459254d3291e98df285 INFO: 172.21.0.1:57404 - "POST /node/69fef459254d3291e98df285 HTTP/1.0" 202 Accepted 2026-05-11 08:46:20,722 - lava_callback - INFO - Starting async job submit for node 69fef459254d3291e98df285 2026-05-11 08:46:20,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:20,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef459254d3291e98df285 HTTP/1.1" 200 None 2026-05-11 08:46:20,738 - lava_callback - DEBUG - Processing node 69fef459254d3291e98df285: baseline-arm-baylibre 2026-05-11 08:46:20,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef459254d3291e98df285 2026-05-11 08:46:20,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:20,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef459254d3291e98df285 HTTP/1.1" 200 None 2026-05-11 08:46:20,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:20,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-11 08:46:20,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:20,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef459254d3291e98df285 HTTP/1.1" 200 None 2026-05-11 08:46:20,784 - lava_callback - ERROR - Error processing callback for node 69fef459254d3291e98df285: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57414 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:46:33,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:46:33,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:47:00,801 - lava_callback - INFO - Received callback for node 69fef480254d3291e98df2a2 INFO: 172.21.0.1:51804 - "POST /node/69fef480254d3291e98df2a2 HTTP/1.0" 202 Accepted 2026-05-11 08:47:00,807 - lava_callback - INFO - Starting async job submit for node 69fef480254d3291e98df2a2 2026-05-11 08:47:00,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:47:00,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef480254d3291e98df2a2 HTTP/1.1" 200 None 2026-05-11 08:47:00,823 - lava_callback - DEBUG - Processing node 69fef480254d3291e98df2a2: baseline-arm-baylibre 2026-05-11 08:47:00,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef480254d3291e98df2a2 2026-05-11 08:47:00,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:47:00,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef480254d3291e98df2a2 HTTP/1.1" 200 None 2026-05-11 08:47:00,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:47:00,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-11 08:47:00,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:47:00,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef480254d3291e98df2a2 HTTP/1.1" 200 None 2026-05-11 08:47:00,869 - lava_callback - ERROR - Error processing callback for node 69fef480254d3291e98df2a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56298 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:47:40,824 - lava_callback - INFO - Received callback for node 69fef4a7254d3291e98df2f9 INFO: 172.21.0.1:53082 - "POST /node/69fef4a7254d3291e98df2f9 HTTP/1.0" 202 Accepted 2026-05-11 08:47:40,829 - lava_callback - INFO - Starting async job submit for node 69fef4a7254d3291e98df2f9 2026-05-11 08:47:40,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:47:40,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a7254d3291e98df2f9 HTTP/1.1" 200 None 2026-05-11 08:47:40,844 - lava_callback - DEBUG - Processing node 69fef4a7254d3291e98df2f9: baseline-arm-baylibre 2026-05-11 08:47:40,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef4a7254d3291e98df2f9 2026-05-11 08:47:40,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:47:40,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a7254d3291e98df2f9 HTTP/1.1" 200 None 2026-05-11 08:47:40,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:47:40,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-11 08:47:40,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:47:40,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4a7254d3291e98df2f9 HTTP/1.1" 200 None 2026-05-11 08:47:40,897 - lava_callback - ERROR - Error processing callback for node 69fef4a7254d3291e98df2f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53480 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:48:00,833 - lava_callback - INFO - Received callback for node 69fef4b7254d3291e98df32b INFO: 172.21.0.1:43738 - "POST /node/69fef4b7254d3291e98df32b HTTP/1.0" 202 Accepted 2026-05-11 08:48:00,838 - lava_callback - INFO - Starting async job submit for node 69fef4b7254d3291e98df32b 2026-05-11 08:48:00,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:00,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4b7254d3291e98df32b HTTP/1.1" 200 None 2026-05-11 08:48:00,864 - lava_callback - DEBUG - Processing node 69fef4b7254d3291e98df32b: baseline-arm64-baylibre 2026-05-11 08:48:00,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef4b7254d3291e98df32b 2026-05-11 08:48:00,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:00,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4b7254d3291e98df32b HTTP/1.1" 200 None 2026-05-11 08:48:00,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:00,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-11 08:48:00,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:00,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4b7254d3291e98df32b HTTP/1.1" 200 None 2026-05-11 08:48:00,911 - lava_callback - ERROR - Error processing callback for node 69fef4b7254d3291e98df32b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:48:01,488 - lava_callback - INFO - Received callback for node 69fef4ba254d3291e98df359 INFO: 172.21.0.1:43754 - "POST /node/69fef4ba254d3291e98df359 HTTP/1.0" 202 Accepted 2026-05-11 08:48:01,493 - lava_callback - INFO - Starting async job submit for node 69fef4ba254d3291e98df359 2026-05-11 08:48:01,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:01,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4ba254d3291e98df359 HTTP/1.1" 200 None 2026-05-11 08:48:01,508 - lava_callback - DEBUG - Processing node 69fef4ba254d3291e98df359: baseline-arm64-baylibre 2026-05-11 08:48:01,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef4ba254d3291e98df359 2026-05-11 08:48:01,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:01,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4ba254d3291e98df359 HTTP/1.1" 200 None 2026-05-11 08:48:01,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:01,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-11 08:48:01,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:01,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4ba254d3291e98df359 HTTP/1.1" 200 None 2026-05-11 08:48:01,558 - lava_callback - ERROR - Error processing callback for node 69fef4ba254d3291e98df359: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:48:02,131 - lava_callback - INFO - Received callback for node 69fef4bb254d3291e98df35c INFO: 172.21.0.1:43760 - "POST /node/69fef4bb254d3291e98df35c HTTP/1.0" 202 Accepted 2026-05-11 08:48:02,137 - lava_callback - INFO - Starting async job submit for node 69fef4bb254d3291e98df35c 2026-05-11 08:48:02,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:02,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4bb254d3291e98df35c HTTP/1.1" 200 None 2026-05-11 08:48:02,159 - lava_callback - DEBUG - Processing node 69fef4bb254d3291e98df35c: baseline-arm64-baylibre 2026-05-11 08:48:02,159 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef4bb254d3291e98df35c 2026-05-11 08:48:02,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:02,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4bb254d3291e98df35c HTTP/1.1" 200 None 2026-05-11 08:48:02,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:02,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-11 08:48:02,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:02,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4bb254d3291e98df35c HTTP/1.1" 200 None 2026-05-11 08:48:02,213 - lava_callback - ERROR - Error processing callback for node 69fef4bb254d3291e98df35c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:48:02,812 - lava_callback - INFO - Received callback for node 69fef4bd254d3291e98df35f INFO: 172.21.0.1:43764 - "POST /node/69fef4bd254d3291e98df35f HTTP/1.0" 202 Accepted 2026-05-11 08:48:02,817 - lava_callback - INFO - Starting async job submit for node 69fef4bd254d3291e98df35f 2026-05-11 08:48:02,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:02,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4bd254d3291e98df35f HTTP/1.1" 200 None 2026-05-11 08:48:02,832 - lava_callback - DEBUG - Processing node 69fef4bd254d3291e98df35f: baseline-arm64-baylibre 2026-05-11 08:48:02,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef4bd254d3291e98df35f 2026-05-11 08:48:02,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:02,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4bd254d3291e98df35f HTTP/1.1" 200 None 2026-05-11 08:48:02,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:02,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-11 08:48:02,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:02,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4bd254d3291e98df35f HTTP/1.1" 200 None 2026-05-11 08:48:02,883 - lava_callback - ERROR - Error processing callback for node 69fef4bd254d3291e98df35f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:48:11,429 - lava_callback - INFO - Received callback for node 6a0195f197995df55c4880e7 INFO: 172.21.0.1:45150 - "POST /node/6a0195f197995df55c4880e7 HTTP/1.0" 202 Accepted 2026-05-11 08:48:11,435 - lava_callback - INFO - Starting async job submit for node 6a0195f197995df55c4880e7 2026-05-11 08:48:11,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:11,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f197995df55c4880e7 HTTP/1.1" 200 None 2026-05-11 08:48:11,474 - lava_callback - DEBUG - Processing node 6a0195f197995df55c4880e7: ltp-fsx 2026-05-11 08:48:11,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:48:11,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:48:11,952 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-6a0195f197995df55c4880e7/log.txt.gz 2026-05-11 08:48:12,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:48:12,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:48:12,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-6a0195f197995df55c4880e7/lava-logs.yaml 2026-05-11 08:48:12,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:48:12,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:48:12,784 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-6a0195f197995df55c4880e7/lava_callback.json.gz 2026-05-11 08:48:12,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:12,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f197995df55c4880e7 HTTP/1.1" 200 None 2026-05-11 08:48:12,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:12,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:48:12,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:12,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195f197995df55c4880e7 HTTP/1.1" 200 None 2026-05-11 08:48:12,863 - lava_callback - INFO - Completed processing callback for node 6a0195f197995df55c4880e7 2026-05-11 08:48:13,183 - lava_callback - INFO - Received callback for node 6a0195f297995df55c4880ea INFO: 172.21.0.1:45164 - "POST /node/6a0195f297995df55c4880ea HTTP/1.0" 202 Accepted 2026-05-11 08:48:13,190 - lava_callback - INFO - Starting async job submit for node 6a0195f297995df55c4880ea 2026-05-11 08:48:13,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:13,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f297995df55c4880ea HTTP/1.1" 200 None 2026-05-11 08:48:13,230 - lava_callback - DEBUG - Processing node 6a0195f297995df55c4880ea: ltp-input 2026-05-11 08:48:13,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:48:13,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:48:13,709 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-6a0195f297995df55c4880ea/log.txt.gz 2026-05-11 08:48:13,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:48:14,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:48:14,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-6a0195f297995df55c4880ea/lava-logs.yaml 2026-05-11 08:48:14,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:48:14,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:48:14,348 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-6a0195f297995df55c4880ea/lava_callback.json.gz 2026-05-11 08:48:14,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:14,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f297995df55c4880ea HTTP/1.1" 200 None 2026-05-11 08:48:14,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:14,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:48:14,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:14,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195f297995df55c4880ea HTTP/1.1" 200 None 2026-05-11 08:48:14,429 - lava_callback - INFO - Completed processing callback for node 6a0195f297995df55c4880ea INFO: 172.21.0.1:45170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51988 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:48:29,561 - lava_callback - INFO - Received callback for node 69fef4cf254d3291e98df399 INFO: 172.21.0.1:51992 - "POST /node/69fef4cf254d3291e98df399 HTTP/1.0" 202 Accepted 2026-05-11 08:48:29,567 - lava_callback - INFO - Starting async job submit for node 69fef4cf254d3291e98df399 2026-05-11 08:48:29,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:29,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4cf254d3291e98df399 HTTP/1.1" 200 None 2026-05-11 08:48:29,583 - lava_callback - DEBUG - Processing node 69fef4cf254d3291e98df399: baseline-arm-clabbe 2026-05-11 08:48:29,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef4cf254d3291e98df399 2026-05-11 08:48:29,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:29,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4cf254d3291e98df399 HTTP/1.1" 200 None 2026-05-11 08:48:29,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:29,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-11 08:48:29,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:29,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4cf254d3291e98df399 HTTP/1.1" 200 None 2026-05-11 08:48:29,645 - lava_callback - ERROR - Error processing callback for node 69fef4cf254d3291e98df399: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:48:30,268 - lava_callback - INFO - Received callback for node 69fef4cc254d3291e98df38c INFO: 172.21.0.1:34396 - "POST /node/69fef4cc254d3291e98df38c HTTP/1.0" 202 Accepted 2026-05-11 08:48:30,273 - lava_callback - INFO - Starting async job submit for node 69fef4cc254d3291e98df38c 2026-05-11 08:48:30,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:30,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4cc254d3291e98df38c HTTP/1.1" 200 None 2026-05-11 08:48:30,288 - lava_callback - DEBUG - Processing node 69fef4cc254d3291e98df38c: baseline-arm64-clabbe 2026-05-11 08:48:30,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef4cc254d3291e98df38c 2026-05-11 08:48:30,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:30,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4cc254d3291e98df38c HTTP/1.1" 200 None 2026-05-11 08:48:30,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:30,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-11 08:48:30,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:30,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4cc254d3291e98df38c HTTP/1.1" 200 None 2026-05-11 08:48:30,340 - lava_callback - ERROR - Error processing callback for node 69fef4cc254d3291e98df38c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:48:30,976 - lava_callback - INFO - Received callback for node 69fef4ce254d3291e98df38f INFO: 172.21.0.1:34412 - "POST /node/69fef4ce254d3291e98df38f HTTP/1.0" 202 Accepted 2026-05-11 08:48:30,982 - lava_callback - INFO - Starting async job submit for node 69fef4ce254d3291e98df38f 2026-05-11 08:48:30,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:30,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4ce254d3291e98df38f HTTP/1.1" 200 None 2026-05-11 08:48:30,997 - lava_callback - DEBUG - Processing node 69fef4ce254d3291e98df38f: baseline-arm64-clabbe 2026-05-11 08:48:30,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef4ce254d3291e98df38f 2026-05-11 08:48:30,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:31,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4ce254d3291e98df38f HTTP/1.1" 200 None 2026-05-11 08:48:31,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:31,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-11 08:48:31,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:31,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4ce254d3291e98df38f HTTP/1.1" 200 None 2026-05-11 08:48:31,048 - lava_callback - ERROR - Error processing callback for node 69fef4ce254d3291e98df38f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:48:31,723 - lava_callback - INFO - Received callback for node 69fef4ce254d3291e98df394 INFO: 172.21.0.1:34416 - "POST /node/69fef4ce254d3291e98df394 HTTP/1.0" 202 Accepted 2026-05-11 08:48:31,729 - lava_callback - INFO - Starting async job submit for node 69fef4ce254d3291e98df394 2026-05-11 08:48:31,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:31,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4ce254d3291e98df394 HTTP/1.1" 200 None 2026-05-11 08:48:31,747 - lava_callback - DEBUG - Processing node 69fef4ce254d3291e98df394: baseline-arm64-clabbe 2026-05-11 08:48:31,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef4ce254d3291e98df394 2026-05-11 08:48:31,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:31,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4ce254d3291e98df394 HTTP/1.1" 200 None 2026-05-11 08:48:31,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:31,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-11 08:48:31,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:31,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4ce254d3291e98df394 HTTP/1.1" 200 None 2026-05-11 08:48:31,793 - lava_callback - ERROR - Error processing callback for node 69fef4ce254d3291e98df394: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:48:33,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:33,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-11 08:48:35,656 - lava_callback - INFO - Received callback for node 69fef4cf254d3291e98df397 INFO: 172.21.0.1:34426 - "POST /node/69fef4cf254d3291e98df397 HTTP/1.0" 202 Accepted 2026-05-11 08:48:35,661 - lava_callback - INFO - Starting async job submit for node 69fef4cf254d3291e98df397 2026-05-11 08:48:35,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:35,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4cf254d3291e98df397 HTTP/1.1" 200 None 2026-05-11 08:48:35,684 - lava_callback - DEBUG - Processing node 69fef4cf254d3291e98df397: baseline-arm64-clabbe 2026-05-11 08:48:35,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef4cf254d3291e98df397 2026-05-11 08:48:35,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:35,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4cf254d3291e98df397 HTTP/1.1" 200 None 2026-05-11 08:48:35,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:35,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-11 08:48:35,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:35,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4cf254d3291e98df397 HTTP/1.1" 200 None 2026-05-11 08:48:35,746 - lava_callback - ERROR - Error processing callback for node 69fef4cf254d3291e98df397: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34442 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:48:37,520 - lava_callback - INFO - Received callback for node 69fef4d1254d3291e98df3a3 INFO: 172.21.0.1:34454 - "POST /node/69fef4d1254d3291e98df3a3 HTTP/1.0" 202 Accepted 2026-05-11 08:48:37,525 - lava_callback - INFO - Starting async job submit for node 69fef4d1254d3291e98df3a3 2026-05-11 08:48:37,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:37,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d1254d3291e98df3a3 HTTP/1.1" 200 None 2026-05-11 08:48:37,552 - lava_callback - DEBUG - Processing node 69fef4d1254d3291e98df3a3: baseline-arm64-clabbe 2026-05-11 08:48:37,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef4d1254d3291e98df3a3 2026-05-11 08:48:37,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:37,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d1254d3291e98df3a3 HTTP/1.1" 200 None 2026-05-11 08:48:37,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:37,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-11 08:48:37,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:37,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4d1254d3291e98df3a3 HTTP/1.1" 200 None 2026-05-11 08:48:37,631 - lava_callback - ERROR - Error processing callback for node 69fef4d1254d3291e98df3a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:48:38,830 - lava_callback - INFO - Received callback for node 69fef4d1254d3291e98df39f INFO: 172.21.0.1:34470 - "POST /node/69fef4d1254d3291e98df39f HTTP/1.0" 202 Accepted 2026-05-11 08:48:38,838 - lava_callback - INFO - Starting async job submit for node 69fef4d1254d3291e98df39f 2026-05-11 08:48:38,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:38,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d1254d3291e98df39f HTTP/1.1" 200 None 2026-05-11 08:48:38,853 - lava_callback - DEBUG - Processing node 69fef4d1254d3291e98df39f: baseline-arm64-clabbe 2026-05-11 08:48:38,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef4d1254d3291e98df39f 2026-05-11 08:48:38,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:38,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d1254d3291e98df39f HTTP/1.1" 200 None 2026-05-11 08:48:38,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:38,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-11 08:48:38,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:38,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4d1254d3291e98df39f HTTP/1.1" 200 None 2026-05-11 08:48:38,906 - lava_callback - ERROR - Error processing callback for node 69fef4d1254d3291e98df39f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41786 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:48:51,455 - lava_callback - INFO - Received callback for node 6a0195f497995df55c4880ed INFO: 172.21.0.1:41788 - "POST /node/6a0195f497995df55c4880ed HTTP/1.0" 202 Accepted 2026-05-11 08:48:51,462 - lava_callback - INFO - Starting async job submit for node 6a0195f497995df55c4880ed 2026-05-11 08:48:51,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:51,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f497995df55c4880ed HTTP/1.1" 200 None 2026-05-11 08:48:51,500 - lava_callback - DEBUG - Processing node 6a0195f497995df55c4880ed: ltp-ipc 2026-05-11 08:48:51,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:48:52,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:48:52,141 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-6a0195f497995df55c4880ed/log.txt.gz 2026-05-11 08:48:52,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:48:52,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:48:52,509 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-6a0195f497995df55c4880ed/lava-logs.yaml 2026-05-11 08:48:52,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:48:52,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:48:52,643 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-6a0195f497995df55c4880ed/lava_callback.json.gz 2026-05-11 08:48:52,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:52,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f497995df55c4880ed HTTP/1.1" 200 None 2026-05-11 08:48:52,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:52,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:48:52,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:48:52,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195f497995df55c4880ed HTTP/1.1" 200 None 2026-05-11 08:48:52,722 - lava_callback - INFO - Completed processing callback for node 6a0195f497995df55c4880ed INFO: 172.21.0.1:41800 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:49:03,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:49:03,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:49:09,544 - lava_callback - INFO - Received callback for node 69fef4f6254d3291e98df41b INFO: 172.21.0.1:41824 - "POST /node/69fef4f6254d3291e98df41b HTTP/1.0" 202 Accepted 2026-05-11 08:49:09,549 - lava_callback - INFO - Starting async job submit for node 69fef4f6254d3291e98df41b 2026-05-11 08:49:09,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:49:09,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4f6254d3291e98df41b HTTP/1.1" 200 None 2026-05-11 08:49:09,564 - lava_callback - DEBUG - Processing node 69fef4f6254d3291e98df41b: baseline-arm-clabbe 2026-05-11 08:49:09,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef4f6254d3291e98df41b 2026-05-11 08:49:09,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:49:09,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4f6254d3291e98df41b HTTP/1.1" 200 None 2026-05-11 08:49:09,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:49:09,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-11 08:49:09,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:49:09,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4f6254d3291e98df41b HTTP/1.1" 200 None 2026-05-11 08:49:09,611 - lava_callback - ERROR - Error processing callback for node 69fef4f6254d3291e98df41b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58000 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:49:33,111 - lava_callback - INFO - Received callback for node 6a0195f597995df55c4880f0 INFO: 172.21.0.1:46578 - "POST /node/6a0195f597995df55c4880f0 HTTP/1.0" 202 Accepted 2026-05-11 08:49:33,117 - lava_callback - INFO - Starting async job submit for node 6a0195f597995df55c4880f0 2026-05-11 08:49:33,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:49:33,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f597995df55c4880f0 HTTP/1.1" 200 None 2026-05-11 08:49:33,159 - lava_callback - DEBUG - Processing node 6a0195f597995df55c4880f0: ltp-pty 2026-05-11 08:49:33,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:49:33,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:49:33,622 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-6a0195f597995df55c4880f0/log.txt.gz 2026-05-11 08:49:33,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:49:34,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:49:34,016 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-6a0195f597995df55c4880f0/lava-logs.yaml 2026-05-11 08:49:34,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:49:34,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:49:34,184 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-6a0195f597995df55c4880f0/lava_callback.json.gz 2026-05-11 08:49:34,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:49:34,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f597995df55c4880f0 HTTP/1.1" 200 None 2026-05-11 08:49:34,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:49:34,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:49:34,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:49:34,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195f597995df55c4880f0 HTTP/1.1" 200 None 2026-05-11 08:49:34,333 - lava_callback - INFO - Completed processing callback for node 6a0195f597995df55c4880f0 INFO: 172.21.0.1:46592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:49:49,386 - lava_callback - INFO - Received callback for node 69fef51e254d3291e98df47b INFO: 172.21.0.1:54002 - "POST /node/69fef51e254d3291e98df47b HTTP/1.0" 202 Accepted 2026-05-11 08:49:49,392 - lava_callback - INFO - Starting async job submit for node 69fef51e254d3291e98df47b 2026-05-11 08:49:49,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:49:49,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef51e254d3291e98df47b HTTP/1.1" 200 None 2026-05-11 08:49:49,407 - lava_callback - DEBUG - Processing node 69fef51e254d3291e98df47b: baseline-arm-clabbe 2026-05-11 08:49:49,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef51e254d3291e98df47b 2026-05-11 08:49:49,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:49:49,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef51e254d3291e98df47b HTTP/1.1" 200 None 2026-05-11 08:49:49,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:49:49,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-11 08:49:49,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:49:49,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef51e254d3291e98df47b HTTP/1.1" 200 None 2026-05-11 08:49:49,454 - lava_callback - ERROR - Error processing callback for node 69fef51e254d3291e98df47b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:50:03,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:50:03,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:50:29,748 - lava_callback - INFO - Received callback for node 69fef544254d3291e98df4cf INFO: 172.21.0.1:51538 - "POST /node/69fef544254d3291e98df4cf HTTP/1.0" 202 Accepted 2026-05-11 08:50:29,754 - lava_callback - INFO - Starting async job submit for node 69fef544254d3291e98df4cf 2026-05-11 08:50:29,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:50:29,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef544254d3291e98df4cf HTTP/1.1" 200 None 2026-05-11 08:50:29,770 - lava_callback - DEBUG - Processing node 69fef544254d3291e98df4cf: baseline-arm-clabbe 2026-05-11 08:50:29,770 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef544254d3291e98df4cf 2026-05-11 08:50:29,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:50:29,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef544254d3291e98df4cf HTTP/1.1" 200 None 2026-05-11 08:50:29,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:50:29,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-11 08:50:29,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:50:29,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef544254d3291e98df4cf HTTP/1.1" 200 None 2026-05-11 08:50:29,818 - lava_callback - ERROR - Error processing callback for node 69fef544254d3291e98df4cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:51:09,574 - lava_callback - INFO - Received callback for node 69fef56b254d3291e98df508 INFO: 172.21.0.1:41524 - "POST /node/69fef56b254d3291e98df508 HTTP/1.0" 202 Accepted 2026-05-11 08:51:09,580 - lava_callback - INFO - Starting async job submit for node 69fef56b254d3291e98df508 2026-05-11 08:51:09,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:51:09,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef56b254d3291e98df508 HTTP/1.1" 200 None 2026-05-11 08:51:09,595 - lava_callback - DEBUG - Processing node 69fef56b254d3291e98df508: baseline-arm-clabbe 2026-05-11 08:51:09,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef56b254d3291e98df508 2026-05-11 08:51:09,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:51:09,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef56b254d3291e98df508 HTTP/1.1" 200 None 2026-05-11 08:51:09,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:51:09,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-11 08:51:09,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:51:09,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef56b254d3291e98df508 HTTP/1.1" 200 None 2026-05-11 08:51:09,641 - lava_callback - ERROR - Error processing callback for node 69fef56b254d3291e98df508: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:51:31,128 - lava_callback - INFO - Received callback for node 6a01982697995df55c488842 INFO: 172.21.0.1:40568 - "POST /node/6a01982697995df55c488842 HTTP/1.0" 202 Accepted 2026-05-11 08:51:31,134 - lava_callback - INFO - Starting async job submit for node 6a01982697995df55c488842 2026-05-11 08:51:31,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:51:31,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01982697995df55c488842 HTTP/1.1" 200 None 2026-05-11 08:51:31,170 - lava_callback - DEBUG - Processing node 6a01982697995df55c488842: baseline-x86 2026-05-11 08:51:31,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:51:31,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:51:31,586 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-6a01982697995df55c488842/log.txt.gz 2026-05-11 08:51:31,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:51:31,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:51:31,881 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-6a01982697995df55c488842/lava-logs.yaml 2026-05-11 08:51:31,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:51:31,978 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:51:31,980 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-6a01982697995df55c488842/lava_callback.json.gz 2026-05-11 08:51:31,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:51:32,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01982697995df55c488842 HTTP/1.1" 200 None 2026-05-11 08:51:32,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:51:32,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01914b97995df55c487f67 HTTP/1.1" 200 None 2026-05-11 08:51:32,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:51:32,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01982697995df55c488842 HTTP/1.1" 200 None 2026-05-11 08:51:32,065 - lava_callback - INFO - Completed processing callback for node 6a01982697995df55c488842 2026-05-11 08:51:33,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:51:34,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52178 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:51:50,446 - lava_callback - INFO - Received callback for node 69fef591254d3291e98df52c INFO: 172.21.0.1:38706 - "POST /node/69fef591254d3291e98df52c HTTP/1.0" 202 Accepted 2026-05-11 08:51:50,457 - lava_callback - INFO - Starting async job submit for node 69fef591254d3291e98df52c 2026-05-11 08:51:50,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:51:50,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef591254d3291e98df52c HTTP/1.1" 200 None 2026-05-11 08:51:50,484 - lava_callback - DEBUG - Processing node 69fef591254d3291e98df52c: baseline-arm-clabbe 2026-05-11 08:51:50,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef591254d3291e98df52c 2026-05-11 08:51:50,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:51:50,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef591254d3291e98df52c HTTP/1.1" 200 None 2026-05-11 08:51:50,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:51:50,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-11 08:51:50,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:51:50,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef591254d3291e98df52c HTTP/1.1" 200 None 2026-05-11 08:51:50,561 - lava_callback - ERROR - Error processing callback for node 69fef591254d3291e98df52c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37690 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:52:11,575 - lava_callback - INFO - Received callback for node 6a0195f897995df55c4880f6 INFO: 172.21.0.1:56546 - "POST /node/6a0195f897995df55c4880f6 HTTP/1.0" 202 Accepted 2026-05-11 08:52:11,583 - lava_callback - INFO - Starting async job submit for node 6a0195f897995df55c4880f6 2026-05-11 08:52:11,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:52:11,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f897995df55c4880f6 HTTP/1.1" 200 None 2026-05-11 08:52:11,633 - lava_callback - DEBUG - Processing node 6a0195f897995df55c4880f6: ltp-smoke 2026-05-11 08:52:12,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:52:12,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:52:12,311 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-6a0195f897995df55c4880f6/log.txt.gz 2026-05-11 08:52:12,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:52:13,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:52:13,049 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-6a0195f897995df55c4880f6/lava-logs.yaml 2026-05-11 08:52:13,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:52:13,194 - lava_callback - INFO - Received callback for node 6a0195fb97995df55c4880fc INFO: 172.21.0.1:56562 - "POST /node/6a0195fb97995df55c4880fc HTTP/1.0" 202 Accepted 2026-05-11 08:52:13,202 - lava_callback - INFO - Starting async job submit for node 6a0195fb97995df55c4880fc 2026-05-11 08:52:13,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:52:13,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195fb97995df55c4880fc HTTP/1.1" 200 None 2026-05-11 08:52:13,267 - lava_callback - DEBUG - Processing node 6a0195fb97995df55c4880fc: ltp-syscalls-ipc 2026-05-11 08:52:13,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:52:13,557 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-6a0195f897995df55c4880f6/lava_callback.json.gz 2026-05-11 08:52:13,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:52:13,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f897995df55c4880f6 HTTP/1.1" 200 None 2026-05-11 08:52:13,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:52:13,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:52:13,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:52:13,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195f897995df55c4880f6 HTTP/1.1" 200 None 2026-05-11 08:52:13,977 - lava_callback - INFO - Completed processing callback for node 6a0195f897995df55c4880f6 2026-05-11 08:52:14,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:52:14,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:52:14,153 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-6a0195fb97995df55c4880fc/log.txt.gz 2026-05-11 08:52:14,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:52:14,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:52:14,645 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-6a0195fb97995df55c4880fc/lava-logs.yaml 2026-05-11 08:52:14,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:52:14,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:52:14,868 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-6a0195fb97995df55c4880fc/lava_callback.json.gz 2026-05-11 08:52:14,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:52:14,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195fb97995df55c4880fc HTTP/1.1" 200 None 2026-05-11 08:52:14,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:52:14,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:52:14,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:52:15,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195fb97995df55c4880fc HTTP/1.1" 200 None 2026-05-11 08:52:15,016 - lava_callback - INFO - Completed processing callback for node 6a0195fb97995df55c4880fc INFO: 172.21.0.1:56566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:52:28,107 - lava_callback - INFO - Received callback for node 6a0198b797995df55c48887f INFO: 172.21.0.1:51856 - "POST /node/6a0198b797995df55c48887f HTTP/1.0" 202 Accepted 2026-05-11 08:52:28,116 - lava_callback - INFO - Starting async job submit for node 6a0198b797995df55c48887f 2026-05-11 08:52:28,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:52:28,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0198b797995df55c48887f HTTP/1.1" 200 None 2026-05-11 08:52:28,146 - lava_callback - DEBUG - Processing node 6a0198b797995df55c48887f: baseline-arm 2026-05-11 08:52:28,154 - lava_callback - WARNING - Failed to upload log 2026-05-11 08:52:28,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:52:28,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:52:28,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a0198b797995df55c48887f/lava-logs.yaml 2026-05-11 08:52:28,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:52:28,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:52:28,351 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a0198b797995df55c48887f/lava_callback.json.gz 2026-05-11 08:52:28,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:52:28,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0198b797995df55c48887f HTTP/1.1" 200 None 2026-05-11 08:52:28,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:52:28,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:52:28,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:52:28,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0198b797995df55c48887f HTTP/1.1" 200 None 2026-05-11 08:52:28,442 - lava_callback - INFO - Completed processing callback for node 6a0198b797995df55c48887f 2026-05-11 08:52:34,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:52:34,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:53:11,886 - lava_callback - INFO - Received callback for node 6a0195fc97995df55c4880ff INFO: 172.21.0.1:44718 - "POST /node/6a0195fc97995df55c4880ff HTTP/1.0" 202 Accepted 2026-05-11 08:53:11,892 - lava_callback - INFO - Starting async job submit for node 6a0195fc97995df55c4880ff 2026-05-11 08:53:11,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:53:11,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195fc97995df55c4880ff HTTP/1.1" 200 None 2026-05-11 08:53:11,944 - lava_callback - DEBUG - Processing node 6a0195fc97995df55c4880ff: ltp-timers 2026-05-11 08:53:12,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:53:12,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:53:12,405 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-6a0195fc97995df55c4880ff/log.txt.gz 2026-05-11 08:53:12,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:53:12,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:53:12,822 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-6a0195fc97995df55c4880ff/lava-logs.yaml 2026-05-11 08:53:12,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:53:12,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:53:12,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-6a0195fc97995df55c4880ff/lava_callback.json.gz 2026-05-11 08:53:12,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:53:12,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195fc97995df55c4880ff HTTP/1.1" 200 None 2026-05-11 08:53:12,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:53:13,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:53:13,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:53:13,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195fc97995df55c4880ff HTTP/1.1" 200 None 2026-05-11 08:53:13,029 - lava_callback - INFO - Completed processing callback for node 6a0195fc97995df55c4880ff INFO: 172.21.0.1:44732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:53:33,587 - lava_callback - INFO - Received callback for node 6a0195fd97995df55c488102 INFO: 172.21.0.1:39154 - "POST /node/6a0195fd97995df55c488102 HTTP/1.0" 202 Accepted 2026-05-11 08:53:33,594 - lava_callback - INFO - Starting async job submit for node 6a0195fd97995df55c488102 2026-05-11 08:53:33,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:53:33,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195fd97995df55c488102 HTTP/1.1" 200 None 2026-05-11 08:53:33,633 - lava_callback - DEBUG - Processing node 6a0195fd97995df55c488102: ltp-watchqueue 2026-05-11 08:53:33,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:53:34,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:53:34,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-11 08:53:34,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:53:34,053 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-6a0195fd97995df55c488102/log.txt.gz 2026-05-11 08:53:34,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:53:34,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:53:34,428 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-6a0195fd97995df55c488102/lava-logs.yaml 2026-05-11 08:53:34,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:53:34,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:53:34,720 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-6a0195fd97995df55c488102/lava_callback.json.gz 2026-05-11 08:53:34,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:53:34,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195fd97995df55c488102 HTTP/1.1" 200 None 2026-05-11 08:53:34,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:53:34,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:53:34,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:53:34,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195fd97995df55c488102 HTTP/1.1" 200 None 2026-05-11 08:53:34,798 - lava_callback - INFO - Completed processing callback for node 6a0195fd97995df55c488102 INFO: 172.21.0.1:39166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:54:04,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:54:04,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:55:13,552 - lava_callback - INFO - Received callback for node 6a0194d297995df55c487f97 INFO: 172.21.0.1:59816 - "POST /node/6a0194d297995df55c487f97 HTTP/1.0" 202 Accepted 2026-05-11 08:55:13,559 - lava_callback - INFO - Starting async job submit for node 6a0194d297995df55c487f97 2026-05-11 08:55:13,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:55:13,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0194d297995df55c487f97 HTTP/1.1" 200 None 2026-05-11 08:55:13,636 - lava_callback - DEBUG - Processing node 6a0194d297995df55c487f97: ltp-smoke 2026-05-11 08:55:14,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:55:14,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:55:14,362 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-6a0194d297995df55c487f97/log.txt.gz 2026-05-11 08:55:14,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:55:14,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:55:14,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-6a0194d297995df55c487f97/lava-logs.yaml 2026-05-11 08:55:14,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:55:14,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:55:14,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-6a0194d297995df55c487f97/lava_callback.json.gz 2026-05-11 08:55:15,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:55:15,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0194d297995df55c487f97 HTTP/1.1" 200 None 2026-05-11 08:55:15,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:55:15,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912c97995df55c487f3d HTTP/1.1" 200 None 2026-05-11 08:55:15,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:55:15,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0194d297995df55c487f97 HTTP/1.1" 200 None INFO: 172.21.0.1:59826 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-11 08:55:15,281 - lava_callback - INFO - Completed processing callback for node 6a0194d297995df55c487f97 INFO: 172.21.0.1:59830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:55:34,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:55:34,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55186 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:56:06,937 - lava_callback - INFO - Received callback for node 6a01998997995df55c4888fe INFO: 172.21.0.1:55194 - "POST /node/6a01998997995df55c4888fe HTTP/1.0" 202 Accepted 2026-05-11 08:56:06,943 - lava_callback - INFO - Starting async job submit for node 6a01998997995df55c4888fe 2026-05-11 08:56:06,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:06,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01998997995df55c4888fe HTTP/1.1" 200 None 2026-05-11 08:56:06,976 - lava_callback - DEBUG - Processing node 6a01998997995df55c4888fe: baseline-arm64 2026-05-11 08:56:07,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:07,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:07,228 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998997995df55c4888fe/log.txt.gz 2026-05-11 08:56:07,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:07,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:07,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998997995df55c4888fe/lava-logs.yaml 2026-05-11 08:56:07,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:07,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:07,637 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998997995df55c4888fe/lava_callback.json.gz 2026-05-11 08:56:07,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:07,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01998997995df55c4888fe HTTP/1.1" 200 None 2026-05-11 08:56:07,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:07,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:56:07,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:07,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01998997995df55c4888fe HTTP/1.1" 200 None 2026-05-11 08:56:07,711 - lava_callback - INFO - Completed processing callback for node 6a01998997995df55c4888fe INFO: 172.21.0.1:46550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:56:24,496 - lava_callback - INFO - Received callback for node 6a01999797995df55c48892d INFO: 172.21.0.1:34440 - "POST /node/6a01999797995df55c48892d HTTP/1.0" 202 Accepted 2026-05-11 08:56:24,508 - lava_callback - INFO - Starting async job submit for node 6a01999797995df55c48892d 2026-05-11 08:56:24,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:24,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999797995df55c48892d HTTP/1.1" 200 None 2026-05-11 08:56:24,552 - lava_callback - DEBUG - Processing node 6a01999797995df55c48892d: baseline-arm64 2026-05-11 08:56:24,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:24,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:24,809 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999797995df55c48892d/log.txt.gz 2026-05-11 08:56:24,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:25,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:25,071 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999797995df55c48892d/lava-logs.yaml 2026-05-11 08:56:25,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:25,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:25,187 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999797995df55c48892d/lava_callback.json.gz 2026-05-11 08:56:25,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:25,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999797995df55c48892d HTTP/1.1" 200 None 2026-05-11 08:56:25,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:25,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:56:25,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:25,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01999797995df55c48892d HTTP/1.1" 200 None 2026-05-11 08:56:25,305 - lava_callback - INFO - Completed processing callback for node 6a01999797995df55c48892d INFO: 172.21.0.1:34448 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:56:34,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:34,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-11 08:56:34,749 - lava_callback - INFO - Received callback for node 6a0199a797995df55c488958 INFO: 172.21.0.1:33728 - "POST /node/6a0199a797995df55c488958 HTTP/1.0" 202 Accepted 2026-05-11 08:56:34,755 - lava_callback - INFO - Starting async job submit for node 6a0199a797995df55c488958 2026-05-11 08:56:34,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:34,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199a797995df55c488958 HTTP/1.1" 200 None 2026-05-11 08:56:34,773 - lava_callback - DEBUG - Processing node 6a0199a797995df55c488958: baseline-nfs-arm64 2026-05-11 08:56:34,775 - lava_callback - WARNING - Failed to upload log 2026-05-11 08:56:34,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:34,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:34,856 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a797995df55c488958/lava-logs.yaml 2026-05-11 08:56:34,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:34,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:34,938 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a797995df55c488958/lava_callback.json.gz 2026-05-11 08:56:34,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:34,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199a797995df55c488958 HTTP/1.1" 200 None 2026-05-11 08:56:34,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:34,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:56:34,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:34,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199a797995df55c488958 HTTP/1.1" 200 None 2026-05-11 08:56:35,001 - lava_callback - INFO - Completed processing callback for node 6a0199a797995df55c488958 INFO: 172.21.0.1:33742 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:56:45,387 - lava_callback - INFO - Received callback for node 6a01998b97995df55c488904 INFO: 172.21.0.1:44062 - "POST /node/6a01998b97995df55c488904 HTTP/1.0" 202 Accepted 2026-05-11 08:56:45,393 - lava_callback - INFO - Starting async job submit for node 6a01998b97995df55c488904 2026-05-11 08:56:45,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:45,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01998b97995df55c488904 HTTP/1.1" 200 None 2026-05-11 08:56:45,429 - lava_callback - DEBUG - Processing node 6a01998b97995df55c488904: baseline-arm64 2026-05-11 08:56:45,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:45,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:45,789 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998b97995df55c488904/log.txt.gz 2026-05-11 08:56:45,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:46,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:46,193 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998b97995df55c488904/lava-logs.yaml 2026-05-11 08:56:46,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:46,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:46,302 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998b97995df55c488904/lava_callback.json.gz 2026-05-11 08:56:46,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:46,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01998b97995df55c488904 HTTP/1.1" 200 None 2026-05-11 08:56:46,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:46,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:56:46,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:46,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01998b97995df55c488904 HTTP/1.1" 200 None 2026-05-11 08:56:46,383 - lava_callback - INFO - Completed processing callback for node 6a01998b97995df55c488904 INFO: 172.21.0.1:44064 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:56:49,924 - lava_callback - INFO - Received callback for node 6a0195b397995df55c487ffc INFO: 172.21.0.1:40806 - "POST /node/6a0195b397995df55c487ffc HTTP/1.0" 202 Accepted 2026-05-11 08:56:49,931 - lava_callback - INFO - Starting async job submit for node 6a0195b397995df55c487ffc 2026-05-11 08:56:49,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:49,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195b397995df55c487ffc HTTP/1.1" 200 None 2026-05-11 08:56:49,999 - lava_callback - DEBUG - Processing node 6a0195b397995df55c487ffc: baseline-arm 2026-05-11 08:56:50,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:50,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:50,728 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b397995df55c487ffc/log.txt.gz INFO: 172.21.0.1:40808 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:56:51,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:51,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:51,294 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b397995df55c487ffc/lava-logs.yaml 2026-05-11 08:56:51,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:56:51,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:56:51,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b397995df55c487ffc/lava_callback.json.gz DEBUG: Setup failed for 6a0195b397995df55c487ffc. Transitting job node result: incomplete -> fail 2026-05-11 08:56:51,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:51,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195b397995df55c487ffc HTTP/1.1" 200 None 2026-05-11 08:56:51,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:51,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:56:51,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:56:51,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195b397995df55c487ffc HTTP/1.1" 200 None 2026-05-11 08:56:51,759 - lava_callback - INFO - Completed processing callback for node 6a0195b397995df55c487ffc INFO: 172.21.0.1:40822 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:57:04,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:04,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:57:08,599 - lava_callback - INFO - Received callback for node 6a01998a97995df55c488901 INFO: 172.21.0.1:40822 - "POST /node/6a01998a97995df55c488901 HTTP/1.0" 202 Accepted 2026-05-11 08:57:08,605 - lava_callback - INFO - Starting async job submit for node 6a01998a97995df55c488901 2026-05-11 08:57:08,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:08,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01998a97995df55c488901 HTTP/1.1" 200 None 2026-05-11 08:57:08,645 - lava_callback - DEBUG - Processing node 6a01998a97995df55c488901: baseline-arm64 2026-05-11 08:57:08,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:09,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:09,017 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998a97995df55c488901/log.txt.gz 2026-05-11 08:57:09,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:09,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:09,346 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998a97995df55c488901/lava-logs.yaml 2026-05-11 08:57:09,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:09,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:09,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998a97995df55c488901/lava_callback.json.gz 2026-05-11 08:57:09,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:09,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01998a97995df55c488901 HTTP/1.1" 200 None 2026-05-11 08:57:09,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:09,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:57:09,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:09,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01998a97995df55c488901 HTTP/1.1" 200 None 2026-05-11 08:57:09,645 - lava_callback - INFO - Completed processing callback for node 6a01998a97995df55c488901 INFO: 172.21.0.1:42024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:57:34,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:34,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-11 08:57:34,988 - lava_callback - INFO - Received callback for node 6a0199cf97995df55c488a17 INFO: 172.21.0.1:53930 - "POST /node/6a0199cf97995df55c488a17 HTTP/1.0" 202 Accepted 2026-05-11 08:57:34,994 - lava_callback - INFO - Starting async job submit for node 6a0199cf97995df55c488a17 2026-05-11 08:57:35,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:35,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199cf97995df55c488a17 HTTP/1.1" 200 None 2026-05-11 08:57:35,033 - lava_callback - DEBUG - Processing node 6a0199cf97995df55c488a17: baseline-arm64-pengutronix 2026-05-11 08:57:35,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:35,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:35,313 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a0199cf97995df55c488a17/log.txt.gz 2026-05-11 08:57:35,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:35,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:35,758 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a0199cf97995df55c488a17/lava-logs.yaml 2026-05-11 08:57:35,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:35,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:35,888 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a0199cf97995df55c488a17/lava_callback.json.gz 2026-05-11 08:57:35,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:35,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199cf97995df55c488a17 HTTP/1.1" 200 None 2026-05-11 08:57:35,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:35,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:57:35,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:35,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199cf97995df55c488a17 HTTP/1.1" 200 None 2026-05-11 08:57:35,964 - lava_callback - INFO - Completed processing callback for node 6a0199cf97995df55c488a17 INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42260 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:57:46,539 - lava_callback - INFO - Received callback for node 6a01999697995df55c48892a INFO: 172.21.0.1:42276 - "POST /node/6a01999697995df55c48892a HTTP/1.0" 202 Accepted 2026-05-11 08:57:46,545 - lava_callback - INFO - Starting async job submit for node 6a01999697995df55c48892a 2026-05-11 08:57:46,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:46,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999697995df55c48892a HTTP/1.1" 200 None 2026-05-11 08:57:46,581 - lava_callback - DEBUG - Processing node 6a01999697995df55c48892a: baseline-arm64 2026-05-11 08:57:46,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:47,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:47,026 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999697995df55c48892a/log.txt.gz 2026-05-11 08:57:47,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:47,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:47,468 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999697995df55c48892a/lava-logs.yaml 2026-05-11 08:57:47,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:47,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:47,604 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999697995df55c48892a/lava_callback.json.gz 2026-05-11 08:57:47,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:47,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999697995df55c48892a HTTP/1.1" 200 None 2026-05-11 08:57:47,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:47,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:57:47,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:47,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01999697995df55c48892a HTTP/1.1" 200 None 2026-05-11 08:57:47,674 - lava_callback - INFO - Completed processing callback for node 6a01999697995df55c48892a 2026-05-11 08:57:49,792 - lava_callback - INFO - Received callback for node 6a01999397995df55c488924 INFO: 172.21.0.1:37708 - "POST /node/6a01999397995df55c488924 HTTP/1.0" 202 Accepted 2026-05-11 08:57:49,798 - lava_callback - INFO - Starting async job submit for node 6a01999397995df55c488924 2026-05-11 08:57:49,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:49,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999397995df55c488924 HTTP/1.1" 200 None 2026-05-11 08:57:49,833 - lava_callback - DEBUG - Processing node 6a01999397995df55c488924: baseline-arm64 2026-05-11 08:57:50,053 - lava_callback - INFO - Received callback for node 69fef6f8254d3291e98df5e6 INFO: 172.21.0.1:37718 - "POST /node/69fef6f8254d3291e98df5e6 HTTP/1.0" 202 Accepted 2026-05-11 08:57:50,069 - lava_callback - INFO - Starting async job submit for node 69fef6f8254d3291e98df5e6 2026-05-11 08:57:50,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:50,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:50,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef6f8254d3291e98df5e6 HTTP/1.1" 200 None 2026-05-11 08:57:50,172 - lava_callback - DEBUG - Processing node 69fef6f8254d3291e98df5e6: baseline-arm-clabbe 2026-05-11 08:57:50,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef6f8254d3291e98df5e6 2026-05-11 08:57:50,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:50,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef6f8254d3291e98df5e6 HTTP/1.1" 200 None 2026-05-11 08:57:50,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:50,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-11 08:57:50,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:50,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef6f8254d3291e98df5e6 HTTP/1.1" 200 None 2026-05-11 08:57:50,227 - lava_callback - ERROR - Error processing callback for node 69fef6f8254d3291e98df5e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:57:50,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:50,533 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999397995df55c488924/log.txt.gz 2026-05-11 08:57:50,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:57:51,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:51,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999397995df55c488924/lava-logs.yaml 2026-05-11 08:57:51,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:51,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:51,138 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999397995df55c488924/lava_callback.json.gz 2026-05-11 08:57:51,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:51,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999397995df55c488924 HTTP/1.1" 200 None 2026-05-11 08:57:51,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:51,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:57:51,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:51,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01999397995df55c488924 HTTP/1.1" 200 None 2026-05-11 08:57:51,214 - lava_callback - INFO - Completed processing callback for node 6a01999397995df55c488924 2026-05-11 08:57:53,297 - lava_callback - INFO - Received callback for node 6a0199c097995df55c4889bc INFO: 172.21.0.1:37728 - "POST /node/6a0199c097995df55c4889bc HTTP/1.0" 202 Accepted 2026-05-11 08:57:53,303 - lava_callback - INFO - Starting async job submit for node 6a0199c097995df55c4889bc 2026-05-11 08:57:53,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:53,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199c097995df55c4889bc HTTP/1.1" 200 None 2026-05-11 08:57:53,340 - lava_callback - DEBUG - Processing node 6a0199c097995df55c4889bc: baseline-arm64-broonie 2026-05-11 08:57:53,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:53,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:53,678 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199c097995df55c4889bc/log.txt.gz 2026-05-11 08:57:53,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:53,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:53,952 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199c097995df55c4889bc/lava-logs.yaml 2026-05-11 08:57:53,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:54,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:54,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199c097995df55c4889bc/lava_callback.json.gz 2026-05-11 08:57:54,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:54,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199c097995df55c4889bc HTTP/1.1" 200 None 2026-05-11 08:57:54,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:54,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:57:54,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:54,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199c097995df55c4889bc HTTP/1.1" 200 None 2026-05-11 08:57:54,127 - lava_callback - INFO - Completed processing callback for node 6a0199c097995df55c4889bc 2026-05-11 08:57:55,255 - lava_callback - INFO - Received callback for node 6a0199d397995df55c488a27 INFO: 172.21.0.1:37732 - "POST /node/6a0199d397995df55c488a27 HTTP/1.0" 202 Accepted 2026-05-11 08:57:55,262 - lava_callback - INFO - Starting async job submit for node 6a0199d397995df55c488a27 2026-05-11 08:57:55,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:55,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199d397995df55c488a27 HTTP/1.1" 200 None 2026-05-11 08:57:55,319 - lava_callback - DEBUG - Processing node 6a0199d397995df55c488a27: baseline-arm64-foundriesio 2026-05-11 08:57:55,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:55,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:55,755 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a0199d397995df55c488a27/log.txt.gz 2026-05-11 08:57:55,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:56,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:56,114 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a0199d397995df55c488a27/lava-logs.yaml 2026-05-11 08:57:56,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:56,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:56,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a0199d397995df55c488a27/lava_callback.json.gz 2026-05-11 08:57:56,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:56,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199d397995df55c488a27 HTTP/1.1" 200 None 2026-05-11 08:57:56,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:56,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:57:56,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:56,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199d397995df55c488a27 HTTP/1.1" 200 None 2026-05-11 08:57:56,320 - lava_callback - INFO - Completed processing callback for node 6a0199d397995df55c488a27 INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:57:56,692 - lava_callback - INFO - Received callback for node 6a01998e97995df55c488918 INFO: 172.21.0.1:37762 - "POST /node/6a01998e97995df55c488918 HTTP/1.0" 202 Accepted 2026-05-11 08:57:56,699 - lava_callback - INFO - Starting async job submit for node 6a01998e97995df55c488918 2026-05-11 08:57:56,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:56,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01998e97995df55c488918 HTTP/1.1" 200 None 2026-05-11 08:57:56,743 - lava_callback - DEBUG - Processing node 6a01998e97995df55c488918: baseline-arm64 2026-05-11 08:57:56,900 - lava_callback - WARNING - Failed to upload log 2026-05-11 08:57:56,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:57,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:57,072 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998e97995df55c488918/lava-logs.yaml 2026-05-11 08:57:57,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:57,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:57,158 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998e97995df55c488918/lava_callback.json.gz 2026-05-11 08:57:57,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:57,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01998e97995df55c488918 HTTP/1.1" 200 None 2026-05-11 08:57:57,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:57,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:57:57,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:57,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01998e97995df55c488918 HTTP/1.1" 200 None 2026-05-11 08:57:57,303 - lava_callback - INFO - Completed processing callback for node 6a01998e97995df55c488918 2026-05-11 08:57:57,351 - lava_callback - INFO - Received callback for node 6a01999897995df55c488930 INFO: 172.21.0.1:37770 - "POST /node/6a01999897995df55c488930 HTTP/1.0" 202 Accepted 2026-05-11 08:57:57,363 - lava_callback - INFO - Starting async job submit for node 6a01999897995df55c488930 2026-05-11 08:57:57,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:57,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999897995df55c488930 HTTP/1.1" 200 None 2026-05-11 08:57:57,406 - lava_callback - DEBUG - Processing node 6a01999897995df55c488930: baseline-arm64 2026-05-11 08:57:57,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:57,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:57,728 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999897995df55c488930/log.txt.gz 2026-05-11 08:57:57,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:58,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:58,016 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999897995df55c488930/lava-logs.yaml 2026-05-11 08:57:58,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:58,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:58,120 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999897995df55c488930/lava_callback.json.gz 2026-05-11 08:57:58,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:58,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999897995df55c488930 HTTP/1.1" 200 None 2026-05-11 08:57:58,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:58,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:57:58,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:58,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01999897995df55c488930 HTTP/1.1" 200 None 2026-05-11 08:57:58,191 - lava_callback - INFO - Completed processing callback for node 6a01999897995df55c488930 2026-05-11 08:57:58,371 - lava_callback - INFO - Received callback for node 6a01999597995df55c488927 INFO: 172.21.0.1:37772 - "POST /node/6a01999597995df55c488927 HTTP/1.0" 202 Accepted 2026-05-11 08:57:58,379 - lava_callback - INFO - Starting async job submit for node 6a01999597995df55c488927 2026-05-11 08:57:58,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:58,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999597995df55c488927 HTTP/1.1" 200 None 2026-05-11 08:57:58,434 - lava_callback - DEBUG - Processing node 6a01999597995df55c488927: baseline-arm64 2026-05-11 08:57:58,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:58,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:58,818 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999597995df55c488927/log.txt.gz 2026-05-11 08:57:58,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:59,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:59,147 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999597995df55c488927/lava-logs.yaml 2026-05-11 08:57:59,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:57:59,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:57:59,248 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999597995df55c488927/lava_callback.json.gz 2026-05-11 08:57:59,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:59,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999597995df55c488927 HTTP/1.1" 200 None 2026-05-11 08:57:59,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:59,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:57:59,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:57:59,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01999597995df55c488927 HTTP/1.1" 200 None 2026-05-11 08:57:59,421 - lava_callback - INFO - Completed processing callback for node 6a01999597995df55c488927 2026-05-11 08:58:02,178 - lava_callback - INFO - Received callback for node 6a0199d097995df55c488a1a INFO: 172.21.0.1:42650 - "POST /node/6a0199d097995df55c488a1a HTTP/1.0" 202 Accepted 2026-05-11 08:58:02,184 - lava_callback - INFO - Starting async job submit for node 6a0199d097995df55c488a1a 2026-05-11 08:58:02,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:02,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199d097995df55c488a1a HTTP/1.1" 200 None 2026-05-11 08:58:02,223 - lava_callback - DEBUG - Processing node 6a0199d097995df55c488a1a: baseline-arm64-pengutronix 2026-05-11 08:58:02,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:02,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:02,493 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a0199d097995df55c488a1a/log.txt.gz 2026-05-11 08:58:02,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:02,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:02,737 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a0199d097995df55c488a1a/lava-logs.yaml 2026-05-11 08:58:02,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:02,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:02,830 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a0199d097995df55c488a1a/lava_callback.json.gz 2026-05-11 08:58:02,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:02,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199d097995df55c488a1a HTTP/1.1" 200 None 2026-05-11 08:58:02,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:02,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:02,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:02,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199d097995df55c488a1a HTTP/1.1" 200 None 2026-05-11 08:58:02,899 - lava_callback - INFO - Completed processing callback for node 6a0199d097995df55c488a1a 2026-05-11 08:58:04,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:04,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-11 08:58:04,264 - lava_callback - INFO - Received callback for node 6a0199a597995df55c488952 INFO: 172.21.0.1:42656 - "POST /node/6a0199a597995df55c488952 HTTP/1.0" 202 Accepted 2026-05-11 08:58:04,270 - lava_callback - INFO - Starting async job submit for node 6a0199a597995df55c488952 2026-05-11 08:58:04,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:04,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199a597995df55c488952 HTTP/1.1" 200 None 2026-05-11 08:58:04,306 - lava_callback - DEBUG - Processing node 6a0199a597995df55c488952: baseline-nfs-arm64 2026-05-11 08:58:04,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:04,743 - lava_callback - INFO - Received callback for node 6a0199d197995df55c488a1d INFO: 172.21.0.1:42672 - "POST /node/6a0199d197995df55c488a1d HTTP/1.0" 202 Accepted 2026-05-11 08:58:04,750 - lava_callback - INFO - Starting async job submit for node 6a0199d197995df55c488a1d 2026-05-11 08:58:04,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:04,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199d197995df55c488a1d HTTP/1.1" 200 None 2026-05-11 08:58:04,792 - lava_callback - DEBUG - Processing node 6a0199d197995df55c488a1d: baseline-arm64-pengutronix 2026-05-11 08:58:04,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:04,883 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a597995df55c488952/log.txt.gz 2026-05-11 08:58:04,944 - lava_callback - INFO - Received callback for node 6a01999297995df55c488921 2026-05-11 08:58:05,016 - lava_callback - INFO - Starting async job submit for node 6a01999297995df55c488921 INFO: 172.21.0.1:42676 - "POST /node/6a01999297995df55c488921 HTTP/1.0" 202 Accepted 2026-05-11 08:58:05,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:05,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:05,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999297995df55c488921 HTTP/1.1" 200 None 2026-05-11 08:58:05,218 - lava_callback - DEBUG - Processing node 6a01999297995df55c488921: baseline-arm64 2026-05-11 08:58:05,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:05,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:05,517 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a0199d197995df55c488a1d/log.txt.gz 2026-05-11 08:58:05,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:05,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:05,695 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a597995df55c488952/lava-logs.yaml 2026-05-11 08:58:05,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:05,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:05,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:05,798 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999297995df55c488921/log.txt.gz 2026-05-11 08:58:05,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:05,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:05,887 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a597995df55c488952/lava_callback.json.gz 2026-05-11 08:58:05,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:05,940 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a0199d197995df55c488a1d/lava-logs.yaml 2026-05-11 08:58:05,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:05,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:05,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199a597995df55c488952 HTTP/1.1" 200 None 2026-05-11 08:58:05,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:06,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:06,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:06,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199a597995df55c488952 HTTP/1.1" 200 None 2026-05-11 08:58:06,041 - lava_callback - INFO - Completed processing callback for node 6a0199a597995df55c488952 2026-05-11 08:58:06,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:06,127 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-6a0199d197995df55c488a1d/lava_callback.json.gz 2026-05-11 08:58:06,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:06,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:06,179 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999297995df55c488921/lava-logs.yaml 2026-05-11 08:58:06,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199d197995df55c488a1d HTTP/1.1" 200 None 2026-05-11 08:58:06,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:06,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:06,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:06,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:06,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199d197995df55c488a1d HTTP/1.1" 200 None 2026-05-11 08:58:06,243 - lava_callback - INFO - Completed processing callback for node 6a0199d197995df55c488a1d 2026-05-11 08:58:06,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:06,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999297995df55c488921/lava_callback.json.gz 2026-05-11 08:58:06,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:06,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999297995df55c488921 HTTP/1.1" 200 None 2026-05-11 08:58:06,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:06,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:06,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:06,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01999297995df55c488921 HTTP/1.1" 200 None 2026-05-11 08:58:06,431 - lava_callback - INFO - Completed processing callback for node 6a01999297995df55c488921 INFO: 172.21.0.1:42690 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:58:08,289 - lava_callback - INFO - Received callback for node 6a0199d297995df55c488a20 INFO: 172.21.0.1:42692 - "POST /node/6a0199d297995df55c488a20 HTTP/1.0" 202 Accepted 2026-05-11 08:58:08,294 - lava_callback - INFO - Starting async job submit for node 6a0199d297995df55c488a20 2026-05-11 08:58:08,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:08,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199d297995df55c488a20 HTTP/1.1" 200 None 2026-05-11 08:58:08,331 - lava_callback - DEBUG - Processing node 6a0199d297995df55c488a20: baseline-arm64-foundriesio 2026-05-11 08:58:08,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:08,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:08,614 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a0199d297995df55c488a20/log.txt.gz 2026-05-11 08:58:08,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:08,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:08,872 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a0199d297995df55c488a20/lava-logs.yaml 2026-05-11 08:58:08,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:08,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:08,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a0199d297995df55c488a20/lava_callback.json.gz 2026-05-11 08:58:09,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:09,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199d297995df55c488a20 HTTP/1.1" 200 None 2026-05-11 08:58:09,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:09,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:09,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:09,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199d297995df55c488a20 HTTP/1.1" 200 None 2026-05-11 08:58:09,142 - lava_callback - INFO - Completed processing callback for node 6a0199d297995df55c488a20 2026-05-11 08:58:11,609 - lava_callback - INFO - Received callback for node 6a0199c397995df55c4889ce INFO: 172.21.0.1:53612 - "POST /node/6a0199c397995df55c4889ce HTTP/1.0" 202 Accepted 2026-05-11 08:58:11,616 - lava_callback - INFO - Starting async job submit for node 6a0199c397995df55c4889ce 2026-05-11 08:58:11,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:11,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199c397995df55c4889ce HTTP/1.1" 200 None 2026-05-11 08:58:11,652 - lava_callback - DEBUG - Processing node 6a0199c397995df55c4889ce: baseline-arm64-broonie 2026-05-11 08:58:11,827 - lava_callback - INFO - Received callback for node 6a01999a97995df55c488939 INFO: 172.21.0.1:53628 - "POST /node/6a01999a97995df55c488939 HTTP/1.0" 202 Accepted 2026-05-11 08:58:11,845 - lava_callback - INFO - Starting async job submit for node 6a01999a97995df55c488939 2026-05-11 08:58:11,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:11,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:11,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999a97995df55c488939 HTTP/1.1" 200 None 2026-05-11 08:58:11,934 - lava_callback - DEBUG - Processing node 6a01999a97995df55c488939: baseline-arm64 2026-05-11 08:58:12,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:12,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199c397995df55c4889ce/log.txt.gz 2026-05-11 08:58:12,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:12,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:12,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:12,483 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999a97995df55c488939/log.txt.gz 2026-05-11 08:58:12,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:12,576 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199c397995df55c4889ce/lava-logs.yaml 2026-05-11 08:58:12,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:12,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:12,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:12,739 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199c397995df55c4889ce/lava_callback.json.gz 2026-05-11 08:58:12,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:12,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199c397995df55c4889ce HTTP/1.1" 200 None 2026-05-11 08:58:12,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:12,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:12,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:12,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:12,809 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999a97995df55c488939/lava-logs.yaml 2026-05-11 08:58:12,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:12,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199c397995df55c4889ce HTTP/1.1" 200 None 2026-05-11 08:58:12,835 - lava_callback - INFO - Completed processing callback for node 6a0199c397995df55c4889ce 2026-05-11 08:58:12,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:12,956 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999a97995df55c488939/lava_callback.json.gz 2026-05-11 08:58:12,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:13,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999a97995df55c488939 HTTP/1.1" 200 None 2026-05-11 08:58:13,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:13,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:13,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:13,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01999a97995df55c488939 HTTP/1.1" 200 None 2026-05-11 08:58:13,059 - lava_callback - INFO - Completed processing callback for node 6a01999a97995df55c488939 2026-05-11 08:58:14,699 - lava_callback - INFO - Received callback for node 6a0199c497995df55c4889d1 INFO: 172.21.0.1:53636 - "POST /node/6a0199c497995df55c4889d1 HTTP/1.0" 202 Accepted 2026-05-11 08:58:14,706 - lava_callback - INFO - Starting async job submit for node 6a0199c497995df55c4889d1 2026-05-11 08:58:14,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:14,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199c497995df55c4889d1 HTTP/1.1" 200 None 2026-05-11 08:58:14,742 - lava_callback - DEBUG - Processing node 6a0199c497995df55c4889d1: baseline-arm64-broonie 2026-05-11 08:58:14,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:15,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:15,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199c497995df55c4889d1/log.txt.gz INFO: 172.21.0.1:53650 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-11 08:58:15,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:15,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:15,349 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199c497995df55c4889d1/lava-logs.yaml 2026-05-11 08:58:15,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:15,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:15,440 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199c497995df55c4889d1/lava_callback.json.gz 2026-05-11 08:58:15,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:15,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199c497995df55c4889d1 HTTP/1.1" 200 None 2026-05-11 08:58:15,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:15,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:15,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:15,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199c497995df55c4889d1 HTTP/1.1" 200 None 2026-05-11 08:58:15,520 - lava_callback - INFO - Completed processing callback for node 6a0199c497995df55c4889d1 INFO: 172.21.0.1:53658 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:58:17,245 - lava_callback - INFO - Received callback for node 6a0199a697995df55c488955 INFO: 172.21.0.1:53670 - "POST /node/6a0199a697995df55c488955 HTTP/1.0" 202 Accepted 2026-05-11 08:58:17,252 - lava_callback - INFO - Starting async job submit for node 6a0199a697995df55c488955 2026-05-11 08:58:17,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:17,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199a697995df55c488955 HTTP/1.1" 200 None 2026-05-11 08:58:17,288 - lava_callback - DEBUG - Processing node 6a0199a697995df55c488955: baseline-nfs-arm64 2026-05-11 08:58:17,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:17,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:17,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a697995df55c488955/log.txt.gz 2026-05-11 08:58:18,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:18,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:18,285 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a697995df55c488955/lava-logs.yaml 2026-05-11 08:58:18,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:18,337 - lava_callback - INFO - Received callback for node 6a0199cd97995df55c488a10 INFO: 172.21.0.1:53684 - "POST /node/6a0199cd97995df55c488a10 HTTP/1.0" 202 Accepted 2026-05-11 08:58:18,343 - lava_callback - INFO - Starting async job submit for node 6a0199cd97995df55c488a10 2026-05-11 08:58:18,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:18,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199cd97995df55c488a10 HTTP/1.1" 200 None 2026-05-11 08:58:18,384 - lava_callback - DEBUG - Processing node 6a0199cd97995df55c488a10: baseline-arm64-kontron 2026-05-11 08:58:18,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:18,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a697995df55c488955/lava_callback.json.gz 2026-05-11 08:58:18,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:18,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199a697995df55c488955 HTTP/1.1" 200 None 2026-05-11 08:58:18,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:18,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:18,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:18,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:18,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199a697995df55c488955 HTTP/1.1" 200 None 2026-05-11 08:58:18,730 - lava_callback - INFO - Completed processing callback for node 6a0199a697995df55c488955 2026-05-11 08:58:18,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:18,816 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-6a0199cd97995df55c488a10/log.txt.gz 2026-05-11 08:58:19,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:19,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:19,171 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-6a0199cd97995df55c488a10/lava-logs.yaml 2026-05-11 08:58:19,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:19,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:19,284 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-6a0199cd97995df55c488a10/lava_callback.json.gz 2026-05-11 08:58:19,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:19,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199cd97995df55c488a10 HTTP/1.1" 200 None 2026-05-11 08:58:19,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:19,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:19,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:19,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199cd97995df55c488a10 HTTP/1.1" 200 None 2026-05-11 08:58:19,356 - lava_callback - INFO - Completed processing callback for node 6a0199cd97995df55c488a10 2026-05-11 08:58:21,476 - lava_callback - INFO - Received callback for node 69fef71d254d3291e98df5ef INFO: 172.21.0.1:56398 - "POST /node/69fef71d254d3291e98df5ef HTTP/1.0" 202 Accepted 2026-05-11 08:58:21,481 - lava_callback - INFO - Starting async job submit for node 69fef71d254d3291e98df5ef 2026-05-11 08:58:21,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:21,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef71d254d3291e98df5ef HTTP/1.1" 200 None 2026-05-11 08:58:21,495 - lava_callback - DEBUG - Processing node 69fef71d254d3291e98df5ef: baseline-arm-baylibre 2026-05-11 08:58:21,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef71d254d3291e98df5ef 2026-05-11 08:58:21,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:21,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef71d254d3291e98df5ef HTTP/1.1" 200 None 2026-05-11 08:58:21,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:21,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-11 08:58:21,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:21,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef71d254d3291e98df5ef HTTP/1.1" 200 None 2026-05-11 08:58:21,541 - lava_callback - ERROR - Error processing callback for node 69fef71d254d3291e98df5ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:58:22,412 - lava_callback - INFO - Received callback for node 6a01998c97995df55c488907 INFO: 172.21.0.1:56400 - "POST /node/6a01998c97995df55c488907 HTTP/1.0" 202 Accepted 2026-05-11 08:58:22,418 - lava_callback - INFO - Starting async job submit for node 6a01998c97995df55c488907 2026-05-11 08:58:22,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:22,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01998c97995df55c488907 HTTP/1.1" 200 None 2026-05-11 08:58:22,455 - lava_callback - DEBUG - Processing node 6a01998c97995df55c488907: baseline-arm64 2026-05-11 08:58:22,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:22,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:22,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998c97995df55c488907/log.txt.gz 2026-05-11 08:58:22,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:23,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:23,064 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998c97995df55c488907/lava-logs.yaml 2026-05-11 08:58:23,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:23,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:23,164 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998c97995df55c488907/lava_callback.json.gz 2026-05-11 08:58:23,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:23,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01998c97995df55c488907 HTTP/1.1" 200 None 2026-05-11 08:58:23,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:23,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:23,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:23,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01998c97995df55c488907 HTTP/1.1" 200 None 2026-05-11 08:58:23,236 - lava_callback - INFO - Completed processing callback for node 6a01998c97995df55c488907 2026-05-11 08:58:25,996 - lava_callback - INFO - Received callback for node 6a0199ab97995df55c488987 INFO: 172.21.0.1:56404 - "POST /node/6a0199ab97995df55c488987 HTTP/1.0" 202 Accepted 2026-05-11 08:58:26,004 - lava_callback - INFO - Starting async job submit for node 6a0199ab97995df55c488987 2026-05-11 08:58:26,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:26,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199ab97995df55c488987 HTTP/1.1" 200 None 2026-05-11 08:58:26,042 - lava_callback - DEBUG - Processing node 6a0199ab97995df55c488987: baseline-nfs-arm64 2026-05-11 08:58:26,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:26,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:26,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199ab97995df55c488987/log.txt.gz INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:58:26,560 - lava_callback - INFO - Received callback for node 6a01999c97995df55c488940 INFO: 172.21.0.1:56414 - "POST /node/6a01999c97995df55c488940 HTTP/1.0" 202 Accepted 2026-05-11 08:58:26,582 - lava_callback - INFO - Starting async job submit for node 6a01999c97995df55c488940 2026-05-11 08:58:26,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:26,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:26,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999c97995df55c488940 HTTP/1.1" 200 None 2026-05-11 08:58:26,776 - lava_callback - DEBUG - Processing node 6a01999c97995df55c488940: baseline-arm64 2026-05-11 08:58:27,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:27,064 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199ab97995df55c488987/lava-logs.yaml 2026-05-11 08:58:27,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:27,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:27,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:27,211 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199ab97995df55c488987/lava_callback.json.gz 2026-05-11 08:58:27,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:27,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:27,236 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999c97995df55c488940/log.txt.gz 2026-05-11 08:58:27,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199ab97995df55c488987 HTTP/1.1" 200 None 2026-05-11 08:58:27,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:27,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:27,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:27,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:27,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199ab97995df55c488987 HTTP/1.1" 200 None 2026-05-11 08:58:27,437 - lava_callback - INFO - Completed processing callback for node 6a0199ab97995df55c488987 2026-05-11 08:58:27,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:27,606 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999c97995df55c488940/lava-logs.yaml 2026-05-11 08:58:27,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:27,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:27,734 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999c97995df55c488940/lava_callback.json.gz 2026-05-11 08:58:27,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:27,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999c97995df55c488940 HTTP/1.1" 200 None 2026-05-11 08:58:27,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:27,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:27,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:27,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01999c97995df55c488940 HTTP/1.1" 200 None 2026-05-11 08:58:27,885 - lava_callback - INFO - Completed processing callback for node 6a01999c97995df55c488940 2026-05-11 08:58:30,137 - lava_callback - INFO - Received callback for node 6a0199a297995df55c48894c INFO: 172.21.0.1:55460 - "POST /node/6a0199a297995df55c48894c HTTP/1.0" 202 Accepted 2026-05-11 08:58:30,143 - lava_callback - INFO - Starting async job submit for node 6a0199a297995df55c48894c 2026-05-11 08:58:30,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:30,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199a297995df55c48894c HTTP/1.1" 200 None 2026-05-11 08:58:30,181 - lava_callback - DEBUG - Processing node 6a0199a297995df55c48894c: baseline-nfs-arm64 2026-05-11 08:58:30,438 - lava_callback - INFO - Received callback for node 6a0195b497995df55c487fff INFO: 172.21.0.1:55474 - "POST /node/6a0195b497995df55c487fff HTTP/1.0" 202 Accepted 2026-05-11 08:58:30,460 - lava_callback - INFO - Starting async job submit for node 6a0195b497995df55c487fff 2026-05-11 08:58:30,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:30,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:30,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195b497995df55c487fff HTTP/1.1" 200 None 2026-05-11 08:58:30,544 - lava_callback - DEBUG - Processing node 6a0195b497995df55c487fff: baseline-arm 2026-05-11 08:58:30,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:30,743 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a297995df55c48894c/log.txt.gz 2026-05-11 08:58:30,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:31,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:31,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:31,071 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b497995df55c487fff/log.txt.gz 2026-05-11 08:58:31,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:31,203 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a297995df55c48894c/lava-logs.yaml 2026-05-11 08:58:31,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:31,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:31,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:31,325 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a297995df55c48894c/lava_callback.json.gz 2026-05-11 08:58:31,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:31,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:31,350 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b497995df55c487fff/lava-logs.yaml 2026-05-11 08:58:31,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:31,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199a297995df55c48894c HTTP/1.1" 200 None 2026-05-11 08:58:31,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:31,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:31,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:31,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199a297995df55c48894c HTTP/1.1" 200 None 2026-05-11 08:58:31,411 - lava_callback - INFO - Completed processing callback for node 6a0199a297995df55c48894c 2026-05-11 08:58:31,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:31,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a0195b497995df55c487fff/lava_callback.json.gz 2026-05-11 08:58:31,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:31,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195b497995df55c487fff HTTP/1.1" 200 None 2026-05-11 08:58:31,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:31,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:58:31,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:31,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195b497995df55c487fff HTTP/1.1" 200 None 2026-05-11 08:58:31,594 - lava_callback - INFO - Completed processing callback for node 6a0195b497995df55c487fff 2026-05-11 08:58:31,632 - lava_callback - INFO - Received callback for node 6a0199bc97995df55c4889b3 INFO: 172.21.0.1:55486 - "POST /node/6a0199bc97995df55c4889b3 HTTP/1.0" 202 Accepted 2026-05-11 08:58:31,646 - lava_callback - INFO - Starting async job submit for node 6a0199bc97995df55c4889b3 2026-05-11 08:58:31,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:31,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199bc97995df55c4889b3 HTTP/1.1" 200 None 2026-05-11 08:58:31,701 - lava_callback - DEBUG - Processing node 6a0199bc97995df55c4889b3: baseline-arm64-broonie 2026-05-11 08:58:31,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:32,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:32,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199bc97995df55c4889b3/log.txt.gz 2026-05-11 08:58:32,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:32,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:32,352 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199bc97995df55c4889b3/lava-logs.yaml 2026-05-11 08:58:32,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:32,418 - lava_callback - INFO - Received callback for node 6a0199ad97995df55c488990 INFO: 172.21.0.1:55494 - "POST /node/6a0199ad97995df55c488990 HTTP/1.0" 202 Accepted 2026-05-11 08:58:32,425 - lava_callback - INFO - Starting async job submit for node 6a0199ad97995df55c488990 2026-05-11 08:58:32,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:32,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:32,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199bc97995df55c4889b3/lava_callback.json.gz 2026-05-11 08:58:32,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:32,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199ad97995df55c488990 HTTP/1.1" 200 None 2026-05-11 08:58:32,489 - lava_callback - DEBUG - Processing node 6a0199ad97995df55c488990: baseline-nfs-arm64 2026-05-11 08:58:32,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199bc97995df55c4889b3 HTTP/1.1" 200 None 2026-05-11 08:58:32,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:32,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:32,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:32,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199bc97995df55c4889b3 HTTP/1.1" 200 None 2026-05-11 08:58:32,741 - lava_callback - INFO - Completed processing callback for node 6a0199bc97995df55c4889b3 2026-05-11 08:58:32,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:33,067 - lava_callback - INFO - Received callback for node 6a0199bd97995df55c4889b6 INFO: 172.21.0.1:55510 - "POST /node/6a0199bd97995df55c4889b6 HTTP/1.0" 202 Accepted 2026-05-11 08:58:33,076 - lava_callback - INFO - Starting async job submit for node 6a0199bd97995df55c4889b6 2026-05-11 08:58:33,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:33,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:33,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199ad97995df55c488990/log.txt.gz 2026-05-11 08:58:33,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199bd97995df55c4889b6 HTTP/1.1" 200 None 2026-05-11 08:58:33,184 - lava_callback - DEBUG - Processing node 6a0199bd97995df55c4889b6: baseline-arm64-broonie 2026-05-11 08:58:33,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:33,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:33,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:33,713 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199bd97995df55c4889b6/log.txt.gz 2026-05-11 08:58:33,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:33,812 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199ad97995df55c488990/lava-logs.yaml 2026-05-11 08:58:33,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:33,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:33,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:33,983 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199bd97995df55c4889b6/lava-logs.yaml 2026-05-11 08:58:33,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:34,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:34,045 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199ad97995df55c488990/lava_callback.json.gz 2026-05-11 08:58:34,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:34,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199ad97995df55c488990 HTTP/1.1" 200 None 2026-05-11 08:58:34,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:34,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:34,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:34,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:34,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199bd97995df55c4889b6/lava_callback.json.gz 2026-05-11 08:58:34,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:34,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199bd97995df55c4889b6 HTTP/1.1" 200 None 2026-05-11 08:58:34,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:34,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199ad97995df55c488990 HTTP/1.1" 200 None 2026-05-11 08:58:34,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:34,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:34,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:34,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-11 08:58:34,226 - lava_callback - INFO - Completed processing callback for node 6a0199ad97995df55c488990 2026-05-11 08:58:34,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199bd97995df55c4889b6 HTTP/1.1" 200 None 2026-05-11 08:58:34,269 - lava_callback - INFO - Completed processing callback for node 6a0199bd97995df55c4889b6 2026-05-11 08:58:34,481 - lava_callback - INFO - Received callback for node 6a0199c197995df55c4889c3 INFO: 172.21.0.1:55524 - "POST /node/6a0199c197995df55c4889c3 HTTP/1.0" 202 Accepted 2026-05-11 08:58:34,491 - lava_callback - INFO - Starting async job submit for node 6a0199c197995df55c4889c3 2026-05-11 08:58:34,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:34,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199c197995df55c4889c3 HTTP/1.1" 200 None 2026-05-11 08:58:34,540 - lava_callback - DEBUG - Processing node 6a0199c197995df55c4889c3: baseline-arm64-broonie 2026-05-11 08:58:34,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:34,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:34,912 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199c197995df55c4889c3/log.txt.gz 2026-05-11 08:58:35,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:35,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:35,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199c197995df55c4889c3/lava-logs.yaml 2026-05-11 08:58:35,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:35,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:35,314 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199c197995df55c4889c3/lava_callback.json.gz 2026-05-11 08:58:35,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:35,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199c197995df55c4889c3 HTTP/1.1" 200 None 2026-05-11 08:58:35,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:35,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:35,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:35,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199c197995df55c4889c3 HTTP/1.1" 200 None 2026-05-11 08:58:35,392 - lava_callback - INFO - Completed processing callback for node 6a0199c197995df55c4889c3 2026-05-11 08:58:36,374 - lava_callback - INFO - Received callback for node 6a0199a897995df55c48895f INFO: 172.21.0.1:55528 - "POST /node/6a0199a897995df55c48895f HTTP/1.0" 202 Accepted 2026-05-11 08:58:36,381 - lava_callback - INFO - Starting async job submit for node 6a0199a897995df55c48895f 2026-05-11 08:58:36,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:36,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199a897995df55c48895f HTTP/1.1" 200 None 2026-05-11 08:58:36,424 - lava_callback - DEBUG - Processing node 6a0199a897995df55c48895f: baseline-nfs-arm64 INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:58:36,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:36,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:36,803 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a897995df55c48895f/log.txt.gz 2026-05-11 08:58:36,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:37,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:37,135 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a897995df55c48895f/lava-logs.yaml 2026-05-11 08:58:37,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:37,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:37,236 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a897995df55c48895f/lava_callback.json.gz 2026-05-11 08:58:37,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:37,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199a897995df55c48895f HTTP/1.1" 200 None 2026-05-11 08:58:37,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:37,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:37,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:37,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199a897995df55c48895f HTTP/1.1" 200 None 2026-05-11 08:58:37,334 - lava_callback - INFO - Completed processing callback for node 6a0199a897995df55c48895f 2026-05-11 08:58:43,688 - lava_callback - INFO - Received callback for node 6a0199ca97995df55c488a07 INFO: 172.21.0.1:60100 - "POST /node/6a0199ca97995df55c488a07 HTTP/1.0" 202 Accepted 2026-05-11 08:58:43,694 - lava_callback - INFO - Starting async job submit for node 6a0199ca97995df55c488a07 2026-05-11 08:58:43,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:43,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199ca97995df55c488a07 HTTP/1.1" 200 None 2026-05-11 08:58:43,745 - lava_callback - DEBUG - Processing node 6a0199ca97995df55c488a07: baseline-arm64-clabbe 2026-05-11 08:58:43,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:44,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:44,062 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-6a0199ca97995df55c488a07/log.txt.gz 2026-05-11 08:58:44,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:44,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:44,322 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-6a0199ca97995df55c488a07/lava-logs.yaml 2026-05-11 08:58:44,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:44,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:44,427 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-6a0199ca97995df55c488a07/lava_callback.json.gz 2026-05-11 08:58:44,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:44,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199ca97995df55c488a07 HTTP/1.1" 200 None 2026-05-11 08:58:44,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:44,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:44,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:44,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199ca97995df55c488a07 HTTP/1.1" 200 None 2026-05-11 08:58:44,498 - lava_callback - INFO - Completed processing callback for node 6a0199ca97995df55c488a07 INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:58:53,389 - lava_callback - INFO - Received callback for node 6a0199ba97995df55c4889b0 INFO: 172.21.0.1:55984 - "POST /node/6a0199ba97995df55c4889b0 HTTP/1.0" 202 Accepted 2026-05-11 08:58:53,395 - lava_callback - INFO - Starting async job submit for node 6a0199ba97995df55c4889b0 2026-05-11 08:58:53,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:53,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199ba97995df55c4889b0 HTTP/1.1" 200 None 2026-05-11 08:58:53,432 - lava_callback - DEBUG - Processing node 6a0199ba97995df55c4889b0: baseline-arm64-broonie 2026-05-11 08:58:53,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:53,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:53,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199ba97995df55c4889b0/log.txt.gz 2026-05-11 08:58:53,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:54,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:54,080 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199ba97995df55c4889b0/lava-logs.yaml 2026-05-11 08:58:54,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:54,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:54,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199ba97995df55c4889b0/lava_callback.json.gz 2026-05-11 08:58:54,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:54,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199ba97995df55c4889b0 HTTP/1.1" 200 None 2026-05-11 08:58:54,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:54,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:54,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:54,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199ba97995df55c4889b0 HTTP/1.1" 200 None 2026-05-11 08:58:54,308 - lava_callback - INFO - Completed processing callback for node 6a0199ba97995df55c4889b0 INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:58:57,838 - lava_callback - INFO - Received callback for node 6a01999f97995df55c488946 INFO: 172.21.0.1:56002 - "POST /node/6a01999f97995df55c488946 HTTP/1.0" 202 Accepted 2026-05-11 08:58:57,845 - lava_callback - INFO - Starting async job submit for node 6a01999f97995df55c488946 2026-05-11 08:58:57,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:57,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999f97995df55c488946 HTTP/1.1" 200 None 2026-05-11 08:58:57,882 - lava_callback - DEBUG - Processing node 6a01999f97995df55c488946: baseline-nfs-arm64 2026-05-11 08:58:58,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:58,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:58,347 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01999f97995df55c488946/log.txt.gz 2026-05-11 08:58:58,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:58,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:58,719 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01999f97995df55c488946/lava-logs.yaml 2026-05-11 08:58:58,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:58:58,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:58:58,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01999f97995df55c488946/lava_callback.json.gz 2026-05-11 08:58:58,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:58,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999f97995df55c488946 HTTP/1.1" 200 None 2026-05-11 08:58:58,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:58,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:58:58,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:58:58,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01999f97995df55c488946 HTTP/1.1" 200 None 2026-05-11 08:58:58,896 - lava_callback - INFO - Completed processing callback for node 6a01999f97995df55c488946 2026-05-11 08:59:00,815 - lava_callback - INFO - Received callback for node 6a01998f97995df55c48891b INFO: 172.21.0.1:59550 - "POST /node/6a01998f97995df55c48891b HTTP/1.0" 202 Accepted 2026-05-11 08:59:00,822 - lava_callback - INFO - Starting async job submit for node 6a01998f97995df55c48891b 2026-05-11 08:59:00,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:00,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01998f97995df55c48891b HTTP/1.1" 200 None 2026-05-11 08:59:00,866 - lava_callback - DEBUG - Processing node 6a01998f97995df55c48891b: baseline-arm64 2026-05-11 08:59:01,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:59:01,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:59:01,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998f97995df55c48891b/log.txt.gz 2026-05-11 08:59:01,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:59:01,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:59:01,304 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998f97995df55c48891b/lava-logs.yaml 2026-05-11 08:59:01,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:59:01,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:59:01,382 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01998f97995df55c48891b/lava_callback.json.gz 2026-05-11 08:59:01,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:01,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01998f97995df55c48891b HTTP/1.1" 200 None 2026-05-11 08:59:01,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:01,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 08:59:01,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:01,444 - lava_callback - INFO - Received callback for node 69fef748254d3291e98df601 INFO: 172.21.0.1:59560 - "POST /node/69fef748254d3291e98df601 HTTP/1.0" 202 Accepted 2026-05-11 08:59:01,449 - lava_callback - INFO - Starting async job submit for node 69fef748254d3291e98df601 2026-05-11 08:59:01,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:01,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef748254d3291e98df601 HTTP/1.1" 200 None 2026-05-11 08:59:01,468 - lava_callback - DEBUG - Processing node 69fef748254d3291e98df601: baseline-arm-baylibre 2026-05-11 08:59:01,468 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef748254d3291e98df601 2026-05-11 08:59:01,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:01,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01998f97995df55c48891b HTTP/1.1" 200 None 2026-05-11 08:59:01,553 - lava_callback - INFO - Completed processing callback for node 6a01998f97995df55c48891b 2026-05-11 08:59:01,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef748254d3291e98df601 HTTP/1.1" 200 None 2026-05-11 08:59:01,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:01,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-11 08:59:01,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:01,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef748254d3291e98df601 HTTP/1.1" 200 None 2026-05-11 08:59:01,638 - lava_callback - ERROR - Error processing callback for node 69fef748254d3291e98df601: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 08:59:04,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:04,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:59:25,066 - lava_callback - INFO - Received callback for node 6a0195d697995df55c48809f INFO: 172.21.0.1:42762 - "POST /node/6a0195d697995df55c48809f HTTP/1.0" 202 Accepted 2026-05-11 08:59:25,113 - lava_callback - INFO - Starting async job submit for node 6a0195d697995df55c48809f 2026-05-11 08:59:25,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:25,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195d697995df55c48809f HTTP/1.1" 200 None 2026-05-11 08:59:25,153 - lava_callback - DEBUG - Processing node 6a0195d697995df55c48809f: baseline-arm-pengutronix 2026-05-11 08:59:25,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:59:25,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:59:25,332 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a0195d697995df55c48809f/log.txt.gz 2026-05-11 08:59:25,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:59:25,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:59:25,517 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a0195d697995df55c48809f/lava-logs.yaml 2026-05-11 08:59:25,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 08:59:25,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 08:59:25,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a0195d697995df55c48809f/lava_callback.json.gz DEBUG: Setup failed for 6a0195d697995df55c48809f. Transitting job node result: incomplete -> fail 2026-05-11 08:59:25,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:25,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195d697995df55c48809f HTTP/1.1" 200 None 2026-05-11 08:59:25,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:25,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 08:59:25,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:25,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195d697995df55c48809f HTTP/1.1" 200 None 2026-05-11 08:59:25,753 - lava_callback - INFO - Completed processing callback for node 6a0195d697995df55c48809f INFO: 172.21.0.1:42764 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:59:34,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:34,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39756 - "GET / HTTP/1.0" 200 OK 2026-05-11 08:59:41,525 - lava_callback - INFO - Received callback for node 69fef76f254d3291e98df60f INFO: 172.21.0.1:40224 - "POST /node/69fef76f254d3291e98df60f HTTP/1.0" 202 Accepted 2026-05-11 08:59:41,531 - lava_callback - INFO - Starting async job submit for node 69fef76f254d3291e98df60f 2026-05-11 08:59:41,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:41,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef76f254d3291e98df60f HTTP/1.1" 200 None 2026-05-11 08:59:41,574 - lava_callback - DEBUG - Processing node 69fef76f254d3291e98df60f: baseline-arm-baylibre 2026-05-11 08:59:41,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef76f254d3291e98df60f 2026-05-11 08:59:41,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:41,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef76f254d3291e98df60f HTTP/1.1" 200 None 2026-05-11 08:59:41,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:41,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-11 08:59:41,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 08:59:41,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef76f254d3291e98df60f HTTP/1.1" 200 None 2026-05-11 08:59:41,642 - lava_callback - ERROR - Error processing callback for node 69fef76f254d3291e98df60f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33336 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:00:05,644 - lava_callback - INFO - Received callback for node 6a0195ee97995df55c4880e1 INFO: 172.21.0.1:50824 - "POST /node/6a0195ee97995df55c4880e1 HTTP/1.0" 202 Accepted 2026-05-11 09:00:05,651 - lava_callback - INFO - Starting async job submit for node 6a0195ee97995df55c4880e1 2026-05-11 09:00:05,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:00:05,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195ee97995df55c4880e1 HTTP/1.1" 200 None 2026-05-11 09:00:05,689 - lava_callback - DEBUG - Processing node 6a0195ee97995df55c4880e1: ltp-dio 2026-05-11 09:00:06,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:00:06,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:00:06,215 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-6a0195ee97995df55c4880e1/log.txt.gz 2026-05-11 09:00:06,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50836 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:00:06,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:00:06,628 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-6a0195ee97995df55c4880e1/lava-logs.yaml 2026-05-11 09:00:06,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:00:06,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:00:06,920 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-6a0195ee97995df55c4880e1/lava_callback.json.gz 2026-05-11 09:00:06,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:00:06,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195ee97995df55c4880e1 HTTP/1.1" 200 None 2026-05-11 09:00:06,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:00:06,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 09:00:06,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:00:06,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195ee97995df55c4880e1 HTTP/1.1" 200 None 2026-05-11 09:00:06,994 - lava_callback - INFO - Completed processing callback for node 6a0195ee97995df55c4880e1 2026-05-11 09:00:13,320 - lava_callback - INFO - Received callback for node 6a0199be97995df55c4889b9 INFO: 172.21.0.1:39604 - "POST /node/6a0199be97995df55c4889b9 HTTP/1.0" 202 Accepted 2026-05-11 09:00:13,326 - lava_callback - INFO - Starting async job submit for node 6a0199be97995df55c4889b9 2026-05-11 09:00:13,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:00:13,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199be97995df55c4889b9 HTTP/1.1" 200 None 2026-05-11 09:00:13,381 - lava_callback - DEBUG - Processing node 6a0199be97995df55c4889b9: baseline-arm64-broonie 2026-05-11 09:00:13,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:00:13,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:00:13,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199be97995df55c4889b9/log.txt.gz 2026-05-11 09:00:14,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:00:14,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:00:14,329 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199be97995df55c4889b9/lava-logs.yaml 2026-05-11 09:00:14,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:00:14,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:00:14,468 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199be97995df55c4889b9/lava_callback.json.gz 2026-05-11 09:00:14,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:00:14,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199be97995df55c4889b9 HTTP/1.1" 200 None 2026-05-11 09:00:14,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:00:14,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:00:14,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:00:14,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199be97995df55c4889b9 HTTP/1.1" 200 None 2026-05-11 09:00:14,547 - lava_callback - INFO - Completed processing callback for node 6a0199be97995df55c4889b9 INFO: 172.21.0.1:39610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:00:34,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:00:34,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:05:41,928 - lava_callback - INFO - Received callback for node 69fef8d2254d3291e98df6e5 INFO: 172.21.0.1:58758 - "POST /node/69fef8d2254d3291e98df6e5 HTTP/1.0" 202 Accepted 2026-05-11 09:05:41,934 - lava_callback - INFO - Starting async job submit for node 69fef8d2254d3291e98df6e5 2026-05-11 09:05:41,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:05:41,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef8d2254d3291e98df6e5 HTTP/1.1" 200 None 2026-05-11 09:05:41,950 - lava_callback - DEBUG - Processing node 69fef8d2254d3291e98df6e5: baseline-arm-baylibre 2026-05-11 09:05:41,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef8d2254d3291e98df6e5 2026-05-11 09:05:41,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:05:41,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef8d2254d3291e98df6e5 HTTP/1.1" 200 None 2026-05-11 09:05:41,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:05:41,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-11 09:05:41,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:05:42,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef8d2254d3291e98df6e5 HTTP/1.1" 200 None 2026-05-11 09:05:42,018 - lava_callback - ERROR - Error processing callback for node 69fef8d2254d3291e98df6e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:06:33,616 - lava_callback - INFO - Received callback for node 6a0199b997995df55c4889a9 INFO: 172.21.0.1:60792 - "POST /node/6a0199b997995df55c4889a9 HTTP/1.0" 202 Accepted 2026-05-11 09:06:33,622 - lava_callback - INFO - Starting async job submit for node 6a0199b997995df55c4889a9 2026-05-11 09:06:33,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:06:33,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199b997995df55c4889a9 HTTP/1.1" 200 None 2026-05-11 09:06:33,679 - lava_callback - DEBUG - Processing node 6a0199b997995df55c4889a9: baseline-arm64-broonie 2026-05-11 09:06:33,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:06:33,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:06:33,970 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199b997995df55c4889a9/log.txt.gz 2026-05-11 09:06:34,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:06:34,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:06:34,285 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199b997995df55c4889a9/lava-logs.yaml 2026-05-11 09:06:34,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:06:34,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:06:34,409 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-6a0199b997995df55c4889a9/lava_callback.json.gz 2026-05-11 09:06:34,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:06:34,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199b997995df55c4889a9 HTTP/1.1" 200 None 2026-05-11 09:06:34,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:06:34,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:06:34,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:06:34,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199b997995df55c4889a9 HTTP/1.1" 200 None 2026-05-11 09:06:34,483 - lava_callback - INFO - Completed processing callback for node 6a0199b997995df55c4889a9 INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:07:04,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:07:04,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:07:35,675 - lava_callback - INFO - Received callback for node 6a01999e97995df55c488943 INFO: 172.21.0.1:35858 - "POST /node/6a01999e97995df55c488943 HTTP/1.0" 202 Accepted 2026-05-11 09:07:35,682 - lava_callback - INFO - Starting async job submit for node 6a01999e97995df55c488943 2026-05-11 09:07:35,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:07:35,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999e97995df55c488943 HTTP/1.1" 200 None 2026-05-11 09:07:35,731 - lava_callback - DEBUG - Processing node 6a01999e97995df55c488943: baseline-arm64 2026-05-11 09:07:36,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:07:36,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:07:36,198 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999e97995df55c488943/log.txt.gz 2026-05-11 09:07:36,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35872 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:07:36,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:07:36,606 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999e97995df55c488943/lava-logs.yaml 2026-05-11 09:07:36,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:07:36,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:07:36,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999e97995df55c488943/lava_callback.json.gz DEBUG: Setup failed for 6a01999e97995df55c488943. Transitting job node result: incomplete -> fail 2026-05-11 09:07:36,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:07:37,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999e97995df55c488943 HTTP/1.1" 200 None 2026-05-11 09:07:37,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:07:37,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:07:37,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:07:37,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01999e97995df55c488943 HTTP/1.1" 200 None 2026-05-11 09:07:37,138 - lava_callback - INFO - Completed processing callback for node 6a01999e97995df55c488943 2026-05-11 09:07:38,702 - lava_callback - INFO - Received callback for node 6a01999997995df55c488936 INFO: 172.21.0.1:35882 - "POST /node/6a01999997995df55c488936 HTTP/1.0" 202 Accepted 2026-05-11 09:07:38,709 - lava_callback - INFO - Starting async job submit for node 6a01999997995df55c488936 2026-05-11 09:07:38,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:07:38,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999997995df55c488936 HTTP/1.1" 200 None 2026-05-11 09:07:38,748 - lava_callback - DEBUG - Processing node 6a01999997995df55c488936: baseline-arm64 2026-05-11 09:07:39,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:07:39,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:07:39,329 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999997995df55c488936/log.txt.gz 2026-05-11 09:07:39,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:07:39,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:07:39,754 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999997995df55c488936/lava-logs.yaml 2026-05-11 09:07:39,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:07:39,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:07:39,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01999997995df55c488936/lava_callback.json.gz 2026-05-11 09:07:39,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:07:39,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01999997995df55c488936 HTTP/1.1" 200 None 2026-05-11 09:07:39,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:07:39,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:07:39,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:07:39,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01999997995df55c488936 HTTP/1.1" 200 None 2026-05-11 09:07:40,064 - lava_callback - INFO - Completed processing callback for node 6a01999997995df55c488936 2026-05-11 09:07:44,579 - lava_callback - INFO - Received callback for node 6a0199aa97995df55c488962 INFO: 172.21.0.1:56580 - "POST /node/6a0199aa97995df55c488962 HTTP/1.0" 202 Accepted 2026-05-11 09:07:44,586 - lava_callback - INFO - Starting async job submit for node 6a0199aa97995df55c488962 2026-05-11 09:07:44,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:07:44,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199aa97995df55c488962 HTTP/1.1" 200 None 2026-05-11 09:07:44,626 - lava_callback - DEBUG - Processing node 6a0199aa97995df55c488962: baseline-nfs-arm64 2026-05-11 09:07:45,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:07:45,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:07:45,238 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199aa97995df55c488962/log.txt.gz 2026-05-11 09:07:45,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:07:45,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:07:45,843 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199aa97995df55c488962/lava-logs.yaml 2026-05-11 09:07:45,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:07:45,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:07:45,995 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199aa97995df55c488962/lava_callback.json.gz 2026-05-11 09:07:46,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:07:46,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199aa97995df55c488962 HTTP/1.1" 200 None 2026-05-11 09:07:46,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:07:46,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:07:46,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:07:46,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199aa97995df55c488962 HTTP/1.1" 200 None 2026-05-11 09:07:46,122 - lava_callback - INFO - Completed processing callback for node 6a0199aa97995df55c488962 INFO: 172.21.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:08:04,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:08:04,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47552 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:08:11,850 - lava_callback - INFO - Received callback for node 6a0195f797995df55c4880f3 INFO: 172.21.0.1:56348 - "POST /node/6a0195f797995df55c4880f3 HTTP/1.0" 202 Accepted 2026-05-11 09:08:11,897 - lava_callback - INFO - Starting async job submit for node 6a0195f797995df55c4880f3 2026-05-11 09:08:11,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:08:11,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f797995df55c4880f3 HTTP/1.1" 200 None 2026-05-11 09:08:11,955 - lava_callback - DEBUG - Processing node 6a0195f797995df55c4880f3: ltp-sched 2026-05-11 09:08:12,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:08:12,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:08:12,326 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-6a0195f797995df55c4880f3/log.txt.gz 2026-05-11 09:08:12,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:08:12,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:08:12,505 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-6a0195f797995df55c4880f3/lava-logs.yaml 2026-05-11 09:08:12,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:08:12,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:08:12,589 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-6a0195f797995df55c4880f3/lava_callback.json.gz 2026-05-11 09:08:12,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:08:12,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0195f797995df55c4880f3 HTTP/1.1" 200 None 2026-05-11 09:08:12,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:08:12,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 09:08:12,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:08:12,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0195f797995df55c4880f3 HTTP/1.1" 200 None 2026-05-11 09:08:12,725 - lava_callback - INFO - Completed processing callback for node 6a0195f797995df55c4880f3 INFO: 172.21.0.1:56362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:08:34,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:08:34,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:10:02,094 - lava_callback - INFO - Received callback for node 69fef9e2254d3291e98df7a8 INFO: 172.21.0.1:35940 - "POST /node/69fef9e2254d3291e98df7a8 HTTP/1.0" 202 Accepted 2026-05-11 09:10:02,102 - lava_callback - INFO - Starting async job submit for node 69fef9e2254d3291e98df7a8 2026-05-11 09:10:02,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:10:02,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef9e2254d3291e98df7a8 HTTP/1.1" 200 None 2026-05-11 09:10:02,120 - lava_callback - DEBUG - Processing node 69fef9e2254d3291e98df7a8: baseline-arm-baylibre 2026-05-11 09:10:02,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fef9e2254d3291e98df7a8 2026-05-11 09:10:02,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:10:02,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef9e2254d3291e98df7a8 HTTP/1.1" 200 None 2026-05-11 09:10:02,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:10:02,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-11 09:10:02,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:10:02,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef9e2254d3291e98df7a8 HTTP/1.1" 200 None 2026-05-11 09:10:02,201 - lava_callback - ERROR - Error processing callback for node 69fef9e2254d3291e98df7a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:12:02,239 - lava_callback - INFO - Received callback for node 69fefa53254d3291e98df7da INFO: 172.21.0.1:54458 - "POST /node/69fefa53254d3291e98df7da HTTP/1.0" 202 Accepted 2026-05-11 09:12:02,248 - lava_callback - INFO - Starting async job submit for node 69fefa53254d3291e98df7da 2026-05-11 09:12:02,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:12:02,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefa53254d3291e98df7da HTTP/1.1" 200 None 2026-05-11 09:12:02,263 - lava_callback - DEBUG - Processing node 69fefa53254d3291e98df7da: baseline-arm-baylibre 2026-05-11 09:12:02,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fefa53254d3291e98df7da 2026-05-11 09:12:02,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:12:02,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefa53254d3291e98df7da HTTP/1.1" 200 None 2026-05-11 09:12:02,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:12:02,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-11 09:12:02,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:12:02,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefa53254d3291e98df7da HTTP/1.1" 200 None 2026-05-11 09:12:02,316 - lava_callback - ERROR - Error processing callback for node 69fefa53254d3291e98df7da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:13:50,886 - lava_callback - INFO - Received callback for node 69fefac6254d3291e98df81f INFO: 172.21.0.1:60842 - "POST /node/69fefac6254d3291e98df81f HTTP/1.0" 202 Accepted 2026-05-11 09:13:50,892 - lava_callback - INFO - Starting async job submit for node 69fefac6254d3291e98df81f 2026-05-11 09:13:50,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:13:50,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefac6254d3291e98df81f HTTP/1.1" 200 None 2026-05-11 09:13:50,911 - lava_callback - DEBUG - Processing node 69fefac6254d3291e98df81f: baseline-arm-clabbe 2026-05-11 09:13:50,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fefac6254d3291e98df81f 2026-05-11 09:13:50,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:13:50,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefac6254d3291e98df81f HTTP/1.1" 200 None 2026-05-11 09:13:50,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:13:50,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-11 09:13:50,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:13:50,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefac6254d3291e98df81f HTTP/1.1" 200 None 2026-05-11 09:13:50,985 - lava_callback - ERROR - Error processing callback for node 69fefac6254d3291e98df81f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:14:30,808 - lava_callback - INFO - Received callback for node 69fefaeb254d3291e98df835 INFO: 172.21.0.1:49908 - "POST /node/69fefaeb254d3291e98df835 HTTP/1.0" 202 Accepted 2026-05-11 09:14:30,814 - lava_callback - INFO - Starting async job submit for node 69fefaeb254d3291e98df835 2026-05-11 09:14:30,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:14:30,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefaeb254d3291e98df835 HTTP/1.1" 200 None 2026-05-11 09:14:30,842 - lava_callback - DEBUG - Processing node 69fefaeb254d3291e98df835: baseline-arm-clabbe 2026-05-11 09:14:30,842 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fefaeb254d3291e98df835 2026-05-11 09:14:30,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:14:30,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefaeb254d3291e98df835 HTTP/1.1" 200 None 2026-05-11 09:14:30,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:14:30,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-11 09:14:30,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:14:30,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefaeb254d3291e98df835 HTTP/1.1" 200 None 2026-05-11 09:14:30,887 - lava_callback - ERROR - Error processing callback for node 69fefaeb254d3291e98df835: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:16:10,956 - lava_callback - INFO - Received callback for node 69fefb4d254d3291e98df858 INFO: 172.21.0.1:57330 - "POST /node/69fefb4d254d3291e98df858 HTTP/1.0" 202 Accepted 2026-05-11 09:16:10,961 - lava_callback - INFO - Starting async job submit for node 69fefb4d254d3291e98df858 2026-05-11 09:16:10,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:16:10,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefb4d254d3291e98df858 HTTP/1.1" 200 None 2026-05-11 09:16:10,977 - lava_callback - DEBUG - Processing node 69fefb4d254d3291e98df858: baseline-arm-clabbe 2026-05-11 09:16:10,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fefb4d254d3291e98df858 2026-05-11 09:16:10,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:16:10,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefb4d254d3291e98df858 HTTP/1.1" 200 None 2026-05-11 09:16:10,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:16:11,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-11 09:16:11,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:16:11,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefb4d254d3291e98df858 HTTP/1.1" 200 None 2026-05-11 09:16:11,037 - lava_callback - ERROR - Error processing callback for node 69fefb4d254d3291e98df858: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38116 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:16:44,780 - lava_callback - INFO - Received callback for node 6a0199a497995df55c48894f INFO: 172.21.0.1:58734 - "POST /node/6a0199a497995df55c48894f HTTP/1.0" 202 Accepted 2026-05-11 09:16:44,789 - lava_callback - INFO - Starting async job submit for node 6a0199a497995df55c48894f 2026-05-11 09:16:44,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:16:44,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199a497995df55c48894f HTTP/1.1" 200 None 2026-05-11 09:16:44,851 - lava_callback - DEBUG - Processing node 6a0199a497995df55c48894f: baseline-nfs-arm64 2026-05-11 09:16:45,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:16:46,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:16:46,085 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a497995df55c48894f/log.txt.gz INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:16:46,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:16:46,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:16:46,845 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a497995df55c48894f/lava-logs.yaml 2026-05-11 09:16:46,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:16:47,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:16:47,165 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a0199a497995df55c48894f/lava_callback.json.gz DEBUG: Setup failed for 6a0199a497995df55c48894f. Transitting job node result: incomplete -> fail 2026-05-11 09:16:47,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:16:47,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a0199a497995df55c48894f HTTP/1.1" 200 None 2026-05-11 09:16:47,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:16:47,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:16:47,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:16:47,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a0199a497995df55c48894f HTTP/1.1" 200 None 2026-05-11 09:16:47,411 - lava_callback - INFO - Completed processing callback for node 6a0199a497995df55c48894f 2026-05-11 09:16:50,947 - lava_callback - INFO - Received callback for node 69fefb73254d3291e98df864 INFO: 172.21.0.1:46400 - "POST /node/69fefb73254d3291e98df864 HTTP/1.0" 202 Accepted 2026-05-11 09:16:50,954 - lava_callback - INFO - Starting async job submit for node 69fefb73254d3291e98df864 2026-05-11 09:16:50,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:16:50,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefb73254d3291e98df864 HTTP/1.1" 200 None 2026-05-11 09:16:50,971 - lava_callback - DEBUG - Processing node 69fefb73254d3291e98df864: baseline-arm-clabbe 2026-05-11 09:16:50,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fefb73254d3291e98df864 2026-05-11 09:16:50,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:16:50,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefb73254d3291e98df864 HTTP/1.1" 200 None 2026-05-11 09:16:50,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:16:51,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-11 09:16:51,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:16:51,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefb73254d3291e98df864 HTTP/1.1" 200 None 2026-05-11 09:16:51,026 - lava_callback - ERROR - Error processing callback for node 69fefb73254d3291e98df864: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:17:04,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:17:04,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55500 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:17:28,429 - lava_callback - INFO - Received callback for node 6a019e9197995df55c488d39 INFO: 172.21.0.1:55506 - "POST /node/6a019e9197995df55c488d39 HTTP/1.0" 202 Accepted 2026-05-11 09:17:28,436 - lava_callback - INFO - Starting async job submit for node 6a019e9197995df55c488d39 2026-05-11 09:17:28,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:17:28,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a019e9197995df55c488d39 HTTP/1.1" 200 None 2026-05-11 09:17:28,454 - lava_callback - DEBUG - Processing node 6a019e9197995df55c488d39: baseline-arm 2026-05-11 09:17:28,460 - lava_callback - WARNING - Failed to upload log 2026-05-11 09:17:28,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:17:28,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:17:28,566 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a019e9197995df55c488d39/lava-logs.yaml 2026-05-11 09:17:28,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:17:28,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:17:28,651 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a019e9197995df55c488d39/lava_callback.json.gz 2026-05-11 09:17:28,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:17:28,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a019e9197995df55c488d39 HTTP/1.1" 200 None 2026-05-11 09:17:28,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:17:28,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 09:17:28,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:17:28,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a019e9197995df55c488d39 HTTP/1.1" 200 None 2026-05-11 09:17:28,931 - lava_callback - INFO - Completed processing callback for node 6a019e9197995df55c488d39 2026-05-11 09:17:34,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:17:34,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39104 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:17:51,051 - lava_callback - INFO - Received callback for node 69fefbba254d3291e98df88b INFO: 172.21.0.1:60746 - "POST /node/69fefbba254d3291e98df88b HTTP/1.0" 202 Accepted 2026-05-11 09:17:51,057 - lava_callback - INFO - Starting async job submit for node 69fefbba254d3291e98df88b 2026-05-11 09:17:51,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:17:51,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefbba254d3291e98df88b HTTP/1.1" 200 None 2026-05-11 09:17:51,084 - lava_callback - DEBUG - Processing node 69fefbba254d3291e98df88b: baseline-arm-clabbe 2026-05-11 09:17:51,084 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fefbba254d3291e98df88b 2026-05-11 09:17:51,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:17:51,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefbba254d3291e98df88b HTTP/1.1" 200 None 2026-05-11 09:17:51,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:17:51,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-11 09:17:51,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:17:51,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefbba254d3291e98df88b HTTP/1.1" 200 None 2026-05-11 09:17:51,129 - lava_callback - ERROR - Error processing callback for node 69fefbba254d3291e98df88b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52840 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:19:11,233 - lava_callback - INFO - Received callback for node 69fefc03254d3291e98df8b0 INFO: 172.21.0.1:44010 - "POST /node/69fefc03254d3291e98df8b0 HTTP/1.0" 202 Accepted 2026-05-11 09:19:11,240 - lava_callback - INFO - Starting async job submit for node 69fefc03254d3291e98df8b0 2026-05-11 09:19:11,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:19:11,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefc03254d3291e98df8b0 HTTP/1.1" 200 None 2026-05-11 09:19:11,256 - lava_callback - DEBUG - Processing node 69fefc03254d3291e98df8b0: baseline-arm-clabbe 2026-05-11 09:19:11,256 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fefc03254d3291e98df8b0 2026-05-11 09:19:11,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:19:11,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefc03254d3291e98df8b0 HTTP/1.1" 200 None 2026-05-11 09:19:11,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:19:11,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-11 09:19:11,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:19:11,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefc03254d3291e98df8b0 HTTP/1.1" 200 None 2026-05-11 09:19:11,325 - lava_callback - ERROR - Error processing callback for node 69fefc03254d3291e98df8b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56206 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:20:31,224 - lava_callback - INFO - Received callback for node 69fefc4d254d3291e98df8c7 INFO: 172.21.0.1:38492 - "POST /node/69fefc4d254d3291e98df8c7 HTTP/1.0" 202 Accepted 2026-05-11 09:20:31,230 - lava_callback - INFO - Starting async job submit for node 69fefc4d254d3291e98df8c7 2026-05-11 09:20:31,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:20:31,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefc4d254d3291e98df8c7 HTTP/1.1" 200 None 2026-05-11 09:20:31,244 - lava_callback - DEBUG - Processing node 69fefc4d254d3291e98df8c7: baseline-arm-clabbe 2026-05-11 09:20:31,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fefc4d254d3291e98df8c7 2026-05-11 09:20:31,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:20:31,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefc4d254d3291e98df8c7 HTTP/1.1" 200 None 2026-05-11 09:20:31,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:20:31,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-11 09:20:31,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:20:31,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefc4d254d3291e98df8c7 HTTP/1.1" 200 None 2026-05-11 09:20:31,305 - lava_callback - ERROR - Error processing callback for node 69fefc4d254d3291e98df8c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:21:31,356 - lava_callback - INFO - Received callback for node 69fefc96254d3291e98df8e3 INFO: 172.21.0.1:45682 - "POST /node/69fefc96254d3291e98df8e3 HTTP/1.0" 202 Accepted 2026-05-11 09:21:31,361 - lava_callback - INFO - Starting async job submit for node 69fefc96254d3291e98df8e3 2026-05-11 09:21:31,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:21:31,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefc96254d3291e98df8e3 HTTP/1.1" 200 None 2026-05-11 09:21:31,385 - lava_callback - DEBUG - Processing node 69fefc96254d3291e98df8e3: baseline-arm-clabbe 2026-05-11 09:21:31,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fefc96254d3291e98df8e3 2026-05-11 09:21:31,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:21:31,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefc96254d3291e98df8e3 HTTP/1.1" 200 None 2026-05-11 09:21:31,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:21:31,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-11 09:21:31,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:21:31,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefc96254d3291e98df8e3 HTTP/1.1" 200 None 2026-05-11 09:21:31,446 - lava_callback - ERROR - Error processing callback for node 69fefc96254d3291e98df8e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:23:55,660 - lava_callback - INFO - Received callback for node 6a01a01097995df55c488de1 INFO: 172.21.0.1:50992 - "POST /node/6a01a01097995df55c488de1 HTTP/1.0" 202 Accepted 2026-05-11 09:23:55,666 - lava_callback - INFO - Starting async job submit for node 6a01a01097995df55c488de1 2026-05-11 09:23:55,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:23:55,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a01097995df55c488de1 HTTP/1.1" 200 None 2026-05-11 09:23:55,695 - lava_callback - DEBUG - Processing node 6a01a01097995df55c488de1: baseline-nfs-arm64 2026-05-11 09:23:55,696 - lava_callback - WARNING - Failed to upload log 2026-05-11 09:23:55,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:23:55,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:23:55,793 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a01097995df55c488de1/lava-logs.yaml 2026-05-11 09:23:55,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:23:55,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:23:55,879 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a01097995df55c488de1/lava_callback.json.gz 2026-05-11 09:23:55,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:23:55,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a01097995df55c488de1 HTTP/1.1" 200 None 2026-05-11 09:23:55,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:23:55,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:23:55,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:23:55,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a01097995df55c488de1 HTTP/1.1" 200 None 2026-05-11 09:23:55,937 - lava_callback - INFO - Completed processing callback for node 6a01a01097995df55c488de1 INFO: 172.21.0.1:50996 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:24:04,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:24:04,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43114 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:26:02,963 - lava_callback - INFO - Received callback for node 69fefd9e254d3291e98df946 INFO: 172.21.0.1:52524 - "POST /node/69fefd9e254d3291e98df946 HTTP/1.0" 202 Accepted 2026-05-11 09:26:02,968 - lava_callback - INFO - Starting async job submit for node 69fefd9e254d3291e98df946 2026-05-11 09:26:02,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:26:02,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefd9e254d3291e98df946 HTTP/1.1" 200 None 2026-05-11 09:26:02,983 - lava_callback - DEBUG - Processing node 69fefd9e254d3291e98df946: baseline-arm64-baylibre 2026-05-11 09:26:02,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fefd9e254d3291e98df946 2026-05-11 09:26:02,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:26:02,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefd9e254d3291e98df946 HTTP/1.1" 200 None 2026-05-11 09:26:02,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:26:03,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-11 09:26:03,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:26:03,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefd9e254d3291e98df946 HTTP/1.1" 200 None 2026-05-11 09:26:03,027 - lava_callback - ERROR - Error processing callback for node 69fefd9e254d3291e98df946: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34802 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:27:04,120 - lava_callback - INFO - Received callback for node 6a01a0a097995df55c488e1a INFO: 172.21.0.1:58166 - "POST /node/6a01a0a097995df55c488e1a HTTP/1.0" 202 Accepted 2026-05-11 09:27:04,128 - lava_callback - INFO - Starting async job submit for node 6a01a0a097995df55c488e1a 2026-05-11 09:27:04,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:27:04,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a0a097995df55c488e1a HTTP/1.1" 200 None 2026-05-11 09:27:04,173 - lava_callback - DEBUG - Processing node 6a01a0a097995df55c488e1a: baseline-arm64 2026-05-11 09:27:04,333 - lava_callback - WARNING - Failed to upload log 2026-05-11 09:27:04,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:27:04,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:27:04,564 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a0a097995df55c488e1a/lava-logs.yaml 2026-05-11 09:27:04,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:27:04,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:27:04,647 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a0a097995df55c488e1a/lava_callback.json.gz 2026-05-11 09:27:04,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:27:04,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a0a097995df55c488e1a HTTP/1.1" 200 None 2026-05-11 09:27:04,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:27:04,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:27:04,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:27:04,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a0a097995df55c488e1a HTTP/1.1" 200 None 2026-05-11 09:27:04,816 - lava_callback - INFO - Completed processing callback for node 6a01a0a097995df55c488e1a INFO: 172.21.0.1:58182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35796 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:27:34,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:27:34,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:29:30,879 - lava_callback - INFO - Received callback for node 6a01a14d97995df55c488e6d INFO: 172.21.0.1:34992 - "POST /node/6a01a14d97995df55c488e6d HTTP/1.0" 202 Accepted 2026-05-11 09:29:30,887 - lava_callback - INFO - Starting async job submit for node 6a01a14d97995df55c488e6d 2026-05-11 09:29:30,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:29:30,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a14d97995df55c488e6d HTTP/1.1" 200 None 2026-05-11 09:29:30,949 - lava_callback - DEBUG - Processing node 6a01a14d97995df55c488e6d: baseline-arm64-foundriesio 2026-05-11 09:29:31,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:29:31,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:29:31,325 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a01a14d97995df55c488e6d/log.txt.gz 2026-05-11 09:29:31,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:29:31,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:29:31,598 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a01a14d97995df55c488e6d/lava-logs.yaml 2026-05-11 09:29:31,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:29:31,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:29:31,705 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-6a01a14d97995df55c488e6d/lava_callback.json.gz 2026-05-11 09:29:31,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:29:31,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a14d97995df55c488e6d HTTP/1.1" 200 None 2026-05-11 09:29:31,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:29:31,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:29:31,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:29:31,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a14d97995df55c488e6d HTTP/1.1" 200 None 2026-05-11 09:29:31,787 - lava_callback - INFO - Completed processing callback for node 6a01a14d97995df55c488e6d 2026-05-11 09:29:34,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:29:34,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:29:51,713 - lava_callback - INFO - Received callback for node 69fefe82254d3291e98df9f8 INFO: 172.21.0.1:51534 - "POST /node/69fefe82254d3291e98df9f8 HTTP/1.0" 202 Accepted 2026-05-11 09:29:51,719 - lava_callback - INFO - Starting async job submit for node 69fefe82254d3291e98df9f8 2026-05-11 09:29:51,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:29:51,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefe82254d3291e98df9f8 HTTP/1.1" 200 None 2026-05-11 09:29:51,734 - lava_callback - DEBUG - Processing node 69fefe82254d3291e98df9f8: baseline-arm64-clabbe 2026-05-11 09:29:51,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fefe82254d3291e98df9f8 2026-05-11 09:29:51,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:29:51,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefe82254d3291e98df9f8 HTTP/1.1" 200 None 2026-05-11 09:29:51,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:29:51,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-11 09:29:51,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:29:51,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefe82254d3291e98df9f8 HTTP/1.1" 200 None 2026-05-11 09:29:51,781 - lava_callback - ERROR - Error processing callback for node 69fefe82254d3291e98df9f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51538 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:30:06,036 - lava_callback - INFO - Received callback for node 6a01a0ee97995df55c488e3c INFO: 172.21.0.1:41900 - "POST /node/6a01a0ee97995df55c488e3c HTTP/1.0" 202 Accepted 2026-05-11 09:30:06,043 - lava_callback - INFO - Starting async job submit for node 6a01a0ee97995df55c488e3c 2026-05-11 09:30:06,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:30:06,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a0ee97995df55c488e3c HTTP/1.1" 200 None 2026-05-11 09:30:06,079 - lava_callback - DEBUG - Processing node 6a01a0ee97995df55c488e3c: baseline-arm64 2026-05-11 09:30:06,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:30:06,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:30:06,518 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a0ee97995df55c488e3c/log.txt.gz INFO: 172.21.0.1:41906 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:30:06,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:30:06,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:30:06,888 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a0ee97995df55c488e3c/lava-logs.yaml 2026-05-11 09:30:06,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:30:07,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:30:07,004 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a0ee97995df55c488e3c/lava_callback.json.gz 2026-05-11 09:30:07,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:30:07,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a0ee97995df55c488e3c HTTP/1.1" 200 None 2026-05-11 09:30:07,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:30:07,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:30:07,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:30:07,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a0ee97995df55c488e3c HTTP/1.1" 200 None 2026-05-11 09:30:07,076 - lava_callback - INFO - Completed processing callback for node 6a01a0ee97995df55c488e3c INFO: 172.21.0.1:34234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:30:34,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:30:34,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56920 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:31:28,759 - lava_callback - INFO - Received callback for node 6a01a1ab97995df55c488e9a INFO: 172.21.0.1:56936 - "POST /node/6a01a1ab97995df55c488e9a HTTP/1.0" 202 Accepted 2026-05-11 09:31:28,769 - lava_callback - INFO - Starting async job submit for node 6a01a1ab97995df55c488e9a 2026-05-11 09:31:28,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:31:28,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a1ab97995df55c488e9a HTTP/1.1" 200 None 2026-05-11 09:31:28,847 - lava_callback - DEBUG - Processing node 6a01a1ab97995df55c488e9a: baseline-arm64 2026-05-11 09:31:29,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:31:29,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:31:29,303 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a1ab97995df55c488e9a/log.txt.gz 2026-05-11 09:31:29,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:31:29,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:31:29,656 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a1ab97995df55c488e9a/lava-logs.yaml 2026-05-11 09:31:29,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:31:29,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:31:29,784 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a1ab97995df55c488e9a/lava_callback.json.gz 2026-05-11 09:31:29,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:31:29,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a1ab97995df55c488e9a HTTP/1.1" 200 None 2026-05-11 09:31:29,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:31:29,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:31:29,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:31:29,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a1ab97995df55c488e9a HTTP/1.1" 200 None 2026-05-11 09:31:29,867 - lava_callback - INFO - Completed processing callback for node 6a01a1ab97995df55c488e9a 2026-05-11 09:31:34,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:31:34,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:32:37,469 - lava_callback - INFO - Received callback for node 6a01a1f297995df55c488ec0 INFO: 172.21.0.1:50458 - "POST /node/6a01a1f297995df55c488ec0 HTTP/1.0" 202 Accepted 2026-05-11 09:32:37,476 - lava_callback - INFO - Starting async job submit for node 6a01a1f297995df55c488ec0 2026-05-11 09:32:37,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:32:37,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a1f297995df55c488ec0 HTTP/1.1" 200 None 2026-05-11 09:32:37,522 - lava_callback - DEBUG - Processing node 6a01a1f297995df55c488ec0: baseline-arm64 2026-05-11 09:32:37,743 - lava_callback - WARNING - Failed to upload log 2026-05-11 09:32:37,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:32:38,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:32:38,023 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a1f297995df55c488ec0/lava-logs.yaml 2026-05-11 09:32:38,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:32:38,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:32:38,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a1f297995df55c488ec0/lava_callback.json.gz 2026-05-11 09:32:38,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:32:38,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a1f297995df55c488ec0 HTTP/1.1" 200 None 2026-05-11 09:32:38,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:32:38,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:32:38,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:32:38,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a1f297995df55c488ec0 HTTP/1.1" 200 None 2026-05-11 09:32:38,252 - lava_callback - INFO - Completed processing callback for node 6a01a1f297995df55c488ec0 2026-05-11 09:32:40,884 - lava_callback - INFO - Received callback for node 69feff1e254d3291e98dfa52 INFO: 172.21.0.1:51442 - "POST /node/69feff1e254d3291e98dfa52 HTTP/1.0" 202 Accepted 2026-05-11 09:32:40,889 - lava_callback - INFO - Starting async job submit for node 69feff1e254d3291e98dfa52 2026-05-11 09:32:40,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:32:40,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feff1e254d3291e98dfa52 HTTP/1.1" 200 None 2026-05-11 09:32:40,909 - lava_callback - DEBUG - Processing node 69feff1e254d3291e98dfa52: baseline-arm64-clabbe 2026-05-11 09:32:40,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69feff1e254d3291e98dfa52 2026-05-11 09:32:40,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:32:40,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feff1e254d3291e98dfa52 HTTP/1.1" 200 None 2026-05-11 09:32:40,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:32:40,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-11 09:32:40,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:32:40,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69feff1e254d3291e98dfa52 HTTP/1.1" 200 None 2026-05-11 09:32:40,955 - lava_callback - ERROR - Error processing callback for node 69feff1e254d3291e98dfa52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:33:04,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:33:04,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:34:51,933 - lava_callback - INFO - Received callback for node 69feffb4254d3291e98dfaaa INFO: 172.21.0.1:36364 - "POST /node/69feffb4254d3291e98dfaaa HTTP/1.0" 202 Accepted 2026-05-11 09:34:51,940 - lava_callback - INFO - Starting async job submit for node 69feffb4254d3291e98dfaaa 2026-05-11 09:34:51,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:34:51,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feffb4254d3291e98dfaaa HTTP/1.1" 200 None 2026-05-11 09:34:51,957 - lava_callback - DEBUG - Processing node 69feffb4254d3291e98dfaaa: baseline-arm64-clabbe 2026-05-11 09:34:51,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69feffb4254d3291e98dfaaa 2026-05-11 09:34:51,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:34:51,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feffb4254d3291e98dfaaa HTTP/1.1" 200 None 2026-05-11 09:34:51,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:34:51,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-11 09:34:51,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:34:52,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69feffb4254d3291e98dfaaa HTTP/1.1" 200 None 2026-05-11 09:34:52,007 - lava_callback - ERROR - Error processing callback for node 69feffb4254d3291e98dfaaa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34230 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:35:55,983 - lava_callback - INFO - Received callback for node 6a019eda97995df55c488d5b INFO: 172.21.0.1:34242 - "POST /node/6a019eda97995df55c488d5b HTTP/1.0" 202 Accepted 2026-05-11 09:35:55,990 - lava_callback - INFO - Starting async job submit for node 6a019eda97995df55c488d5b 2026-05-11 09:35:56,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:35:56,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a019eda97995df55c488d5b HTTP/1.1" 200 None 2026-05-11 09:35:56,062 - lava_callback - DEBUG - Processing node 6a019eda97995df55c488d5b: ltp-smoke INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:35:56,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:35:56,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:35:56,606 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-6a019eda97995df55c488d5b/log.txt.gz 2026-05-11 09:35:56,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:35:57,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:35:57,051 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-6a019eda97995df55c488d5b/lava-logs.yaml 2026-05-11 09:35:57,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:35:57,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:35:57,176 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-6a019eda97995df55c488d5b/lava_callback.json.gz 2026-05-11 09:35:57,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:35:57,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a019eda97995df55c488d5b HTTP/1.1" 200 None 2026-05-11 09:35:57,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:35:57,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912c97995df55c487f3d HTTP/1.1" 200 None 2026-05-11 09:35:57,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:35:57,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a019eda97995df55c488d5b HTTP/1.1" 200 None 2026-05-11 09:35:57,469 - lava_callback - INFO - Completed processing callback for node 6a019eda97995df55c488d5b 2026-05-11 09:36:04,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:36:04,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:37:32,085 - lava_callback - INFO - Received callback for node 69ff004f254d3291e98dfb07 INFO: 172.21.0.1:50604 - "POST /node/69ff004f254d3291e98dfb07 HTTP/1.0" 202 Accepted 2026-05-11 09:37:32,091 - lava_callback - INFO - Starting async job submit for node 69ff004f254d3291e98dfb07 2026-05-11 09:37:32,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:37:32,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff004f254d3291e98dfb07 HTTP/1.1" 200 None 2026-05-11 09:37:32,109 - lava_callback - DEBUG - Processing node 69ff004f254d3291e98dfb07: baseline-arm64-clabbe 2026-05-11 09:37:32,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff004f254d3291e98dfb07 2026-05-11 09:37:32,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:37:32,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff004f254d3291e98dfb07 HTTP/1.1" 200 None 2026-05-11 09:37:32,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:37:32,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-11 09:37:32,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:37:32,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff004f254d3291e98dfb07 HTTP/1.1" 200 None 2026-05-11 09:37:32,173 - lava_callback - ERROR - Error processing callback for node 69ff004f254d3291e98dfb07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60532 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:38:52,070 - lava_callback - INFO - Received callback for node 69ff009b254d3291e98dfb36 INFO: 172.21.0.1:60548 - "POST /node/69ff009b254d3291e98dfb36 HTTP/1.0" 202 Accepted 2026-05-11 09:38:52,076 - lava_callback - INFO - Starting async job submit for node 69ff009b254d3291e98dfb36 2026-05-11 09:38:52,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:38:52,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff009b254d3291e98dfb36 HTTP/1.1" 200 None 2026-05-11 09:38:52,100 - lava_callback - DEBUG - Processing node 69ff009b254d3291e98dfb36: baseline-arm64-clabbe 2026-05-11 09:38:52,100 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff009b254d3291e98dfb36 2026-05-11 09:38:52,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:38:52,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff009b254d3291e98dfb36 HTTP/1.1" 200 None 2026-05-11 09:38:52,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:38:52,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-11 09:38:52,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:38:52,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff009b254d3291e98dfb36 HTTP/1.1" 200 None 2026-05-11 09:38:52,147 - lava_callback - ERROR - Error processing callback for node 69ff009b254d3291e98dfb36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45686 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:42:33,267 - lava_callback - INFO - Received callback for node 6a01a05497995df55c488e02 INFO: 172.21.0.1:58184 - "POST /node/6a01a05497995df55c488e02 HTTP/1.0" 202 Accepted 2026-05-11 09:42:33,274 - lava_callback - INFO - Starting async job submit for node 6a01a05497995df55c488e02 2026-05-11 09:42:33,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:42:33,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a05497995df55c488e02 HTTP/1.1" 200 None 2026-05-11 09:42:33,341 - lava_callback - DEBUG - Processing node 6a01a05497995df55c488e02: baseline-arm 2026-05-11 09:42:34,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:42:34,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:42:34,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a01a05497995df55c488e02/log.txt.gz 2026-05-11 09:42:34,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:42:34,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:42:34,882 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a01a05497995df55c488e02/lava-logs.yaml 2026-05-11 09:42:34,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:42:35,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:42:35,022 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a01a05497995df55c488e02/lava_callback.json.gz DEBUG: Setup failed for 6a01a05497995df55c488e02. Transitting job node result: incomplete -> fail 2026-05-11 09:42:35,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:42:35,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a05497995df55c488e02 HTTP/1.1" 200 None 2026-05-11 09:42:35,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:42:35,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 09:42:35,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:42:35,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a05497995df55c488e02 HTTP/1.1" 200 None 2026-05-11 09:42:35,318 - lava_callback - INFO - Completed processing callback for node 6a01a05497995df55c488e02 INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:43:04,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:43:04,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50348 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:43:11,359 - lava_callback - INFO - Received callback for node 6a01a2f997995df55c488f22 INFO: 172.21.0.1:57962 - "POST /node/6a01a2f997995df55c488f22 HTTP/1.0" 202 Accepted 2026-05-11 09:43:11,367 - lava_callback - INFO - Starting async job submit for node 6a01a2f997995df55c488f22 2026-05-11 09:43:11,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:43:11,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a2f997995df55c488f22 HTTP/1.1" 200 None 2026-05-11 09:43:11,432 - lava_callback - DEBUG - Processing node 6a01a2f997995df55c488f22: baseline-arm64 2026-05-11 09:43:11,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:43:11,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:43:11,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a2f997995df55c488f22/log.txt.gz 2026-05-11 09:43:12,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:43:12,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:43:12,433 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a2f997995df55c488f22/lava-logs.yaml 2026-05-11 09:43:12,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:43:12,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:43:12,593 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a2f997995df55c488f22/lava_callback.json.gz DEBUG: Setup failed for 6a01a2f997995df55c488f22. Transitting job node result: incomplete -> fail 2026-05-11 09:43:12,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:43:12,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a2f997995df55c488f22 HTTP/1.1" 200 None 2026-05-11 09:43:12,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:43:12,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:43:12,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:43:12,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a2f997995df55c488f22 HTTP/1.1" 200 None 2026-05-11 09:43:12,816 - lava_callback - INFO - Completed processing callback for node 6a01a2f997995df55c488f22 INFO: 172.21.0.1:57968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:43:34,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:43:34,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:43:55,218 - lava_callback - INFO - Received callback for node 6a01a3f897995df55c488f94 INFO: 172.21.0.1:42846 - "POST /node/6a01a3f897995df55c488f94 HTTP/1.0" 202 Accepted 2026-05-11 09:43:55,225 - lava_callback - INFO - Starting async job submit for node 6a01a3f897995df55c488f94 2026-05-11 09:43:55,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:43:55,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a3f897995df55c488f94 HTTP/1.1" 200 None 2026-05-11 09:43:55,266 - lava_callback - DEBUG - Processing node 6a01a3f897995df55c488f94: ltp-sched 2026-05-11 09:43:55,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:43:55,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:43:55,801 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-6a01a3f897995df55c488f94/log.txt.gz 2026-05-11 09:43:56,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:43:56,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:43:56,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-6a01a3f897995df55c488f94/lava-logs.yaml 2026-05-11 09:43:56,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:43:56,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:43:56,482 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-6a01a3f897995df55c488f94/lava_callback.json.gz 2026-05-11 09:43:56,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:43:56,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a3f897995df55c488f94 HTTP/1.1" 200 None 2026-05-11 09:43:56,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:43:56,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 09:43:56,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:43:56,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a3f897995df55c488f94 HTTP/1.1" 200 None 2026-05-11 09:43:56,556 - lava_callback - INFO - Completed processing callback for node 6a01a3f897995df55c488f94 2026-05-11 09:44:04,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:44:04,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:44:32,290 - lava_callback - INFO - Received callback for node 69ff01f0254d3291e98dfc0b INFO: 172.21.0.1:44674 - "POST /node/69ff01f0254d3291e98dfc0b HTTP/1.0" 202 Accepted 2026-05-11 09:44:32,296 - lava_callback - INFO - Starting async job submit for node 69ff01f0254d3291e98dfc0b 2026-05-11 09:44:32,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:44:32,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff01f0254d3291e98dfc0b HTTP/1.1" 200 None 2026-05-11 09:44:32,311 - lava_callback - DEBUG - Processing node 69ff01f0254d3291e98dfc0b: baseline-arm64-clabbe 2026-05-11 09:44:32,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff01f0254d3291e98dfc0b 2026-05-11 09:44:32,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:44:32,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff01f0254d3291e98dfc0b HTTP/1.1" 200 None 2026-05-11 09:44:32,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:44:32,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-11 09:44:32,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:44:32,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff01f0254d3291e98dfc0b HTTP/1.1" 200 None 2026-05-11 09:44:32,373 - lava_callback - ERROR - Error processing callback for node 69ff01f0254d3291e98dfc0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:46:44,189 - lava_callback - INFO - Received callback for node 69ff0281254d3291e98dfc5f INFO: 172.21.0.1:57672 - "POST /node/69ff0281254d3291e98dfc5f HTTP/1.0" 202 Accepted 2026-05-11 09:46:44,195 - lava_callback - INFO - Starting async job submit for node 69ff0281254d3291e98dfc5f 2026-05-11 09:46:44,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:46:44,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0281254d3291e98dfc5f HTTP/1.1" 200 None 2026-05-11 09:46:44,210 - lava_callback - DEBUG - Processing node 69ff0281254d3291e98dfc5f: baseline-arm64-baylibre 2026-05-11 09:46:44,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0281254d3291e98dfc5f 2026-05-11 09:46:44,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:46:44,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0281254d3291e98dfc5f HTTP/1.1" 200 None 2026-05-11 09:46:44,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:46:44,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 09:46:44,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:46:44,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0281254d3291e98dfc5f HTTP/1.1" 200 None 2026-05-11 09:46:44,258 - lava_callback - ERROR - Error processing callback for node 69ff0281254d3291e98dfc5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47666 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:48:04,138 - lava_callback - INFO - Received callback for node 69ff02cd254d3291e98dfc8a INFO: 172.21.0.1:53616 - "POST /node/69ff02cd254d3291e98dfc8a HTTP/1.0" 202 Accepted 2026-05-11 09:48:04,143 - lava_callback - INFO - Starting async job submit for node 69ff02cd254d3291e98dfc8a 2026-05-11 09:48:04,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:48:04,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff02cd254d3291e98dfc8a HTTP/1.1" 200 None 2026-05-11 09:48:04,159 - lava_callback - DEBUG - Processing node 69ff02cd254d3291e98dfc8a: baseline-arm64-baylibre 2026-05-11 09:48:04,159 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff02cd254d3291e98dfc8a 2026-05-11 09:48:04,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:48:04,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff02cd254d3291e98dfc8a HTTP/1.1" 200 None 2026-05-11 09:48:04,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:48:04,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 09:48:04,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:48:04,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff02cd254d3291e98dfc8a HTTP/1.1" 200 None 2026-05-11 09:48:04,239 - lava_callback - ERROR - Error processing callback for node 69ff02cd254d3291e98dfc8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52004 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:49:13,498 - lava_callback - INFO - Received callback for node 6a01a39497995df55c488f6c INFO: 172.21.0.1:56452 - "POST /node/6a01a39497995df55c488f6c HTTP/1.0" 202 Accepted 2026-05-11 09:49:13,507 - lava_callback - INFO - Starting async job submit for node 6a01a39497995df55c488f6c 2026-05-11 09:49:13,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:49:13,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a39497995df55c488f6c HTTP/1.1" 200 None 2026-05-11 09:49:13,561 - lava_callback - DEBUG - Processing node 6a01a39497995df55c488f6c: baseline-nfs-arm64 2026-05-11 09:49:14,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:49:14,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:49:14,262 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a39497995df55c488f6c/log.txt.gz 2026-05-11 09:49:14,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:49:14,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:49:14,693 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a39497995df55c488f6c/lava-logs.yaml 2026-05-11 09:49:14,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:49:14,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:49:14,826 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a39497995df55c488f6c/lava_callback.json.gz 2026-05-11 09:49:14,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:49:14,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a39497995df55c488f6c HTTP/1.1" 200 None 2026-05-11 09:49:14,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:49:14,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:49:14,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:49:14,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a39497995df55c488f6c HTTP/1.1" 200 None 2026-05-11 09:49:14,958 - lava_callback - INFO - Completed processing callback for node 6a01a39497995df55c488f6c INFO: 172.21.0.1:56468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:49:34,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:49:34,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:50:44,308 - lava_callback - INFO - Received callback for node 69ff0368254d3291e98dfce2 INFO: 172.21.0.1:59326 - "POST /node/69ff0368254d3291e98dfce2 HTTP/1.0" 202 Accepted 2026-05-11 09:50:44,318 - lava_callback - INFO - Starting async job submit for node 69ff0368254d3291e98dfce2 2026-05-11 09:50:44,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:50:44,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0368254d3291e98dfce2 HTTP/1.1" 200 None 2026-05-11 09:50:44,337 - lava_callback - DEBUG - Processing node 69ff0368254d3291e98dfce2: baseline-arm64-baylibre 2026-05-11 09:50:44,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0368254d3291e98dfce2 2026-05-11 09:50:44,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:50:44,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0368254d3291e98dfce2 HTTP/1.1" 200 None 2026-05-11 09:50:44,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:50:44,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 09:50:44,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:50:44,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0368254d3291e98dfce2 HTTP/1.1" 200 None 2026-05-11 09:50:44,423 - lava_callback - ERROR - Error processing callback for node 69ff0368254d3291e98dfce2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34302 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:50:57,250 - lava_callback - INFO - Received callback for node 6a01a66097995df55c48909c INFO: 172.21.0.1:34310 - "POST /node/6a01a66097995df55c48909c HTTP/1.0" 202 Accepted 2026-05-11 09:50:57,256 - lava_callback - INFO - Starting async job submit for node 6a01a66097995df55c48909c 2026-05-11 09:50:57,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:50:57,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a66097995df55c48909c HTTP/1.1" 200 None 2026-05-11 09:50:57,272 - lava_callback - DEBUG - Processing node 6a01a66097995df55c48909c: baseline-nfs-arm64 2026-05-11 09:50:57,273 - lava_callback - WARNING - Failed to upload log 2026-05-11 09:50:57,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:50:57,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:50:57,385 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a66097995df55c48909c/lava-logs.yaml 2026-05-11 09:50:57,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:50:57,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:50:57,481 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a66097995df55c48909c/lava_callback.json.gz 2026-05-11 09:50:57,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:50:57,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a66097995df55c48909c HTTP/1.1" 200 None 2026-05-11 09:50:57,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:50:57,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:50:57,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:50:57,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a66097995df55c48909c HTTP/1.1" 200 None 2026-05-11 09:50:57,552 - lava_callback - INFO - Completed processing callback for node 6a01a66097995df55c48909c 2026-05-11 09:51:04,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:51:04,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58064 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:51:34,190 - lava_callback - INFO - Received callback for node 6a01a34397995df55c488f49 INFO: 172.21.0.1:36886 - "POST /node/6a01a34397995df55c488f49 HTTP/1.0" 202 Accepted 2026-05-11 09:51:34,196 - lava_callback - INFO - Starting async job submit for node 6a01a34397995df55c488f49 2026-05-11 09:51:34,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:51:34,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a34397995df55c488f49 HTTP/1.1" 200 None 2026-05-11 09:51:34,255 - lava_callback - DEBUG - Processing node 6a01a34397995df55c488f49: baseline-arm64 2026-05-11 09:51:34,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:51:34,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:51:34,866 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a34397995df55c488f49/log.txt.gz 2026-05-11 09:51:35,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:51:35,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:51:35,408 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a34397995df55c488f49/lava-logs.yaml 2026-05-11 09:51:35,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:51:35,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:51:35,572 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a34397995df55c488f49/lava_callback.json.gz 2026-05-11 09:51:35,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:51:35,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a34397995df55c488f49 HTTP/1.1" 200 None 2026-05-11 09:51:35,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:51:35,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:51:35,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:51:35,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a34397995df55c488f49 HTTP/1.1" 200 None 2026-05-11 09:51:35,734 - lava_callback - INFO - Completed processing callback for node 6a01a34397995df55c488f49 INFO: 172.21.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57446 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:52:04,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:52:04,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:52:26,203 - lava_callback - INFO - Received callback for node 6a01a6a397995df55c4890bb INFO: 172.21.0.1:54426 - "POST /node/6a01a6a397995df55c4890bb HTTP/1.0" 202 Accepted 2026-05-11 09:52:26,213 - lava_callback - INFO - Starting async job submit for node 6a01a6a397995df55c4890bb 2026-05-11 09:52:26,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:52:26,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a6a397995df55c4890bb HTTP/1.1" 200 None 2026-05-11 09:52:26,287 - lava_callback - DEBUG - Processing node 6a01a6a397995df55c4890bb: baseline-arm64 2026-05-11 09:52:26,461 - lava_callback - WARNING - Failed to upload log INFO: 172.21.0.1:54440 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:52:26,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:52:26,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:52:26,686 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a6a397995df55c4890bb/lava-logs.yaml 2026-05-11 09:52:26,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:52:26,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:52:26,796 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a6a397995df55c4890bb/lava_callback.json.gz 2026-05-11 09:52:26,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:52:26,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a6a397995df55c4890bb HTTP/1.1" 200 None 2026-05-11 09:52:26,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:52:26,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:52:26,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:52:26,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a6a397995df55c4890bb HTTP/1.1" 200 None 2026-05-11 09:52:26,946 - lava_callback - INFO - Completed processing callback for node 6a01a6a397995df55c4890bb 2026-05-11 09:52:34,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:52:34,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42322 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:53:24,439 - lava_callback - INFO - Received callback for node 69ff03ff254d3291e98dfd35 INFO: 172.21.0.1:39912 - "POST /node/69ff03ff254d3291e98dfd35 HTTP/1.0" 202 Accepted 2026-05-11 09:53:24,448 - lava_callback - INFO - Starting async job submit for node 69ff03ff254d3291e98dfd35 2026-05-11 09:53:24,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:53:24,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff03ff254d3291e98dfd35 HTTP/1.1" 200 None 2026-05-11 09:53:24,463 - lava_callback - DEBUG - Processing node 69ff03ff254d3291e98dfd35: baseline-arm64-baylibre 2026-05-11 09:53:24,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff03ff254d3291e98dfd35 2026-05-11 09:53:24,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:53:24,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff03ff254d3291e98dfd35 HTTP/1.1" 200 None 2026-05-11 09:53:24,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:53:24,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 09:53:24,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:53:24,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff03ff254d3291e98dfd35 HTTP/1.1" 200 None 2026-05-11 09:53:24,522 - lava_callback - ERROR - Error processing callback for node 69ff03ff254d3291e98dfd35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48100 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:53:46,205 - lava_callback - INFO - Received callback for node 6a01a6ef97995df55c4890e3 INFO: 172.21.0.1:45540 - "POST /node/6a01a6ef97995df55c4890e3 HTTP/1.0" 202 Accepted 2026-05-11 09:53:46,213 - lava_callback - INFO - Starting async job submit for node 6a01a6ef97995df55c4890e3 2026-05-11 09:53:46,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:53:46,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a6ef97995df55c4890e3 HTTP/1.1" 200 None 2026-05-11 09:53:46,275 - lava_callback - DEBUG - Processing node 6a01a6ef97995df55c4890e3: baseline-arm64 2026-05-11 09:53:46,461 - lava_callback - WARNING - Failed to upload log INFO: 172.21.0.1:45546 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:53:46,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:53:46,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:53:46,683 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a6ef97995df55c4890e3/lava-logs.yaml 2026-05-11 09:53:46,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 09:53:46,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 09:53:46,765 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a6ef97995df55c4890e3/lava_callback.json.gz 2026-05-11 09:53:46,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:53:46,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a6ef97995df55c4890e3 HTTP/1.1" 200 None 2026-05-11 09:53:46,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:53:46,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 09:53:46,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:53:46,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a6ef97995df55c4890e3 HTTP/1.1" 200 None 2026-05-11 09:53:46,904 - lava_callback - INFO - Completed processing callback for node 6a01a6ef97995df55c4890e3 INFO: 172.21.0.1:40340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40342 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:54:04,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:54:04,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:55:44,563 - lava_callback - INFO - Received callback for node 69ff0492254d3291e98dfd8e INFO: 172.21.0.1:36840 - "POST /node/69ff0492254d3291e98dfd8e HTTP/1.0" 202 Accepted 2026-05-11 09:55:44,569 - lava_callback - INFO - Starting async job submit for node 69ff0492254d3291e98dfd8e 2026-05-11 09:55:44,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:55:44,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0492254d3291e98dfd8e HTTP/1.1" 200 None 2026-05-11 09:55:44,584 - lava_callback - DEBUG - Processing node 69ff0492254d3291e98dfd8e: baseline-arm64-baylibre 2026-05-11 09:55:44,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0492254d3291e98dfd8e 2026-05-11 09:55:44,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:55:44,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0492254d3291e98dfd8e HTTP/1.1" 200 None 2026-05-11 09:55:44,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:55:44,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 09:55:44,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:55:44,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0492254d3291e98dfd8e HTTP/1.1" 200 None 2026-05-11 09:55:44,634 - lava_callback - ERROR - Error processing callback for node 69ff0492254d3291e98dfd8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54992 - "GET / HTTP/1.0" 200 OK 2026-05-11 09:58:04,723 - lava_callback - INFO - Received callback for node 69ff0529254d3291e98dfdde INFO: 172.21.0.1:57106 - "POST /node/69ff0529254d3291e98dfdde HTTP/1.0" 202 Accepted 2026-05-11 09:58:04,729 - lava_callback - INFO - Starting async job submit for node 69ff0529254d3291e98dfdde 2026-05-11 09:58:04,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:58:04,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0529254d3291e98dfdde HTTP/1.1" 200 None 2026-05-11 09:58:04,745 - lava_callback - DEBUG - Processing node 69ff0529254d3291e98dfdde: baseline-arm64-baylibre 2026-05-11 09:58:04,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0529254d3291e98dfdde 2026-05-11 09:58:04,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:58:04,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0529254d3291e98dfdde HTTP/1.1" 200 None 2026-05-11 09:58:04,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:58:04,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 09:58:04,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 09:58:04,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0529254d3291e98dfdde HTTP/1.1" 200 None 2026-05-11 09:58:04,792 - lava_callback - ERROR - Error processing callback for node 69ff0529254d3291e98dfdde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36326 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:00:52,996 - lava_callback - INFO - Received callback for node 69ff05c4254d3291e98dfe2e INFO: 172.21.0.1:36336 - "POST /node/69ff05c4254d3291e98dfe2e HTTP/1.0" 202 Accepted 2026-05-11 10:00:53,002 - lava_callback - INFO - Starting async job submit for node 69ff05c4254d3291e98dfe2e 2026-05-11 10:00:53,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:00:53,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff05c4254d3291e98dfe2e HTTP/1.1" 200 None 2026-05-11 10:00:53,017 - lava_callback - DEBUG - Processing node 69ff05c4254d3291e98dfe2e: baseline-arm64-clabbe 2026-05-11 10:00:53,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff05c4254d3291e98dfe2e 2026-05-11 10:00:53,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:00:53,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff05c4254d3291e98dfe2e HTTP/1.1" 200 None 2026-05-11 10:00:53,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:00:53,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:00:53,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:00:53,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff05c4254d3291e98dfe2e HTTP/1.1" 200 None 2026-05-11 10:00:53,069 - lava_callback - ERROR - Error processing callback for node 69ff05c4254d3291e98dfe2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:01:20,484 - lava_callback - INFO - Received callback for node 6a01a26b97995df55c488ef5 INFO: 172.21.0.1:38426 - "POST /node/6a01a26b97995df55c488ef5 HTTP/1.0" 202 Accepted 2026-05-11 10:01:20,534 - lava_callback - INFO - Starting async job submit for node 6a01a26b97995df55c488ef5 2026-05-11 10:01:20,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:01:20,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a26b97995df55c488ef5 HTTP/1.1" 200 None 2026-05-11 10:01:20,576 - lava_callback - DEBUG - Processing node 6a01a26b97995df55c488ef5: baseline-arm-pengutronix 2026-05-11 10:01:20,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:01:20,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:01:20,762 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a01a26b97995df55c488ef5/log.txt.gz 2026-05-11 10:01:20,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:01:20,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:01:20,948 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a01a26b97995df55c488ef5/lava-logs.yaml 2026-05-11 10:01:20,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:01:21,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:01:21,090 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a01a26b97995df55c488ef5/lava_callback.json.gz DEBUG: Setup failed for 6a01a26b97995df55c488ef5. Transitting job node result: incomplete -> fail 2026-05-11 10:01:21,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:01:21,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a26b97995df55c488ef5 HTTP/1.1" 200 None 2026-05-11 10:01:21,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:01:21,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 10:01:21,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:01:21,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a26b97995df55c488ef5 HTTP/1.1" 200 None 2026-05-11 10:01:21,239 - lava_callback - INFO - Completed processing callback for node 6a01a26b97995df55c488ef5 INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:01:34,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:01:34,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:01:51,414 - lava_callback - INFO - Received callback for node 6a01a8f897995df55c4891be INFO: 172.21.0.1:44704 - "POST /node/6a01a8f897995df55c4891be HTTP/1.0" 202 Accepted 2026-05-11 10:01:51,420 - lava_callback - INFO - Starting async job submit for node 6a01a8f897995df55c4891be 2026-05-11 10:01:51,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:01:51,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a8f897995df55c4891be HTTP/1.1" 200 None 2026-05-11 10:01:51,436 - lava_callback - DEBUG - Processing node 6a01a8f897995df55c4891be: baseline-nfs-arm64 2026-05-11 10:01:51,438 - lava_callback - WARNING - Failed to upload log 2026-05-11 10:01:51,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:01:51,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:01:51,514 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a8f897995df55c4891be/lava-logs.yaml 2026-05-11 10:01:51,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:01:51,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:01:51,611 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a8f897995df55c4891be/lava_callback.json.gz 2026-05-11 10:01:51,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:01:51,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a8f897995df55c4891be HTTP/1.1" 200 None 2026-05-11 10:01:51,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:01:51,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 10:01:51,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:01:51,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a8f897995df55c4891be HTTP/1.1" 200 None 2026-05-11 10:01:51,668 - lava_callback - INFO - Completed processing callback for node 6a01a8f897995df55c4891be INFO: 172.21.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39868 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:02:04,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:02:04,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-11 10:02:04,930 - lava_callback - INFO - Received callback for node 69ff060c254d3291e98dfe54 INFO: 172.21.0.1:39884 - "POST /node/69ff060c254d3291e98dfe54 HTTP/1.0" 202 Accepted 2026-05-11 10:02:04,936 - lava_callback - INFO - Starting async job submit for node 69ff060c254d3291e98dfe54 2026-05-11 10:02:04,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:02:04,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff060c254d3291e98dfe54 HTTP/1.1" 200 None 2026-05-11 10:02:04,982 - lava_callback - DEBUG - Processing node 69ff060c254d3291e98dfe54: baseline-arm64-baylibre 2026-05-11 10:02:04,982 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff060c254d3291e98dfe54 2026-05-11 10:02:04,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:02:04,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff060c254d3291e98dfe54 HTTP/1.1" 200 None 2026-05-11 10:02:04,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:02:05,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:02:05,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:02:05,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff060c254d3291e98dfe54 HTTP/1.1" 200 None 2026-05-11 10:02:05,033 - lava_callback - ERROR - Error processing callback for node 69ff060c254d3291e98dfe54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:55574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET /.well-known/security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:03:31,811 - lava_callback - INFO - Received callback for node 6a01a4bb97995df55c488fe2 INFO: 172.21.0.1:48862 - "POST /node/6a01a4bb97995df55c488fe2 HTTP/1.0" 202 Accepted 2026-05-11 10:03:31,820 - lava_callback - INFO - Starting async job submit for node 6a01a4bb97995df55c488fe2 2026-05-11 10:03:31,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:03:35,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a4bb97995df55c488fe2 HTTP/1.1" 200 None 2026-05-11 10:03:35,898 - lava_callback - DEBUG - Processing node 6a01a4bb97995df55c488fe2: baseline-nfs-arm64 INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:03:37,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:03:37,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:03:37,212 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a4bb97995df55c488fe2/log.txt.gz 2026-05-11 10:03:37,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:03:37,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:03:37,959 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a4bb97995df55c488fe2/lava-logs.yaml 2026-05-11 10:03:37,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:03:38,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:03:38,114 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a4bb97995df55c488fe2/lava_callback.json.gz DEBUG: Setup failed for 6a01a4bb97995df55c488fe2. Transitting job node result: incomplete -> fail 2026-05-11 10:03:38,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:03:38,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a4bb97995df55c488fe2 HTTP/1.1" 200 None 2026-05-11 10:03:38,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:03:38,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 10:03:38,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:03:38,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a4bb97995df55c488fe2 HTTP/1.1" 200 None 2026-05-11 10:03:38,363 - lava_callback - INFO - Completed processing callback for node 6a01a4bb97995df55c488fe2 INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44278 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:04:04,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:04:04,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59518 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:04:25,054 - lava_callback - INFO - Received callback for node 69ff06a5254d3291e98dfea4 INFO: 172.21.0.1:59704 - "POST /node/69ff06a5254d3291e98dfea4 HTTP/1.0" 202 Accepted 2026-05-11 10:04:25,060 - lava_callback - INFO - Starting async job submit for node 69ff06a5254d3291e98dfea4 2026-05-11 10:04:25,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:04:25,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff06a5254d3291e98dfea4 HTTP/1.1" 200 None 2026-05-11 10:04:25,077 - lava_callback - DEBUG - Processing node 69ff06a5254d3291e98dfea4: baseline-arm64-baylibre 2026-05-11 10:04:25,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff06a5254d3291e98dfea4 2026-05-11 10:04:25,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:04:25,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff06a5254d3291e98dfea4 HTTP/1.1" 200 None 2026-05-11 10:04:25,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:04:25,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:04:25,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:04:25,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff06a5254d3291e98dfea4 HTTP/1.1" 200 None 2026-05-11 10:04:25,125 - lava_callback - ERROR - Error processing callback for node 69ff06a5254d3291e98dfea4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55048 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:04:37,991 - lava_callback - INFO - Received callback for node 6a01a76497995df55c489118 INFO: 172.21.0.1:55054 - "POST /node/6a01a76497995df55c489118 HTTP/1.0" 202 Accepted 2026-05-11 10:04:38,001 - lava_callback - INFO - Starting async job submit for node 6a01a76497995df55c489118 2026-05-11 10:04:38,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:04:38,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a76497995df55c489118 HTTP/1.1" 200 None 2026-05-11 10:04:38,068 - lava_callback - DEBUG - Processing node 6a01a76497995df55c489118: baseline-arm64 2026-05-11 10:04:38,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:04:38,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:04:38,640 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a76497995df55c489118/log.txt.gz 2026-05-11 10:04:38,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:04:39,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:04:39,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a76497995df55c489118/lava-logs.yaml 2026-05-11 10:04:39,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:04:39,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:04:39,185 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a76497995df55c489118/lava_callback.json.gz DEBUG: Setup failed for 6a01a76497995df55c489118. Transitting job node result: incomplete -> fail 2026-05-11 10:04:39,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:04:39,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a76497995df55c489118 HTTP/1.1" 200 None 2026-05-11 10:04:39,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:04:39,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 10:04:39,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:04:39,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a76497995df55c489118 HTTP/1.1" 200 None 2026-05-11 10:04:39,392 - lava_callback - INFO - Completed processing callback for node 6a01a76497995df55c489118 INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:04:46,848 - lava_callback - INFO - Received callback for node 6a01a98a97995df55c489206 INFO: 172.21.0.1:57816 - "POST /node/6a01a98a97995df55c489206 HTTP/1.0" 202 Accepted 2026-05-11 10:04:46,858 - lava_callback - INFO - Starting async job submit for node 6a01a98a97995df55c489206 2026-05-11 10:04:46,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:04:46,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a98a97995df55c489206 HTTP/1.1" 200 None 2026-05-11 10:04:46,934 - lava_callback - DEBUG - Processing node 6a01a98a97995df55c489206: baseline-arm64 2026-05-11 10:04:47,125 - lava_callback - WARNING - Failed to upload log 2026-05-11 10:04:47,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:04:47,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:04:47,334 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a98a97995df55c489206/lava-logs.yaml 2026-05-11 10:04:47,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:04:47,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:04:47,418 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a98a97995df55c489206/lava_callback.json.gz 2026-05-11 10:04:47,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:04:47,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a98a97995df55c489206 HTTP/1.1" 200 None 2026-05-11 10:04:47,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:04:47,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 10:04:47,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:04:47,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a98a97995df55c489206 HTTP/1.1" 200 None 2026-05-11 10:04:47,558 - lava_callback - INFO - Completed processing callback for node 6a01a98a97995df55c489206 INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:05:04,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:05:04,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60344 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:05:53,127 - lava_callback - INFO - Received callback for node 69ff06f9254d3291e98dfed3 INFO: 172.21.0.1:60352 - "POST /node/69ff06f9254d3291e98dfed3 HTTP/1.0" 202 Accepted 2026-05-11 10:05:53,133 - lava_callback - INFO - Starting async job submit for node 69ff06f9254d3291e98dfed3 2026-05-11 10:05:53,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:05:53,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff06f9254d3291e98dfed3 HTTP/1.1" 200 None 2026-05-11 10:05:53,152 - lava_callback - DEBUG - Processing node 69ff06f9254d3291e98dfed3: baseline-arm64-clabbe 2026-05-11 10:05:53,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff06f9254d3291e98dfed3 2026-05-11 10:05:53,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:05:53,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff06f9254d3291e98dfed3 HTTP/1.1" 200 None 2026-05-11 10:05:53,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:05:53,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:05:53,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:05:53,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff06f9254d3291e98dfed3 HTTP/1.1" 200 None 2026-05-11 10:05:53,202 - lava_callback - ERROR - Error processing callback for node 69ff06f9254d3291e98dfed3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60362 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:05:59,938 - lava_callback - INFO - Received callback for node 6a01a9d797995df55c48922f INFO: 172.21.0.1:54144 - "POST /node/6a01a9d797995df55c48922f HTTP/1.0" 202 Accepted 2026-05-11 10:05:59,944 - lava_callback - INFO - Starting async job submit for node 6a01a9d797995df55c48922f 2026-05-11 10:05:59,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:05:59,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a9d797995df55c48922f HTTP/1.1" 200 None 2026-05-11 10:05:59,987 - lava_callback - DEBUG - Processing node 6a01a9d797995df55c48922f: baseline-arm64 2026-05-11 10:06:00,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:06:00,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:06:00,266 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a9d797995df55c48922f/log.txt.gz 2026-05-11 10:06:00,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:06:00,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:06:00,475 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a9d797995df55c48922f/lava-logs.yaml 2026-05-11 10:06:00,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:06:00,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:06:00,569 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a9d797995df55c48922f/lava_callback.json.gz 2026-05-11 10:06:00,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:06:00,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a9d797995df55c48922f HTTP/1.1" 200 None 2026-05-11 10:06:00,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:06:00,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 10:06:00,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:06:00,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a9d797995df55c48922f HTTP/1.1" 200 None 2026-05-11 10:06:00,720 - lava_callback - INFO - Completed processing callback for node 6a01a9d797995df55c48922f 2026-05-11 10:06:04,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:06:04,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35420 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:08:33,262 - lava_callback - INFO - Received callback for node 69ff0791254d3291e98dff25 INFO: 172.21.0.1:47158 - "POST /node/69ff0791254d3291e98dff25 HTTP/1.0" 202 Accepted 2026-05-11 10:08:33,268 - lava_callback - INFO - Starting async job submit for node 69ff0791254d3291e98dff25 2026-05-11 10:08:33,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:08:33,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0791254d3291e98dff25 HTTP/1.1" 200 None 2026-05-11 10:08:33,291 - lava_callback - DEBUG - Processing node 69ff0791254d3291e98dff25: baseline-arm64-clabbe 2026-05-11 10:08:33,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0791254d3291e98dff25 2026-05-11 10:08:33,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:08:33,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0791254d3291e98dff25 HTTP/1.1" 200 None 2026-05-11 10:08:33,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:08:33,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:08:33,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:08:33,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0791254d3291e98dff25 HTTP/1.1" 200 None 2026-05-11 10:08:33,337 - lava_callback - ERROR - Error processing callback for node 69ff0791254d3291e98dff25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:10:22,741 - lava_callback - INFO - Received callback for node 6a01a8a697995df55c489197 INFO: 172.21.0.1:39924 - "POST /node/6a01a8a697995df55c489197 HTTP/1.0" 202 Accepted 2026-05-11 10:10:22,748 - lava_callback - INFO - Starting async job submit for node 6a01a8a697995df55c489197 2026-05-11 10:10:22,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:10:22,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a8a697995df55c489197 HTTP/1.1" 200 None 2026-05-11 10:10:22,788 - lava_callback - DEBUG - Processing node 6a01a8a697995df55c489197: baseline-nfs-arm64 2026-05-11 10:10:23,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:10:23,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:10:23,526 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a8a697995df55c489197/log.txt.gz 2026-05-11 10:10:23,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:10:24,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:10:24,036 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a8a697995df55c489197/lava-logs.yaml 2026-05-11 10:10:24,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:10:24,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:10:24,171 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01a8a697995df55c489197/lava_callback.json.gz 2026-05-11 10:10:24,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:10:24,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a8a697995df55c489197 HTTP/1.1" 200 None 2026-05-11 10:10:24,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:10:24,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 10:10:24,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:10:24,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a8a697995df55c489197 HTTP/1.1" 200 None 2026-05-11 10:10:24,307 - lava_callback - INFO - Completed processing callback for node 6a01a8a697995df55c489197 INFO: 172.21.0.1:39936 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:10:34,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:10:34,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:11:29,247 - lava_callback - INFO - Received callback for node 6a01a73b97995df55c489105 INFO: 172.21.0.1:58202 - "POST /node/6a01a73b97995df55c489105 HTTP/1.0" 202 Accepted 2026-05-11 10:11:29,256 - lava_callback - INFO - Starting async job submit for node 6a01a73b97995df55c489105 2026-05-11 10:11:29,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:11:29,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a73b97995df55c489105 HTTP/1.1" 200 None 2026-05-11 10:11:29,348 - lava_callback - DEBUG - Processing node 6a01a73b97995df55c489105: baseline-arm 2026-05-11 10:11:30,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:11:30,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:11:30,152 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a01a73b97995df55c489105/log.txt.gz 2026-05-11 10:11:30,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:11:30,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:11:30,680 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a01a73b97995df55c489105/lava-logs.yaml 2026-05-11 10:11:30,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:11:30,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:11:30,843 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a01a73b97995df55c489105/lava_callback.json.gz DEBUG: Setup failed for 6a01a73b97995df55c489105. Transitting job node result: incomplete -> fail 2026-05-11 10:11:30,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:11:30,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a73b97995df55c489105 HTTP/1.1" 200 None 2026-05-11 10:11:30,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:11:30,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 10:11:30,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:11:31,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a73b97995df55c489105 HTTP/1.1" 200 None 2026-05-11 10:11:31,100 - lava_callback - INFO - Completed processing callback for node 6a01a73b97995df55c489105 2026-05-11 10:11:34,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:11:34,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-11 10:11:36,335 - lava_callback - INFO - Received callback for node 6a01a73997995df55c489102 INFO: 172.21.0.1:36576 - "POST /node/6a01a73997995df55c489102 HTTP/1.0" 202 Accepted 2026-05-11 10:11:36,342 - lava_callback - INFO - Starting async job submit for node 6a01a73997995df55c489102 2026-05-11 10:11:36,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:11:36,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a73997995df55c489102 HTTP/1.1" 200 None 2026-05-11 10:11:36,415 - lava_callback - DEBUG - Processing node 6a01a73997995df55c489102: ltp-smoke INFO: 172.21.0.1:36586 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:11:36,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:11:36,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:11:36,980 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-6a01a73997995df55c489102/log.txt.gz 2026-05-11 10:11:37,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:11:37,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:11:37,402 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-6a01a73997995df55c489102/lava-logs.yaml 2026-05-11 10:11:37,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:11:37,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:11:37,549 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-6a01a73997995df55c489102/lava_callback.json.gz 2026-05-11 10:11:37,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:11:37,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a73997995df55c489102 HTTP/1.1" 200 None 2026-05-11 10:11:37,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:11:37,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912c97995df55c487f3d HTTP/1.1" 200 None 2026-05-11 10:11:37,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:11:37,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a73997995df55c489102 HTTP/1.1" 200 None 2026-05-11 10:11:37,880 - lava_callback - INFO - Completed processing callback for node 6a01a73997995df55c489102 INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:12:04,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:12:04,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:12:13,409 - lava_callback - INFO - Received callback for node 69ff0873254d3291e98dffa9 INFO: 172.21.0.1:40832 - "POST /node/69ff0873254d3291e98dffa9 HTTP/1.0" 202 Accepted 2026-05-11 10:12:13,415 - lava_callback - INFO - Starting async job submit for node 69ff0873254d3291e98dffa9 2026-05-11 10:12:13,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:12:13,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0873254d3291e98dffa9 HTTP/1.1" 200 None 2026-05-11 10:12:13,431 - lava_callback - DEBUG - Processing node 69ff0873254d3291e98dffa9: baseline-arm64-clabbe 2026-05-11 10:12:13,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0873254d3291e98dffa9 2026-05-11 10:12:13,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:12:13,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0873254d3291e98dffa9 HTTP/1.1" 200 None 2026-05-11 10:12:13,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:12:13,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:12:13,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:12:13,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0873254d3291e98dffa9 HTTP/1.1" 200 None 2026-05-11 10:12:13,476 - lava_callback - ERROR - Error processing callback for node 69ff0873254d3291e98dffa9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58152 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:12:58,347 - lava_callback - INFO - Received callback for node 6a01a94097995df55c4891e0 INFO: 172.21.0.1:58154 - "POST /node/6a01a94097995df55c4891e0 HTTP/1.0" 202 Accepted 2026-05-11 10:12:58,354 - lava_callback - INFO - Starting async job submit for node 6a01a94097995df55c4891e0 2026-05-11 10:12:58,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:12:58,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a94097995df55c4891e0 HTTP/1.1" 200 None 2026-05-11 10:12:58,393 - lava_callback - DEBUG - Processing node 6a01a94097995df55c4891e0: baseline-arm64 2026-05-11 10:12:58,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:12:58,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:12:58,988 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a94097995df55c4891e0/log.txt.gz 2026-05-11 10:12:59,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:12:59,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:12:59,368 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a94097995df55c4891e0/lava-logs.yaml 2026-05-11 10:12:59,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:12:59,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:12:59,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01a94097995df55c4891e0/lava_callback.json.gz 2026-05-11 10:12:59,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:12:59,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01a94097995df55c4891e0 HTTP/1.1" 200 None 2026-05-11 10:12:59,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:12:59,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 10:12:59,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:12:59,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01a94097995df55c4891e0 HTTP/1.1" 200 None 2026-05-11 10:12:59,684 - lava_callback - INFO - Completed processing callback for node 6a01a94097995df55c4891e0 2026-05-11 10:13:04,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:13:04,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52432 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:14:53,511 - lava_callback - INFO - Received callback for node 69ff0908254d3291e98dfffa INFO: 172.21.0.1:52448 - "POST /node/69ff0908254d3291e98dfffa HTTP/1.0" 202 Accepted 2026-05-11 10:14:53,516 - lava_callback - INFO - Starting async job submit for node 69ff0908254d3291e98dfffa 2026-05-11 10:14:53,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:14:53,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0908254d3291e98dfffa HTTP/1.1" 200 None 2026-05-11 10:14:53,534 - lava_callback - DEBUG - Processing node 69ff0908254d3291e98dfffa: baseline-arm64-clabbe 2026-05-11 10:14:53,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0908254d3291e98dfffa 2026-05-11 10:14:53,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:14:53,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0908254d3291e98dfffa HTTP/1.1" 200 None 2026-05-11 10:14:53,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:14:53,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:14:53,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:14:53,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0908254d3291e98dfffa HTTP/1.1" 200 None 2026-05-11 10:14:53,591 - lava_callback - ERROR - Error processing callback for node 69ff0908254d3291e98dfffa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:15:53,522 - lava_callback - INFO - Received callback for node 69ff0954254d3291e98e0020 INFO: 172.21.0.1:56486 - "POST /node/69ff0954254d3291e98e0020 HTTP/1.0" 202 Accepted 2026-05-11 10:15:53,528 - lava_callback - INFO - Starting async job submit for node 69ff0954254d3291e98e0020 2026-05-11 10:15:53,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:15:53,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0954254d3291e98e0020 HTTP/1.1" 200 None 2026-05-11 10:15:53,544 - lava_callback - DEBUG - Processing node 69ff0954254d3291e98e0020: baseline-arm64-clabbe 2026-05-11 10:15:53,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0954254d3291e98e0020 2026-05-11 10:15:53,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:15:53,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0954254d3291e98e0020 HTTP/1.1" 200 None 2026-05-11 10:15:53,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:15:53,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:15:53,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:15:53,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0954254d3291e98e0020 HTTP/1.1" 200 None 2026-05-11 10:15:53,603 - lava_callback - ERROR - Error processing callback for node 69ff0954254d3291e98e0020: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:19:31,200 - lava_callback - INFO - Received callback for node 6a01aa9a97995df55c489280 INFO: 172.21.0.1:51876 - "POST /node/6a01aa9a97995df55c489280 HTTP/1.0" 202 Accepted 2026-05-11 10:19:31,208 - lava_callback - INFO - Starting async job submit for node 6a01aa9a97995df55c489280 2026-05-11 10:19:31,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:19:31,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01aa9a97995df55c489280 HTTP/1.1" 200 None 2026-05-11 10:19:31,272 - lava_callback - DEBUG - Processing node 6a01aa9a97995df55c489280: baseline-arm64 2026-05-11 10:19:31,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:19:31,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:19:31,861 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01aa9a97995df55c489280/log.txt.gz 2026-05-11 10:19:32,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:19:32,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:19:32,219 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01aa9a97995df55c489280/lava-logs.yaml 2026-05-11 10:19:32,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:19:32,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:19:32,358 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01aa9a97995df55c489280/lava_callback.json.gz DEBUG: Setup failed for 6a01aa9a97995df55c489280. Transitting job node result: incomplete -> fail 2026-05-11 10:19:32,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:19:32,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01aa9a97995df55c489280 HTTP/1.1" 200 None 2026-05-11 10:19:32,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:19:32,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 10:19:32,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:19:32,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01aa9a97995df55c489280 HTTP/1.1" 200 None 2026-05-11 10:19:32,546 - lava_callback - INFO - Completed processing callback for node 6a01aa9a97995df55c489280 2026-05-11 10:19:34,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:19:34,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:20:53,787 - lava_callback - INFO - Received callback for node 69ff0a7e254d3291e98e00c1 INFO: 172.21.0.1:44322 - "POST /node/69ff0a7e254d3291e98e00c1 HTTP/1.0" 202 Accepted 2026-05-11 10:20:53,793 - lava_callback - INFO - Starting async job submit for node 69ff0a7e254d3291e98e00c1 2026-05-11 10:20:53,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:20:53,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0a7e254d3291e98e00c1 HTTP/1.1" 200 None 2026-05-11 10:20:53,808 - lava_callback - DEBUG - Processing node 69ff0a7e254d3291e98e00c1: baseline-arm64-clabbe 2026-05-11 10:20:53,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0a7e254d3291e98e00c1 2026-05-11 10:20:53,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:20:53,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0a7e254d3291e98e00c1 HTTP/1.1" 200 None 2026-05-11 10:20:53,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:20:53,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:20:53,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:20:53,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0a7e254d3291e98e00c1 HTTP/1.1" 200 None 2026-05-11 10:20:53,856 - lava_callback - ERROR - Error processing callback for node 69ff0a7e254d3291e98e00c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:21:24,780 - lava_callback - INFO - Received callback for node 6a01ab1a97995df55c4892a4 INFO: 172.21.0.1:41198 - "POST /node/6a01ab1a97995df55c4892a4 HTTP/1.0" 202 Accepted 2026-05-11 10:21:24,791 - lava_callback - INFO - Starting async job submit for node 6a01ab1a97995df55c4892a4 2026-05-11 10:21:24,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:21:24,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01ab1a97995df55c4892a4 HTTP/1.1" 200 None 2026-05-11 10:21:24,881 - lava_callback - DEBUG - Processing node 6a01ab1a97995df55c4892a4: baseline-nfs-arm64 2026-05-11 10:21:25,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:21:25,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:21:25,579 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01ab1a97995df55c4892a4/log.txt.gz 2026-05-11 10:21:25,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:21:26,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:21:26,002 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01ab1a97995df55c4892a4/lava-logs.yaml 2026-05-11 10:21:26,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:21:26,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:21:26,129 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01ab1a97995df55c4892a4/lava_callback.json.gz 2026-05-11 10:21:26,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:21:26,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01ab1a97995df55c4892a4 HTTP/1.1" 200 None 2026-05-11 10:21:26,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:21:26,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 10:21:26,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:21:26,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01ab1a97995df55c4892a4 HTTP/1.1" 200 None 2026-05-11 10:21:26,251 - lava_callback - INFO - Completed processing callback for node 6a01ab1a97995df55c4892a4 INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:21:34,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:21:34,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49070 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:22:06,131 - lava_callback - INFO - Received callback for node 69ff0ac6254d3291e98e00ec INFO: 172.21.0.1:52252 - "POST /node/69ff0ac6254d3291e98e00ec HTTP/1.0" 202 Accepted 2026-05-11 10:22:06,140 - lava_callback - INFO - Starting async job submit for node 69ff0ac6254d3291e98e00ec 2026-05-11 10:22:06,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:22:06,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0ac6254d3291e98e00ec HTTP/1.1" 200 None 2026-05-11 10:22:06,156 - lava_callback - DEBUG - Processing node 69ff0ac6254d3291e98e00ec: baseline-arm64-baylibre 2026-05-11 10:22:06,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0ac6254d3291e98e00ec 2026-05-11 10:22:06,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:22:06,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0ac6254d3291e98e00ec HTTP/1.1" 200 None 2026-05-11 10:22:06,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:22:06,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:22:06,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:22:06,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0ac6254d3291e98e00ec HTTP/1.1" 200 None 2026-05-11 10:22:06,218 - lava_callback - ERROR - Error processing callback for node 69ff0ac6254d3291e98e00ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49238 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:23:33,839 - lava_callback - INFO - Received callback for node 69ff0b18254d3291e98e0109 INFO: 172.21.0.1:39744 - "POST /node/69ff0b18254d3291e98e0109 HTTP/1.0" 202 Accepted 2026-05-11 10:23:33,845 - lava_callback - INFO - Starting async job submit for node 69ff0b18254d3291e98e0109 2026-05-11 10:23:33,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:23:33,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0b18254d3291e98e0109 HTTP/1.1" 200 None 2026-05-11 10:23:33,863 - lava_callback - DEBUG - Processing node 69ff0b18254d3291e98e0109: baseline-arm64-clabbe 2026-05-11 10:23:33,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0b18254d3291e98e0109 2026-05-11 10:23:33,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:23:33,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0b18254d3291e98e0109 HTTP/1.1" 200 None 2026-05-11 10:23:33,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:23:33,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:23:33,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:23:33,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0b18254d3291e98e0109 HTTP/1.1" 200 None 2026-05-11 10:23:33,908 - lava_callback - ERROR - Error processing callback for node 69ff0b18254d3291e98e0109: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:24:53,895 - lava_callback - INFO - Received callback for node 69ff0b67254d3291e98e0137 INFO: 172.21.0.1:49400 - "POST /node/69ff0b67254d3291e98e0137 HTTP/1.0" 202 Accepted 2026-05-11 10:24:53,904 - lava_callback - INFO - Starting async job submit for node 69ff0b67254d3291e98e0137 2026-05-11 10:24:53,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:24:53,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0b67254d3291e98e0137 HTTP/1.1" 200 None 2026-05-11 10:24:53,937 - lava_callback - DEBUG - Processing node 69ff0b67254d3291e98e0137: baseline-arm64-clabbe 2026-05-11 10:24:53,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0b67254d3291e98e0137 2026-05-11 10:24:53,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:24:53,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0b67254d3291e98e0137 HTTP/1.1" 200 None 2026-05-11 10:24:53,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:24:53,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:24:53,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:24:53,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0b67254d3291e98e0137 HTTP/1.1" 200 None 2026-05-11 10:24:53,987 - lava_callback - ERROR - Error processing callback for node 69ff0b67254d3291e98e0137: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:25:18,107 - lava_callback - INFO - Received callback for node 6a01abb197995df55c4892ea INFO: 172.21.0.1:48768 - "POST /node/6a01abb197995df55c4892ea HTTP/1.0" 202 Accepted 2026-05-11 10:25:18,114 - lava_callback - INFO - Starting async job submit for node 6a01abb197995df55c4892ea 2026-05-11 10:25:18,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:25:18,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01abb197995df55c4892ea HTTP/1.1" 200 None 2026-05-11 10:25:18,152 - lava_callback - DEBUG - Processing node 6a01abb197995df55c4892ea: baseline-arm64 2026-05-11 10:25:18,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:25:18,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:25:18,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01abb197995df55c4892ea/log.txt.gz 2026-05-11 10:25:19,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:25:19,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:25:19,228 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01abb197995df55c4892ea/lava-logs.yaml 2026-05-11 10:25:19,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:25:19,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:25:19,385 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-6a01abb197995df55c4892ea/lava_callback.json.gz 2026-05-11 10:25:19,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:25:19,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01abb197995df55c4892ea HTTP/1.1" 200 None 2026-05-11 10:25:19,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:25:19,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 10:25:19,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:25:19,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01abb197995df55c4892ea HTTP/1.1" 200 None 2026-05-11 10:25:19,535 - lava_callback - INFO - Completed processing callback for node 6a01abb197995df55c4892ea INFO: 172.21.0.1:40990 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:25:34,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:25:34,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44404 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:26:01,392 - lava_callback - INFO - Received callback for node 6a01aa2f97995df55c489253 INFO: 172.21.0.1:53778 - "POST /node/6a01aa2f97995df55c489253 HTTP/1.0" 202 Accepted 2026-05-11 10:26:01,441 - lava_callback - INFO - Starting async job submit for node 6a01aa2f97995df55c489253 2026-05-11 10:26:01,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:26:01,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01aa2f97995df55c489253 HTTP/1.1" 200 None 2026-05-11 10:26:01,479 - lava_callback - DEBUG - Processing node 6a01aa2f97995df55c489253: baseline-arm-pengutronix 2026-05-11 10:26:01,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:26:01,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:26:01,665 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a01aa2f97995df55c489253/log.txt.gz 2026-05-11 10:26:01,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:26:01,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:26:01,832 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a01aa2f97995df55c489253/lava-logs.yaml 2026-05-11 10:26:01,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:26:01,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:26:01,918 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a01aa2f97995df55c489253/lava_callback.json.gz DEBUG: Setup failed for 6a01aa2f97995df55c489253. Transitting job node result: incomplete -> fail 2026-05-11 10:26:01,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:26:02,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01aa2f97995df55c489253 HTTP/1.1" 200 None 2026-05-11 10:26:02,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:26:02,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 10:26:02,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:26:02,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01aa2f97995df55c489253 HTTP/1.1" 200 None 2026-05-11 10:26:02,103 - lava_callback - INFO - Completed processing callback for node 6a01aa2f97995df55c489253 2026-05-11 10:26:04,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:26:04,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53780 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:26:13,970 - lava_callback - INFO - Received callback for node 69ff0bb3254d3291e98e0153 INFO: 172.21.0.1:51384 - "POST /node/69ff0bb3254d3291e98e0153 HTTP/1.0" 202 Accepted 2026-05-11 10:26:13,976 - lava_callback - INFO - Starting async job submit for node 69ff0bb3254d3291e98e0153 2026-05-11 10:26:13,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:26:13,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0bb3254d3291e98e0153 HTTP/1.1" 200 None 2026-05-11 10:26:13,991 - lava_callback - DEBUG - Processing node 69ff0bb3254d3291e98e0153: baseline-arm64-clabbe 2026-05-11 10:26:13,992 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0bb3254d3291e98e0153 2026-05-11 10:26:13,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:26:14,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0bb3254d3291e98e0153 HTTP/1.1" 200 None 2026-05-11 10:26:14,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:26:14,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:26:14,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:26:14,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0bb3254d3291e98e0153 HTTP/1.1" 200 None 2026-05-11 10:26:14,038 - lava_callback - ERROR - Error processing callback for node 69ff0bb3254d3291e98e0153: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43956 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:27:09,652 - lava_callback - INFO - Received callback for node 6a01aa5197995df55c48925f INFO: 172.21.0.1:43968 - "POST /node/6a01aa5197995df55c48925f HTTP/1.0" 202 Accepted 2026-05-11 10:27:09,660 - lava_callback - INFO - Starting async job submit for node 6a01aa5197995df55c48925f 2026-05-11 10:27:09,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:27:09,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01aa5197995df55c48925f HTTP/1.1" 200 None 2026-05-11 10:27:09,718 - lava_callback - DEBUG - Processing node 6a01aa5197995df55c48925f: baseline-nfs-arm64 2026-05-11 10:27:10,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:27:10,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:27:10,895 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01aa5197995df55c48925f/log.txt.gz 2026-05-11 10:27:11,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:27:11,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:27:11,687 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01aa5197995df55c48925f/lava-logs.yaml 2026-05-11 10:27:11,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:27:11,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:27:11,871 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01aa5197995df55c48925f/lava_callback.json.gz DEBUG: Setup failed for 6a01aa5197995df55c48925f. Transitting job node result: incomplete -> fail 2026-05-11 10:27:11,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:27:11,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01aa5197995df55c48925f HTTP/1.1" 200 None 2026-05-11 10:27:11,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:27:11,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 10:27:11,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:27:12,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01aa5197995df55c48925f HTTP/1.1" 200 None 2026-05-11 10:27:12,099 - lava_callback - INFO - Completed processing callback for node 6a01aa5197995df55c48925f INFO: 172.21.0.1:44458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40786 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:27:34,015 - lava_callback - INFO - Received callback for node 69ff0bff254d3291e98e017f INFO: 172.21.0.1:46848 - "POST /node/69ff0bff254d3291e98e017f HTTP/1.0" 202 Accepted 2026-05-11 10:27:34,021 - lava_callback - INFO - Starting async job submit for node 69ff0bff254d3291e98e017f 2026-05-11 10:27:34,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:27:34,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0bff254d3291e98e017f HTTP/1.1" 200 None 2026-05-11 10:27:34,036 - lava_callback - DEBUG - Processing node 69ff0bff254d3291e98e017f: baseline-arm64-clabbe 2026-05-11 10:27:34,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0bff254d3291e98e017f 2026-05-11 10:27:34,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:27:34,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0bff254d3291e98e017f HTTP/1.1" 200 None 2026-05-11 10:27:34,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:27:34,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:27:34,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:27:34,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0bff254d3291e98e017f HTTP/1.1" 200 None 2026-05-11 10:27:34,135 - lava_callback - ERROR - Error processing callback for node 69ff0bff254d3291e98e017f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 10:27:34,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:27:34,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46696 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:27:49,325 - lava_callback - INFO - Received callback for node 6a01ab5c97995df55c4892cf INFO: 172.21.0.1:46706 - "POST /node/6a01ab5c97995df55c4892cf HTTP/1.0" 202 Accepted 2026-05-11 10:27:49,332 - lava_callback - INFO - Starting async job submit for node 6a01ab5c97995df55c4892cf 2026-05-11 10:27:49,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:27:49,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01ab5c97995df55c4892cf HTTP/1.1" 200 None 2026-05-11 10:27:49,402 - lava_callback - DEBUG - Processing node 6a01ab5c97995df55c4892cf: baseline-arm 2026-05-11 10:27:50,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:27:50,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:27:50,087 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-6a01ab5c97995df55c4892cf/log.txt.gz 2026-05-11 10:27:50,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:27:50,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:27:50,614 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-6a01ab5c97995df55c4892cf/lava-logs.yaml 2026-05-11 10:27:50,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:27:50,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:27:50,754 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-6a01ab5c97995df55c4892cf/lava_callback.json.gz DEBUG: Setup failed for 6a01ab5c97995df55c4892cf. Transitting job node result: incomplete -> fail 2026-05-11 10:27:50,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:27:50,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01ab5c97995df55c4892cf HTTP/1.1" 200 None 2026-05-11 10:27:50,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:27:50,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 10:27:50,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:27:50,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01ab5c97995df55c4892cf HTTP/1.1" 200 None 2026-05-11 10:27:51,062 - lava_callback - INFO - Completed processing callback for node 6a01ab5c97995df55c4892cf INFO: 172.21.0.1:41016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:28:04,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:28:04,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:28:34,070 - lava_callback - INFO - Received callback for node 69ff0c4d254d3291e98e01a9 INFO: 172.21.0.1:43954 - "POST /node/69ff0c4d254d3291e98e01a9 HTTP/1.0" 202 Accepted 2026-05-11 10:28:34,076 - lava_callback - INFO - Starting async job submit for node 69ff0c4d254d3291e98e01a9 2026-05-11 10:28:34,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:28:34,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0c4d254d3291e98e01a9 HTTP/1.1" 200 None 2026-05-11 10:28:34,097 - lava_callback - DEBUG - Processing node 69ff0c4d254d3291e98e01a9: baseline-arm64-clabbe 2026-05-11 10:28:34,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0c4d254d3291e98e01a9 2026-05-11 10:28:34,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:28:34,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0c4d254d3291e98e01a9 HTTP/1.1" 200 None 2026-05-11 10:28:34,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:28:34,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:28:34,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:28:34,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0c4d254d3291e98e01a9 HTTP/1.1" 200 None 2026-05-11 10:28:34,148 - lava_callback - ERROR - Error processing callback for node 69ff0c4d254d3291e98e01a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:29:54,130 - lava_callback - INFO - Received callback for node 69ff0c9d254d3291e98e01c5 INFO: 172.21.0.1:50630 - "POST /node/69ff0c9d254d3291e98e01c5 HTTP/1.0" 202 Accepted 2026-05-11 10:29:54,138 - lava_callback - INFO - Starting async job submit for node 69ff0c9d254d3291e98e01c5 2026-05-11 10:29:54,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:29:54,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0c9d254d3291e98e01c5 HTTP/1.1" 200 None 2026-05-11 10:29:54,154 - lava_callback - DEBUG - Processing node 69ff0c9d254d3291e98e01c5: baseline-arm64-clabbe 2026-05-11 10:29:54,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0c9d254d3291e98e01c5 2026-05-11 10:29:54,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:29:54,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0c9d254d3291e98e01c5 HTTP/1.1" 200 None 2026-05-11 10:29:54,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:29:54,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:29:54,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:29:54,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0c9d254d3291e98e01c5 HTTP/1.1" 200 None 2026-05-11 10:29:54,208 - lava_callback - ERROR - Error processing callback for node 69ff0c9d254d3291e98e01c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 10:29:57,049 - lava_callback - INFO - Received callback for node 6a01ab8097995df55c4892e1 INFO: 172.21.0.1:50632 - "POST /node/6a01ab8097995df55c4892e1 HTTP/1.0" 202 Accepted 2026-05-11 10:29:57,055 - lava_callback - INFO - Starting async job submit for node 6a01ab8097995df55c4892e1 2026-05-11 10:29:57,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:29:57,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01ab8097995df55c4892e1 HTTP/1.1" 200 None 2026-05-11 10:29:57,127 - lava_callback - DEBUG - Processing node 6a01ab8097995df55c4892e1: ltp-smoke INFO: 172.21.0.1:50638 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:29:57,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:29:57,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:29:57,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-6a01ab8097995df55c4892e1/log.txt.gz 2026-05-11 10:29:58,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:29:58,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:29:58,157 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-6a01ab8097995df55c4892e1/lava-logs.yaml 2026-05-11 10:29:58,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:29:58,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:29:58,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-6a01ab8097995df55c4892e1/lava_callback.json.gz 2026-05-11 10:29:58,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:29:58,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01ab8097995df55c4892e1 HTTP/1.1" 200 None 2026-05-11 10:29:58,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:29:58,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912c97995df55c487f3d HTTP/1.1" 200 None 2026-05-11 10:29:58,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:29:58,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01ab8097995df55c4892e1 HTTP/1.1" 200 None 2026-05-11 10:29:58,623 - lava_callback - INFO - Completed processing callback for node 6a01ab8097995df55c4892e1 2026-05-11 10:30:04,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:30:04,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:32:34,185 - lava_callback - INFO - Received callback for node 69ff0d3a254d3291e98e0214 INFO: 172.21.0.1:37488 - "POST /node/69ff0d3a254d3291e98e0214 HTTP/1.0" 202 Accepted 2026-05-11 10:32:34,192 - lava_callback - INFO - Starting async job submit for node 69ff0d3a254d3291e98e0214 2026-05-11 10:32:34,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:32:34,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0d3a254d3291e98e0214 HTTP/1.1" 200 None 2026-05-11 10:32:34,212 - lava_callback - DEBUG - Processing node 69ff0d3a254d3291e98e0214: baseline-arm64-clabbe 2026-05-11 10:32:34,212 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0d3a254d3291e98e0214 2026-05-11 10:32:34,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:32:34,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0d3a254d3291e98e0214 HTTP/1.1" 200 None 2026-05-11 10:32:34,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:32:34,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:32:34,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:32:34,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0d3a254d3291e98e0214 HTTP/1.1" 200 None 2026-05-11 10:32:34,265 - lava_callback - ERROR - Error processing callback for node 69ff0d3a254d3291e98e0214: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48094 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:33:54,269 - lava_callback - INFO - Received callback for node 69ff0d89254d3291e98e023e INFO: 172.21.0.1:48106 - "POST /node/69ff0d89254d3291e98e023e HTTP/1.0" 202 Accepted 2026-05-11 10:33:54,275 - lava_callback - INFO - Starting async job submit for node 69ff0d89254d3291e98e023e 2026-05-11 10:33:54,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:33:54,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0d89254d3291e98e023e HTTP/1.1" 200 None 2026-05-11 10:33:54,290 - lava_callback - DEBUG - Processing node 69ff0d89254d3291e98e023e: baseline-arm64-clabbe 2026-05-11 10:33:54,290 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0d89254d3291e98e023e 2026-05-11 10:33:54,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:33:54,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0d89254d3291e98e023e HTTP/1.1" 200 None 2026-05-11 10:33:54,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:33:54,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:33:54,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:33:54,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0d89254d3291e98e023e HTTP/1.1" 200 None 2026-05-11 10:33:54,337 - lava_callback - ERROR - Error processing callback for node 69ff0d89254d3291e98e023e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58358 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:35:54,284 - lava_callback - INFO - Received callback for node 69ff0dfb254d3291e98e026e INFO: 172.21.0.1:58366 - "POST /node/69ff0dfb254d3291e98e026e HTTP/1.0" 202 Accepted 2026-05-11 10:35:54,289 - lava_callback - INFO - Starting async job submit for node 69ff0dfb254d3291e98e026e 2026-05-11 10:35:54,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:35:54,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0dfb254d3291e98e026e HTTP/1.1" 200 None 2026-05-11 10:35:54,305 - lava_callback - DEBUG - Processing node 69ff0dfb254d3291e98e026e: baseline-arm64-clabbe 2026-05-11 10:35:54,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0dfb254d3291e98e026e 2026-05-11 10:35:54,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:35:54,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0dfb254d3291e98e026e HTTP/1.1" 200 None 2026-05-11 10:35:54,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:35:54,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:35:54,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:35:54,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0dfb254d3291e98e026e HTTP/1.1" 200 None 2026-05-11 10:35:54,362 - lava_callback - ERROR - Error processing callback for node 69ff0dfb254d3291e98e026e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39666 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:38:34,396 - lava_callback - INFO - Received callback for node 69ff0e95254d3291e98e02c1 INFO: 172.21.0.1:53370 - "POST /node/69ff0e95254d3291e98e02c1 HTTP/1.0" 202 Accepted 2026-05-11 10:38:34,406 - lava_callback - INFO - Starting async job submit for node 69ff0e95254d3291e98e02c1 2026-05-11 10:38:34,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:38:34,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0e95254d3291e98e02c1 HTTP/1.1" 200 None 2026-05-11 10:38:34,428 - lava_callback - DEBUG - Processing node 69ff0e95254d3291e98e02c1: baseline-arm64-clabbe 2026-05-11 10:38:34,428 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0e95254d3291e98e02c1 2026-05-11 10:38:34,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:38:34,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0e95254d3291e98e02c1 HTTP/1.1" 200 None 2026-05-11 10:38:34,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:38:34,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:38:34,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:38:34,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0e95254d3291e98e02c1 HTTP/1.1" 200 None 2026-05-11 10:38:34,489 - lava_callback - ERROR - Error processing callback for node 69ff0e95254d3291e98e02c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:39:27,030 - lava_callback - INFO - Received callback for node 69ff0eda254d3291e98e02e1 INFO: 172.21.0.1:58540 - "POST /node/69ff0eda254d3291e98e02e1 HTTP/1.0" 202 Accepted 2026-05-11 10:39:27,036 - lava_callback - INFO - Starting async job submit for node 69ff0eda254d3291e98e02e1 2026-05-11 10:39:27,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:39:27,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0eda254d3291e98e02e1 HTTP/1.1" 200 None 2026-05-11 10:39:27,051 - lava_callback - DEBUG - Processing node 69ff0eda254d3291e98e02e1: baseline-arm64-baylibre 2026-05-11 10:39:27,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0eda254d3291e98e02e1 2026-05-11 10:39:27,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:39:27,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0eda254d3291e98e02e1 HTTP/1.1" 200 None 2026-05-11 10:39:27,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:39:27,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-11 10:39:27,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:39:27,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0eda254d3291e98e02e1 HTTP/1.1" 200 None 2026-05-11 10:39:27,110 - lava_callback - ERROR - Error processing callback for node 69ff0eda254d3291e98e02e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:40:47,006 - lava_callback - INFO - Received callback for node 69ff0f28254d3291e98e0317 INFO: 172.21.0.1:58614 - "POST /node/69ff0f28254d3291e98e0317 HTTP/1.0" 202 Accepted 2026-05-11 10:40:47,011 - lava_callback - INFO - Starting async job submit for node 69ff0f28254d3291e98e0317 2026-05-11 10:40:47,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:40:47,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0f28254d3291e98e0317 HTTP/1.1" 200 None 2026-05-11 10:40:47,027 - lava_callback - DEBUG - Processing node 69ff0f28254d3291e98e0317: baseline-arm64-baylibre 2026-05-11 10:40:47,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0f28254d3291e98e0317 2026-05-11 10:40:47,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:40:47,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0f28254d3291e98e0317 HTTP/1.1" 200 None 2026-05-11 10:40:47,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:40:47,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-11 10:40:47,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:40:47,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0f28254d3291e98e0317 HTTP/1.1" 200 None 2026-05-11 10:40:47,096 - lava_callback - ERROR - Error processing callback for node 69ff0f28254d3291e98e0317: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40218 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:42:07,101 - lava_callback - INFO - Received callback for node 69ff0f75254d3291e98e034c INFO: 172.21.0.1:40228 - "POST /node/69ff0f75254d3291e98e034c HTTP/1.0" 202 Accepted 2026-05-11 10:42:07,107 - lava_callback - INFO - Starting async job submit for node 69ff0f75254d3291e98e034c 2026-05-11 10:42:07,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:42:07,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0f75254d3291e98e034c HTTP/1.1" 200 None 2026-05-11 10:42:07,121 - lava_callback - DEBUG - Processing node 69ff0f75254d3291e98e034c: baseline-arm64-baylibre 2026-05-11 10:42:07,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0f75254d3291e98e034c 2026-05-11 10:42:07,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:42:07,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0f75254d3291e98e034c HTTP/1.1" 200 None 2026-05-11 10:42:07,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:42:07,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-11 10:42:07,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:42:07,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0f75254d3291e98e034c HTTP/1.1" 200 None 2026-05-11 10:42:07,167 - lava_callback - ERROR - Error processing callback for node 69ff0f75254d3291e98e034c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34594 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:43:27,251 - lava_callback - INFO - Received callback for node 69ff0fc1254d3291e98e0378 INFO: 172.21.0.1:34608 - "POST /node/69ff0fc1254d3291e98e0378 HTTP/1.0" 202 Accepted 2026-05-11 10:43:27,257 - lava_callback - INFO - Starting async job submit for node 69ff0fc1254d3291e98e0378 2026-05-11 10:43:27,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:43:27,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0fc1254d3291e98e0378 HTTP/1.1" 200 None 2026-05-11 10:43:27,271 - lava_callback - DEBUG - Processing node 69ff0fc1254d3291e98e0378: baseline-arm64-baylibre 2026-05-11 10:43:27,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff0fc1254d3291e98e0378 2026-05-11 10:43:27,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:43:27,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0fc1254d3291e98e0378 HTTP/1.1" 200 None 2026-05-11 10:43:27,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:43:27,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-11 10:43:27,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:43:27,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0fc1254d3291e98e0378 HTTP/1.1" 200 None 2026-05-11 10:43:27,324 - lava_callback - ERROR - Error processing callback for node 69ff0fc1254d3291e98e0378: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:44:54,647 - lava_callback - INFO - Received callback for node 69ff1016254d3291e98e03ab INFO: 172.21.0.1:51994 - "POST /node/69ff1016254d3291e98e03ab HTTP/1.0" 202 Accepted 2026-05-11 10:44:54,653 - lava_callback - INFO - Starting async job submit for node 69ff1016254d3291e98e03ab 2026-05-11 10:44:54,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:44:54,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1016254d3291e98e03ab HTTP/1.1" 200 None 2026-05-11 10:44:54,668 - lava_callback - DEBUG - Processing node 69ff1016254d3291e98e03ab: baseline-arm64-clabbe 2026-05-11 10:44:54,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1016254d3291e98e03ab 2026-05-11 10:44:54,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:44:54,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1016254d3291e98e03ab HTTP/1.1" 200 None 2026-05-11 10:44:54,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:44:54,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-11 10:44:54,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:44:54,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1016254d3291e98e03ab HTTP/1.1" 200 None 2026-05-11 10:44:54,714 - lava_callback - ERROR - Error processing callback for node 69ff1016254d3291e98e03ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:46:14,764 - lava_callback - INFO - Received callback for node 69ff1064254d3291e98e03ce INFO: 172.21.0.1:58036 - "POST /node/69ff1064254d3291e98e03ce HTTP/1.0" 202 Accepted 2026-05-11 10:46:14,770 - lava_callback - INFO - Starting async job submit for node 69ff1064254d3291e98e03ce 2026-05-11 10:46:14,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:46:14,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1064254d3291e98e03ce HTTP/1.1" 200 None 2026-05-11 10:46:14,792 - lava_callback - DEBUG - Processing node 69ff1064254d3291e98e03ce: baseline-arm64-clabbe 2026-05-11 10:46:14,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1064254d3291e98e03ce 2026-05-11 10:46:14,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:46:14,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1064254d3291e98e03ce HTTP/1.1" 200 None 2026-05-11 10:46:14,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:46:14,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-11 10:46:14,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:46:14,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1064254d3291e98e03ce HTTP/1.1" 200 None 2026-05-11 10:46:14,845 - lava_callback - ERROR - Error processing callback for node 69ff1064254d3291e98e03ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:47:08,277 - lava_callback - INFO - Received callback for node 6a01af0897995df55c489334 INFO: 172.21.0.1:45402 - "POST /node/6a01af0897995df55c489334 HTTP/1.0" 202 Accepted 2026-05-11 10:47:08,289 - lava_callback - INFO - Starting async job submit for node 6a01af0897995df55c489334 2026-05-11 10:47:08,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:47:08,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01af0897995df55c489334 HTTP/1.1" 200 None 2026-05-11 10:47:08,358 - lava_callback - DEBUG - Processing node 6a01af0897995df55c489334: baseline-nfs-arm64 2026-05-11 10:47:09,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:47:09,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:47:09,837 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01af0897995df55c489334/log.txt.gz 2026-05-11 10:47:10,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:47:10,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:47:10,637 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01af0897995df55c489334/lava-logs.yaml 2026-05-11 10:47:10,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 10:47:10,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 10:47:10,813 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-6a01af0897995df55c489334/lava_callback.json.gz DEBUG: Setup failed for 6a01af0897995df55c489334. Transitting job node result: incomplete -> fail 2026-05-11 10:47:10,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:47:10,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01af0897995df55c489334 HTTP/1.1" 200 None 2026-05-11 10:47:10,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:47:10,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01913497995df55c487f46 HTTP/1.1" 200 None 2026-05-11 10:47:10,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:47:10,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01af0897995df55c489334 HTTP/1.1" 200 None 2026-05-11 10:47:11,054 - lava_callback - INFO - Completed processing callback for node 6a01af0897995df55c489334 INFO: 172.21.0.1:53194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:47:34,763 - lava_callback - INFO - Received callback for node 69ff10b2254d3291e98e0403 INFO: 172.21.0.1:39780 - "POST /node/69ff10b2254d3291e98e0403 HTTP/1.0" 202 Accepted 2026-05-11 10:47:34,769 - lava_callback - INFO - Starting async job submit for node 69ff10b2254d3291e98e0403 2026-05-11 10:47:34,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:47:34,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff10b2254d3291e98e0403 HTTP/1.1" 200 None 2026-05-11 10:47:34,789 - lava_callback - DEBUG - Processing node 69ff10b2254d3291e98e0403: baseline-arm64-clabbe 2026-05-11 10:47:34,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff10b2254d3291e98e0403 2026-05-11 10:47:34,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:47:34,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff10b2254d3291e98e0403 HTTP/1.1" 200 None 2026-05-11 10:47:34,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:47:34,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-11 10:47:34,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:47:34,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff10b2254d3291e98e0403 HTTP/1.1" 200 None 2026-05-11 10:47:34,842 - lava_callback - ERROR - Error processing callback for node 69ff10b2254d3291e98e0403: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-11 10:47:35,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:47:35,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41846 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:48:55,282 - lava_callback - INFO - Received callback for node 69ff1102254d3291e98e0439 INFO: 172.21.0.1:41858 - "POST /node/69ff1102254d3291e98e0439 HTTP/1.0" 202 Accepted 2026-05-11 10:48:55,290 - lava_callback - INFO - Starting async job submit for node 69ff1102254d3291e98e0439 2026-05-11 10:48:55,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:48:55,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1102254d3291e98e0439 HTTP/1.1" 200 None 2026-05-11 10:48:55,306 - lava_callback - DEBUG - Processing node 69ff1102254d3291e98e0439: baseline-arm64-clabbe 2026-05-11 10:48:55,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1102254d3291e98e0439 2026-05-11 10:48:55,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:48:55,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1102254d3291e98e0439 HTTP/1.1" 200 None 2026-05-11 10:48:55,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:48:55,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-11 10:48:55,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:48:55,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1102254d3291e98e0439 HTTP/1.1" 200 None 2026-05-11 10:48:55,355 - lava_callback - ERROR - Error processing callback for node 69ff1102254d3291e98e0439: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47728 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:49:54,912 - lava_callback - INFO - Received callback for node 69ff1150254d3291e98e0456 INFO: 172.21.0.1:47734 - "POST /node/69ff1150254d3291e98e0456 HTTP/1.0" 202 Accepted 2026-05-11 10:49:54,921 - lava_callback - INFO - Starting async job submit for node 69ff1150254d3291e98e0456 2026-05-11 10:49:54,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:49:54,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1150254d3291e98e0456 HTTP/1.1" 200 None 2026-05-11 10:49:54,944 - lava_callback - DEBUG - Processing node 69ff1150254d3291e98e0456: baseline-arm64-clabbe 2026-05-11 10:49:54,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1150254d3291e98e0456 2026-05-11 10:49:54,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:49:54,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1150254d3291e98e0456 HTTP/1.1" 200 None 2026-05-11 10:49:54,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:49:54,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-11 10:49:54,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:49:54,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1150254d3291e98e0456 HTTP/1.1" 200 None 2026-05-11 10:49:54,998 - lava_callback - ERROR - Error processing callback for node 69ff1150254d3291e98e0456: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:51:14,938 - lava_callback - INFO - Received callback for node 69ff119d254d3291e98e0486 INFO: 172.21.0.1:48880 - "POST /node/69ff119d254d3291e98e0486 HTTP/1.0" 202 Accepted 2026-05-11 10:51:14,943 - lava_callback - INFO - Starting async job submit for node 69ff119d254d3291e98e0486 2026-05-11 10:51:14,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:51:14,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff119d254d3291e98e0486 HTTP/1.1" 200 None 2026-05-11 10:51:14,958 - lava_callback - DEBUG - Processing node 69ff119d254d3291e98e0486: baseline-arm64-clabbe 2026-05-11 10:51:14,959 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff119d254d3291e98e0486 2026-05-11 10:51:14,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:51:14,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff119d254d3291e98e0486 HTTP/1.1" 200 None 2026-05-11 10:51:14,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:51:14,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-11 10:51:14,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:51:15,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff119d254d3291e98e0486 HTTP/1.1" 200 None 2026-05-11 10:51:15,005 - lava_callback - ERROR - Error processing callback for node 69ff119d254d3291e98e0486: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57380 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:52:34,968 - lava_callback - INFO - Received callback for node 69ff11e9254d3291e98e04ae INFO: 172.21.0.1:57886 - "POST /node/69ff11e9254d3291e98e04ae HTTP/1.0" 202 Accepted 2026-05-11 10:52:34,974 - lava_callback - INFO - Starting async job submit for node 69ff11e9254d3291e98e04ae 2026-05-11 10:52:34,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:52:34,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff11e9254d3291e98e04ae HTTP/1.1" 200 None 2026-05-11 10:52:34,988 - lava_callback - DEBUG - Processing node 69ff11e9254d3291e98e04ae: baseline-arm64-clabbe 2026-05-11 10:52:34,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff11e9254d3291e98e04ae 2026-05-11 10:52:34,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:52:35,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff11e9254d3291e98e04ae HTTP/1.1" 200 None 2026-05-11 10:52:35,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:52:35,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-11 10:52:35,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:52:35,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff11e9254d3291e98e04ae HTTP/1.1" 200 None 2026-05-11 10:52:35,033 - lava_callback - ERROR - Error processing callback for node 69ff11e9254d3291e98e04ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60696 - "GET / HTTP/1.0" 200 OK 2026-05-11 10:56:47,940 - lava_callback - INFO - Received callback for node 69ff12eb254d3291e98e0538 INFO: 172.21.0.1:60710 - "POST /node/69ff12eb254d3291e98e0538 HTTP/1.0" 202 Accepted 2026-05-11 10:56:47,946 - lava_callback - INFO - Starting async job submit for node 69ff12eb254d3291e98e0538 2026-05-11 10:56:47,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:56:47,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff12eb254d3291e98e0538 HTTP/1.1" 200 None 2026-05-11 10:56:47,965 - lava_callback - DEBUG - Processing node 69ff12eb254d3291e98e0538: baseline-arm64-baylibre 2026-05-11 10:56:47,965 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff12eb254d3291e98e0538 2026-05-11 10:56:47,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:56:47,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff12eb254d3291e98e0538 HTTP/1.1" 200 None 2026-05-11 10:56:47,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:56:48,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-11 10:56:48,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:56:48,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff12eb254d3291e98e0538 HTTP/1.1" 200 None 2026-05-11 10:56:48,029 - lava_callback - ERROR - Error processing callback for node 69ff12eb254d3291e98e0538: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45894 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-11 10:58:15,279 - lava_callback - INFO - Received callback for node 69ff133d254d3291e98e056b INFO: 172.21.0.1:45906 - "POST /node/69ff133d254d3291e98e056b HTTP/1.0" 202 Accepted 2026-05-11 10:58:15,289 - lava_callback - INFO - Starting async job submit for node 69ff133d254d3291e98e056b 2026-05-11 10:58:15,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:58:15,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff133d254d3291e98e056b HTTP/1.1" 200 None 2026-05-11 10:58:15,303 - lava_callback - DEBUG - Processing node 69ff133d254d3291e98e056b: baseline-arm64-clabbe 2026-05-11 10:58:15,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff133d254d3291e98e056b 2026-05-11 10:58:15,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:58:15,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff133d254d3291e98e056b HTTP/1.1" 200 None 2026-05-11 10:58:15,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:58:15,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-11 10:58:15,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 10:58:15,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff133d254d3291e98e056b HTTP/1.1" 200 None 2026-05-11 10:58:15,360 - lava_callback - ERROR - Error processing callback for node 69ff133d254d3291e98e056b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56698 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:00:55,393 - lava_callback - INFO - Received callback for node 69ff13d6254d3291e98e05b8 INFO: 172.21.0.1:56700 - "POST /node/69ff13d6254d3291e98e05b8 HTTP/1.0" 202 Accepted 2026-05-11 11:00:55,398 - lava_callback - INFO - Starting async job submit for node 69ff13d6254d3291e98e05b8 2026-05-11 11:00:55,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:00:55,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff13d6254d3291e98e05b8 HTTP/1.1" 200 None 2026-05-11 11:00:55,421 - lava_callback - DEBUG - Processing node 69ff13d6254d3291e98e05b8: baseline-arm64-clabbe 2026-05-11 11:00:55,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff13d6254d3291e98e05b8 2026-05-11 11:00:55,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:00:55,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff13d6254d3291e98e05b8 HTTP/1.1" 200 None 2026-05-11 11:00:55,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:00:55,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-11 11:00:55,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:00:55,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff13d6254d3291e98e05b8 HTTP/1.1" 200 None 2026-05-11 11:00:55,466 - lava_callback - ERROR - Error processing callback for node 69ff13d6254d3291e98e05b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36362 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-11 11:02:15,498 - lava_callback - INFO - Received callback for node 69ff1422254d3291e98e05dd INFO: 172.21.0.1:36366 - "POST /node/69ff1422254d3291e98e05dd HTTP/1.0" 202 Accepted 2026-05-11 11:02:15,504 - lava_callback - INFO - Starting async job submit for node 69ff1422254d3291e98e05dd 2026-05-11 11:02:15,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:02:15,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1422254d3291e98e05dd HTTP/1.1" 200 None 2026-05-11 11:02:15,555 - lava_callback - DEBUG - Processing node 69ff1422254d3291e98e05dd: baseline-arm64-clabbe 2026-05-11 11:02:15,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1422254d3291e98e05dd 2026-05-11 11:02:15,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36378 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:02:17,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1422254d3291e98e05dd HTTP/1.1" 200 None 2026-05-11 11:02:17,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:02:17,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-11 11:02:17,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:02:17,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1422254d3291e98e05dd HTTP/1.1" 200 None 2026-05-11 11:02:17,126 - lava_callback - ERROR - Error processing callback for node 69ff1422254d3291e98e05dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33166 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-11 11:03:15,615 - lava_callback - INFO - Received callback for node 69ff146e254d3291e98e0610 INFO: 172.21.0.1:33182 - "POST /node/69ff146e254d3291e98e0610 HTTP/1.0" 202 Accepted 2026-05-11 11:03:15,620 - lava_callback - INFO - Starting async job submit for node 69ff146e254d3291e98e0610 2026-05-11 11:03:15,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:03:15,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff146e254d3291e98e0610 HTTP/1.1" 200 None 2026-05-11 11:03:15,635 - lava_callback - DEBUG - Processing node 69ff146e254d3291e98e0610: baseline-arm64-clabbe 2026-05-11 11:03:15,635 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff146e254d3291e98e0610 2026-05-11 11:03:15,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:03:15,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff146e254d3291e98e0610 HTTP/1.1" 200 None 2026-05-11 11:03:15,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:03:15,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-11 11:03:15,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:03:15,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff146e254d3291e98e0610 HTTP/1.1" 200 None 2026-05-11 11:03:15,710 - lava_callback - ERROR - Error processing callback for node 69ff146e254d3291e98e0610: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:04:35,625 - lava_callback - INFO - Received callback for node 69ff14b9254d3291e98e062f INFO: 172.21.0.1:34908 - "POST /node/69ff14b9254d3291e98e062f HTTP/1.0" 202 Accepted 2026-05-11 11:04:35,631 - lava_callback - INFO - Starting async job submit for node 69ff14b9254d3291e98e062f 2026-05-11 11:04:35,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:04:35,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff14b9254d3291e98e062f HTTP/1.1" 200 None 2026-05-11 11:04:35,646 - lava_callback - DEBUG - Processing node 69ff14b9254d3291e98e062f: baseline-arm64-clabbe 2026-05-11 11:04:35,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff14b9254d3291e98e062f 2026-05-11 11:04:35,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:04:35,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff14b9254d3291e98e062f HTTP/1.1" 200 None 2026-05-11 11:04:35,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:04:35,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-11 11:04:35,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:04:35,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff14b9254d3291e98e062f HTTP/1.1" 200 None 2026-05-11 11:04:35,696 - lava_callback - ERROR - Error processing callback for node 69ff14b9254d3291e98e062f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:05:55,628 - lava_callback - INFO - Received callback for node 69ff1505254d3291e98e0660 INFO: 172.21.0.1:40074 - "POST /node/69ff1505254d3291e98e0660 HTTP/1.0" 202 Accepted 2026-05-11 11:05:55,634 - lava_callback - INFO - Starting async job submit for node 69ff1505254d3291e98e0660 2026-05-11 11:05:55,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:05:55,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1505254d3291e98e0660 HTTP/1.1" 200 None 2026-05-11 11:05:55,652 - lava_callback - DEBUG - Processing node 69ff1505254d3291e98e0660: baseline-arm64-clabbe 2026-05-11 11:05:55,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1505254d3291e98e0660 2026-05-11 11:05:55,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:05:55,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1505254d3291e98e0660 HTTP/1.1" 200 None 2026-05-11 11:05:55,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:05:55,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-11 11:05:55,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:05:55,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1505254d3291e98e0660 HTTP/1.1" 200 None 2026-05-11 11:05:55,700 - lava_callback - ERROR - Error processing callback for node 69ff1505254d3291e98e0660: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:13:08,858 - lava_callback - INFO - Received callback for node 69ff16bf254d3291e98e0741 INFO: 172.21.0.1:39800 - "POST /node/69ff16bf254d3291e98e0741 HTTP/1.0" 202 Accepted 2026-05-11 11:13:08,866 - lava_callback - INFO - Starting async job submit for node 69ff16bf254d3291e98e0741 2026-05-11 11:13:08,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:13:08,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff16bf254d3291e98e0741 HTTP/1.1" 200 None 2026-05-11 11:13:08,887 - lava_callback - DEBUG - Processing node 69ff16bf254d3291e98e0741: baseline-arm-baylibre 2026-05-11 11:13:08,888 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff16bf254d3291e98e0741 2026-05-11 11:13:08,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:13:08,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff16bf254d3291e98e0741 HTTP/1.1" 200 None 2026-05-11 11:13:08,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:13:08,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-11 11:13:08,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:13:08,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff16bf254d3291e98e0741 HTTP/1.1" 200 None 2026-05-11 11:13:08,958 - lava_callback - ERROR - Error processing callback for node 69ff16bf254d3291e98e0741: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:13:48,836 - lava_callback - INFO - Received callback for node 69ff16e5254d3291e98e074d INFO: 172.21.0.1:59474 - "POST /node/69ff16e5254d3291e98e074d HTTP/1.0" 202 Accepted 2026-05-11 11:13:48,841 - lava_callback - INFO - Starting async job submit for node 69ff16e5254d3291e98e074d 2026-05-11 11:13:48,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:13:48,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff16e5254d3291e98e074d HTTP/1.1" 200 None 2026-05-11 11:13:48,861 - lava_callback - DEBUG - Processing node 69ff16e5254d3291e98e074d: baseline-arm-baylibre 2026-05-11 11:13:48,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff16e5254d3291e98e074d 2026-05-11 11:13:48,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:13:48,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff16e5254d3291e98e074d HTTP/1.1" 200 None 2026-05-11 11:13:48,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:13:48,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-11 11:13:48,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:13:48,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff16e5254d3291e98e074d HTTP/1.1" 200 None 2026-05-11 11:13:48,907 - lava_callback - ERROR - Error processing callback for node 69ff16e5254d3291e98e074d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44590 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:15:48,950 - lava_callback - INFO - Received callback for node 69ff1754254d3291e98e078c INFO: 172.21.0.1:44594 - "POST /node/69ff1754254d3291e98e078c HTTP/1.0" 202 Accepted 2026-05-11 11:15:48,956 - lava_callback - INFO - Starting async job submit for node 69ff1754254d3291e98e078c 2026-05-11 11:15:48,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:15:48,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1754254d3291e98e078c HTTP/1.1" 200 None 2026-05-11 11:15:48,974 - lava_callback - DEBUG - Processing node 69ff1754254d3291e98e078c: baseline-arm-baylibre 2026-05-11 11:15:48,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1754254d3291e98e078c 2026-05-11 11:15:48,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:15:48,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1754254d3291e98e078c HTTP/1.1" 200 None 2026-05-11 11:15:48,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:15:49,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-11 11:15:49,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:15:49,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1754254d3291e98e078c HTTP/1.1" 200 None 2026-05-11 11:15:49,018 - lava_callback - ERROR - Error processing callback for node 69ff1754254d3291e98e078c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:16:28,969 - lava_callback - INFO - Received callback for node 69ff1778254d3291e98e079b INFO: 172.21.0.1:37630 - "POST /node/69ff1778254d3291e98e079b HTTP/1.0" 202 Accepted 2026-05-11 11:16:28,975 - lava_callback - INFO - Starting async job submit for node 69ff1778254d3291e98e079b 2026-05-11 11:16:28,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:16:28,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1778254d3291e98e079b HTTP/1.1" 200 None 2026-05-11 11:16:28,990 - lava_callback - DEBUG - Processing node 69ff1778254d3291e98e079b: baseline-arm-baylibre 2026-05-11 11:16:28,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1778254d3291e98e079b 2026-05-11 11:16:28,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:16:29,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1778254d3291e98e079b HTTP/1.1" 200 None 2026-05-11 11:16:29,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:16:29,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-11 11:16:29,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:16:29,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1778254d3291e98e079b HTTP/1.1" 200 None 2026-05-11 11:16:29,034 - lava_callback - ERROR - Error processing callback for node 69ff1778254d3291e98e079b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:16:49,007 - lava_callback - INFO - Received callback for node 69ff179f254d3291e98e07a9 INFO: 172.21.0.1:48826 - "POST /node/69ff179f254d3291e98e07a9 HTTP/1.0" 202 Accepted 2026-05-11 11:16:49,013 - lava_callback - INFO - Starting async job submit for node 69ff179f254d3291e98e07a9 2026-05-11 11:16:49,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:16:49,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff179f254d3291e98e07a9 HTTP/1.1" 200 None 2026-05-11 11:16:49,029 - lava_callback - DEBUG - Processing node 69ff179f254d3291e98e07a9: baseline-arm-baylibre 2026-05-11 11:16:49,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff179f254d3291e98e07a9 2026-05-11 11:16:49,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:16:49,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff179f254d3291e98e07a9 HTTP/1.1" 200 None 2026-05-11 11:16:49,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:16:49,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-11 11:16:49,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:16:49,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff179f254d3291e98e07a9 HTTP/1.1" 200 None 2026-05-11 11:16:49,097 - lava_callback - ERROR - Error processing callback for node 69ff179f254d3291e98e07a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39164 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:17:29,104 - lava_callback - INFO - Received callback for node 69ff17c6254d3291e98e07bc INFO: 172.21.0.1:39168 - "POST /node/69ff17c6254d3291e98e07bc HTTP/1.0" 202 Accepted 2026-05-11 11:17:29,110 - lava_callback - INFO - Starting async job submit for node 69ff17c6254d3291e98e07bc 2026-05-11 11:17:29,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:17:29,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff17c6254d3291e98e07bc HTTP/1.1" 200 None 2026-05-11 11:17:29,125 - lava_callback - DEBUG - Processing node 69ff17c6254d3291e98e07bc: baseline-arm-baylibre 2026-05-11 11:17:29,125 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff17c6254d3291e98e07bc 2026-05-11 11:17:29,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:17:29,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff17c6254d3291e98e07bc HTTP/1.1" 200 None 2026-05-11 11:17:29,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:17:29,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-11 11:17:29,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:17:29,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff17c6254d3291e98e07bc HTTP/1.1" 200 None 2026-05-11 11:17:29,168 - lava_callback - ERROR - Error processing callback for node 69ff17c6254d3291e98e07bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:19:36,207 - lava_callback - INFO - Received callback for node 69ff1834254d3291e98e07ee INFO: 172.21.0.1:33000 - "POST /node/69ff1834254d3291e98e07ee HTTP/1.0" 202 Accepted 2026-05-11 11:19:36,213 - lava_callback - INFO - Starting async job submit for node 69ff1834254d3291e98e07ee 2026-05-11 11:19:36,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:19:36,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1834254d3291e98e07ee HTTP/1.1" 200 None 2026-05-11 11:19:36,246 - lava_callback - DEBUG - Processing node 69ff1834254d3291e98e07ee: baseline-arm-clabbe 2026-05-11 11:19:36,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1834254d3291e98e07ee 2026-05-11 11:19:36,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:19:36,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1834254d3291e98e07ee HTTP/1.1" 200 None 2026-05-11 11:19:36,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:19:36,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-11 11:19:36,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:19:36,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1834254d3291e98e07ee HTTP/1.1" 200 None 2026-05-11 11:19:36,308 - lava_callback - ERROR - Error processing callback for node 69ff1834254d3291e98e07ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-11 11:20:16,076 - lava_callback - INFO - Received callback for node 69ff185a254d3291e98e07f9 INFO: 172.21.0.1:52674 - "POST /node/69ff185a254d3291e98e07f9 HTTP/1.0" 202 Accepted 2026-05-11 11:20:16,082 - lava_callback - INFO - Starting async job submit for node 69ff185a254d3291e98e07f9 2026-05-11 11:20:16,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:20:16,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff185a254d3291e98e07f9 HTTP/1.1" 200 None 2026-05-11 11:20:16,098 - lava_callback - DEBUG - Processing node 69ff185a254d3291e98e07f9: baseline-arm-clabbe 2026-05-11 11:20:16,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff185a254d3291e98e07f9 2026-05-11 11:20:16,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:20:16,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff185a254d3291e98e07f9 HTTP/1.1" 200 None 2026-05-11 11:20:16,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:20:16,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-11 11:20:16,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:20:16,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff185a254d3291e98e07f9 HTTP/1.1" 200 None 2026-05-11 11:20:16,147 - lava_callback - ERROR - Error processing callback for node 69ff185a254d3291e98e07f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44854 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:20:36,309 - lava_callback - INFO - Received callback for node 69ff1880254d3291e98e0806 INFO: 172.21.0.1:44548 - "POST /node/69ff1880254d3291e98e0806 HTTP/1.0" 202 Accepted 2026-05-11 11:20:36,315 - lava_callback - INFO - Starting async job submit for node 69ff1880254d3291e98e0806 2026-05-11 11:20:36,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:20:36,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1880254d3291e98e0806 HTTP/1.1" 200 None 2026-05-11 11:20:36,330 - lava_callback - DEBUG - Processing node 69ff1880254d3291e98e0806: baseline-arm-clabbe 2026-05-11 11:20:36,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1880254d3291e98e0806 2026-05-11 11:20:36,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:20:36,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1880254d3291e98e0806 HTTP/1.1" 200 None 2026-05-11 11:20:36,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:20:36,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-11 11:20:36,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:20:36,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1880254d3291e98e0806 HTTP/1.1" 200 None 2026-05-11 11:20:36,376 - lava_callback - ERROR - Error processing callback for node 69ff1880254d3291e98e0806: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44438 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-11 11:21:16,187 - lava_callback - INFO - Received callback for node 69ff18a6254d3291e98e080f INFO: 172.21.0.1:44448 - "POST /node/69ff18a6254d3291e98e080f HTTP/1.0" 202 Accepted 2026-05-11 11:21:16,195 - lava_callback - INFO - Starting async job submit for node 69ff18a6254d3291e98e080f 2026-05-11 11:21:16,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:21:16,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff18a6254d3291e98e080f HTTP/1.1" 200 None 2026-05-11 11:21:16,212 - lava_callback - DEBUG - Processing node 69ff18a6254d3291e98e080f: baseline-arm-clabbe 2026-05-11 11:21:16,212 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff18a6254d3291e98e080f 2026-05-11 11:21:16,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:21:16,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff18a6254d3291e98e080f HTTP/1.1" 200 None 2026-05-11 11:21:16,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:21:16,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-11 11:21:16,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:21:16,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff18a6254d3291e98e080f HTTP/1.1" 200 None 2026-05-11 11:21:16,259 - lava_callback - ERROR - Error processing callback for node 69ff18a6254d3291e98e080f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:21:56,277 - lava_callback - INFO - Received callback for node 69ff18cb254d3291e98e0819 INFO: 172.21.0.1:53320 - "POST /node/69ff18cb254d3291e98e0819 HTTP/1.0" 202 Accepted 2026-05-11 11:21:56,283 - lava_callback - INFO - Starting async job submit for node 69ff18cb254d3291e98e0819 2026-05-11 11:21:56,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:21:56,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff18cb254d3291e98e0819 HTTP/1.1" 200 None 2026-05-11 11:21:56,298 - lava_callback - DEBUG - Processing node 69ff18cb254d3291e98e0819: baseline-arm-clabbe 2026-05-11 11:21:56,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff18cb254d3291e98e0819 2026-05-11 11:21:56,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:21:56,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff18cb254d3291e98e0819 HTTP/1.1" 200 None 2026-05-11 11:21:56,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:21:56,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-11 11:21:56,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:21:56,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff18cb254d3291e98e0819 HTTP/1.1" 200 None 2026-05-11 11:21:56,358 - lava_callback - ERROR - Error processing callback for node 69ff18cb254d3291e98e0819: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:22:36,240 - lava_callback - INFO - Received callback for node 69ff18f0254d3291e98e0824 INFO: 172.21.0.1:42058 - "POST /node/69ff18f0254d3291e98e0824 HTTP/1.0" 202 Accepted 2026-05-11 11:22:36,246 - lava_callback - INFO - Starting async job submit for node 69ff18f0254d3291e98e0824 2026-05-11 11:22:36,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:22:36,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff18f0254d3291e98e0824 HTTP/1.1" 200 None 2026-05-11 11:22:36,262 - lava_callback - DEBUG - Processing node 69ff18f0254d3291e98e0824: baseline-arm-clabbe 2026-05-11 11:22:36,262 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff18f0254d3291e98e0824 2026-05-11 11:22:36,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:22:36,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff18f0254d3291e98e0824 HTTP/1.1" 200 None 2026-05-11 11:22:36,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:22:36,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d23e4d4e78cd76adcc6 HTTP/1.1" 200 None 2026-05-11 11:22:36,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:22:36,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff18f0254d3291e98e0824 HTTP/1.1" 200 None 2026-05-11 11:22:36,316 - lava_callback - ERROR - Error processing callback for node 69ff18f0254d3291e98e0824: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34862 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:25:08,379 - lava_callback - INFO - Received callback for node 69ff198e254d3291e98e0845 INFO: 172.21.0.1:34868 - "POST /node/69ff198e254d3291e98e0845 HTTP/1.0" 202 Accepted 2026-05-11 11:25:08,387 - lava_callback - INFO - Starting async job submit for node 69ff198e254d3291e98e0845 2026-05-11 11:25:08,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:25:08,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff198e254d3291e98e0845 HTTP/1.1" 200 None 2026-05-11 11:25:08,410 - lava_callback - DEBUG - Processing node 69ff198e254d3291e98e0845: baseline-x86 2026-05-11 11:25:08,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff198e254d3291e98e0845 2026-05-11 11:25:08,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:25:08,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff198e254d3291e98e0845 HTTP/1.1" 200 None 2026-05-11 11:25:08,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:25:08,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d56e4d4e78cd76adcf2 HTTP/1.1" 200 None 2026-05-11 11:25:08,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:25:08,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff198e254d3291e98e0845 HTTP/1.1" 200 None 2026-05-11 11:25:08,463 - lava_callback - ERROR - Error processing callback for node 69ff198e254d3291e98e0845: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:36:50,229 - lava_callback - INFO - Received callback for node 69ff1c4d254d3291e98e09c1 INFO: 172.21.0.1:41888 - "POST /node/69ff1c4d254d3291e98e09c1 HTTP/1.0" 202 Accepted 2026-05-11 11:36:50,235 - lava_callback - INFO - Starting async job submit for node 69ff1c4d254d3291e98e09c1 2026-05-11 11:36:50,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:36:50,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1c4d254d3291e98e09c1 HTTP/1.1" 200 None 2026-05-11 11:36:50,250 - lava_callback - DEBUG - Processing node 69ff1c4d254d3291e98e09c1: baseline-arm64-baylibre 2026-05-11 11:36:50,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1c4d254d3291e98e09c1 2026-05-11 11:36:50,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:36:50,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1c4d254d3291e98e09c1 HTTP/1.1" 200 None 2026-05-11 11:36:50,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:36:50,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-11 11:36:50,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:36:50,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1c4d254d3291e98e09c1 HTTP/1.1" 200 None 2026-05-11 11:36:50,303 - lava_callback - ERROR - Error processing callback for node 69ff1c4d254d3291e98e09c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:41:10,395 - lava_callback - INFO - Received callback for node 69ff1d44254d3291e98e0a3d INFO: 172.21.0.1:35788 - "POST /node/69ff1d44254d3291e98e0a3d HTTP/1.0" 202 Accepted 2026-05-11 11:41:10,401 - lava_callback - INFO - Starting async job submit for node 69ff1d44254d3291e98e0a3d 2026-05-11 11:41:10,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:41:10,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1d44254d3291e98e0a3d HTTP/1.1" 200 None 2026-05-11 11:41:10,416 - lava_callback - DEBUG - Processing node 69ff1d44254d3291e98e0a3d: baseline-arm64-baylibre 2026-05-11 11:41:10,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1d44254d3291e98e0a3d 2026-05-11 11:41:10,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:41:10,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1d44254d3291e98e0a3d HTTP/1.1" 200 None 2026-05-11 11:41:10,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:41:10,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-11 11:41:10,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:41:10,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1d44254d3291e98e0a3d HTTP/1.1" 200 None 2026-05-11 11:41:10,460 - lava_callback - ERROR - Error processing callback for node 69ff1d44254d3291e98e0a3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58992 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:60726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:43:24,779 - lava_callback - INFO - Received callback for node 6a01aec897995df55c48932a INFO: 172.21.0.1:44638 - "POST /node/6a01aec897995df55c48932a HTTP/1.0" 202 Accepted 2026-05-11 11:43:24,826 - lava_callback - INFO - Starting async job submit for node 6a01aec897995df55c48932a 2026-05-11 11:43:24,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:43:24,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01aec897995df55c48932a HTTP/1.1" 200 None 2026-05-11 11:43:24,865 - lava_callback - DEBUG - Processing node 6a01aec897995df55c48932a: baseline-arm-pengutronix 2026-05-11 11:43:24,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 11:43:25,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 11:43:25,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a01aec897995df55c48932a/log.txt.gz 2026-05-11 11:43:25,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 11:43:25,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 11:43:25,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a01aec897995df55c48932a/lava-logs.yaml 2026-05-11 11:43:25,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 11:43:25,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 11:43:25,317 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-6a01aec897995df55c48932a/lava_callback.json.gz DEBUG: Setup failed for 6a01aec897995df55c48932a. Transitting job node result: incomplete -> fail 2026-05-11 11:43:25,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:43:25,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01aec897995df55c48932a HTTP/1.1" 200 None 2026-05-11 11:43:25,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:43:25,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/6a01912697995df55c487f37 HTTP/1.1" 200 None 2026-05-11 11:43:25,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:43:25,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/6a01aec897995df55c48932a HTTP/1.1" 200 None 2026-05-11 11:43:25,520 - lava_callback - INFO - Completed processing callback for node 6a01aec897995df55c48932a INFO: 172.21.0.1:44646 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:43:35,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:43:35,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:43:50,572 - lava_callback - INFO - Received callback for node 69ff1de4254d3291e98e0aa4 INFO: 172.21.0.1:38466 - "POST /node/69ff1de4254d3291e98e0aa4 HTTP/1.0" 202 Accepted 2026-05-11 11:43:50,578 - lava_callback - INFO - Starting async job submit for node 69ff1de4254d3291e98e0aa4 2026-05-11 11:43:50,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:43:50,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1de4254d3291e98e0aa4 HTTP/1.1" 200 None 2026-05-11 11:43:50,594 - lava_callback - DEBUG - Processing node 69ff1de4254d3291e98e0aa4: baseline-arm64-baylibre 2026-05-11 11:43:50,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1de4254d3291e98e0aa4 2026-05-11 11:43:50,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:43:50,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1de4254d3291e98e0aa4 HTTP/1.1" 200 None 2026-05-11 11:43:50,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:43:50,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-11 11:43:50,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:43:50,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1de4254d3291e98e0aa4 HTTP/1.1" 200 None 2026-05-11 11:43:50,639 - lava_callback - ERROR - Error processing callback for node 69ff1de4254d3291e98e0aa4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:45:17,164 - lava_callback - INFO - Received callback for node 69ff1e39254d3291e98e0ac2 INFO: 172.21.0.1:33314 - "POST /node/69ff1e39254d3291e98e0ac2 HTTP/1.0" 202 Accepted 2026-05-11 11:45:17,169 - lava_callback - INFO - Starting async job submit for node 69ff1e39254d3291e98e0ac2 2026-05-11 11:45:17,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:45:17,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1e39254d3291e98e0ac2 HTTP/1.1" 200 None 2026-05-11 11:45:17,183 - lava_callback - DEBUG - Processing node 69ff1e39254d3291e98e0ac2: baseline-arm64-clabbe 2026-05-11 11:45:17,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1e39254d3291e98e0ac2 2026-05-11 11:45:17,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:45:17,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1e39254d3291e98e0ac2 HTTP/1.1" 200 None 2026-05-11 11:45:17,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:45:17,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-11 11:45:17,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:45:17,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1e39254d3291e98e0ac2 HTTP/1.1" 200 None 2026-05-11 11:45:17,231 - lava_callback - ERROR - Error processing callback for node 69ff1e39254d3291e98e0ac2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34704 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:46:17,220 - lava_callback - INFO - Received callback for node 69ff1e85254d3291e98e0af4 INFO: 172.21.0.1:34714 - "POST /node/69ff1e85254d3291e98e0af4 HTTP/1.0" 202 Accepted 2026-05-11 11:46:17,226 - lava_callback - INFO - Starting async job submit for node 69ff1e85254d3291e98e0af4 2026-05-11 11:46:17,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:46:17,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1e85254d3291e98e0af4 HTTP/1.1" 200 None 2026-05-11 11:46:17,241 - lava_callback - DEBUG - Processing node 69ff1e85254d3291e98e0af4: baseline-arm64-clabbe 2026-05-11 11:46:17,241 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1e85254d3291e98e0af4 2026-05-11 11:46:17,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:46:17,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1e85254d3291e98e0af4 HTTP/1.1" 200 None 2026-05-11 11:46:17,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:46:17,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-11 11:46:17,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:46:17,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1e85254d3291e98e0af4 HTTP/1.1" 200 None 2026-05-11 11:46:17,300 - lava_callback - ERROR - Error processing callback for node 69ff1e85254d3291e98e0af4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:47:37,201 - lava_callback - INFO - Received callback for node 69ff1ed1254d3291e98e0b15 INFO: 172.21.0.1:51796 - "POST /node/69ff1ed1254d3291e98e0b15 HTTP/1.0" 202 Accepted 2026-05-11 11:47:37,207 - lava_callback - INFO - Starting async job submit for node 69ff1ed1254d3291e98e0b15 2026-05-11 11:47:37,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:47:37,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1ed1254d3291e98e0b15 HTTP/1.1" 200 None 2026-05-11 11:47:37,223 - lava_callback - DEBUG - Processing node 69ff1ed1254d3291e98e0b15: baseline-arm64-clabbe 2026-05-11 11:47:37,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1ed1254d3291e98e0b15 2026-05-11 11:47:37,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:47:37,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1ed1254d3291e98e0b15 HTTP/1.1" 200 None 2026-05-11 11:47:37,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:47:37,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-11 11:47:37,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:47:37,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1ed1254d3291e98e0b15 HTTP/1.1" 200 None 2026-05-11 11:47:37,294 - lava_callback - ERROR - Error processing callback for node 69ff1ed1254d3291e98e0b15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:48:57,219 - lava_callback - INFO - Received callback for node 69ff1f1f254d3291e98e0b50 INFO: 172.21.0.1:43360 - "POST /node/69ff1f1f254d3291e98e0b50 HTTP/1.0" 202 Accepted 2026-05-11 11:48:57,225 - lava_callback - INFO - Starting async job submit for node 69ff1f1f254d3291e98e0b50 2026-05-11 11:48:57,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:48:57,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1f1f254d3291e98e0b50 HTTP/1.1" 200 None 2026-05-11 11:48:57,241 - lava_callback - DEBUG - Processing node 69ff1f1f254d3291e98e0b50: baseline-arm64-clabbe 2026-05-11 11:48:57,241 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1f1f254d3291e98e0b50 2026-05-11 11:48:57,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:48:57,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1f1f254d3291e98e0b50 HTTP/1.1" 200 None 2026-05-11 11:48:57,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:48:57,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-11 11:48:57,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:48:57,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1f1f254d3291e98e0b50 HTTP/1.1" 200 None 2026-05-11 11:48:57,296 - lava_callback - ERROR - Error processing callback for node 69ff1f1f254d3291e98e0b50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44974 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:50:17,383 - lava_callback - INFO - Received callback for node 69ff1f6c254d3291e98e0b8a INFO: 172.21.0.1:44984 - "POST /node/69ff1f6c254d3291e98e0b8a HTTP/1.0" 202 Accepted 2026-05-11 11:50:17,392 - lava_callback - INFO - Starting async job submit for node 69ff1f6c254d3291e98e0b8a 2026-05-11 11:50:17,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:50:17,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1f6c254d3291e98e0b8a HTTP/1.1" 200 None 2026-05-11 11:50:17,408 - lava_callback - DEBUG - Processing node 69ff1f6c254d3291e98e0b8a: baseline-arm64-clabbe 2026-05-11 11:50:17,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1f6c254d3291e98e0b8a 2026-05-11 11:50:17,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:50:17,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1f6c254d3291e98e0b8a HTTP/1.1" 200 None 2026-05-11 11:50:17,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:50:17,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-11 11:50:17,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:50:17,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1f6c254d3291e98e0b8a HTTP/1.1" 200 None 2026-05-11 11:50:17,458 - lava_callback - ERROR - Error processing callback for node 69ff1f6c254d3291e98e0b8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38800 - "GET / HTTP/1.0" 200 OK 2026-05-11 11:51:37,357 - lava_callback - INFO - Received callback for node 69ff1fb8254d3291e98e0ba6 INFO: 172.21.0.1:38808 - "POST /node/69ff1fb8254d3291e98e0ba6 HTTP/1.0" 202 Accepted 2026-05-11 11:51:37,363 - lava_callback - INFO - Starting async job submit for node 69ff1fb8254d3291e98e0ba6 2026-05-11 11:51:37,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:51:37,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1fb8254d3291e98e0ba6 HTTP/1.1" 200 None 2026-05-11 11:51:37,379 - lava_callback - DEBUG - Processing node 69ff1fb8254d3291e98e0ba6: baseline-arm64-clabbe 2026-05-11 11:51:37,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff1fb8254d3291e98e0ba6 2026-05-11 11:51:37,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:51:37,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1fb8254d3291e98e0ba6 HTTP/1.1" 200 None 2026-05-11 11:51:37,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:51:37,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-11 11:51:37,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 11:51:37,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1fb8254d3291e98e0ba6 HTTP/1.1" 200 None 2026-05-11 11:51:37,434 - lava_callback - ERROR - Error processing callback for node 69ff1fb8254d3291e98e0ba6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:41:34,093 - lava_callback - INFO - Received callback for node 69ff2b69254d3291e98e0cd3 INFO: 172.21.0.1:60462 - "POST /node/69ff2b69254d3291e98e0cd3 HTTP/1.0" 202 Accepted 2026-05-11 12:41:34,099 - lava_callback - INFO - Starting async job submit for node 69ff2b69254d3291e98e0cd3 2026-05-11 12:41:34,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:41:34,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2b69254d3291e98e0cd3 HTTP/1.1" 200 None 2026-05-11 12:41:34,114 - lava_callback - DEBUG - Processing node 69ff2b69254d3291e98e0cd3: baseline-arm-baylibre 2026-05-11 12:41:34,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2b69254d3291e98e0cd3 2026-05-11 12:41:34,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:41:34,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2b69254d3291e98e0cd3 HTTP/1.1" 200 None 2026-05-11 12:41:34,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:41:34,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cdcef513bcf3f028109 HTTP/1.1" 200 None 2026-05-11 12:41:34,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:41:34,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2b69254d3291e98e0cd3 HTTP/1.1" 200 None 2026-05-11 12:41:34,171 - lava_callback - ERROR - Error processing callback for node 69ff2b69254d3291e98e0cd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38696 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:41:53,688 - lava_callback - INFO - Received callback for node 69ff2b8e254d3291e98e0cdf INFO: 172.21.0.1:39718 - "POST /node/69ff2b8e254d3291e98e0cdf HTTP/1.0" 202 Accepted 2026-05-11 12:41:53,693 - lava_callback - INFO - Starting async job submit for node 69ff2b8e254d3291e98e0cdf 2026-05-11 12:41:53,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:41:53,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2b8e254d3291e98e0cdf HTTP/1.1" 200 None 2026-05-11 12:41:53,721 - lava_callback - DEBUG - Processing node 69ff2b8e254d3291e98e0cdf: baseline-arm-baylibre 2026-05-11 12:41:53,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2b8e254d3291e98e0cdf 2026-05-11 12:41:53,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:41:53,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2b8e254d3291e98e0cdf HTTP/1.1" 200 None 2026-05-11 12:41:53,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:41:53,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cdcef513bcf3f028109 HTTP/1.1" 200 None 2026-05-11 12:41:53,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:41:53,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2b8e254d3291e98e0cdf HTTP/1.1" 200 None 2026-05-11 12:41:53,766 - lava_callback - ERROR - Error processing callback for node 69ff2b8e254d3291e98e0cdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:42:33,734 - lava_callback - INFO - Received callback for node 69ff2bb3254d3291e98e0cef INFO: 172.21.0.1:35822 - "POST /node/69ff2bb3254d3291e98e0cef HTTP/1.0" 202 Accepted 2026-05-11 12:42:33,740 - lava_callback - INFO - Starting async job submit for node 69ff2bb3254d3291e98e0cef 2026-05-11 12:42:33,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:42:33,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2bb3254d3291e98e0cef HTTP/1.1" 200 None 2026-05-11 12:42:33,755 - lava_callback - DEBUG - Processing node 69ff2bb3254d3291e98e0cef: baseline-arm-baylibre 2026-05-11 12:42:33,756 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2bb3254d3291e98e0cef 2026-05-11 12:42:33,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:42:33,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2bb3254d3291e98e0cef HTTP/1.1" 200 None 2026-05-11 12:42:33,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:42:33,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cdcef513bcf3f028109 HTTP/1.1" 200 None 2026-05-11 12:42:33,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:42:33,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2bb3254d3291e98e0cef HTTP/1.1" 200 None 2026-05-11 12:42:33,801 - lava_callback - ERROR - Error processing callback for node 69ff2bb3254d3291e98e0cef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:43:13,821 - lava_callback - INFO - Received callback for node 69ff2bd8254d3291e98e0cff INFO: 172.21.0.1:37264 - "POST /node/69ff2bd8254d3291e98e0cff HTTP/1.0" 202 Accepted 2026-05-11 12:43:13,827 - lava_callback - INFO - Starting async job submit for node 69ff2bd8254d3291e98e0cff 2026-05-11 12:43:13,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:43:13,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2bd8254d3291e98e0cff HTTP/1.1" 200 None 2026-05-11 12:43:13,849 - lava_callback - DEBUG - Processing node 69ff2bd8254d3291e98e0cff: baseline-arm-baylibre 2026-05-11 12:43:13,849 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2bd8254d3291e98e0cff 2026-05-11 12:43:13,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:43:13,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2bd8254d3291e98e0cff HTTP/1.1" 200 None 2026-05-11 12:43:13,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:43:13,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cdcef513bcf3f028109 HTTP/1.1" 200 None 2026-05-11 12:43:13,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:43:13,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2bd8254d3291e98e0cff HTTP/1.1" 200 None 2026-05-11 12:43:13,915 - lava_callback - ERROR - Error processing callback for node 69ff2bd8254d3291e98e0cff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:43:53,814 - lava_callback - INFO - Received callback for node 69ff2bfc254d3291e98e0d0c INFO: 172.21.0.1:48984 - "POST /node/69ff2bfc254d3291e98e0d0c HTTP/1.0" 202 Accepted 2026-05-11 12:43:53,819 - lava_callback - INFO - Starting async job submit for node 69ff2bfc254d3291e98e0d0c 2026-05-11 12:43:53,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:43:53,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2bfc254d3291e98e0d0c HTTP/1.1" 200 None 2026-05-11 12:43:53,834 - lava_callback - DEBUG - Processing node 69ff2bfc254d3291e98e0d0c: baseline-arm-baylibre 2026-05-11 12:43:53,835 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2bfc254d3291e98e0d0c 2026-05-11 12:43:53,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:43:53,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2bfc254d3291e98e0d0c HTTP/1.1" 200 None 2026-05-11 12:43:53,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:43:53,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:43:53,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:43:53,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2bfc254d3291e98e0d0c HTTP/1.1" 200 None 2026-05-11 12:43:53,888 - lava_callback - ERROR - Error processing callback for node 69ff2bfc254d3291e98e0d0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43082 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:44:33,947 - lava_callback - INFO - Received callback for node 69ff2c21254d3291e98e0d1e INFO: 172.21.0.1:39566 - "POST /node/69ff2c21254d3291e98e0d1e HTTP/1.0" 202 Accepted 2026-05-11 12:44:33,952 - lava_callback - INFO - Starting async job submit for node 69ff2c21254d3291e98e0d1e 2026-05-11 12:44:33,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:44:33,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2c21254d3291e98e0d1e HTTP/1.1" 200 None 2026-05-11 12:44:33,967 - lava_callback - DEBUG - Processing node 69ff2c21254d3291e98e0d1e: baseline-arm-baylibre 2026-05-11 12:44:33,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2c21254d3291e98e0d1e 2026-05-11 12:44:33,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:44:33,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2c21254d3291e98e0d1e HTTP/1.1" 200 None 2026-05-11 12:44:33,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:44:34,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:44:34,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:44:34,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2c21254d3291e98e0d1e HTTP/1.1" 200 None 2026-05-11 12:44:34,026 - lava_callback - ERROR - Error processing callback for node 69ff2c21254d3291e98e0d1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:45:13,907 - lava_callback - INFO - Received callback for node 69ff2c46254d3291e98e0d2b INFO: 172.21.0.1:55986 - "POST /node/69ff2c46254d3291e98e0d2b HTTP/1.0" 202 Accepted 2026-05-11 12:45:13,912 - lava_callback - INFO - Starting async job submit for node 69ff2c46254d3291e98e0d2b 2026-05-11 12:45:13,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:45:13,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2c46254d3291e98e0d2b HTTP/1.1" 200 None 2026-05-11 12:45:13,928 - lava_callback - DEBUG - Processing node 69ff2c46254d3291e98e0d2b: baseline-arm-baylibre 2026-05-11 12:45:13,929 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2c46254d3291e98e0d2b 2026-05-11 12:45:13,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:45:13,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2c46254d3291e98e0d2b HTTP/1.1" 200 None 2026-05-11 12:45:13,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:45:13,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cdcef513bcf3f028109 HTTP/1.1" 200 None 2026-05-11 12:45:13,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:45:13,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2c46254d3291e98e0d2b HTTP/1.1" 200 None 2026-05-11 12:45:13,989 - lava_callback - ERROR - Error processing callback for node 69ff2c46254d3291e98e0d2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47528 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:45:33,933 - lava_callback - INFO - Received callback for node 69ff2c68254d3291e98e0d3b INFO: 172.21.0.1:33710 - "POST /node/69ff2c68254d3291e98e0d3b HTTP/1.0" 202 Accepted 2026-05-11 12:45:33,939 - lava_callback - INFO - Starting async job submit for node 69ff2c68254d3291e98e0d3b 2026-05-11 12:45:33,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:45:33,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2c68254d3291e98e0d3b HTTP/1.1" 200 None 2026-05-11 12:45:33,954 - lava_callback - DEBUG - Processing node 69ff2c68254d3291e98e0d3b: baseline-arm-baylibre 2026-05-11 12:45:33,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2c68254d3291e98e0d3b 2026-05-11 12:45:33,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:45:33,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2c68254d3291e98e0d3b HTTP/1.1" 200 None 2026-05-11 12:45:33,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:45:33,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:45:33,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:45:34,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2c68254d3291e98e0d3b HTTP/1.1" 200 None 2026-05-11 12:45:34,015 - lava_callback - ERROR - Error processing callback for node 69ff2c68254d3291e98e0d3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:46:14,003 - lava_callback - INFO - Received callback for node 69ff2c8e254d3291e98e0d4a INFO: 172.21.0.1:36698 - "POST /node/69ff2c8e254d3291e98e0d4a HTTP/1.0" 202 Accepted 2026-05-11 12:46:14,008 - lava_callback - INFO - Starting async job submit for node 69ff2c8e254d3291e98e0d4a 2026-05-11 12:46:14,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:46:14,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2c8e254d3291e98e0d4a HTTP/1.1" 200 None 2026-05-11 12:46:14,025 - lava_callback - DEBUG - Processing node 69ff2c8e254d3291e98e0d4a: baseline-arm-baylibre 2026-05-11 12:46:14,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2c8e254d3291e98e0d4a 2026-05-11 12:46:14,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:46:14,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2c8e254d3291e98e0d4a HTTP/1.1" 200 None 2026-05-11 12:46:14,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:46:14,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cdcef513bcf3f028109 HTTP/1.1" 200 None 2026-05-11 12:46:14,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:46:14,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2c8e254d3291e98e0d4a HTTP/1.1" 200 None 2026-05-11 12:46:14,079 - lava_callback - ERROR - Error processing callback for node 69ff2c8e254d3291e98e0d4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54918 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:47:34,078 - lava_callback - INFO - Received callback for node 69ff2cd5254d3291e98e0d6c INFO: 172.21.0.1:56066 - "POST /node/69ff2cd5254d3291e98e0d6c HTTP/1.0" 202 Accepted 2026-05-11 12:47:34,083 - lava_callback - INFO - Starting async job submit for node 69ff2cd5254d3291e98e0d6c 2026-05-11 12:47:34,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:47:34,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2cd5254d3291e98e0d6c HTTP/1.1" 200 None 2026-05-11 12:47:34,099 - lava_callback - DEBUG - Processing node 69ff2cd5254d3291e98e0d6c: baseline-arm-baylibre 2026-05-11 12:47:34,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2cd5254d3291e98e0d6c 2026-05-11 12:47:34,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:47:34,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2cd5254d3291e98e0d6c HTTP/1.1" 200 None 2026-05-11 12:47:34,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:47:34,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:47:34,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:47:34,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2cd5254d3291e98e0d6c HTTP/1.1" 200 None 2026-05-11 12:47:34,147 - lava_callback - ERROR - Error processing callback for node 69ff2cd5254d3291e98e0d6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57564 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:48:34,074 - lava_callback - INFO - Received callback for node 69ff2d1f254d3291e98e0d8d INFO: 172.21.0.1:43010 - "POST /node/69ff2d1f254d3291e98e0d8d HTTP/1.0" 202 Accepted 2026-05-11 12:48:34,079 - lava_callback - INFO - Starting async job submit for node 69ff2d1f254d3291e98e0d8d 2026-05-11 12:48:34,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:48:34,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2d1f254d3291e98e0d8d HTTP/1.1" 200 None 2026-05-11 12:48:34,094 - lava_callback - DEBUG - Processing node 69ff2d1f254d3291e98e0d8d: baseline-arm-baylibre 2026-05-11 12:48:34,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2d1f254d3291e98e0d8d 2026-05-11 12:48:34,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:48:34,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2d1f254d3291e98e0d8d HTTP/1.1" 200 None 2026-05-11 12:48:34,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:48:34,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:48:34,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:48:34,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2d1f254d3291e98e0d8d HTTP/1.1" 200 None 2026-05-11 12:48:34,150 - lava_callback - ERROR - Error processing callback for node 69ff2d1f254d3291e98e0d8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60588 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:49:19,524 - lava_callback - INFO - Received callback for node 69ff2d45254d3291e98e0d9c INFO: 172.21.0.1:60590 - "POST /node/69ff2d45254d3291e98e0d9c HTTP/1.0" 202 Accepted 2026-05-11 12:49:19,536 - lava_callback - INFO - Starting async job submit for node 69ff2d45254d3291e98e0d9c 2026-05-11 12:49:19,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:49:19,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2d45254d3291e98e0d9c HTTP/1.1" 200 None 2026-05-11 12:49:19,563 - lava_callback - DEBUG - Processing node 69ff2d45254d3291e98e0d9c: baseline-arm-clabbe 2026-05-11 12:49:19,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2d45254d3291e98e0d9c 2026-05-11 12:49:19,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:49:19,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2d45254d3291e98e0d9c HTTP/1.1" 200 None 2026-05-11 12:49:19,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:49:19,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cdcef513bcf3f028109 HTTP/1.1" 200 None 2026-05-11 12:49:19,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:49:19,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2d45254d3291e98e0d9c HTTP/1.1" 200 None 2026-05-11 12:49:19,628 - lava_callback - ERROR - Error processing callback for node 69ff2d45254d3291e98e0d9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:49:59,463 - lava_callback - INFO - Received callback for node 69ff2d6b254d3291e98e0db1 INFO: 172.21.0.1:56426 - "POST /node/69ff2d6b254d3291e98e0db1 HTTP/1.0" 202 Accepted 2026-05-11 12:49:59,469 - lava_callback - INFO - Starting async job submit for node 69ff2d6b254d3291e98e0db1 2026-05-11 12:49:59,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:49:59,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2d6b254d3291e98e0db1 HTTP/1.1" 200 None 2026-05-11 12:49:59,484 - lava_callback - DEBUG - Processing node 69ff2d6b254d3291e98e0db1: baseline-arm-clabbe 2026-05-11 12:49:59,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2d6b254d3291e98e0db1 2026-05-11 12:49:59,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:49:59,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2d6b254d3291e98e0db1 HTTP/1.1" 200 None 2026-05-11 12:49:59,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:49:59,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cdcef513bcf3f028109 HTTP/1.1" 200 None 2026-05-11 12:49:59,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:49:59,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2d6b254d3291e98e0db1 HTTP/1.1" 200 None 2026-05-11 12:49:59,530 - lava_callback - ERROR - Error processing callback for node 69ff2d6b254d3291e98e0db1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:50:34,203 - lava_callback - INFO - Received callback for node 69ff2d8f254d3291e98e0dc3 INFO: 172.21.0.1:35884 - "POST /node/69ff2d8f254d3291e98e0dc3 HTTP/1.0" 202 Accepted 2026-05-11 12:50:34,209 - lava_callback - INFO - Starting async job submit for node 69ff2d8f254d3291e98e0dc3 2026-05-11 12:50:34,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:50:34,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2d8f254d3291e98e0dc3 HTTP/1.1" 200 None 2026-05-11 12:50:34,231 - lava_callback - DEBUG - Processing node 69ff2d8f254d3291e98e0dc3: baseline-arm-baylibre 2026-05-11 12:50:34,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2d8f254d3291e98e0dc3 2026-05-11 12:50:34,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:50:34,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2d8f254d3291e98e0dc3 HTTP/1.1" 200 None 2026-05-11 12:50:34,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:50:34,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:50:34,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:50:34,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2d8f254d3291e98e0dc3 HTTP/1.1" 200 None 2026-05-11 12:50:34,294 - lava_callback - ERROR - Error processing callback for node 69ff2d8f254d3291e98e0dc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:51:19,555 - lava_callback - INFO - Received callback for node 69ff2db6254d3291e98e0dd9 INFO: 172.21.0.1:59654 - "POST /node/69ff2db6254d3291e98e0dd9 HTTP/1.0" 202 Accepted 2026-05-11 12:51:19,560 - lava_callback - INFO - Starting async job submit for node 69ff2db6254d3291e98e0dd9 2026-05-11 12:51:19,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:51:19,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2db6254d3291e98e0dd9 HTTP/1.1" 200 None 2026-05-11 12:51:19,575 - lava_callback - DEBUG - Processing node 69ff2db6254d3291e98e0dd9: baseline-arm-clabbe 2026-05-11 12:51:19,576 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2db6254d3291e98e0dd9 2026-05-11 12:51:19,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:51:19,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2db6254d3291e98e0dd9 HTTP/1.1" 200 None 2026-05-11 12:51:19,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:51:19,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cdcef513bcf3f028109 HTTP/1.1" 200 None 2026-05-11 12:51:19,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:51:19,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2db6254d3291e98e0dd9 HTTP/1.1" 200 None 2026-05-11 12:51:19,636 - lava_callback - ERROR - Error processing callback for node 69ff2db6254d3291e98e0dd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:51:59,536 - lava_callback - INFO - Received callback for node 69ff2ddc254d3291e98e0de8 INFO: 172.21.0.1:50840 - "POST /node/69ff2ddc254d3291e98e0de8 HTTP/1.0" 202 Accepted 2026-05-11 12:51:59,541 - lava_callback - INFO - Starting async job submit for node 69ff2ddc254d3291e98e0de8 2026-05-11 12:51:59,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:51:59,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2ddc254d3291e98e0de8 HTTP/1.1" 200 None 2026-05-11 12:51:59,556 - lava_callback - DEBUG - Processing node 69ff2ddc254d3291e98e0de8: baseline-arm-clabbe 2026-05-11 12:51:59,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2ddc254d3291e98e0de8 2026-05-11 12:51:59,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:51:59,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2ddc254d3291e98e0de8 HTTP/1.1" 200 None 2026-05-11 12:51:59,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:51:59,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:51:59,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:51:59,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2ddc254d3291e98e0de8 HTTP/1.1" 200 None 2026-05-11 12:51:59,604 - lava_callback - ERROR - Error processing callback for node 69ff2ddc254d3291e98e0de8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:52:19,674 - lava_callback - INFO - Received callback for node 69ff2e01254d3291e98e0dfa INFO: 172.21.0.1:50060 - "POST /node/69ff2e01254d3291e98e0dfa HTTP/1.0" 202 Accepted 2026-05-11 12:52:19,679 - lava_callback - INFO - Starting async job submit for node 69ff2e01254d3291e98e0dfa 2026-05-11 12:52:19,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:52:19,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2e01254d3291e98e0dfa HTTP/1.1" 200 None 2026-05-11 12:52:19,694 - lava_callback - DEBUG - Processing node 69ff2e01254d3291e98e0dfa: baseline-arm-clabbe 2026-05-11 12:52:19,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2e01254d3291e98e0dfa 2026-05-11 12:52:19,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:52:19,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2e01254d3291e98e0dfa HTTP/1.1" 200 None 2026-05-11 12:52:19,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:52:19,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cdcef513bcf3f028109 HTTP/1.1" 200 None 2026-05-11 12:52:19,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:52:19,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2e01254d3291e98e0dfa HTTP/1.1" 200 None 2026-05-11 12:52:19,744 - lava_callback - ERROR - Error processing callback for node 69ff2e01254d3291e98e0dfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:52:59,601 - lava_callback - INFO - Received callback for node 69ff2e25254d3291e98e0e0c INFO: 172.21.0.1:57296 - "POST /node/69ff2e25254d3291e98e0e0c HTTP/1.0" 202 Accepted 2026-05-11 12:52:59,607 - lava_callback - INFO - Starting async job submit for node 69ff2e25254d3291e98e0e0c 2026-05-11 12:52:59,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:52:59,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2e25254d3291e98e0e0c HTTP/1.1" 200 None 2026-05-11 12:52:59,622 - lava_callback - DEBUG - Processing node 69ff2e25254d3291e98e0e0c: baseline-arm-clabbe 2026-05-11 12:52:59,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2e25254d3291e98e0e0c 2026-05-11 12:52:59,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:52:59,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2e25254d3291e98e0e0c HTTP/1.1" 200 None 2026-05-11 12:52:59,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:52:59,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cdcef513bcf3f028109 HTTP/1.1" 200 None 2026-05-11 12:52:59,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:52:59,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2e25254d3291e98e0e0c HTTP/1.1" 200 None 2026-05-11 12:52:59,686 - lava_callback - ERROR - Error processing callback for node 69ff2e25254d3291e98e0e0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51640 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:53:39,648 - lava_callback - INFO - Received callback for node 69ff2e4a254d3291e98e0e23 INFO: 172.21.0.1:51646 - "POST /node/69ff2e4a254d3291e98e0e23 HTTP/1.0" 202 Accepted 2026-05-11 12:53:39,658 - lava_callback - INFO - Starting async job submit for node 69ff2e4a254d3291e98e0e23 2026-05-11 12:53:39,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:53:39,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2e4a254d3291e98e0e23 HTTP/1.1" 200 None 2026-05-11 12:53:39,673 - lava_callback - DEBUG - Processing node 69ff2e4a254d3291e98e0e23: baseline-arm-clabbe 2026-05-11 12:53:39,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2e4a254d3291e98e0e23 2026-05-11 12:53:39,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:53:39,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2e4a254d3291e98e0e23 HTTP/1.1" 200 None 2026-05-11 12:53:39,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:53:39,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cdcef513bcf3f028109 HTTP/1.1" 200 None 2026-05-11 12:53:39,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:53:39,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2e4a254d3291e98e0e23 HTTP/1.1" 200 None 2026-05-11 12:53:39,720 - lava_callback - ERROR - Error processing callback for node 69ff2e4a254d3291e98e0e23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:54:19,651 - lava_callback - INFO - Received callback for node 69ff2e71254d3291e98e0e33 INFO: 172.21.0.1:54720 - "POST /node/69ff2e71254d3291e98e0e33 HTTP/1.0" 202 Accepted 2026-05-11 12:54:19,656 - lava_callback - INFO - Starting async job submit for node 69ff2e71254d3291e98e0e33 2026-05-11 12:54:19,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:54:19,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2e71254d3291e98e0e33 HTTP/1.1" 200 None 2026-05-11 12:54:19,672 - lava_callback - DEBUG - Processing node 69ff2e71254d3291e98e0e33: baseline-arm-clabbe 2026-05-11 12:54:19,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2e71254d3291e98e0e33 2026-05-11 12:54:19,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:54:19,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2e71254d3291e98e0e33 HTTP/1.1" 200 None 2026-05-11 12:54:19,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:54:19,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:54:19,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:54:19,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2e71254d3291e98e0e33 HTTP/1.1" 200 None 2026-05-11 12:54:19,722 - lava_callback - ERROR - Error processing callback for node 69ff2e71254d3291e98e0e33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39850 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:54:59,749 - lava_callback - INFO - Received callback for node 69ff2e96254d3291e98e0e49 INFO: 172.21.0.1:51050 - "POST /node/69ff2e96254d3291e98e0e49 HTTP/1.0" 202 Accepted 2026-05-11 12:54:59,755 - lava_callback - INFO - Starting async job submit for node 69ff2e96254d3291e98e0e49 2026-05-11 12:54:59,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:54:59,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2e96254d3291e98e0e49 HTTP/1.1" 200 None 2026-05-11 12:54:59,773 - lava_callback - DEBUG - Processing node 69ff2e96254d3291e98e0e49: baseline-arm-clabbe 2026-05-11 12:54:59,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2e96254d3291e98e0e49 2026-05-11 12:54:59,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:54:59,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2e96254d3291e98e0e49 HTTP/1.1" 200 None 2026-05-11 12:54:59,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:54:59,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:54:59,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:54:59,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2e96254d3291e98e0e49 HTTP/1.1" 200 None 2026-05-11 12:54:59,827 - lava_callback - ERROR - Error processing callback for node 69ff2e96254d3291e98e0e49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34066 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:55:34,574 - lava_callback - INFO - Received callback for node 69ff2eb6254d3291e98e0e5b INFO: 172.21.0.1:50736 - "POST /node/69ff2eb6254d3291e98e0e5b HTTP/1.0" 202 Accepted 2026-05-11 12:55:34,579 - lava_callback - INFO - Starting async job submit for node 69ff2eb6254d3291e98e0e5b 2026-05-11 12:55:34,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:55:34,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2eb6254d3291e98e0e5b HTTP/1.1" 200 None 2026-05-11 12:55:34,595 - lava_callback - DEBUG - Processing node 69ff2eb6254d3291e98e0e5b: baseline-arm-baylibre 2026-05-11 12:55:34,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2eb6254d3291e98e0e5b 2026-05-11 12:55:34,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:55:34,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2eb6254d3291e98e0e5b HTTP/1.1" 200 None 2026-05-11 12:55:34,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:55:34,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:55:34,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:55:34,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2eb6254d3291e98e0e5b HTTP/1.1" 200 None 2026-05-11 12:55:34,667 - lava_callback - ERROR - Error processing callback for node 69ff2eb6254d3291e98e0e5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:56:19,769 - lava_callback - INFO - Received callback for node 69ff2ede254d3291e98e0e6c INFO: 172.21.0.1:36674 - "POST /node/69ff2ede254d3291e98e0e6c HTTP/1.0" 202 Accepted 2026-05-11 12:56:19,775 - lava_callback - INFO - Starting async job submit for node 69ff2ede254d3291e98e0e6c 2026-05-11 12:56:19,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:56:19,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2ede254d3291e98e0e6c HTTP/1.1" 200 None 2026-05-11 12:56:19,799 - lava_callback - DEBUG - Processing node 69ff2ede254d3291e98e0e6c: baseline-arm-clabbe 2026-05-11 12:56:19,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2ede254d3291e98e0e6c 2026-05-11 12:56:19,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:56:19,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2ede254d3291e98e0e6c HTTP/1.1" 200 None 2026-05-11 12:56:19,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:56:19,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:56:19,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:56:19,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2ede254d3291e98e0e6c HTTP/1.1" 200 None 2026-05-11 12:56:19,844 - lava_callback - ERROR - Error processing callback for node 69ff2ede254d3291e98e0e6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:56:34,488 - lava_callback - INFO - Received callback for node 69ff2efe254d3291e98e0e7f INFO: 172.21.0.1:45386 - "POST /node/69ff2efe254d3291e98e0e7f HTTP/1.0" 202 Accepted 2026-05-11 12:56:34,493 - lava_callback - INFO - Starting async job submit for node 69ff2efe254d3291e98e0e7f 2026-05-11 12:56:34,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:56:34,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2efe254d3291e98e0e7f HTTP/1.1" 200 None 2026-05-11 12:56:34,517 - lava_callback - DEBUG - Processing node 69ff2efe254d3291e98e0e7f: baseline-arm-baylibre 2026-05-11 12:56:34,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2efe254d3291e98e0e7f 2026-05-11 12:56:34,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:56:34,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2efe254d3291e98e0e7f HTTP/1.1" 200 None 2026-05-11 12:56:34,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:56:34,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:56:34,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:56:34,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2efe254d3291e98e0e7f HTTP/1.1" 200 None 2026-05-11 12:56:34,580 - lava_callback - ERROR - Error processing callback for node 69ff2efe254d3291e98e0e7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:57:19,879 - lava_callback - INFO - Received callback for node 69ff2f27254d3291e98e0e8f INFO: 172.21.0.1:38394 - "POST /node/69ff2f27254d3291e98e0e8f HTTP/1.0" 202 Accepted 2026-05-11 12:57:19,885 - lava_callback - INFO - Starting async job submit for node 69ff2f27254d3291e98e0e8f 2026-05-11 12:57:19,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:57:19,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2f27254d3291e98e0e8f HTTP/1.1" 200 None 2026-05-11 12:57:19,907 - lava_callback - DEBUG - Processing node 69ff2f27254d3291e98e0e8f: baseline-arm-clabbe 2026-05-11 12:57:19,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2f27254d3291e98e0e8f 2026-05-11 12:57:19,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:57:19,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2f27254d3291e98e0e8f HTTP/1.1" 200 None 2026-05-11 12:57:19,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:57:19,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:57:19,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:57:19,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2f27254d3291e98e0e8f HTTP/1.1" 200 None 2026-05-11 12:57:19,957 - lava_callback - ERROR - Error processing callback for node 69ff2f27254d3291e98e0e8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44712 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:57:59,805 - lava_callback - INFO - Received callback for node 69ff2f4c254d3291e98e0ea4 INFO: 172.21.0.1:57068 - "POST /node/69ff2f4c254d3291e98e0ea4 HTTP/1.0" 202 Accepted 2026-05-11 12:57:59,812 - lava_callback - INFO - Starting async job submit for node 69ff2f4c254d3291e98e0ea4 2026-05-11 12:57:59,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:57:59,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2f4c254d3291e98e0ea4 HTTP/1.1" 200 None 2026-05-11 12:57:59,826 - lava_callback - DEBUG - Processing node 69ff2f4c254d3291e98e0ea4: baseline-arm-clabbe 2026-05-11 12:57:59,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2f4c254d3291e98e0ea4 2026-05-11 12:57:59,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:57:59,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2f4c254d3291e98e0ea4 HTTP/1.1" 200 None 2026-05-11 12:57:59,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:57:59,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:57:59,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:57:59,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2f4c254d3291e98e0ea4 HTTP/1.1" 200 None 2026-05-11 12:57:59,871 - lava_callback - ERROR - Error processing callback for node 69ff2f4c254d3291e98e0ea4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44326 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:58:34,772 - lava_callback - INFO - Received callback for node 69ff2f6e254d3291e98e0eb2 INFO: 172.21.0.1:39050 - "POST /node/69ff2f6e254d3291e98e0eb2 HTTP/1.0" 202 Accepted 2026-05-11 12:58:34,778 - lava_callback - INFO - Starting async job submit for node 69ff2f6e254d3291e98e0eb2 2026-05-11 12:58:34,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:58:34,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2f6e254d3291e98e0eb2 HTTP/1.1" 200 None 2026-05-11 12:58:34,800 - lava_callback - DEBUG - Processing node 69ff2f6e254d3291e98e0eb2: baseline-arm-baylibre 2026-05-11 12:58:34,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2f6e254d3291e98e0eb2 2026-05-11 12:58:34,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:58:34,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2f6e254d3291e98e0eb2 HTTP/1.1" 200 None 2026-05-11 12:58:34,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:58:34,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:58:34,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:58:34,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2f6e254d3291e98e0eb2 HTTP/1.1" 200 None 2026-05-11 12:58:34,845 - lava_callback - ERROR - Error processing callback for node 69ff2f6e254d3291e98e0eb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33794 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:59:14,674 - lava_callback - INFO - Received callback for node 69ff2f93254d3291e98e0ebf INFO: 172.21.0.1:59638 - "POST /node/69ff2f93254d3291e98e0ebf HTTP/1.0" 202 Accepted 2026-05-11 12:59:14,679 - lava_callback - INFO - Starting async job submit for node 69ff2f93254d3291e98e0ebf 2026-05-11 12:59:14,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:59:14,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2f93254d3291e98e0ebf HTTP/1.1" 200 None 2026-05-11 12:59:14,696 - lava_callback - DEBUG - Processing node 69ff2f93254d3291e98e0ebf: baseline-arm-baylibre 2026-05-11 12:59:14,696 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2f93254d3291e98e0ebf 2026-05-11 12:59:14,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:59:14,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2f93254d3291e98e0ebf HTTP/1.1" 200 None 2026-05-11 12:59:14,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:59:14,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:59:14,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:59:14,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2f93254d3291e98e0ebf HTTP/1.1" 200 None 2026-05-11 12:59:14,740 - lava_callback - ERROR - Error processing callback for node 69ff2f93254d3291e98e0ebf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60088 - "GET / HTTP/1.0" 200 OK 2026-05-11 12:59:54,892 - lava_callback - INFO - Received callback for node 69ff2fb9254d3291e98e0ed5 INFO: 172.21.0.1:60092 - "POST /node/69ff2fb9254d3291e98e0ed5 HTTP/1.0" 202 Accepted 2026-05-11 12:59:54,898 - lava_callback - INFO - Starting async job submit for node 69ff2fb9254d3291e98e0ed5 2026-05-11 12:59:54,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:59:54,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2fb9254d3291e98e0ed5 HTTP/1.1" 200 None 2026-05-11 12:59:54,914 - lava_callback - DEBUG - Processing node 69ff2fb9254d3291e98e0ed5: baseline-arm-baylibre 2026-05-11 12:59:54,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff2fb9254d3291e98e0ed5 2026-05-11 12:59:54,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:59:54,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff2fb9254d3291e98e0ed5 HTTP/1.1" 200 None 2026-05-11 12:59:54,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:59:54,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 12:59:54,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 12:59:54,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff2fb9254d3291e98e0ed5 HTTP/1.1" 200 None 2026-05-11 12:59:54,962 - lava_callback - ERROR - Error processing callback for node 69ff2fb9254d3291e98e0ed5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60742 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:00:59,956 - lava_callback - INFO - Received callback for node 69ff3004254d3291e98e0ef3 INFO: 172.21.0.1:55200 - "POST /node/69ff3004254d3291e98e0ef3 HTTP/1.0" 202 Accepted 2026-05-11 13:00:59,962 - lava_callback - INFO - Starting async job submit for node 69ff3004254d3291e98e0ef3 2026-05-11 13:00:59,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:00:59,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3004254d3291e98e0ef3 HTTP/1.1" 200 None 2026-05-11 13:00:59,992 - lava_callback - DEBUG - Processing node 69ff3004254d3291e98e0ef3: baseline-arm-clabbe 2026-05-11 13:00:59,992 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3004254d3291e98e0ef3 2026-05-11 13:00:59,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:01:00,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3004254d3291e98e0ef3 HTTP/1.1" 200 None 2026-05-11 13:01:00,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:01:00,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:01:00,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:01:00,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3004254d3291e98e0ef3 HTTP/1.1" 200 None 2026-05-11 13:01:00,052 - lava_callback - ERROR - Error processing callback for node 69ff3004254d3291e98e0ef3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:01:39,939 - lava_callback - INFO - Received callback for node 69ff302b254d3291e98e0f06 INFO: 172.21.0.1:41462 - "POST /node/69ff302b254d3291e98e0f06 HTTP/1.0" 202 Accepted 2026-05-11 13:01:39,944 - lava_callback - INFO - Starting async job submit for node 69ff302b254d3291e98e0f06 2026-05-11 13:01:39,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:01:39,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff302b254d3291e98e0f06 HTTP/1.1" 200 None 2026-05-11 13:01:39,960 - lava_callback - DEBUG - Processing node 69ff302b254d3291e98e0f06: baseline-arm-clabbe 2026-05-11 13:01:39,960 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff302b254d3291e98e0f06 2026-05-11 13:01:39,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:01:39,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff302b254d3291e98e0f06 HTTP/1.1" 200 None 2026-05-11 13:01:39,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:01:39,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:01:39,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:01:40,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff302b254d3291e98e0f06 HTTP/1.1" 200 None 2026-05-11 13:01:40,005 - lava_callback - ERROR - Error processing callback for node 69ff302b254d3291e98e0f06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:02:14,892 - lava_callback - INFO - Received callback for node 69ff304c254d3291e98e0f16 INFO: 172.21.0.1:42968 - "POST /node/69ff304c254d3291e98e0f16 HTTP/1.0" 202 Accepted 2026-05-11 13:02:14,897 - lava_callback - INFO - Starting async job submit for node 69ff304c254d3291e98e0f16 2026-05-11 13:02:14,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:02:14,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff304c254d3291e98e0f16 HTTP/1.1" 200 None 2026-05-11 13:02:14,913 - lava_callback - DEBUG - Processing node 69ff304c254d3291e98e0f16: baseline-arm-baylibre 2026-05-11 13:02:14,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff304c254d3291e98e0f16 2026-05-11 13:02:14,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:02:14,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff304c254d3291e98e0f16 HTTP/1.1" 200 None 2026-05-11 13:02:14,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:02:14,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:02:14,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:02:14,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff304c254d3291e98e0f16 HTTP/1.1" 200 None 2026-05-11 13:02:14,981 - lava_callback - ERROR - Error processing callback for node 69ff304c254d3291e98e0f16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:07:00,255 - lava_callback - INFO - Received callback for node 69ff3171254d3291e98e0fb4 INFO: 172.21.0.1:33678 - "POST /node/69ff3171254d3291e98e0fb4 HTTP/1.0" 202 Accepted 2026-05-11 13:07:00,261 - lava_callback - INFO - Starting async job submit for node 69ff3171254d3291e98e0fb4 2026-05-11 13:07:00,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:07:00,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3171254d3291e98e0fb4 HTTP/1.1" 200 None 2026-05-11 13:07:00,277 - lava_callback - DEBUG - Processing node 69ff3171254d3291e98e0fb4: baseline-arm-clabbe 2026-05-11 13:07:00,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3171254d3291e98e0fb4 2026-05-11 13:07:00,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:07:00,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3171254d3291e98e0fb4 HTTP/1.1" 200 None 2026-05-11 13:07:00,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:07:00,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:07:00,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:07:00,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3171254d3291e98e0fb4 HTTP/1.1" 200 None 2026-05-11 13:07:00,363 - lava_callback - ERROR - Error processing callback for node 69ff3171254d3291e98e0fb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:07:40,160 - lava_callback - INFO - Received callback for node 69ff3197254d3291e98e0fd8 INFO: 172.21.0.1:45856 - "POST /node/69ff3197254d3291e98e0fd8 HTTP/1.0" 202 Accepted 2026-05-11 13:07:40,166 - lava_callback - INFO - Starting async job submit for node 69ff3197254d3291e98e0fd8 2026-05-11 13:07:40,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:07:40,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3197254d3291e98e0fd8 HTTP/1.1" 200 None 2026-05-11 13:07:40,188 - lava_callback - DEBUG - Processing node 69ff3197254d3291e98e0fd8: baseline-arm-clabbe 2026-05-11 13:07:40,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3197254d3291e98e0fd8 2026-05-11 13:07:40,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:07:40,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3197254d3291e98e0fd8 HTTP/1.1" 200 None 2026-05-11 13:07:40,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:07:40,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:07:40,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:07:40,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3197254d3291e98e0fd8 HTTP/1.1" 200 None 2026-05-11 13:07:40,238 - lava_callback - ERROR - Error processing callback for node 69ff3197254d3291e98e0fd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-11 13:19:16,130 - lava_callback - INFO - Received callback for node 69ff343f254d3291e98e1143 INFO: 172.21.0.1:51646 - "POST /node/69ff343f254d3291e98e1143 HTTP/1.0" 202 Accepted 2026-05-11 13:19:16,135 - lava_callback - INFO - Starting async job submit for node 69ff343f254d3291e98e1143 2026-05-11 13:19:16,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:19:16,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff343f254d3291e98e1143 HTTP/1.1" 200 None 2026-05-11 13:19:16,153 - lava_callback - DEBUG - Processing node 69ff343f254d3291e98e1143: baseline-arm64-baylibre 2026-05-11 13:19:16,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff343f254d3291e98e1143 2026-05-11 13:19:16,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:19:16,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff343f254d3291e98e1143 HTTP/1.1" 200 None 2026-05-11 13:19:16,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:19:16,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-11 13:19:16,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:19:16,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff343f254d3291e98e1143 HTTP/1.1" 200 None 2026-05-11 13:19:16,205 - lava_callback - ERROR - Error processing callback for node 69ff343f254d3291e98e1143: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49364 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:20:20,794 - lava_callback - INFO - Received callback for node 69ff348f254d3291e98e117d INFO: 172.21.0.1:56570 - "POST /node/69ff348f254d3291e98e117d HTTP/1.0" 202 Accepted 2026-05-11 13:20:20,800 - lava_callback - INFO - Starting async job submit for node 69ff348f254d3291e98e117d 2026-05-11 13:20:20,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:20:20,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff348f254d3291e98e117d HTTP/1.1" 200 None 2026-05-11 13:20:20,817 - lava_callback - DEBUG - Processing node 69ff348f254d3291e98e117d: baseline-arm64-clabbe 2026-05-11 13:20:20,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff348f254d3291e98e117d 2026-05-11 13:20:20,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:20:20,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff348f254d3291e98e117d HTTP/1.1" 200 None 2026-05-11 13:20:20,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:20:20,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-11 13:20:20,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:20:20,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff348f254d3291e98e117d HTTP/1.1" 200 None 2026-05-11 13:20:20,865 - lava_callback - ERROR - Error processing callback for node 69ff348f254d3291e98e117d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57484 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:21:40,771 - lava_callback - INFO - Received callback for node 69ff34da254d3291e98e11a3 INFO: 172.21.0.1:40598 - "POST /node/69ff34da254d3291e98e11a3 HTTP/1.0" 202 Accepted 2026-05-11 13:21:40,776 - lava_callback - INFO - Starting async job submit for node 69ff34da254d3291e98e11a3 2026-05-11 13:21:40,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:21:40,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff34da254d3291e98e11a3 HTTP/1.1" 200 None 2026-05-11 13:21:40,792 - lava_callback - DEBUG - Processing node 69ff34da254d3291e98e11a3: baseline-arm64-clabbe 2026-05-11 13:21:40,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff34da254d3291e98e11a3 2026-05-11 13:21:40,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:21:40,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff34da254d3291e98e11a3 HTTP/1.1" 200 None 2026-05-11 13:21:40,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:21:40,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-11 13:21:40,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:21:40,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff34da254d3291e98e11a3 HTTP/1.1" 200 None 2026-05-11 13:21:40,837 - lava_callback - ERROR - Error processing callback for node 69ff34da254d3291e98e11a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:23:00,939 - lava_callback - INFO - Received callback for node 69ff3525254d3291e98e11d5 INFO: 172.21.0.1:34978 - "POST /node/69ff3525254d3291e98e11d5 HTTP/1.0" 202 Accepted 2026-05-11 13:23:00,949 - lava_callback - INFO - Starting async job submit for node 69ff3525254d3291e98e11d5 2026-05-11 13:23:00,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:23:00,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3525254d3291e98e11d5 HTTP/1.1" 200 None 2026-05-11 13:23:00,981 - lava_callback - DEBUG - Processing node 69ff3525254d3291e98e11d5: baseline-arm64-clabbe 2026-05-11 13:23:00,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3525254d3291e98e11d5 2026-05-11 13:23:00,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:23:01,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3525254d3291e98e11d5 HTTP/1.1" 200 None 2026-05-11 13:23:01,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:23:01,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-11 13:23:01,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:23:01,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3525254d3291e98e11d5 HTTP/1.1" 200 None 2026-05-11 13:23:01,061 - lava_callback - ERROR - Error processing callback for node 69ff3525254d3291e98e11d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:25:20,950 - lava_callback - INFO - Received callback for node 69ff35bb254d3291e98e1235 INFO: 172.21.0.1:47696 - "POST /node/69ff35bb254d3291e98e1235 HTTP/1.0" 202 Accepted 2026-05-11 13:25:20,955 - lava_callback - INFO - Starting async job submit for node 69ff35bb254d3291e98e1235 2026-05-11 13:25:20,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:25:20,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff35bb254d3291e98e1235 HTTP/1.1" 200 None 2026-05-11 13:25:20,976 - lava_callback - DEBUG - Processing node 69ff35bb254d3291e98e1235: baseline-arm64-clabbe 2026-05-11 13:25:20,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff35bb254d3291e98e1235 2026-05-11 13:25:20,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:25:20,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff35bb254d3291e98e1235 HTTP/1.1" 200 None 2026-05-11 13:25:20,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:25:21,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-11 13:25:21,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:25:21,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff35bb254d3291e98e1235 HTTP/1.1" 200 None 2026-05-11 13:25:21,028 - lava_callback - ERROR - Error processing callback for node 69ff35bb254d3291e98e1235: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:26:20,967 - lava_callback - INFO - Received callback for node 69ff35f9254d3291e98e125c INFO: 172.21.0.1:37426 - "POST /node/69ff35f9254d3291e98e125c HTTP/1.0" 202 Accepted 2026-05-11 13:26:20,972 - lava_callback - INFO - Starting async job submit for node 69ff35f9254d3291e98e125c 2026-05-11 13:26:20,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:26:20,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff35f9254d3291e98e125c HTTP/1.1" 200 None 2026-05-11 13:26:20,990 - lava_callback - DEBUG - Processing node 69ff35f9254d3291e98e125c: baseline-arm-clabbe 2026-05-11 13:26:20,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff35f9254d3291e98e125c 2026-05-11 13:26:20,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:26:21,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff35f9254d3291e98e125c HTTP/1.1" 200 None 2026-05-11 13:26:21,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:26:21,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:26:21,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:26:21,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff35f9254d3291e98e125c HTTP/1.1" 200 None 2026-05-11 13:26:21,040 - lava_callback - ERROR - Error processing callback for node 69ff35f9254d3291e98e125c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:27:21,075 - lava_callback - INFO - Received callback for node 69ff362c254d3291e98e127c INFO: 172.21.0.1:34200 - "POST /node/69ff362c254d3291e98e127c HTTP/1.0" 202 Accepted 2026-05-11 13:27:21,081 - lava_callback - INFO - Starting async job submit for node 69ff362c254d3291e98e127c 2026-05-11 13:27:21,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:27:21,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff362c254d3291e98e127c HTTP/1.1" 200 None 2026-05-11 13:27:21,098 - lava_callback - DEBUG - Processing node 69ff362c254d3291e98e127c: baseline-arm64-clabbe 2026-05-11 13:27:21,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff362c254d3291e98e127c 2026-05-11 13:27:21,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:27:21,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff362c254d3291e98e127c HTTP/1.1" 200 None 2026-05-11 13:27:21,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:27:21,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-11 13:27:21,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:27:21,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff362c254d3291e98e127c HTTP/1.1" 200 None 2026-05-11 13:27:21,157 - lava_callback - ERROR - Error processing callback for node 69ff362c254d3291e98e127c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57480 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-11 13:28:16,277 - lava_callback - INFO - Received callback for node 69ff366e254d3291e98e12a4 INFO: 172.21.0.1:57496 - "POST /node/69ff366e254d3291e98e12a4 HTTP/1.0" 202 Accepted 2026-05-11 13:28:16,283 - lava_callback - INFO - Starting async job submit for node 69ff366e254d3291e98e12a4 2026-05-11 13:28:16,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:28:16,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff366e254d3291e98e12a4 HTTP/1.1" 200 None 2026-05-11 13:28:16,299 - lava_callback - DEBUG - Processing node 69ff366e254d3291e98e12a4: baseline-arm64-baylibre 2026-05-11 13:28:16,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff366e254d3291e98e12a4 2026-05-11 13:28:16,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:28:16,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff366e254d3291e98e12a4 HTTP/1.1" 200 None 2026-05-11 13:28:16,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:28:16,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 13:28:16,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:28:16,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff366e254d3291e98e12a4 HTTP/1.1" 200 None 2026-05-11 13:28:16,344 - lava_callback - ERROR - Error processing callback for node 69ff366e254d3291e98e12a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:29:41,314 - lava_callback - INFO - Received callback for node 69ff36c0254d3291e98e12e1 INFO: 172.21.0.1:44290 - "POST /node/69ff36c0254d3291e98e12e1 HTTP/1.0" 202 Accepted 2026-05-11 13:29:41,320 - lava_callback - INFO - Starting async job submit for node 69ff36c0254d3291e98e12e1 2026-05-11 13:29:41,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:29:41,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff36c0254d3291e98e12e1 HTTP/1.1" 200 None 2026-05-11 13:29:41,335 - lava_callback - DEBUG - Processing node 69ff36c0254d3291e98e12e1: baseline-arm64-clabbe 2026-05-11 13:29:41,335 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff36c0254d3291e98e12e1 2026-05-11 13:29:41,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:29:41,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff36c0254d3291e98e12e1 HTTP/1.1" 200 None 2026-05-11 13:29:41,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:29:41,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-11 13:29:41,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:29:41,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff36c0254d3291e98e12e1 HTTP/1.1" 200 None 2026-05-11 13:29:41,381 - lava_callback - ERROR - Error processing callback for node 69ff36c0254d3291e98e12e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42810 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:31:22,151 - lava_callback - INFO - Received callback for node 69ff3721254d3291e98e130d INFO: 172.21.0.1:34820 - "POST /node/69ff3721254d3291e98e130d HTTP/1.0" 202 Accepted 2026-05-11 13:31:22,156 - lava_callback - INFO - Starting async job submit for node 69ff3721254d3291e98e130d 2026-05-11 13:31:22,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:31:22,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3721254d3291e98e130d HTTP/1.1" 200 None 2026-05-11 13:31:22,172 - lava_callback - DEBUG - Processing node 69ff3721254d3291e98e130d: baseline-arm-clabbe 2026-05-11 13:31:22,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3721254d3291e98e130d 2026-05-11 13:31:22,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:31:22,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3721254d3291e98e130d HTTP/1.1" 200 None 2026-05-11 13:31:22,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:31:22,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:31:22,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:31:22,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3721254d3291e98e130d HTTP/1.1" 200 None 2026-05-11 13:31:22,233 - lava_callback - ERROR - Error processing callback for node 69ff3721254d3291e98e130d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:32:02,247 - lava_callback - INFO - Received callback for node 69ff3747254d3291e98e1327 INFO: 172.21.0.1:40048 - "POST /node/69ff3747254d3291e98e1327 HTTP/1.0" 202 Accepted 2026-05-11 13:32:02,253 - lava_callback - INFO - Starting async job submit for node 69ff3747254d3291e98e1327 2026-05-11 13:32:02,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:32:02,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3747254d3291e98e1327 HTTP/1.1" 200 None 2026-05-11 13:32:02,279 - lava_callback - DEBUG - Processing node 69ff3747254d3291e98e1327: baseline-arm-clabbe 2026-05-11 13:32:02,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3747254d3291e98e1327 2026-05-11 13:32:02,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:32:02,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3747254d3291e98e1327 HTTP/1.1" 200 None 2026-05-11 13:32:02,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:32:02,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:32:02,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:32:02,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3747254d3291e98e1327 HTTP/1.1" 200 None 2026-05-11 13:32:02,332 - lava_callback - ERROR - Error processing callback for node 69ff3747254d3291e98e1327: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:32:41,264 - lava_callback - INFO - Received callback for node 69ff376d254d3291e98e1339 INFO: 172.21.0.1:40278 - "POST /node/69ff376d254d3291e98e1339 HTTP/1.0" 202 Accepted 2026-05-11 13:32:41,274 - lava_callback - INFO - Starting async job submit for node 69ff376d254d3291e98e1339 2026-05-11 13:32:41,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:32:41,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff376d254d3291e98e1339 HTTP/1.1" 200 None 2026-05-11 13:32:41,291 - lava_callback - DEBUG - Processing node 69ff376d254d3291e98e1339: baseline-arm-clabbe 2026-05-11 13:32:41,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff376d254d3291e98e1339 2026-05-11 13:32:41,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:32:41,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff376d254d3291e98e1339 HTTP/1.1" 200 None 2026-05-11 13:32:41,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:32:41,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:32:41,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:32:41,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff376d254d3291e98e1339 HTTP/1.1" 200 None 2026-05-11 13:32:41,355 - lava_callback - ERROR - Error processing callback for node 69ff376d254d3291e98e1339: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34534 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:33:16,592 - lava_callback - INFO - Received callback for node 69ff3797254d3291e98e134a INFO: 172.21.0.1:34544 - "POST /node/69ff3797254d3291e98e134a HTTP/1.0" 202 Accepted 2026-05-11 13:33:16,598 - lava_callback - INFO - Starting async job submit for node 69ff3797254d3291e98e134a 2026-05-11 13:33:16,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:33:16,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3797254d3291e98e134a HTTP/1.1" 200 None 2026-05-11 13:33:16,614 - lava_callback - DEBUG - Processing node 69ff3797254d3291e98e134a: baseline-arm64-baylibre 2026-05-11 13:33:16,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3797254d3291e98e134a 2026-05-11 13:33:16,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:33:16,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3797254d3291e98e134a HTTP/1.1" 200 None 2026-05-11 13:33:16,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:33:16,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 13:33:16,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:33:16,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3797254d3291e98e134a HTTP/1.1" 200 None 2026-05-11 13:33:16,667 - lava_callback - ERROR - Error processing callback for node 69ff3797254d3291e98e134a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:34:41,343 - lava_callback - INFO - Received callback for node 69ff37db254d3291e98e1372 INFO: 172.21.0.1:50480 - "POST /node/69ff37db254d3291e98e1372 HTTP/1.0" 202 Accepted 2026-05-11 13:34:41,348 - lava_callback - INFO - Starting async job submit for node 69ff37db254d3291e98e1372 2026-05-11 13:34:41,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:34:41,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff37db254d3291e98e1372 HTTP/1.1" 200 None 2026-05-11 13:34:41,368 - lava_callback - DEBUG - Processing node 69ff37db254d3291e98e1372: baseline-arm-clabbe 2026-05-11 13:34:41,369 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff37db254d3291e98e1372 2026-05-11 13:34:41,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:34:41,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff37db254d3291e98e1372 HTTP/1.1" 200 None 2026-05-11 13:34:41,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:34:41,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:34:41,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:34:41,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff37db254d3291e98e1372 HTTP/1.1" 200 None 2026-05-11 13:34:41,415 - lava_callback - ERROR - Error processing callback for node 69ff37db254d3291e98e1372: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50230 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:35:16,699 - lava_callback - INFO - Received callback for node 69ff3806254d3291e98e1388 INFO: 172.21.0.1:50246 - "POST /node/69ff3806254d3291e98e1388 HTTP/1.0" 202 Accepted 2026-05-11 13:35:16,705 - lava_callback - INFO - Starting async job submit for node 69ff3806254d3291e98e1388 2026-05-11 13:35:16,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:35:16,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3806254d3291e98e1388 HTTP/1.1" 200 None 2026-05-11 13:35:16,725 - lava_callback - DEBUG - Processing node 69ff3806254d3291e98e1388: baseline-arm64-baylibre 2026-05-11 13:35:16,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3806254d3291e98e1388 2026-05-11 13:35:16,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:35:16,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3806254d3291e98e1388 HTTP/1.1" 200 None 2026-05-11 13:35:16,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:35:16,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 13:35:16,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:35:16,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3806254d3291e98e1388 HTTP/1.1" 200 None 2026-05-11 13:35:16,777 - lava_callback - ERROR - Error processing callback for node 69ff3806254d3291e98e1388: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:36:56,849 - lava_callback - INFO - Received callback for node 69ff3873254d3291e98e13c1 INFO: 172.21.0.1:57032 - "POST /node/69ff3873254d3291e98e13c1 HTTP/1.0" 202 Accepted 2026-05-11 13:36:56,855 - lava_callback - INFO - Starting async job submit for node 69ff3873254d3291e98e13c1 2026-05-11 13:36:56,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:36:56,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3873254d3291e98e13c1 HTTP/1.1" 200 None 2026-05-11 13:36:56,871 - lava_callback - DEBUG - Processing node 69ff3873254d3291e98e13c1: baseline-arm-baylibre 2026-05-11 13:36:56,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3873254d3291e98e13c1 2026-05-11 13:36:56,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:36:56,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3873254d3291e98e13c1 HTTP/1.1" 200 None 2026-05-11 13:36:56,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:36:56,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:36:56,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:36:56,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3873254d3291e98e13c1 HTTP/1.1" 200 None 2026-05-11 13:36:56,925 - lava_callback - ERROR - Error processing callback for node 69ff3873254d3291e98e13c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:38:01,438 - lava_callback - INFO - Received callback for node 69ff38a5254d3291e98e13d7 INFO: 172.21.0.1:46198 - "POST /node/69ff38a5254d3291e98e13d7 HTTP/1.0" 202 Accepted 2026-05-11 13:38:01,443 - lava_callback - INFO - Starting async job submit for node 69ff38a5254d3291e98e13d7 2026-05-11 13:38:01,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:38:01,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff38a5254d3291e98e13d7 HTTP/1.1" 200 None 2026-05-11 13:38:01,459 - lava_callback - DEBUG - Processing node 69ff38a5254d3291e98e13d7: baseline-arm-clabbe 2026-05-11 13:38:01,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff38a5254d3291e98e13d7 2026-05-11 13:38:01,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:38:01,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff38a5254d3291e98e13d7 HTTP/1.1" 200 None 2026-05-11 13:38:01,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:38:01,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:38:01,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:38:01,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff38a5254d3291e98e13d7 HTTP/1.1" 200 None 2026-05-11 13:38:01,503 - lava_callback - ERROR - Error processing callback for node 69ff38a5254d3291e98e13d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:38:37,020 - lava_callback - INFO - Received callback for node 69ff38d1254d3291e98e13e8 INFO: 172.21.0.1:38122 - "POST /node/69ff38d1254d3291e98e13e8 HTTP/1.0" 202 Accepted 2026-05-11 13:38:37,026 - lava_callback - INFO - Starting async job submit for node 69ff38d1254d3291e98e13e8 2026-05-11 13:38:37,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:38:37,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff38d1254d3291e98e13e8 HTTP/1.1" 200 None 2026-05-11 13:38:37,040 - lava_callback - DEBUG - Processing node 69ff38d1254d3291e98e13e8: baseline-arm64-baylibre 2026-05-11 13:38:37,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff38d1254d3291e98e13e8 2026-05-11 13:38:37,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:38:37,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff38d1254d3291e98e13e8 HTTP/1.1" 200 None 2026-05-11 13:38:37,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:38:37,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 13:38:37,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:38:37,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff38d1254d3291e98e13e8 HTTP/1.1" 200 None 2026-05-11 13:38:37,093 - lava_callback - ERROR - Error processing callback for node 69ff38d1254d3291e98e13e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:39:41,517 - lava_callback - INFO - Received callback for node 69ff3914254d3291e98e1410 INFO: 172.21.0.1:58266 - "POST /node/69ff3914254d3291e98e1410 HTTP/1.0" 202 Accepted 2026-05-11 13:39:41,523 - lava_callback - INFO - Starting async job submit for node 69ff3914254d3291e98e1410 2026-05-11 13:39:41,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:39:41,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3914254d3291e98e1410 HTTP/1.1" 200 None 2026-05-11 13:39:41,538 - lava_callback - DEBUG - Processing node 69ff3914254d3291e98e1410: baseline-arm-clabbe 2026-05-11 13:39:41,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3914254d3291e98e1410 2026-05-11 13:39:41,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:39:41,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3914254d3291e98e1410 HTTP/1.1" 200 None 2026-05-11 13:39:41,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:39:41,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:39:41,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:39:41,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3914254d3291e98e1410 HTTP/1.1" 200 None 2026-05-11 13:39:41,601 - lava_callback - ERROR - Error processing callback for node 69ff3914254d3291e98e1410: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:40:37,005 - lava_callback - INFO - Received callback for node 69ff3943254d3291e98e1428 INFO: 172.21.0.1:49302 - "POST /node/69ff3943254d3291e98e1428 HTTP/1.0" 202 Accepted 2026-05-11 13:40:37,011 - lava_callback - INFO - Starting async job submit for node 69ff3943254d3291e98e1428 2026-05-11 13:40:37,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:40:37,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3943254d3291e98e1428 HTTP/1.1" 200 None 2026-05-11 13:40:37,029 - lava_callback - DEBUG - Processing node 69ff3943254d3291e98e1428: baseline-arm64-baylibre 2026-05-11 13:40:37,030 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3943254d3291e98e1428 2026-05-11 13:40:37,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:40:37,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3943254d3291e98e1428 HTTP/1.1" 200 None 2026-05-11 13:40:37,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:40:37,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 13:40:37,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:40:37,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3943254d3291e98e1428 HTTP/1.1" 200 None 2026-05-11 13:40:37,088 - lava_callback - ERROR - Error processing callback for node 69ff3943254d3291e98e1428: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60418 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:41:41,580 - lava_callback - INFO - Received callback for node 69ff3985254d3291e98e144f INFO: 172.21.0.1:44806 - "POST /node/69ff3985254d3291e98e144f HTTP/1.0" 202 Accepted 2026-05-11 13:41:41,586 - lava_callback - INFO - Starting async job submit for node 69ff3985254d3291e98e144f 2026-05-11 13:41:41,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:41:41,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3985254d3291e98e144f HTTP/1.1" 200 None 2026-05-11 13:41:41,601 - lava_callback - DEBUG - Processing node 69ff3985254d3291e98e144f: baseline-arm-clabbe 2026-05-11 13:41:41,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3985254d3291e98e144f 2026-05-11 13:41:41,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:41:41,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3985254d3291e98e144f HTTP/1.1" 200 None 2026-05-11 13:41:41,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:41:41,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-11 13:41:41,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:41:41,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3985254d3291e98e144f HTTP/1.1" 200 None 2026-05-11 13:41:41,649 - lava_callback - ERROR - Error processing callback for node 69ff3985254d3291e98e144f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:42:21,558 - lava_callback - INFO - Received callback for node 69ff39b9254d3291e98e146e INFO: 172.21.0.1:38422 - "POST /node/69ff39b9254d3291e98e146e HTTP/1.0" 202 Accepted 2026-05-11 13:42:21,564 - lava_callback - INFO - Starting async job submit for node 69ff39b9254d3291e98e146e 2026-05-11 13:42:21,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:42:21,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff39b9254d3291e98e146e HTTP/1.1" 200 None 2026-05-11 13:42:21,583 - lava_callback - DEBUG - Processing node 69ff39b9254d3291e98e146e: baseline-arm64-clabbe 2026-05-11 13:42:21,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff39b9254d3291e98e146e 2026-05-11 13:42:21,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:42:21,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff39b9254d3291e98e146e HTTP/1.1" 200 None 2026-05-11 13:42:21,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:42:21,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 13:42:21,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:42:21,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff39b9254d3291e98e146e HTTP/1.1" 200 None 2026-05-11 13:42:21,643 - lava_callback - ERROR - Error processing callback for node 69ff39b9254d3291e98e146e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54124 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:43:41,651 - lava_callback - INFO - Received callback for node 69ff3a05254d3291e98e1493 INFO: 172.21.0.1:47448 - "POST /node/69ff3a05254d3291e98e1493 HTTP/1.0" 202 Accepted 2026-05-11 13:43:41,657 - lava_callback - INFO - Starting async job submit for node 69ff3a05254d3291e98e1493 2026-05-11 13:43:41,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:43:41,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3a05254d3291e98e1493 HTTP/1.1" 200 None 2026-05-11 13:43:41,676 - lava_callback - DEBUG - Processing node 69ff3a05254d3291e98e1493: baseline-arm64-clabbe 2026-05-11 13:43:41,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3a05254d3291e98e1493 2026-05-11 13:43:41,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:43:41,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3a05254d3291e98e1493 HTTP/1.1" 200 None 2026-05-11 13:43:41,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:43:41,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 13:43:41,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:43:41,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3a05254d3291e98e1493 HTTP/1.1" 200 None 2026-05-11 13:43:41,721 - lava_callback - ERROR - Error processing callback for node 69ff3a05254d3291e98e1493: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:45:01,609 - lava_callback - INFO - Received callback for node 69ff3a50254d3291e98e14cb INFO: 172.21.0.1:32856 - "POST /node/69ff3a50254d3291e98e14cb HTTP/1.0" 202 Accepted 2026-05-11 13:45:01,616 - lava_callback - INFO - Starting async job submit for node 69ff3a50254d3291e98e14cb 2026-05-11 13:45:01,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:45:01,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3a50254d3291e98e14cb HTTP/1.1" 200 None 2026-05-11 13:45:01,636 - lava_callback - DEBUG - Processing node 69ff3a50254d3291e98e14cb: baseline-arm64-clabbe 2026-05-11 13:45:01,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3a50254d3291e98e14cb 2026-05-11 13:45:01,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:45:01,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3a50254d3291e98e14cb HTTP/1.1" 200 None 2026-05-11 13:45:01,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:45:01,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 13:45:01,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:45:01,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3a50254d3291e98e14cb HTTP/1.1" 200 None 2026-05-11 13:45:01,702 - lava_callback - ERROR - Error processing callback for node 69ff3a50254d3291e98e14cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:46:21,720 - lava_callback - INFO - Received callback for node 69ff3a9f254d3291e98e1503 INFO: 172.21.0.1:48698 - "POST /node/69ff3a9f254d3291e98e1503 HTTP/1.0" 202 Accepted 2026-05-11 13:46:21,725 - lava_callback - INFO - Starting async job submit for node 69ff3a9f254d3291e98e1503 2026-05-11 13:46:21,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:46:21,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3a9f254d3291e98e1503 HTTP/1.1" 200 None 2026-05-11 13:46:21,740 - lava_callback - DEBUG - Processing node 69ff3a9f254d3291e98e1503: baseline-arm64-clabbe 2026-05-11 13:46:21,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3a9f254d3291e98e1503 2026-05-11 13:46:21,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:46:21,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3a9f254d3291e98e1503 HTTP/1.1" 200 None 2026-05-11 13:46:21,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:46:21,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 13:46:21,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:46:21,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3a9f254d3291e98e1503 HTTP/1.1" 200 None 2026-05-11 13:46:21,800 - lava_callback - ERROR - Error processing callback for node 69ff3a9f254d3291e98e1503: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44170 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:47:42,024 - lava_callback - INFO - Received callback for node 69ff3aef254d3291e98e1527 INFO: 172.21.0.1:38614 - "POST /node/69ff3aef254d3291e98e1527 HTTP/1.0" 202 Accepted 2026-05-11 13:47:42,030 - lava_callback - INFO - Starting async job submit for node 69ff3aef254d3291e98e1527 2026-05-11 13:47:42,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:47:42,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3aef254d3291e98e1527 HTTP/1.1" 200 None 2026-05-11 13:47:42,045 - lava_callback - DEBUG - Processing node 69ff3aef254d3291e98e1527: baseline-arm64-clabbe 2026-05-11 13:47:42,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3aef254d3291e98e1527 2026-05-11 13:47:42,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:47:42,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3aef254d3291e98e1527 HTTP/1.1" 200 None 2026-05-11 13:47:42,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:47:42,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 13:47:42,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:47:42,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3aef254d3291e98e1527 HTTP/1.1" 200 None 2026-05-11 13:47:42,098 - lava_callback - ERROR - Error processing callback for node 69ff3aef254d3291e98e1527: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35242 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:49:01,814 - lava_callback - INFO - Received callback for node 69ff3b3e254d3291e98e155f INFO: 172.21.0.1:39322 - "POST /node/69ff3b3e254d3291e98e155f HTTP/1.0" 202 Accepted 2026-05-11 13:49:01,820 - lava_callback - INFO - Starting async job submit for node 69ff3b3e254d3291e98e155f 2026-05-11 13:49:01,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:49:01,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3b3e254d3291e98e155f HTTP/1.1" 200 None 2026-05-11 13:49:01,834 - lava_callback - DEBUG - Processing node 69ff3b3e254d3291e98e155f: baseline-arm64-clabbe 2026-05-11 13:49:01,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3b3e254d3291e98e155f 2026-05-11 13:49:01,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:49:01,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3b3e254d3291e98e155f HTTP/1.1" 200 None 2026-05-11 13:49:01,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:49:01,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 13:49:01,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:49:01,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3b3e254d3291e98e155f HTTP/1.1" 200 None 2026-05-11 13:49:01,881 - lava_callback - ERROR - Error processing callback for node 69ff3b3e254d3291e98e155f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43778 - "GET / HTTP/1.0" 200 OK 2026-05-11 13:59:38,121 - lava_callback - INFO - Received callback for node 69ff3dc6254d3291e98e1661 INFO: 172.21.0.1:43784 - "POST /node/69ff3dc6254d3291e98e1661 HTTP/1.0" 202 Accepted 2026-05-11 13:59:38,127 - lava_callback - INFO - Starting async job submit for node 69ff3dc6254d3291e98e1661 2026-05-11 13:59:38,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:59:38,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3dc6254d3291e98e1661 HTTP/1.1" 200 None 2026-05-11 13:59:38,142 - lava_callback - DEBUG - Processing node 69ff3dc6254d3291e98e1661: baseline-arm64-baylibre 2026-05-11 13:59:38,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3dc6254d3291e98e1661 2026-05-11 13:59:38,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:59:38,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3dc6254d3291e98e1661 HTTP/1.1" 200 None 2026-05-11 13:59:38,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:59:38,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 13:59:38,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 13:59:38,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3dc6254d3291e98e1661 HTTP/1.1" 200 None 2026-05-11 13:59:38,188 - lava_callback - ERROR - Error processing callback for node 69ff3dc6254d3291e98e1661: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK 2026-05-11 14:02:22,356 - lava_callback - INFO - Received callback for node 69ff3e63254d3291e98e16c0 INFO: 172.21.0.1:35994 - "POST /node/69ff3e63254d3291e98e16c0 HTTP/1.0" 202 Accepted 2026-05-11 14:02:22,362 - lava_callback - INFO - Starting async job submit for node 69ff3e63254d3291e98e16c0 2026-05-11 14:02:22,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:02:22,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3e63254d3291e98e16c0 HTTP/1.1" 200 None 2026-05-11 14:02:22,378 - lava_callback - DEBUG - Processing node 69ff3e63254d3291e98e16c0: baseline-arm64-clabbe 2026-05-11 14:02:22,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3e63254d3291e98e16c0 2026-05-11 14:02:22,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:02:22,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3e63254d3291e98e16c0 HTTP/1.1" 200 None 2026-05-11 14:02:22,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:02:22,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 14:02:22,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:02:22,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3e63254d3291e98e16c0 HTTP/1.1" 200 None 2026-05-11 14:02:22,437 - lava_callback - ERROR - Error processing callback for node 69ff3e63254d3291e98e16c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK 2026-05-11 14:05:03,093 - lava_callback - INFO - Received callback for node 69ff3f06254d3291e98e170d INFO: 172.21.0.1:40104 - "POST /node/69ff3f06254d3291e98e170d HTTP/1.0" 202 Accepted 2026-05-11 14:05:03,099 - lava_callback - INFO - Starting async job submit for node 69ff3f06254d3291e98e170d 2026-05-11 14:05:03,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:05:03,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3f06254d3291e98e170d HTTP/1.1" 200 None 2026-05-11 14:05:03,114 - lava_callback - DEBUG - Processing node 69ff3f06254d3291e98e170d: baseline-arm64-clabbe 2026-05-11 14:05:03,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3f06254d3291e98e170d 2026-05-11 14:05:03,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:05:03,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3f06254d3291e98e170d HTTP/1.1" 200 None 2026-05-11 14:05:03,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:05:03,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 14:05:03,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:05:03,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3f06254d3291e98e170d HTTP/1.1" 200 None 2026-05-11 14:05:03,164 - lava_callback - ERROR - Error processing callback for node 69ff3f06254d3291e98e170d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK 2026-05-11 14:05:32,674 - lava_callback - INFO - Received callback for node 69ffd5c58d5045ce94720d87 INFO: 172.21.0.1:36776 - "POST /node/69ffd5c58d5045ce94720d87 HTTP/1.0" 202 Accepted 2026-05-11 14:05:32,680 - lava_callback - INFO - Starting async job submit for node 69ffd5c58d5045ce94720d87 2026-05-11 14:05:32,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:05:32,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c58d5045ce94720d87 HTTP/1.1" 200 None 2026-05-11 14:05:32,714 - lava_callback - DEBUG - Processing node 69ffd5c58d5045ce94720d87: baseline-arm64 2026-05-11 14:05:33,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 14:05:33,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 14:05:33,214 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c58d5045ce94720d87/log.txt.gz 2026-05-11 14:05:33,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 14:05:33,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 14:05:33,561 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c58d5045ce94720d87/lava-logs.yaml 2026-05-11 14:05:33,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 14:05:33,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 14:05:33,682 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c58d5045ce94720d87/lava_callback.json.gz 2026-05-11 14:05:33,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:05:33,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c58d5045ce94720d87 HTTP/1.1" 200 None 2026-05-11 14:05:33,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:05:33,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-11 14:05:33,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:05:33,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5c58d5045ce94720d87 HTTP/1.1" 200 None 2026-05-11 14:05:33,850 - lava_callback - INFO - Completed processing callback for node 69ffd5c58d5045ce94720d87 2026-05-11 14:05:35,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:05:35,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56396 - "GET / HTTP/1.0" 200 OK 2026-05-11 14:08:02,545 - lava_callback - INFO - Received callback for node 69ff3fac254d3291e98e176f INFO: 172.21.0.1:57432 - "POST /node/69ff3fac254d3291e98e176f HTTP/1.0" 202 Accepted 2026-05-11 14:08:02,551 - lava_callback - INFO - Starting async job submit for node 69ff3fac254d3291e98e176f 2026-05-11 14:08:02,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:08:02,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3fac254d3291e98e176f HTTP/1.1" 200 None 2026-05-11 14:08:02,566 - lava_callback - DEBUG - Processing node 69ff3fac254d3291e98e176f: baseline-arm64-clabbe 2026-05-11 14:08:02,566 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ff3fac254d3291e98e176f 2026-05-11 14:08:02,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:08:02,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff3fac254d3291e98e176f HTTP/1.1" 200 None 2026-05-11 14:08:02,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:08:02,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-11 14:08:02,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:08:02,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff3fac254d3291e98e176f HTTP/1.1" 200 None 2026-05-11 14:08:02,618 - lava_callback - ERROR - Error processing callback for node 69ff3fac254d3291e98e176f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43952 - "GET / HTTP/1.0" 200 OK 2026-05-11 14:09:19,928 - lava_callback - INFO - Received callback for node 69ffd5d38d5045ce94720dc1 INFO: 172.21.0.1:34774 - "POST /node/69ffd5d38d5045ce94720dc1 HTTP/1.0" 202 Accepted 2026-05-11 14:09:19,934 - lava_callback - INFO - Starting async job submit for node 69ffd5d38d5045ce94720dc1 2026-05-11 14:09:19,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:09:19,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d38d5045ce94720dc1 HTTP/1.1" 200 None 2026-05-11 14:09:19,967 - lava_callback - DEBUG - Processing node 69ffd5d38d5045ce94720dc1: baseline-nfs-arm64 2026-05-11 14:09:20,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 14:09:20,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 14:09:20,492 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d38d5045ce94720dc1/log.txt.gz 2026-05-11 14:09:20,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 14:09:20,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 14:09:20,911 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d38d5045ce94720dc1/lava-logs.yaml 2026-05-11 14:09:20,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-11 14:09:21,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-11 14:09:21,053 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d38d5045ce94720dc1/lava_callback.json.gz 2026-05-11 14:09:21,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:09:21,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d38d5045ce94720dc1 HTTP/1.1" 200 None 2026-05-11 14:09:21,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:09:21,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-11 14:09:21,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-11 14:09:21,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5d38d5045ce94720dc1 HTTP/1.1" 200 None 2026-05-11 14:09:21,143 - lava_callback - INFO - Completed processing callback for node 69ffd5d38d5045ce94720dc1 INFO: 172.21.0.1:34786 - "GET / HTTP/1.0" 200 OK 2026-05-11 14:09:35,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000