INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:53352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57172 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:14:06,221 - lava_callback - INFO - Received callback for node 69dca5b93c1e37dfe2f86ea3 2026-04-15 08:14:06,230 - lava_callback - INFO - Starting async job submit for node 69dca5b93c1e37dfe2f86ea3 INFO: 172.20.0.1:39786 - "POST /node/69dca5b93c1e37dfe2f86ea3 HTTP/1.0" 202 Accepted 2026-04-15 08:14:06,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:14:06,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca5b93c1e37dfe2f86ea3 HTTP/1.1" 200 None 2026-04-15 08:14:06,255 - lava_callback - DEBUG - Processing node 69dca5b93c1e37dfe2f86ea3: baseline-arm64-clabbe 2026-04-15 08:14:06,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca5b93c1e37dfe2f86ea3 2026-04-15 08:14:06,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:14:06,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca5b93c1e37dfe2f86ea3 HTTP/1.1" 200 None 2026-04-15 08:14:06,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:14:06,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6f39cf16ca753839b3442 HTTP/1.1" 200 None 2026-04-15 08:14:06,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:14:06,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca5b93c1e37dfe2f86ea3 HTTP/1.1" 200 None 2026-04-15 08:14:06,319 - lava_callback - ERROR - Error processing callback for node 69dca5b93c1e37dfe2f86ea3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38404 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:15:26,274 - lava_callback - INFO - Received callback for node 69dca60a3c1e37dfe2f86f01 INFO: 172.20.0.1:59058 - "POST /node/69dca60a3c1e37dfe2f86f01 HTTP/1.0" 202 Accepted 2026-04-15 08:15:26,283 - lava_callback - INFO - Starting async job submit for node 69dca60a3c1e37dfe2f86f01 2026-04-15 08:15:26,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:15:26,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca60a3c1e37dfe2f86f01 HTTP/1.1" 200 None 2026-04-15 08:15:26,325 - lava_callback - DEBUG - Processing node 69dca60a3c1e37dfe2f86f01: baseline-arm64-clabbe 2026-04-15 08:15:26,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca60a3c1e37dfe2f86f01 2026-04-15 08:15:26,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:15:26,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca60a3c1e37dfe2f86f01 HTTP/1.1" 200 None 2026-04-15 08:15:26,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:15:26,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 08:15:26,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:15:26,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca60a3c1e37dfe2f86f01 HTTP/1.1" 200 None 2026-04-15 08:15:26,392 - lava_callback - ERROR - Error processing callback for node 69dca60a3c1e37dfe2f86f01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37352 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:16:46,363 - lava_callback - INFO - Received callback for node 69dca6593c1e37dfe2f86f31 INFO: 172.20.0.1:36582 - "POST /node/69dca6593c1e37dfe2f86f31 HTTP/1.0" 202 Accepted 2026-04-15 08:16:46,369 - lava_callback - INFO - Starting async job submit for node 69dca6593c1e37dfe2f86f31 2026-04-15 08:16:46,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:16:46,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca6593c1e37dfe2f86f31 HTTP/1.1" 200 None 2026-04-15 08:16:46,392 - lava_callback - DEBUG - Processing node 69dca6593c1e37dfe2f86f31: baseline-arm64-clabbe 2026-04-15 08:16:46,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca6593c1e37dfe2f86f31 2026-04-15 08:16:46,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:16:46,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca6593c1e37dfe2f86f31 HTTP/1.1" 200 None 2026-04-15 08:16:46,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:16:46,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 08:16:46,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:16:46,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca6593c1e37dfe2f86f31 HTTP/1.1" 200 None 2026-04-15 08:16:46,465 - lava_callback - ERROR - Error processing callback for node 69dca6593c1e37dfe2f86f31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43960 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:16:56,666 - lava_callback - INFO - Received callback for node 69df05ebf490930782fbc548 INFO: 172.20.0.1:43968 - "POST /node/69df05ebf490930782fbc548 HTTP/1.0" 202 Accepted 2026-04-15 08:16:56,677 - lava_callback - INFO - Starting async job submit for node 69df05ebf490930782fbc548 2026-04-15 08:16:56,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:16:56,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df05ebf490930782fbc548 HTTP/1.1" 200 None 2026-04-15 08:16:56,715 - lava_callback - DEBUG - Processing node 69df05ebf490930782fbc548: baseline-arm64 2026-04-15 08:16:57,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:16:57,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:16:57,374 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df05ebf490930782fbc548/log.txt.gz 2026-04-15 08:16:57,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:16:57,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:16:57,841 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df05ebf490930782fbc548/lava-logs.yaml 2026-04-15 08:16:57,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:16:58,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:16:58,007 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df05ebf490930782fbc548/lava_callback.json.gz 2026-04-15 08:16:58,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:16:58,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df05ebf490930782fbc548 HTTP/1.1" 200 None 2026-04-15 08:16:58,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:16:58,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded948f490930782fb6e2d HTTP/1.1" 200 None 2026-04-15 08:16:58,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:16:58,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df05ebf490930782fbc548 HTTP/1.1" 200 None 2026-04-15 08:16:58,090 - lava_callback - INFO - Completed processing callback for node 69df05ebf490930782fbc548 2026-04-15 08:17:06,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:17:06,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53330 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:17:19,040 - lava_callback - INFO - Received callback for node 69dca68b3c1e37dfe2f86f7e INFO: 172.20.0.1:53344 - "POST /node/69dca68b3c1e37dfe2f86f7e HTTP/1.0" 202 Accepted 2026-04-15 08:17:19,046 - lava_callback - INFO - Starting async job submit for node 69dca68b3c1e37dfe2f86f7e 2026-04-15 08:17:19,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:17:19,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca68b3c1e37dfe2f86f7e HTTP/1.1" 200 None 2026-04-15 08:17:19,062 - lava_callback - DEBUG - Processing node 69dca68b3c1e37dfe2f86f7e: baseline-arm-baylibre 2026-04-15 08:17:19,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca68b3c1e37dfe2f86f7e 2026-04-15 08:17:19,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:17:19,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca68b3c1e37dfe2f86f7e HTTP/1.1" 200 None 2026-04-15 08:17:19,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:17:19,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 08:17:19,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:17:19,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca68b3c1e37dfe2f86f7e HTTP/1.1" 200 None 2026-04-15 08:17:19,115 - lava_callback - ERROR - Error processing callback for node 69dca68b3c1e37dfe2f86f7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49104 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:17:59,053 - lava_callback - INFO - Received callback for node 69dca6a73c1e37dfe2f86ff7 INFO: 172.20.0.1:49114 - "POST /node/69dca6a73c1e37dfe2f86ff7 HTTP/1.0" 202 Accepted 2026-04-15 08:17:59,060 - lava_callback - INFO - Starting async job submit for node 69dca6a73c1e37dfe2f86ff7 2026-04-15 08:17:59,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:17:59,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca6a73c1e37dfe2f86ff7 HTTP/1.1" 200 None 2026-04-15 08:17:59,078 - lava_callback - DEBUG - Processing node 69dca6a73c1e37dfe2f86ff7: baseline-arm-baylibre 2026-04-15 08:17:59,079 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca6a73c1e37dfe2f86ff7 2026-04-15 08:17:59,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:17:59,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca6a73c1e37dfe2f86ff7 HTTP/1.1" 200 None 2026-04-15 08:17:59,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:17:59,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 08:17:59,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:17:59,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca6a73c1e37dfe2f86ff7 HTTP/1.1" 200 None 2026-04-15 08:17:59,127 - lava_callback - ERROR - Error processing callback for node 69dca6a73c1e37dfe2f86ff7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59812 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:18:19,041 - lava_callback - INFO - Received callback for node 69dca6c63c1e37dfe2f8701b INFO: 172.20.0.1:59820 - "POST /node/69dca6c63c1e37dfe2f8701b HTTP/1.0" 202 Accepted 2026-04-15 08:18:19,046 - lava_callback - INFO - Starting async job submit for node 69dca6c63c1e37dfe2f8701b 2026-04-15 08:18:19,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:18:19,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca6c63c1e37dfe2f8701b HTTP/1.1" 200 None 2026-04-15 08:18:19,062 - lava_callback - DEBUG - Processing node 69dca6c63c1e37dfe2f8701b: baseline-arm-baylibre 2026-04-15 08:18:19,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca6c63c1e37dfe2f8701b 2026-04-15 08:18:19,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:18:19,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca6c63c1e37dfe2f8701b HTTP/1.1" 200 None 2026-04-15 08:18:19,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:18:19,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 08:18:19,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:18:19,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca6c63c1e37dfe2f8701b HTTP/1.1" 200 None 2026-04-15 08:18:19,138 - lava_callback - ERROR - Error processing callback for node 69dca6c63c1e37dfe2f8701b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35362 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:19:39,175 - lava_callback - INFO - Received callback for node 69dca70c3c1e37dfe2f87068 INFO: 172.20.0.1:35364 - "POST /node/69dca70c3c1e37dfe2f87068 HTTP/1.0" 202 Accepted 2026-04-15 08:19:39,181 - lava_callback - INFO - Starting async job submit for node 69dca70c3c1e37dfe2f87068 2026-04-15 08:19:39,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:19:39,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca70c3c1e37dfe2f87068 HTTP/1.1" 200 None 2026-04-15 08:19:39,198 - lava_callback - DEBUG - Processing node 69dca70c3c1e37dfe2f87068: baseline-arm-baylibre 2026-04-15 08:19:39,198 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca70c3c1e37dfe2f87068 2026-04-15 08:19:39,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:19:39,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca70c3c1e37dfe2f87068 HTTP/1.1" 200 None 2026-04-15 08:19:39,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:19:39,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 08:19:39,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:19:39,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca70c3c1e37dfe2f87068 HTTP/1.1" 200 None 2026-04-15 08:19:39,253 - lava_callback - ERROR - Error processing callback for node 69dca70c3c1e37dfe2f87068: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54980 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:20:19,152 - lava_callback - INFO - Received callback for node 69dca72f3c1e37dfe2f8707e INFO: 172.20.0.1:54988 - "POST /node/69dca72f3c1e37dfe2f8707e HTTP/1.0" 202 Accepted 2026-04-15 08:20:19,162 - lava_callback - INFO - Starting async job submit for node 69dca72f3c1e37dfe2f8707e 2026-04-15 08:20:19,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:20:19,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca72f3c1e37dfe2f8707e HTTP/1.1" 200 None 2026-04-15 08:20:19,188 - lava_callback - DEBUG - Processing node 69dca72f3c1e37dfe2f8707e: baseline-arm-baylibre 2026-04-15 08:20:19,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca72f3c1e37dfe2f8707e 2026-04-15 08:20:19,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:20:19,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca72f3c1e37dfe2f8707e HTTP/1.1" 200 None 2026-04-15 08:20:19,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:20:19,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 08:20:19,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:20:19,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca72f3c1e37dfe2f8707e HTTP/1.1" 200 None 2026-04-15 08:20:19,280 - lava_callback - ERROR - Error processing callback for node 69dca72f3c1e37dfe2f8707e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48274 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:20:46,500 - lava_callback - INFO - Received callback for node 69dca7523c1e37dfe2f870a2 INFO: 172.20.0.1:60250 - "POST /node/69dca7523c1e37dfe2f870a2 HTTP/1.0" 202 Accepted 2026-04-15 08:20:46,506 - lava_callback - INFO - Starting async job submit for node 69dca7523c1e37dfe2f870a2 2026-04-15 08:20:46,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:20:46,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca7523c1e37dfe2f870a2 HTTP/1.1" 200 None 2026-04-15 08:20:46,523 - lava_callback - DEBUG - Processing node 69dca7523c1e37dfe2f870a2: baseline-arm-clabbe 2026-04-15 08:20:46,523 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca7523c1e37dfe2f870a2 2026-04-15 08:20:46,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:20:46,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca7523c1e37dfe2f870a2 HTTP/1.1" 200 None INFO: 172.20.0.1:60266 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:20:46,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:20:46,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 08:20:46,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:20:46,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca7523c1e37dfe2f870a2 HTTP/1.1" 200 None 2026-04-15 08:20:46,587 - lava_callback - ERROR - Error processing callback for node 69dca7523c1e37dfe2f870a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50040 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:21:19,273 - lava_callback - INFO - Received callback for node 69dca7703c1e37dfe2f870c4 INFO: 172.20.0.1:50042 - "POST /node/69dca7703c1e37dfe2f870c4 HTTP/1.0" 202 Accepted 2026-04-15 08:21:19,282 - lava_callback - INFO - Starting async job submit for node 69dca7703c1e37dfe2f870c4 2026-04-15 08:21:19,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:21:19,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca7703c1e37dfe2f870c4 HTTP/1.1" 200 None 2026-04-15 08:21:19,298 - lava_callback - DEBUG - Processing node 69dca7703c1e37dfe2f870c4: baseline-arm-baylibre 2026-04-15 08:21:19,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca7703c1e37dfe2f870c4 2026-04-15 08:21:19,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:21:19,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca7703c1e37dfe2f870c4 HTTP/1.1" 200 None 2026-04-15 08:21:19,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:21:19,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 08:21:19,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:21:19,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca7703c1e37dfe2f870c4 HTTP/1.1" 200 None 2026-04-15 08:21:19,354 - lava_callback - ERROR - Error processing callback for node 69dca7703c1e37dfe2f870c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54574 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:21:46,585 - lava_callback - INFO - Received callback for node 69dca78e3c1e37dfe2f870eb INFO: 172.20.0.1:54588 - "POST /node/69dca78e3c1e37dfe2f870eb HTTP/1.0" 202 Accepted 2026-04-15 08:21:46,594 - lava_callback - INFO - Starting async job submit for node 69dca78e3c1e37dfe2f870eb 2026-04-15 08:21:46,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:21:46,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca78e3c1e37dfe2f870eb HTTP/1.1" 200 None 2026-04-15 08:21:46,630 - lava_callback - DEBUG - Processing node 69dca78e3c1e37dfe2f870eb: baseline-arm-clabbe 2026-04-15 08:21:46,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca78e3c1e37dfe2f870eb 2026-04-15 08:21:46,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:21:46,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca78e3c1e37dfe2f870eb HTTP/1.1" 200 None 2026-04-15 08:21:46,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:21:46,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 08:21:46,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:21:46,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca78e3c1e37dfe2f870eb HTTP/1.1" 200 None 2026-04-15 08:21:46,708 - lava_callback - ERROR - Error processing callback for node 69dca78e3c1e37dfe2f870eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53814 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:22:26,543 - lava_callback - INFO - Received callback for node 69dca7af3c1e37dfe2f8712a INFO: 172.20.0.1:53826 - "POST /node/69dca7af3c1e37dfe2f8712a HTTP/1.0" 202 Accepted 2026-04-15 08:22:26,549 - lava_callback - INFO - Starting async job submit for node 69dca7af3c1e37dfe2f8712a 2026-04-15 08:22:26,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:22:26,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca7af3c1e37dfe2f8712a HTTP/1.1" 200 None 2026-04-15 08:22:26,565 - lava_callback - DEBUG - Processing node 69dca7af3c1e37dfe2f8712a: baseline-arm-clabbe 2026-04-15 08:22:26,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca7af3c1e37dfe2f8712a 2026-04-15 08:22:26,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:22:26,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca7af3c1e37dfe2f8712a HTTP/1.1" 200 None 2026-04-15 08:22:26,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:22:26,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 08:22:26,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:22:26,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca7af3c1e37dfe2f8712a HTTP/1.1" 200 None 2026-04-15 08:22:26,614 - lava_callback - ERROR - Error processing callback for node 69dca7af3c1e37dfe2f8712a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48106 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:22:59,326 - lava_callback - INFO - Received callback for node 69dca7ce3c1e37dfe2f8714c INFO: 172.20.0.1:48114 - "POST /node/69dca7ce3c1e37dfe2f8714c HTTP/1.0" 202 Accepted 2026-04-15 08:22:59,331 - lava_callback - INFO - Starting async job submit for node 69dca7ce3c1e37dfe2f8714c 2026-04-15 08:22:59,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:22:59,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca7ce3c1e37dfe2f8714c HTTP/1.1" 200 None 2026-04-15 08:22:59,357 - lava_callback - DEBUG - Processing node 69dca7ce3c1e37dfe2f8714c: baseline-arm-baylibre 2026-04-15 08:22:59,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca7ce3c1e37dfe2f8714c 2026-04-15 08:22:59,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:22:59,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca7ce3c1e37dfe2f8714c HTTP/1.1" 200 None 2026-04-15 08:22:59,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:22:59,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 08:22:59,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:22:59,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca7ce3c1e37dfe2f8714c HTTP/1.1" 200 None 2026-04-15 08:22:59,405 - lava_callback - ERROR - Error processing callback for node 69dca7ce3c1e37dfe2f8714c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56164 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:23:46,633 - lava_callback - INFO - Received callback for node 69dca80f3c1e37dfe2f87190 INFO: 172.20.0.1:56170 - "POST /node/69dca80f3c1e37dfe2f87190 HTTP/1.0" 202 Accepted 2026-04-15 08:23:46,638 - lava_callback - INFO - Starting async job submit for node 69dca80f3c1e37dfe2f87190 2026-04-15 08:23:46,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:23:46,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca80f3c1e37dfe2f87190 HTTP/1.1" 200 None 2026-04-15 08:23:46,660 - lava_callback - DEBUG - Processing node 69dca80f3c1e37dfe2f87190: baseline-arm-clabbe 2026-04-15 08:23:46,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca80f3c1e37dfe2f87190 2026-04-15 08:23:46,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:23:46,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca80f3c1e37dfe2f87190 HTTP/1.1" 200 None 2026-04-15 08:23:46,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:23:46,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 08:23:46,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:23:46,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca80f3c1e37dfe2f87190 HTTP/1.1" 200 None 2026-04-15 08:23:46,709 - lava_callback - ERROR - Error processing callback for node 69dca80f3c1e37dfe2f87190: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48754 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:24:26,650 - lava_callback - INFO - Received callback for node 69dca82f3c1e37dfe2f871c3 INFO: 172.20.0.1:48762 - "POST /node/69dca82f3c1e37dfe2f871c3 HTTP/1.0" 202 Accepted 2026-04-15 08:24:26,657 - lava_callback - INFO - Starting async job submit for node 69dca82f3c1e37dfe2f871c3 2026-04-15 08:24:26,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:24:26,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca82f3c1e37dfe2f871c3 HTTP/1.1" 200 None 2026-04-15 08:24:26,673 - lava_callback - DEBUG - Processing node 69dca82f3c1e37dfe2f871c3: baseline-arm-clabbe 2026-04-15 08:24:26,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca82f3c1e37dfe2f871c3 2026-04-15 08:24:26,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:24:26,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca82f3c1e37dfe2f871c3 HTTP/1.1" 200 None 2026-04-15 08:24:26,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:24:26,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 08:24:26,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:24:26,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca82f3c1e37dfe2f871c3 HTTP/1.1" 200 None 2026-04-15 08:24:26,748 - lava_callback - ERROR - Error processing callback for node 69dca82f3c1e37dfe2f871c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54624 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:25:06,854 - lava_callback - INFO - Received callback for node 69dca8533c1e37dfe2f871f9 INFO: 172.20.0.1:54628 - "POST /node/69dca8533c1e37dfe2f871f9 HTTP/1.0" 202 Accepted 2026-04-15 08:25:06,860 - lava_callback - INFO - Starting async job submit for node 69dca8533c1e37dfe2f871f9 2026-04-15 08:25:06,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:25:06,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca8533c1e37dfe2f871f9 HTTP/1.1" 200 None 2026-04-15 08:25:06,876 - lava_callback - DEBUG - Processing node 69dca8533c1e37dfe2f871f9: baseline-arm-clabbe 2026-04-15 08:25:06,876 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca8533c1e37dfe2f871f9 2026-04-15 08:25:06,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:25:06,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca8533c1e37dfe2f871f9 HTTP/1.1" 200 None 2026-04-15 08:25:06,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:25:06,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 08:25:06,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:25:06,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca8533c1e37dfe2f871f9 HTTP/1.1" 200 None 2026-04-15 08:25:06,928 - lava_callback - ERROR - Error processing callback for node 69dca8533c1e37dfe2f871f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57102 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:25:46,714 - lava_callback - INFO - Received callback for node 69dca8773c1e37dfe2f87225 INFO: 172.20.0.1:57112 - "POST /node/69dca8773c1e37dfe2f87225 HTTP/1.0" 202 Accepted 2026-04-15 08:25:46,719 - lava_callback - INFO - Starting async job submit for node 69dca8773c1e37dfe2f87225 2026-04-15 08:25:46,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:25:46,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca8773c1e37dfe2f87225 HTTP/1.1" 200 None 2026-04-15 08:25:46,741 - lava_callback - DEBUG - Processing node 69dca8773c1e37dfe2f87225: baseline-arm-clabbe 2026-04-15 08:25:46,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca8773c1e37dfe2f87225 2026-04-15 08:25:46,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:25:46,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca8773c1e37dfe2f87225 HTTP/1.1" 200 None 2026-04-15 08:25:46,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:25:46,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 08:25:46,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:25:46,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca8773c1e37dfe2f87225 HTTP/1.1" 200 None 2026-04-15 08:25:46,799 - lava_callback - ERROR - Error processing callback for node 69dca8773c1e37dfe2f87225: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55648 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:26:19,539 - lava_callback - INFO - Received callback for node 69dca8993c1e37dfe2f8723b INFO: 172.20.0.1:55660 - "POST /node/69dca8993c1e37dfe2f8723b HTTP/1.0" 202 Accepted 2026-04-15 08:26:19,544 - lava_callback - INFO - Starting async job submit for node 69dca8993c1e37dfe2f8723b 2026-04-15 08:26:19,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:26:19,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca8993c1e37dfe2f8723b HTTP/1.1" 200 None 2026-04-15 08:26:19,560 - lava_callback - DEBUG - Processing node 69dca8993c1e37dfe2f8723b: baseline-arm-baylibre 2026-04-15 08:26:19,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca8993c1e37dfe2f8723b 2026-04-15 08:26:19,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:26:19,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca8993c1e37dfe2f8723b HTTP/1.1" 200 None 2026-04-15 08:26:19,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:26:19,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 08:26:19,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:26:19,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca8993c1e37dfe2f8723b HTTP/1.1" 200 None 2026-04-15 08:26:19,613 - lava_callback - ERROR - Error processing callback for node 69dca8993c1e37dfe2f8723b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55202 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:26:46,788 - lava_callback - INFO - Received callback for node 69dca8bd3c1e37dfe2f8724d INFO: 172.20.0.1:55216 - "POST /node/69dca8bd3c1e37dfe2f8724d HTTP/1.0" 202 Accepted 2026-04-15 08:26:46,794 - lava_callback - INFO - Starting async job submit for node 69dca8bd3c1e37dfe2f8724d 2026-04-15 08:26:46,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:26:46,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca8bd3c1e37dfe2f8724d HTTP/1.1" 200 None 2026-04-15 08:26:46,816 - lava_callback - DEBUG - Processing node 69dca8bd3c1e37dfe2f8724d: baseline-arm-clabbe 2026-04-15 08:26:46,816 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca8bd3c1e37dfe2f8724d 2026-04-15 08:26:46,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:26:46,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca8bd3c1e37dfe2f8724d HTTP/1.1" 200 None 2026-04-15 08:26:46,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:26:46,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 08:26:46,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:26:46,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca8bd3c1e37dfe2f8724d HTTP/1.1" 200 None 2026-04-15 08:26:46,872 - lava_callback - ERROR - Error processing callback for node 69dca8bd3c1e37dfe2f8724d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60536 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:27:26,732 - lava_callback - INFO - Received callback for node 69dca8d93c1e37dfe2f87280 INFO: 172.20.0.1:60550 - "POST /node/69dca8d93c1e37dfe2f87280 HTTP/1.0" 202 Accepted 2026-04-15 08:27:26,744 - lava_callback - INFO - Starting async job submit for node 69dca8d93c1e37dfe2f87280 2026-04-15 08:27:26,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:27:26,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca8d93c1e37dfe2f87280 HTTP/1.1" 200 None 2026-04-15 08:27:26,776 - lava_callback - DEBUG - Processing node 69dca8d93c1e37dfe2f87280: baseline-arm-clabbe 2026-04-15 08:27:26,777 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca8d93c1e37dfe2f87280 2026-04-15 08:27:26,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:27:26,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca8d93c1e37dfe2f87280 HTTP/1.1" 200 None 2026-04-15 08:27:26,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:27:26,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 08:27:26,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:27:26,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca8d93c1e37dfe2f87280 HTTP/1.1" 200 None 2026-04-15 08:27:26,904 - lava_callback - ERROR - Error processing callback for node 69dca8d93c1e37dfe2f87280: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52414 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:27:46,817 - lava_callback - INFO - Received callback for node 69dca8fa3c1e37dfe2f872ad INFO: 172.20.0.1:52426 - "POST /node/69dca8fa3c1e37dfe2f872ad HTTP/1.0" 202 Accepted 2026-04-15 08:27:46,822 - lava_callback - INFO - Starting async job submit for node 69dca8fa3c1e37dfe2f872ad 2026-04-15 08:27:46,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:27:46,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca8fa3c1e37dfe2f872ad HTTP/1.1" 200 None 2026-04-15 08:27:46,848 - lava_callback - DEBUG - Processing node 69dca8fa3c1e37dfe2f872ad: baseline-arm-clabbe 2026-04-15 08:27:46,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca8fa3c1e37dfe2f872ad 2026-04-15 08:27:46,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:27:46,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca8fa3c1e37dfe2f872ad HTTP/1.1" 200 None 2026-04-15 08:27:46,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:27:46,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 08:27:46,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:27:46,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca8fa3c1e37dfe2f872ad HTTP/1.1" 200 None 2026-04-15 08:27:46,924 - lava_callback - ERROR - Error processing callback for node 69dca8fa3c1e37dfe2f872ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35740 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:28:26,779 - lava_callback - INFO - Received callback for node 69dca9183c1e37dfe2f872d5 INFO: 172.20.0.1:35752 - "POST /node/69dca9183c1e37dfe2f872d5 HTTP/1.0" 202 Accepted 2026-04-15 08:28:26,784 - lava_callback - INFO - Starting async job submit for node 69dca9183c1e37dfe2f872d5 2026-04-15 08:28:26,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:28:26,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca9183c1e37dfe2f872d5 HTTP/1.1" 200 None 2026-04-15 08:28:26,804 - lava_callback - DEBUG - Processing node 69dca9183c1e37dfe2f872d5: baseline-arm-clabbe 2026-04-15 08:28:26,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca9183c1e37dfe2f872d5 2026-04-15 08:28:26,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:28:26,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca9183c1e37dfe2f872d5 HTTP/1.1" 200 None 2026-04-15 08:28:26,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:28:26,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 08:28:26,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:28:26,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca9183c1e37dfe2f872d5 HTTP/1.1" 200 None 2026-04-15 08:28:26,853 - lava_callback - ERROR - Error processing callback for node 69dca9183c1e37dfe2f872d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44024 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:29:06,831 - lava_callback - INFO - Received callback for node 69dca93e3c1e37dfe2f87302 INFO: 172.20.0.1:44032 - "POST /node/69dca93e3c1e37dfe2f87302 HTTP/1.0" 202 Accepted 2026-04-15 08:29:06,837 - lava_callback - INFO - Starting async job submit for node 69dca93e3c1e37dfe2f87302 2026-04-15 08:29:06,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:29:06,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca93e3c1e37dfe2f87302 HTTP/1.1" 200 None 2026-04-15 08:29:06,853 - lava_callback - DEBUG - Processing node 69dca93e3c1e37dfe2f87302: baseline-arm-clabbe 2026-04-15 08:29:06,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca93e3c1e37dfe2f87302 2026-04-15 08:29:06,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:29:06,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca93e3c1e37dfe2f87302 HTTP/1.1" 200 None 2026-04-15 08:29:06,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:29:06,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 08:29:06,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:29:06,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca93e3c1e37dfe2f87302 HTTP/1.1" 200 None 2026-04-15 08:29:06,926 - lava_callback - ERROR - Error processing callback for node 69dca93e3c1e37dfe2f87302: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49548 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:29:39,636 - lava_callback - INFO - Received callback for node 69dca9663c1e37dfe2f8732c INFO: 172.20.0.1:49564 - "POST /node/69dca9663c1e37dfe2f8732c HTTP/1.0" 202 Accepted 2026-04-15 08:29:39,642 - lava_callback - INFO - Starting async job submit for node 69dca9663c1e37dfe2f8732c 2026-04-15 08:29:39,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:29:39,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca9663c1e37dfe2f8732c HTTP/1.1" 200 None 2026-04-15 08:29:39,668 - lava_callback - DEBUG - Processing node 69dca9663c1e37dfe2f8732c: baseline-arm64-baylibre 2026-04-15 08:29:39,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca9663c1e37dfe2f8732c 2026-04-15 08:29:39,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:29:39,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca9663c1e37dfe2f8732c HTTP/1.1" 200 None 2026-04-15 08:29:39,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:29:39,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 08:29:39,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:29:39,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca9663c1e37dfe2f8732c HTTP/1.1" 200 None 2026-04-15 08:29:39,724 - lava_callback - ERROR - Error processing callback for node 69dca9663c1e37dfe2f8732c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 08:29:43,570 - lava_callback - INFO - Received callback for node 69df4bf506e8e7b15e962536 INFO: 172.20.0.1:56022 - "POST /node/69df4bf506e8e7b15e962536 HTTP/1.0" 202 Accepted 2026-04-15 08:29:43,576 - lava_callback - INFO - Starting async job submit for node 69df4bf506e8e7b15e962536 2026-04-15 08:29:43,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:29:43,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4bf506e8e7b15e962536 HTTP/1.1" 200 None 2026-04-15 08:29:43,614 - lava_callback - DEBUG - Processing node 69df4bf506e8e7b15e962536: baseline-arm 2026-04-15 08:29:43,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:29:44,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:29:44,006 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69df4bf506e8e7b15e962536/log.txt.gz 2026-04-15 08:29:44,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:29:44,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:29:44,471 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df4bf506e8e7b15e962536/lava-logs.yaml 2026-04-15 08:29:44,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:29:44,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:29:44,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df4bf506e8e7b15e962536/lava_callback.json.gz 2026-04-15 08:29:44,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:29:44,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4bf506e8e7b15e962536 HTTP/1.1" 200 None 2026-04-15 08:29:44,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:29:44,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499906e8e7b15e9624b4 HTTP/1.1" 200 None 2026-04-15 08:29:44,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:29:44,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4bf506e8e7b15e962536 HTTP/1.1" 200 None 2026-04-15 08:29:44,744 - lava_callback - INFO - Completed processing callback for node 69df4bf506e8e7b15e962536 INFO: 172.20.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39664 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:30:06,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:30:06,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51376 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:30:46,974 - lava_callback - INFO - Received callback for node 69dca9a73c1e37dfe2f87377 INFO: 172.20.0.1:51386 - "POST /node/69dca9a73c1e37dfe2f87377 HTTP/1.0" 202 Accepted 2026-04-15 08:30:46,982 - lava_callback - INFO - Starting async job submit for node 69dca9a73c1e37dfe2f87377 2026-04-15 08:30:46,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:30:46,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca9a73c1e37dfe2f87377 HTTP/1.1" 200 None 2026-04-15 08:30:47,000 - lava_callback - DEBUG - Processing node 69dca9a73c1e37dfe2f87377: baseline-arm-clabbe 2026-04-15 08:30:47,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca9a73c1e37dfe2f87377 2026-04-15 08:30:47,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:30:47,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca9a73c1e37dfe2f87377 HTTP/1.1" 200 None 2026-04-15 08:30:47,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:30:47,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 08:30:47,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:30:47,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca9a73c1e37dfe2f87377 HTTP/1.1" 200 None 2026-04-15 08:30:47,067 - lava_callback - ERROR - Error processing callback for node 69dca9a73c1e37dfe2f87377: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45036 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:31:26,975 - lava_callback - INFO - Received callback for node 69dca9c93c1e37dfe2f8739b INFO: 172.20.0.1:45044 - "POST /node/69dca9c93c1e37dfe2f8739b HTTP/1.0" 202 Accepted 2026-04-15 08:31:26,981 - lava_callback - INFO - Starting async job submit for node 69dca9c93c1e37dfe2f8739b 2026-04-15 08:31:26,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:31:27,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca9c93c1e37dfe2f8739b HTTP/1.1" 200 None 2026-04-15 08:31:27,022 - lava_callback - DEBUG - Processing node 69dca9c93c1e37dfe2f8739b: baseline-arm-clabbe 2026-04-15 08:31:27,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca9c93c1e37dfe2f8739b 2026-04-15 08:31:27,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:31:27,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca9c93c1e37dfe2f8739b HTTP/1.1" 200 None 2026-04-15 08:31:27,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:31:27,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 08:31:27,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:31:27,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca9c93c1e37dfe2f8739b HTTP/1.1" 200 None 2026-04-15 08:31:27,131 - lava_callback - ERROR - Error processing callback for node 69dca9c93c1e37dfe2f8739b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41804 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:31:59,787 - lava_callback - INFO - Received callback for node 69dca9f43c1e37dfe2f873ae INFO: 172.20.0.1:43298 - "POST /node/69dca9f43c1e37dfe2f873ae HTTP/1.0" 202 Accepted 2026-04-15 08:31:59,796 - lava_callback - INFO - Starting async job submit for node 69dca9f43c1e37dfe2f873ae 2026-04-15 08:31:59,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:31:59,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca9f43c1e37dfe2f873ae HTTP/1.1" 200 None 2026-04-15 08:31:59,819 - lava_callback - DEBUG - Processing node 69dca9f43c1e37dfe2f873ae: baseline-arm64-baylibre 2026-04-15 08:31:59,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dca9f43c1e37dfe2f873ae 2026-04-15 08:31:59,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:31:59,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dca9f43c1e37dfe2f873ae HTTP/1.1" 200 None 2026-04-15 08:31:59,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:31:59,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 08:31:59,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:31:59,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dca9f43c1e37dfe2f873ae HTTP/1.1" 200 None 2026-04-15 08:31:59,899 - lava_callback - ERROR - Error processing callback for node 69dca9f43c1e37dfe2f873ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55480 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:32:26,038 - lava_callback - INFO - Received callback for node 69df4d0f06e8e7b15e96256e INFO: 172.20.0.1:37848 - "POST /node/69df4d0f06e8e7b15e96256e HTTP/1.0" 202 Accepted 2026-04-15 08:32:26,044 - lava_callback - INFO - Starting async job submit for node 69df4d0f06e8e7b15e96256e 2026-04-15 08:32:26,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:32:26,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d0f06e8e7b15e96256e HTTP/1.1" 200 None 2026-04-15 08:32:26,062 - lava_callback - DEBUG - Processing node 69df4d0f06e8e7b15e96256e: baseline-arm 2026-04-15 08:32:26,066 - lava_callback - WARNING - Failed to upload log 2026-04-15 08:32:26,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:32:26,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:32:26,216 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d0f06e8e7b15e96256e/lava-logs.yaml 2026-04-15 08:32:26,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:32:26,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:32:26,372 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d0f06e8e7b15e96256e/lava_callback.json.gz 2026-04-15 08:32:26,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:32:26,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d0f06e8e7b15e96256e HTTP/1.1" 200 None 2026-04-15 08:32:26,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:32:26,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:32:26,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:32:26,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d0f06e8e7b15e96256e HTTP/1.1" 200 None 2026-04-15 08:32:26,515 - lava_callback - INFO - Completed processing callback for node 69df4d0f06e8e7b15e96256e INFO: 172.20.0.1:37850 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:32:31,903 - lava_callback - INFO - Received callback for node 69df4d0e06e8e7b15e96256b INFO: 172.20.0.1:54926 - "POST /node/69df4d0e06e8e7b15e96256b HTTP/1.0" 202 Accepted 2026-04-15 08:32:31,910 - lava_callback - INFO - Starting async job submit for node 69df4d0e06e8e7b15e96256b 2026-04-15 08:32:31,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:32:31,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d0e06e8e7b15e96256b HTTP/1.1" 200 None 2026-04-15 08:32:31,928 - lava_callback - DEBUG - Processing node 69df4d0e06e8e7b15e96256b: baseline-arm 2026-04-15 08:32:31,933 - lava_callback - WARNING - Failed to upload log 2026-04-15 08:32:31,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:32:32,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:32:32,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d0e06e8e7b15e96256b/lava-logs.yaml 2026-04-15 08:32:32,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:32:32,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:32:32,277 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d0e06e8e7b15e96256b/lava_callback.json.gz 2026-04-15 08:32:32,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:32:32,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d0e06e8e7b15e96256b HTTP/1.1" 200 None 2026-04-15 08:32:32,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:32:32,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:32:32,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:32:32,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d0e06e8e7b15e96256b HTTP/1.1" 200 None 2026-04-15 08:32:32,358 - lava_callback - INFO - Completed processing callback for node 69df4d0e06e8e7b15e96256b 2026-04-15 08:32:36,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:32:36,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50990 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:32:54,374 - lava_callback - INFO - Received callback for node 69df4d1206e8e7b15e962577 INFO: 172.20.0.1:50614 - "POST /node/69df4d1206e8e7b15e962577 HTTP/1.0" 202 Accepted 2026-04-15 08:32:54,428 - lava_callback - INFO - Starting async job submit for node 69df4d1206e8e7b15e962577 2026-04-15 08:32:54,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:32:54,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d1206e8e7b15e962577 HTTP/1.1" 200 None 2026-04-15 08:32:54,464 - lava_callback - DEBUG - Processing node 69df4d1206e8e7b15e962577: baseline-arm 2026-04-15 08:32:54,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:32:54,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:32:54,738 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d1206e8e7b15e962577/log.txt.gz 2026-04-15 08:32:54,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:32:54,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:32:54,979 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d1206e8e7b15e962577/lava-logs.yaml 2026-04-15 08:32:54,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:32:55,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:32:55,117 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d1206e8e7b15e962577/lava_callback.json.gz 2026-04-15 08:32:55,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:32:55,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d1206e8e7b15e962577 HTTP/1.1" 200 None 2026-04-15 08:32:55,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:32:55,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:32:55,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:32:55,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d1206e8e7b15e962577 HTTP/1.1" 200 None 2026-04-15 08:32:55,197 - lava_callback - INFO - Completed processing callback for node 69df4d1206e8e7b15e962577 INFO: 172.20.0.1:50618 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:33:06,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:06,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34836 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:33:07,099 - lava_callback - INFO - Received callback for node 69dcaa2e3c1e37dfe2f873fa INFO: 172.20.0.1:34848 - "POST /node/69dcaa2e3c1e37dfe2f873fa HTTP/1.0" 202 Accepted 2026-04-15 08:33:07,107 - lava_callback - INFO - Starting async job submit for node 69dcaa2e3c1e37dfe2f873fa 2026-04-15 08:33:07,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:07,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaa2e3c1e37dfe2f873fa HTTP/1.1" 200 None 2026-04-15 08:33:07,127 - lava_callback - DEBUG - Processing node 69dcaa2e3c1e37dfe2f873fa: baseline-arm-clabbe 2026-04-15 08:33:07,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcaa2e3c1e37dfe2f873fa 2026-04-15 08:33:07,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:07,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaa2e3c1e37dfe2f873fa HTTP/1.1" 200 None 2026-04-15 08:33:07,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:07,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 08:33:07,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:07,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcaa2e3c1e37dfe2f873fa HTTP/1.1" 200 None 2026-04-15 08:33:07,178 - lava_callback - ERROR - Error processing callback for node 69dcaa2e3c1e37dfe2f873fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33076 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:33:27,058 - lava_callback - INFO - Received callback for node 69dcaa513c1e37dfe2f87436 INFO: 172.20.0.1:33082 - "POST /node/69dcaa513c1e37dfe2f87436 HTTP/1.0" 202 Accepted 2026-04-15 08:33:27,064 - lava_callback - INFO - Starting async job submit for node 69dcaa513c1e37dfe2f87436 2026-04-15 08:33:27,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:27,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaa513c1e37dfe2f87436 HTTP/1.1" 200 None 2026-04-15 08:33:27,080 - lava_callback - DEBUG - Processing node 69dcaa513c1e37dfe2f87436: baseline-arm-clabbe 2026-04-15 08:33:27,080 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcaa513c1e37dfe2f87436 2026-04-15 08:33:27,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:27,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaa513c1e37dfe2f87436 HTTP/1.1" 200 None 2026-04-15 08:33:27,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:27,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 08:33:27,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:27,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcaa513c1e37dfe2f87436 HTTP/1.1" 200 None 2026-04-15 08:33:27,133 - lava_callback - ERROR - Error processing callback for node 69dcaa513c1e37dfe2f87436: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 08:33:35,049 - lava_callback - INFO - Received callback for node 69df4d0d06e8e7b15e962568 INFO: 172.20.0.1:44760 - "POST /node/69df4d0d06e8e7b15e962568 HTTP/1.0" 202 Accepted 2026-04-15 08:33:35,055 - lava_callback - INFO - Starting async job submit for node 69df4d0d06e8e7b15e962568 2026-04-15 08:33:35,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:35,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d0d06e8e7b15e962568 HTTP/1.1" 200 None 2026-04-15 08:33:35,094 - lava_callback - DEBUG - Processing node 69df4d0d06e8e7b15e962568: baseline-arm 2026-04-15 08:33:35,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:35,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:35,410 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d0d06e8e7b15e962568/log.txt.gz 2026-04-15 08:33:35,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:35,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:35,704 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d0d06e8e7b15e962568/lava-logs.yaml 2026-04-15 08:33:35,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:35,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:35,861 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d0d06e8e7b15e962568/lava_callback.json.gz 2026-04-15 08:33:35,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:35,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d0d06e8e7b15e962568 HTTP/1.1" 200 None 2026-04-15 08:33:35,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:35,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:33:35,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:35,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d0d06e8e7b15e962568 HTTP/1.1" 200 None 2026-04-15 08:33:35,945 - lava_callback - INFO - Completed processing callback for node 69df4d0d06e8e7b15e962568 2026-04-15 08:33:36,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:36,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44770 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:33:40,273 - lava_callback - INFO - Received callback for node 69df4d3206e8e7b15e96261e INFO: 172.20.0.1:57588 - "POST /node/69df4d3206e8e7b15e96261e HTTP/1.0" 202 Accepted 2026-04-15 08:33:40,321 - lava_callback - INFO - Starting async job submit for node 69df4d3206e8e7b15e96261e 2026-04-15 08:33:40,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:40,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d3206e8e7b15e96261e HTTP/1.1" 200 None 2026-04-15 08:33:40,359 - lava_callback - DEBUG - Processing node 69df4d3206e8e7b15e96261e: baseline-arm-pengutronix 2026-04-15 08:33:40,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:40,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:40,581 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69df4d3206e8e7b15e96261e/log.txt.gz 2026-04-15 08:33:40,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:40,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:40,834 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69df4d3206e8e7b15e96261e/lava-logs.yaml 2026-04-15 08:33:40,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:40,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:40,964 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69df4d3206e8e7b15e96261e/lava_callback.json.gz 2026-04-15 08:33:40,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:40,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d3206e8e7b15e96261e HTTP/1.1" 200 None 2026-04-15 08:33:41,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:41,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:33:41,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:41,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d3206e8e7b15e96261e HTTP/1.1" 200 None 2026-04-15 08:33:41,046 - lava_callback - INFO - Completed processing callback for node 69df4d3206e8e7b15e96261e 2026-04-15 08:33:44,187 - lava_callback - INFO - Received callback for node 69df4d2106e8e7b15e9625ad INFO: 172.20.0.1:57596 - "POST /node/69df4d2106e8e7b15e9625ad HTTP/1.0" 202 Accepted 2026-04-15 08:33:44,193 - lava_callback - INFO - Starting async job submit for node 69df4d2106e8e7b15e9625ad 2026-04-15 08:33:44,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:44,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d2106e8e7b15e9625ad HTTP/1.1" 200 None 2026-04-15 08:33:44,248 - lava_callback - DEBUG - Processing node 69df4d2106e8e7b15e9625ad: baseline-arm-broonie 2026-04-15 08:33:44,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:44,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:44,606 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69df4d2106e8e7b15e9625ad/log.txt.gz 2026-04-15 08:33:44,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:44,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:44,934 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69df4d2106e8e7b15e9625ad/lava-logs.yaml 2026-04-15 08:33:44,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:45,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:45,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69df4d2106e8e7b15e9625ad/lava_callback.json.gz 2026-04-15 08:33:45,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:45,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d2106e8e7b15e9625ad HTTP/1.1" 200 None 2026-04-15 08:33:45,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:45,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:33:45,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:45,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d2106e8e7b15e9625ad HTTP/1.1" 200 None 2026-04-15 08:33:45,210 - lava_callback - INFO - Completed processing callback for node 69df4d2106e8e7b15e9625ad 2026-04-15 08:33:45,997 - lava_callback - INFO - Received callback for node 69df4d3106e8e7b15e9625e9 INFO: 172.20.0.1:57612 - "POST /node/69df4d3106e8e7b15e9625e9 HTTP/1.0" 202 Accepted 2026-04-15 08:33:46,003 - lava_callback - INFO - Starting async job submit for node 69df4d3106e8e7b15e9625e9 2026-04-15 08:33:46,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:46,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d3106e8e7b15e9625e9 HTTP/1.1" 200 None 2026-04-15 08:33:46,038 - lava_callback - DEBUG - Processing node 69df4d3106e8e7b15e9625e9: baseline-arm-pengutronix 2026-04-15 08:33:46,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:46,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:46,331 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69df4d3106e8e7b15e9625e9/log.txt.gz 2026-04-15 08:33:46,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:57624 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:33:46,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:46,621 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69df4d3106e8e7b15e9625e9/lava-logs.yaml 2026-04-15 08:33:46,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:46,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:46,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69df4d3106e8e7b15e9625e9/lava_callback.json.gz 2026-04-15 08:33:46,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:46,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d3106e8e7b15e9625e9 HTTP/1.1" 200 None 2026-04-15 08:33:46,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:46,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:33:46,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:46,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d3106e8e7b15e9625e9 HTTP/1.1" 200 None 2026-04-15 08:33:46,840 - lava_callback - INFO - Completed processing callback for node 69df4d3106e8e7b15e9625e9 2026-04-15 08:33:47,898 - lava_callback - INFO - Received callback for node 69df4d1106e8e7b15e962574 INFO: 172.20.0.1:57636 - "POST /node/69df4d1106e8e7b15e962574 HTTP/1.0" 202 Accepted 2026-04-15 08:33:47,904 - lava_callback - INFO - Starting async job submit for node 69df4d1106e8e7b15e962574 2026-04-15 08:33:47,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:47,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d1106e8e7b15e962574 HTTP/1.1" 200 None 2026-04-15 08:33:47,941 - lava_callback - DEBUG - Processing node 69df4d1106e8e7b15e962574: baseline-arm 2026-04-15 08:33:48,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:48,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:48,310 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d1106e8e7b15e962574/log.txt.gz 2026-04-15 08:33:48,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:48,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:48,624 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d1106e8e7b15e962574/lava-logs.yaml 2026-04-15 08:33:48,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:33:48,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:33:48,793 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d1106e8e7b15e962574/lava_callback.json.gz 2026-04-15 08:33:48,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:48,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d1106e8e7b15e962574 HTTP/1.1" 200 None 2026-04-15 08:33:48,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:48,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:33:48,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:33:48,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d1106e8e7b15e962574 HTTP/1.1" 200 None 2026-04-15 08:33:48,867 - lava_callback - INFO - Completed processing callback for node 69df4d1106e8e7b15e962574 INFO: 172.20.0.1:38666 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:34:03,539 - lava_callback - INFO - Received callback for node 69df4d2206e8e7b15e9625b0 INFO: 172.20.0.1:60076 - "POST /node/69df4d2206e8e7b15e9625b0 HTTP/1.0" 202 Accepted 2026-04-15 08:34:03,545 - lava_callback - INFO - Starting async job submit for node 69df4d2206e8e7b15e9625b0 2026-04-15 08:34:03,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:03,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d2206e8e7b15e9625b0 HTTP/1.1" 200 None 2026-04-15 08:34:03,584 - lava_callback - DEBUG - Processing node 69df4d2206e8e7b15e9625b0: baseline-arm-broonie 2026-04-15 08:34:03,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:03,879 - lava_callback - INFO - Received callback for node 69df4d1f06e8e7b15e9625a8 2026-04-15 08:34:03,886 - lava_callback - INFO - Starting async job submit for node 69df4d1f06e8e7b15e9625a8 INFO: 172.20.0.1:60078 - "POST /node/69df4d1f06e8e7b15e9625a8 HTTP/1.0" 202 Accepted 2026-04-15 08:34:03,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:03,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d1f06e8e7b15e9625a8 HTTP/1.1" 200 None 2026-04-15 08:34:03,935 - lava_callback - DEBUG - Processing node 69df4d1f06e8e7b15e9625a8: baseline-arm-broonie 2026-04-15 08:34:03,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:03,989 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69df4d2206e8e7b15e9625b0/log.txt.gz 2026-04-15 08:34:04,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:04,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:04,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:04,427 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69df4d1f06e8e7b15e9625a8/log.txt.gz 2026-04-15 08:34:04,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:04,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69df4d2206e8e7b15e9625b0/lava-logs.yaml 2026-04-15 08:34:04,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:04,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:04,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:04,736 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69df4d2206e8e7b15e9625b0/lava_callback.json.gz 2026-04-15 08:34:04,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:04,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:04,777 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69df4d1f06e8e7b15e9625a8/lava-logs.yaml 2026-04-15 08:34:04,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d2206e8e7b15e9625b0 HTTP/1.1" 200 None 2026-04-15 08:34:04,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:04,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:04,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:34:04,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:04,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d2206e8e7b15e9625b0 HTTP/1.1" 200 None 2026-04-15 08:34:04,840 - lava_callback - INFO - Completed processing callback for node 69df4d2206e8e7b15e9625b0 2026-04-15 08:34:04,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:04,960 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69df4d1f06e8e7b15e9625a8/lava_callback.json.gz 2026-04-15 08:34:04,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:05,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d1f06e8e7b15e9625a8 HTTP/1.1" 200 None 2026-04-15 08:34:05,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:05,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:34:05,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:05,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d1f06e8e7b15e9625a8 HTTP/1.1" 200 None 2026-04-15 08:34:05,062 - lava_callback - INFO - Completed processing callback for node 69df4d1f06e8e7b15e9625a8 2026-04-15 08:34:06,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:06,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:60088 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:34:13,943 - lava_callback - INFO - Received callback for node 69df4d5d06e8e7b15e96269a INFO: 172.20.0.1:59588 - "POST /node/69df4d5d06e8e7b15e96269a HTTP/1.0" 202 Accepted 2026-04-15 08:34:13,990 - lava_callback - INFO - Starting async job submit for node 69df4d5d06e8e7b15e96269a 2026-04-15 08:34:14,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:59590 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:34:14,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d5d06e8e7b15e96269a HTTP/1.1" 200 None 2026-04-15 08:34:14,042 - lava_callback - DEBUG - Processing node 69df4d5d06e8e7b15e96269a: baseline-arm 2026-04-15 08:34:14,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:14,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:14,292 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d5d06e8e7b15e96269a/log.txt.gz 2026-04-15 08:34:14,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:14,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:14,684 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d5d06e8e7b15e96269a/lava-logs.yaml 2026-04-15 08:34:14,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:14,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:14,806 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d5d06e8e7b15e96269a/lava_callback.json.gz 2026-04-15 08:34:14,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:14,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d5d06e8e7b15e96269a HTTP/1.1" 200 None 2026-04-15 08:34:14,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:14,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:34:14,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:14,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d5d06e8e7b15e96269a HTTP/1.1" 200 None 2026-04-15 08:34:14,884 - lava_callback - INFO - Completed processing callback for node 69df4d5d06e8e7b15e96269a INFO: 172.20.0.1:59598 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 08:34:15,769 - lava_callback - INFO - Received callback for node 69df4d5c06e8e7b15e962697 INFO: 172.20.0.1:59606 - "POST /node/69df4d5c06e8e7b15e962697 HTTP/1.0" 202 Accepted 2026-04-15 08:34:15,817 - lava_callback - INFO - Starting async job submit for node 69df4d5c06e8e7b15e962697 2026-04-15 08:34:15,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:15,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d5c06e8e7b15e962697 HTTP/1.1" 200 None 2026-04-15 08:34:15,857 - lava_callback - DEBUG - Processing node 69df4d5c06e8e7b15e962697: baseline-arm 2026-04-15 08:34:15,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:16,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:16,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d5c06e8e7b15e962697/log.txt.gz 2026-04-15 08:34:16,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:59608 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:34:16,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:16,538 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d5c06e8e7b15e962697/lava-logs.yaml 2026-04-15 08:34:16,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:16,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:16,695 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d5c06e8e7b15e962697/lava_callback.json.gz 2026-04-15 08:34:16,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:16,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d5c06e8e7b15e962697 HTTP/1.1" 200 None 2026-04-15 08:34:16,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:16,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:34:16,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:16,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d5c06e8e7b15e962697 HTTP/1.1" 200 None 2026-04-15 08:34:16,769 - lava_callback - INFO - Completed processing callback for node 69df4d5c06e8e7b15e962697 2026-04-15 08:34:20,274 - lava_callback - INFO - Received callback for node 69dcaa793c1e37dfe2f87457 INFO: 172.20.0.1:34138 - "POST /node/69dcaa793c1e37dfe2f87457 HTTP/1.0" 202 Accepted 2026-04-15 08:34:20,281 - lava_callback - INFO - Starting async job submit for node 69dcaa793c1e37dfe2f87457 2026-04-15 08:34:20,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:20,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaa793c1e37dfe2f87457 HTTP/1.1" 200 None 2026-04-15 08:34:20,299 - lava_callback - DEBUG - Processing node 69dcaa793c1e37dfe2f87457: baseline-arm64-baylibre 2026-04-15 08:34:20,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcaa793c1e37dfe2f87457 2026-04-15 08:34:20,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:20,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaa793c1e37dfe2f87457 HTTP/1.1" 200 None 2026-04-15 08:34:20,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:20,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 08:34:20,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:20,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcaa793c1e37dfe2f87457 HTTP/1.1" 200 None 2026-04-15 08:34:20,351 - lava_callback - ERROR - Error processing callback for node 69dcaa793c1e37dfe2f87457: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 08:34:25,273 - lava_callback - INFO - Received callback for node 69df4d2c06e8e7b15e9625da INFO: 172.20.0.1:34148 - "POST /node/69df4d2c06e8e7b15e9625da HTTP/1.0" 202 Accepted 2026-04-15 08:34:25,279 - lava_callback - INFO - Starting async job submit for node 69df4d2c06e8e7b15e9625da 2026-04-15 08:34:25,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:25,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d2c06e8e7b15e9625da HTTP/1.1" 200 None 2026-04-15 08:34:25,318 - lava_callback - DEBUG - Processing node 69df4d2c06e8e7b15e9625da: baseline-arm-kontron 2026-04-15 08:34:25,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:25,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:25,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69df4d2c06e8e7b15e9625da/log.txt.gz 2026-04-15 08:34:25,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:25,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:25,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69df4d2c06e8e7b15e9625da/lava-logs.yaml 2026-04-15 08:34:25,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:26,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:26,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69df4d2c06e8e7b15e9625da/lava_callback.json.gz 2026-04-15 08:34:26,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:26,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d2c06e8e7b15e9625da HTTP/1.1" 200 None 2026-04-15 08:34:26,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:26,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:34:26,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:26,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d2c06e8e7b15e9625da HTTP/1.1" 200 None 2026-04-15 08:34:26,134 - lava_callback - INFO - Completed processing callback for node 69df4d2c06e8e7b15e9625da INFO: 172.20.0.1:34152 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:34:26,596 - lava_callback - INFO - Received callback for node 69df4d2e06e8e7b15e9625dd INFO: 172.20.0.1:34164 - "POST /node/69df4d2e06e8e7b15e9625dd HTTP/1.0" 202 Accepted 2026-04-15 08:34:26,602 - lava_callback - INFO - Starting async job submit for node 69df4d2e06e8e7b15e9625dd 2026-04-15 08:34:26,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:26,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d2e06e8e7b15e9625dd HTTP/1.1" 200 None 2026-04-15 08:34:26,641 - lava_callback - DEBUG - Processing node 69df4d2e06e8e7b15e9625dd: baseline-arm-kontron 2026-04-15 08:34:26,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:26,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:26,934 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69df4d2e06e8e7b15e9625dd/log.txt.gz 2026-04-15 08:34:27,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:27,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:27,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69df4d2e06e8e7b15e9625dd/lava-logs.yaml 2026-04-15 08:34:27,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:34:27,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:34:27,376 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69df4d2e06e8e7b15e9625dd/lava_callback.json.gz 2026-04-15 08:34:27,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:27,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d2e06e8e7b15e9625dd HTTP/1.1" 200 None 2026-04-15 08:34:27,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:27,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:34:27,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:27,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d2e06e8e7b15e9625dd HTTP/1.1" 200 None 2026-04-15 08:34:27,472 - lava_callback - INFO - Completed processing callback for node 69df4d2e06e8e7b15e9625dd 2026-04-15 08:34:36,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:34:36,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56316 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:35:05,468 - lava_callback - INFO - Received callback for node 69df4da506e8e7b15e962718 INFO: 172.20.0.1:38094 - "POST /node/69df4da506e8e7b15e962718 HTTP/1.0" 202 Accepted 2026-04-15 08:35:05,473 - lava_callback - INFO - Starting async job submit for node 69df4da506e8e7b15e962718 2026-04-15 08:35:05,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:35:05,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4da506e8e7b15e962718 HTTP/1.1" 200 None 2026-04-15 08:35:05,497 - lava_callback - DEBUG - Processing node 69df4da506e8e7b15e962718: baseline-arm 2026-04-15 08:35:05,505 - lava_callback - WARNING - Failed to upload log 2026-04-15 08:35:05,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:35:05,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:35:05,676 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df4da506e8e7b15e962718/lava-logs.yaml 2026-04-15 08:35:05,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:35:05,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:35:05,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df4da506e8e7b15e962718/lava_callback.json.gz 2026-04-15 08:35:05,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:35:05,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4da506e8e7b15e962718 HTTP/1.1" 200 None 2026-04-15 08:35:05,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:35:05,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:35:05,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:35:05,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4da506e8e7b15e962718 HTTP/1.1" 200 None 2026-04-15 08:35:05,869 - lava_callback - INFO - Completed processing callback for node 69df4da506e8e7b15e962718 2026-04-15 08:35:06,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:35:06,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38096 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:35:07,157 - lava_callback - INFO - Received callback for node 69dcaab23c1e37dfe2f874c3 INFO: 172.20.0.1:38100 - "POST /node/69dcaab23c1e37dfe2f874c3 HTTP/1.0" 202 Accepted 2026-04-15 08:35:07,163 - lava_callback - INFO - Starting async job submit for node 69dcaab23c1e37dfe2f874c3 2026-04-15 08:35:07,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:35:07,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaab23c1e37dfe2f874c3 HTTP/1.1" 200 None 2026-04-15 08:35:07,183 - lava_callback - DEBUG - Processing node 69dcaab23c1e37dfe2f874c3: baseline-arm-clabbe 2026-04-15 08:35:07,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcaab23c1e37dfe2f874c3 2026-04-15 08:35:07,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:35:07,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaab23c1e37dfe2f874c3 HTTP/1.1" 200 None 2026-04-15 08:35:07,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:35:07,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 08:35:07,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:35:07,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcaab23c1e37dfe2f874c3 HTTP/1.1" 200 None 2026-04-15 08:35:07,250 - lava_callback - ERROR - Error processing callback for node 69dcaab23c1e37dfe2f874c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57984 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:36:00,028 - lava_callback - INFO - Received callback for node 69dcaadb3c1e37dfe2f874e7 INFO: 172.20.0.1:33324 - "POST /node/69dcaadb3c1e37dfe2f874e7 HTTP/1.0" 202 Accepted 2026-04-15 08:36:00,034 - lava_callback - INFO - Starting async job submit for node 69dcaadb3c1e37dfe2f874e7 2026-04-15 08:36:00,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:00,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaadb3c1e37dfe2f874e7 HTTP/1.1" 200 None 2026-04-15 08:36:00,050 - lava_callback - DEBUG - Processing node 69dcaadb3c1e37dfe2f874e7: baseline-arm64-baylibre 2026-04-15 08:36:00,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcaadb3c1e37dfe2f874e7 2026-04-15 08:36:00,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:00,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaadb3c1e37dfe2f874e7 HTTP/1.1" 200 None 2026-04-15 08:36:00,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:00,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 08:36:00,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:00,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcaadb3c1e37dfe2f874e7 HTTP/1.1" 200 None 2026-04-15 08:36:00,106 - lava_callback - ERROR - Error processing callback for node 69dcaadb3c1e37dfe2f874e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53272 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:36:43,872 - lava_callback - INFO - Received callback for node 69df4d1e06e8e7b15e9625a1 INFO: 172.20.0.1:55234 - "POST /node/69df4d1e06e8e7b15e9625a1 HTTP/1.0" 202 Accepted 2026-04-15 08:36:43,878 - lava_callback - INFO - Starting async job submit for node 69df4d1e06e8e7b15e9625a1 2026-04-15 08:36:43,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:43,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d1e06e8e7b15e9625a1 HTTP/1.1" 200 None 2026-04-15 08:36:43,930 - lava_callback - DEBUG - Processing node 69df4d1e06e8e7b15e9625a1: baseline-arm-broonie 2026-04-15 08:36:44,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:36:44,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:36:44,296 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69df4d1e06e8e7b15e9625a1/log.txt.gz 2026-04-15 08:36:44,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:36:44,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:36:44,620 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69df4d1e06e8e7b15e9625a1/lava-logs.yaml 2026-04-15 08:36:44,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:36:44,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:36:44,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69df4d1e06e8e7b15e9625a1/lava_callback.json.gz 2026-04-15 08:36:44,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:44,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d1e06e8e7b15e9625a1 HTTP/1.1" 200 None 2026-04-15 08:36:44,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:44,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:36:44,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:44,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d1e06e8e7b15e9625a1 HTTP/1.1" 200 None 2026-04-15 08:36:44,990 - lava_callback - INFO - Completed processing callback for node 69df4d1e06e8e7b15e9625a1 2026-04-15 08:36:45,730 - lava_callback - INFO - Received callback for node 69df4d4806e8e7b15e962642 INFO: 172.20.0.1:55240 - "POST /node/69df4d4806e8e7b15e962642 HTTP/1.0" 202 Accepted 2026-04-15 08:36:45,738 - lava_callback - INFO - Starting async job submit for node 69df4d4806e8e7b15e962642 2026-04-15 08:36:45,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:45,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4806e8e7b15e962642 HTTP/1.1" 200 None 2026-04-15 08:36:45,777 - lava_callback - DEBUG - Processing node 69df4d4806e8e7b15e962642: ltp-dio 2026-04-15 08:36:46,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:36:46,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:36:46,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69df4d4806e8e7b15e962642/log.txt.gz 2026-04-15 08:36:46,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:55256 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:36:46,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:36:46,685 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69df4d4806e8e7b15e962642/lava-logs.yaml 2026-04-15 08:36:46,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:36:46,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:36:46,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69df4d4806e8e7b15e962642/lava_callback.json.gz 2026-04-15 08:36:46,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:46,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4806e8e7b15e962642 HTTP/1.1" 200 None 2026-04-15 08:36:46,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:46,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:36:46,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:46,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d4806e8e7b15e962642 HTTP/1.1" 200 None 2026-04-15 08:36:46,943 - lava_callback - INFO - Completed processing callback for node 69df4d4806e8e7b15e962642 2026-04-15 08:36:47,239 - lava_callback - INFO - Received callback for node 69dcab153c1e37dfe2f87543 INFO: 172.20.0.1:55272 - "POST /node/69dcab153c1e37dfe2f87543 HTTP/1.0" 202 Accepted 2026-04-15 08:36:47,244 - lava_callback - INFO - Starting async job submit for node 69dcab153c1e37dfe2f87543 2026-04-15 08:36:47,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:47,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcab153c1e37dfe2f87543 HTTP/1.1" 200 None 2026-04-15 08:36:47,266 - lava_callback - DEBUG - Processing node 69dcab153c1e37dfe2f87543: baseline-arm-clabbe 2026-04-15 08:36:47,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcab153c1e37dfe2f87543 2026-04-15 08:36:47,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:47,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcab153c1e37dfe2f87543 HTTP/1.1" 200 None 2026-04-15 08:36:47,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:47,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e0e5262f331647aec26c HTTP/1.1" 200 None 2026-04-15 08:36:47,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:36:47,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcab153c1e37dfe2f87543 HTTP/1.1" 200 None 2026-04-15 08:36:47,315 - lava_callback - ERROR - Error processing callback for node 69dcab153c1e37dfe2f87543: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39146 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:37:03,975 - lava_callback - INFO - Received callback for node 69df4d4206e8e7b15e962634 INFO: 172.20.0.1:36360 - "POST /node/69df4d4206e8e7b15e962634 HTTP/1.0" 202 Accepted 2026-04-15 08:37:03,982 - lava_callback - INFO - Starting async job submit for node 69df4d4206e8e7b15e962634 2026-04-15 08:37:04,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:04,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4206e8e7b15e962634 HTTP/1.1" 200 None 2026-04-15 08:37:04,022 - lava_callback - DEBUG - Processing node 69df4d4206e8e7b15e962634: ltp-cap_bounds 2026-04-15 08:37:04,380 - lava_callback - INFO - Received callback for node 69df4d4406e8e7b15e96263b INFO: 172.20.0.1:36370 - "POST /node/69df4d4406e8e7b15e96263b HTTP/1.0" 202 Accepted 2026-04-15 08:37:04,394 - lava_callback - INFO - Starting async job submit for node 69df4d4406e8e7b15e96263b 2026-04-15 08:37:04,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:04,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:37:04,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4406e8e7b15e96263b HTTP/1.1" 200 None 2026-04-15 08:37:04,435 - lava_callback - DEBUG - Processing node 69df4d4406e8e7b15e96263b: ltp-controllers 2026-04-15 08:37:04,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:37:04,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69df4d4206e8e7b15e962634/log.txt.gz 2026-04-15 08:37:05,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:37:05,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:37:05,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:37:05,238 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69df4d4406e8e7b15e96263b/log.txt.gz 2026-04-15 08:37:05,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:37:05,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69df4d4206e8e7b15e962634/lava-logs.yaml 2026-04-15 08:37:05,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:37:05,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:37:05,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:37:05,661 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69df4d4206e8e7b15e962634/lava_callback.json.gz 2026-04-15 08:37:05,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:05,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4206e8e7b15e962634 HTTP/1.1" 200 None 2026-04-15 08:37:05,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:05,716 - lava_callback - INFO - Received callback for node 69df4d4306e8e7b15e962638 2026-04-15 08:37:05,723 - lava_callback - INFO - Starting async job submit for node 69df4d4306e8e7b15e962638 INFO: 172.20.0.1:36372 - "POST /node/69df4d4306e8e7b15e962638 HTTP/1.0" 202 Accepted 2026-04-15 08:37:05,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:37:05,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:37:05,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:05,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:05,757 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69df4d4406e8e7b15e96263b/lava-logs.yaml 2026-04-15 08:37:05,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:37:05,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4306e8e7b15e962638 HTTP/1.1" 200 None 2026-04-15 08:37:05,777 - lava_callback - DEBUG - Processing node 69df4d4306e8e7b15e962638: ltp-containers 2026-04-15 08:37:05,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d4206e8e7b15e962634 HTTP/1.1" 200 None 2026-04-15 08:37:05,802 - lava_callback - INFO - Completed processing callback for node 69df4d4206e8e7b15e962634 2026-04-15 08:37:06,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:37:06,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69df4d4406e8e7b15e96263b/lava_callback.json.gz 2026-04-15 08:37:06,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:06,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4406e8e7b15e96263b HTTP/1.1" 200 None 2026-04-15 08:37:06,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:06,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:37:06,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:37:06,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:06,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d4406e8e7b15e96263b HTTP/1.1" 200 None 2026-04-15 08:37:06,309 - lava_callback - INFO - Completed processing callback for node 69df4d4406e8e7b15e96263b 2026-04-15 08:37:06,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:37:06,415 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69df4d4306e8e7b15e962638/log.txt.gz 2026-04-15 08:37:06,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:36388 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:37:06,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 08:37:06,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:37:06,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:37:06,895 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69df4d4306e8e7b15e962638/lava-logs.yaml 2026-04-15 08:37:06,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:37:07,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:37:07,045 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69df4d4306e8e7b15e962638/lava_callback.json.gz 2026-04-15 08:37:07,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:07,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4306e8e7b15e962638 HTTP/1.1" 200 None 2026-04-15 08:37:07,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:07,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:37:07,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:07,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d4306e8e7b15e962638 HTTP/1.1" 200 None 2026-04-15 08:37:07,123 - lava_callback - INFO - Completed processing callback for node 69df4d4306e8e7b15e962638 INFO: 172.20.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48492 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:37:20,084 - lava_callback - INFO - Received callback for node 69dcab3d3c1e37dfe2f87557 INFO: 172.20.0.1:60540 - "POST /node/69dcab3d3c1e37dfe2f87557 HTTP/1.0" 202 Accepted 2026-04-15 08:37:20,089 - lava_callback - INFO - Starting async job submit for node 69dcab3d3c1e37dfe2f87557 2026-04-15 08:37:20,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:20,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcab3d3c1e37dfe2f87557 HTTP/1.1" 200 None 2026-04-15 08:37:20,106 - lava_callback - DEBUG - Processing node 69dcab3d3c1e37dfe2f87557: baseline-arm64-baylibre 2026-04-15 08:37:20,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcab3d3c1e37dfe2f87557 2026-04-15 08:37:20,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:20,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcab3d3c1e37dfe2f87557 HTTP/1.1" 200 None 2026-04-15 08:37:20,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:20,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 08:37:20,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:20,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcab3d3c1e37dfe2f87557 HTTP/1.1" 200 None 2026-04-15 08:37:20,157 - lava_callback - ERROR - Error processing callback for node 69dcab3d3c1e37dfe2f87557: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 08:37:24,343 - lava_callback - INFO - Received callback for node 69df4d4b06e8e7b15e962649 INFO: 172.20.0.1:60544 - "POST /node/69df4d4b06e8e7b15e962649 HTTP/1.0" 202 Accepted 2026-04-15 08:37:24,349 - lava_callback - INFO - Starting async job submit for node 69df4d4b06e8e7b15e962649 2026-04-15 08:37:24,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:24,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4b06e8e7b15e962649 HTTP/1.1" 200 None 2026-04-15 08:37:24,390 - lava_callback - DEBUG - Processing node 69df4d4b06e8e7b15e962649: ltp-fsx 2026-04-15 08:37:24,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:37:24,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:37:24,879 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69df4d4b06e8e7b15e962649/log.txt.gz 2026-04-15 08:37:25,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:37:25,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:37:25,326 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69df4d4b06e8e7b15e962649/lava-logs.yaml 2026-04-15 08:37:25,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:37:25,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:37:25,679 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69df4d4b06e8e7b15e962649/lava_callback.json.gz 2026-04-15 08:37:25,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:25,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4b06e8e7b15e962649 HTTP/1.1" 200 None 2026-04-15 08:37:25,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:25,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:37:25,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:25,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d4b06e8e7b15e962649 HTTP/1.1" 200 None 2026-04-15 08:37:25,763 - lava_callback - INFO - Completed processing callback for node 69df4d4b06e8e7b15e962649 INFO: 172.20.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57914 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:37:36,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:37:36,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44244 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:38:40,150 - lava_callback - INFO - Received callback for node 69dcab893c1e37dfe2f8759a INFO: 172.20.0.1:45038 - "POST /node/69dcab893c1e37dfe2f8759a HTTP/1.0" 202 Accepted 2026-04-15 08:38:40,155 - lava_callback - INFO - Starting async job submit for node 69dcab893c1e37dfe2f8759a 2026-04-15 08:38:40,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:38:40,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcab893c1e37dfe2f8759a HTTP/1.1" 200 None 2026-04-15 08:38:40,171 - lava_callback - DEBUG - Processing node 69dcab893c1e37dfe2f8759a: baseline-arm64-baylibre 2026-04-15 08:38:40,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcab893c1e37dfe2f8759a 2026-04-15 08:38:40,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:38:40,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcab893c1e37dfe2f8759a HTTP/1.1" 200 None 2026-04-15 08:38:40,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:38:40,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 08:38:40,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:38:40,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcab893c1e37dfe2f8759a HTTP/1.1" 200 None 2026-04-15 08:38:40,226 - lava_callback - ERROR - Error processing callback for node 69dcab893c1e37dfe2f8759a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55188 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:39:40,184 - lava_callback - INFO - Received callback for node 69dcabc83c1e37dfe2f89cda INFO: 172.20.0.1:39488 - "POST /node/69dcabc83c1e37dfe2f89cda HTTP/1.0" 202 Accepted 2026-04-15 08:39:40,193 - lava_callback - INFO - Starting async job submit for node 69dcabc83c1e37dfe2f89cda 2026-04-15 08:39:40,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:39:40,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcabc83c1e37dfe2f89cda HTTP/1.1" 200 None 2026-04-15 08:39:40,226 - lava_callback - DEBUG - Processing node 69dcabc83c1e37dfe2f89cda: baseline-arm64-baylibre 2026-04-15 08:39:40,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcabc83c1e37dfe2f89cda 2026-04-15 08:39:40,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:39:40,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcabc83c1e37dfe2f89cda HTTP/1.1" 200 None 2026-04-15 08:39:40,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:39:40,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 08:39:40,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:39:40,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcabc83c1e37dfe2f89cda HTTP/1.1" 200 None 2026-04-15 08:39:40,300 - lava_callback - ERROR - Error processing callback for node 69dcabc83c1e37dfe2f89cda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33392 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:41:00,259 - lava_callback - INFO - Received callback for node 69dcac153c1e37dfe2f89d05 INFO: 172.20.0.1:48340 - "POST /node/69dcac153c1e37dfe2f89d05 HTTP/1.0" 202 Accepted 2026-04-15 08:41:00,264 - lava_callback - INFO - Starting async job submit for node 69dcac153c1e37dfe2f89d05 2026-04-15 08:41:00,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:00,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcac153c1e37dfe2f89d05 HTTP/1.1" 200 None 2026-04-15 08:41:00,280 - lava_callback - DEBUG - Processing node 69dcac153c1e37dfe2f89d05: baseline-arm64-baylibre 2026-04-15 08:41:00,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcac153c1e37dfe2f89d05 2026-04-15 08:41:00,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:00,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcac153c1e37dfe2f89d05 HTTP/1.1" 200 None 2026-04-15 08:41:00,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:00,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 08:41:00,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:00,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcac153c1e37dfe2f89d05 HTTP/1.1" 200 None 2026-04-15 08:41:00,336 - lava_callback - ERROR - Error processing callback for node 69dcac153c1e37dfe2f89d05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 08:41:03,935 - lava_callback - INFO - Received callback for node 69df4d4f06e8e7b15e962653 INFO: 172.20.0.1:48346 - "POST /node/69df4d4f06e8e7b15e962653 HTTP/1.0" 202 Accepted 2026-04-15 08:41:03,942 - lava_callback - INFO - Starting async job submit for node 69df4d4f06e8e7b15e962653 2026-04-15 08:41:03,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:03,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4f06e8e7b15e962653 HTTP/1.1" 200 None 2026-04-15 08:41:03,988 - lava_callback - DEBUG - Processing node 69df4d4f06e8e7b15e962653: ltp-pty 2026-04-15 08:41:04,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:41:04,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:41:04,489 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69df4d4f06e8e7b15e962653/log.txt.gz 2026-04-15 08:41:04,613 - lava_callback - INFO - Received callback for node 69df4d5406e8e7b15e96268d INFO: 172.20.0.1:48358 - "POST /node/69df4d5406e8e7b15e96268d HTTP/1.0" 202 Accepted 2026-04-15 08:41:04,633 - lava_callback - INFO - Starting async job submit for node 69df4d5406e8e7b15e96268d 2026-04-15 08:41:04,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:04,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d5406e8e7b15e96268d HTTP/1.1" 200 None 2026-04-15 08:41:04,774 - lava_callback - DEBUG - Processing node 69df4d5406e8e7b15e96268d: ltp-syscalls-ipc 2026-04-15 08:41:04,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:41:05,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:41:05,137 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69df4d4f06e8e7b15e962653/lava-logs.yaml 2026-04-15 08:41:05,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:41:05,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:41:05,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:41:05,298 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69df4d5406e8e7b15e96268d/log.txt.gz 2026-04-15 08:41:05,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:41:05,356 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69df4d4f06e8e7b15e962653/lava_callback.json.gz 2026-04-15 08:41:05,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:05,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4f06e8e7b15e962653 HTTP/1.1" 200 None 2026-04-15 08:41:05,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:05,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:41:05,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:41:05,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:05,577 - lava_callback - INFO - Received callback for node 69df4d5006e8e7b15e962656 INFO: 172.20.0.1:48364 - "POST /node/69df4d5006e8e7b15e962656 HTTP/1.0" 202 Accepted 2026-04-15 08:41:05,589 - lava_callback - INFO - Starting async job submit for node 69df4d5006e8e7b15e962656 2026-04-15 08:41:05,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d4f06e8e7b15e962653 HTTP/1.1" 200 None 2026-04-15 08:41:05,622 - lava_callback - INFO - Completed processing callback for node 69df4d4f06e8e7b15e962653 2026-04-15 08:41:05,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:05,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d5006e8e7b15e962656 HTTP/1.1" 200 None 2026-04-15 08:41:05,702 - lava_callback - DEBUG - Processing node 69df4d5006e8e7b15e962656: ltp-sched 2026-04-15 08:41:05,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:41:05,899 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69df4d5406e8e7b15e96268d/lava-logs.yaml 2026-04-15 08:41:06,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:41:06,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:41:06,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:41:06,255 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69df4d5006e8e7b15e962656/log.txt.gz 2026-04-15 08:41:06,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:41:06,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69df4d5406e8e7b15e96268d/lava_callback.json.gz 2026-04-15 08:41:06,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:06,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d5406e8e7b15e96268d HTTP/1.1" 200 None 2026-04-15 08:41:06,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:06,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:41:06,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:41:06,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:06,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d5406e8e7b15e96268d HTTP/1.1" 200 None 2026-04-15 08:41:06,522 - lava_callback - INFO - Completed processing callback for node 69df4d5406e8e7b15e96268d INFO: 172.20.0.1:48366 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:41:06,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:06,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 08:41:06,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:41:06,759 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69df4d5006e8e7b15e962656/lava-logs.yaml 2026-04-15 08:41:06,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:41:06,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:41:06,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69df4d5006e8e7b15e962656/lava_callback.json.gz 2026-04-15 08:41:06,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:06,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d5006e8e7b15e962656 HTTP/1.1" 200 None 2026-04-15 08:41:06,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:06,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:41:06,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:07,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d5006e8e7b15e962656 HTTP/1.1" 200 None 2026-04-15 08:41:07,015 - lava_callback - INFO - Completed processing callback for node 69df4d5006e8e7b15e962656 INFO: 172.20.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53718 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:41:36,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:36,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 08:41:43,983 - lava_callback - INFO - Received callback for node 69df4d5606e8e7b15e962690 INFO: 172.20.0.1:60404 - "POST /node/69df4d5606e8e7b15e962690 HTTP/1.0" 202 Accepted 2026-04-15 08:41:43,994 - lava_callback - INFO - Starting async job submit for node 69df4d5606e8e7b15e962690 2026-04-15 08:41:44,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:44,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d5606e8e7b15e962690 HTTP/1.1" 200 None 2026-04-15 08:41:44,084 - lava_callback - DEBUG - Processing node 69df4d5606e8e7b15e962690: ltp-timers 2026-04-15 08:41:44,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:41:45,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:41:45,015 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69df4d5606e8e7b15e962690/log.txt.gz 2026-04-15 08:41:45,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:41:45,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:41:45,738 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69df4d5606e8e7b15e962690/lava-logs.yaml 2026-04-15 08:41:45,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:41:46,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:41:46,140 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69df4d5606e8e7b15e962690/lava_callback.json.gz 2026-04-15 08:41:46,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:46,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d5606e8e7b15e962690 HTTP/1.1" 200 None 2026-04-15 08:41:46,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:46,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:41:46,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:41:46,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d5606e8e7b15e962690 HTTP/1.1" 200 None 2026-04-15 08:41:46,319 - lava_callback - INFO - Completed processing callback for node 69df4d5606e8e7b15e962690 INFO: 172.20.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58528 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:42:06,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:42:06,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45516 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:42:27,558 - lava_callback - INFO - Received callback for node 69dcac643c1e37dfe2f89d3b INFO: 172.20.0.1:45520 - "POST /node/69dcac643c1e37dfe2f89d3b HTTP/1.0" 202 Accepted 2026-04-15 08:42:27,568 - lava_callback - INFO - Starting async job submit for node 69dcac643c1e37dfe2f89d3b 2026-04-15 08:42:27,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:42:27,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcac643c1e37dfe2f89d3b HTTP/1.1" 200 None 2026-04-15 08:42:27,597 - lava_callback - DEBUG - Processing node 69dcac643c1e37dfe2f89d3b: baseline-arm64-clabbe 2026-04-15 08:42:27,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcac643c1e37dfe2f89d3b 2026-04-15 08:42:27,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:42:27,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcac643c1e37dfe2f89d3b HTTP/1.1" 200 None 2026-04-15 08:42:27,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:42:27,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 08:42:27,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:42:27,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcac643c1e37dfe2f89d3b HTTP/1.1" 200 None 2026-04-15 08:42:27,744 - lava_callback - ERROR - Error processing callback for node 69dcac643c1e37dfe2f89d3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 08:42:28,711 - lava_callback - INFO - Received callback for node 69df4f5606e8e7b15e962887 INFO: 172.20.0.1:45528 - "POST /node/69df4f5606e8e7b15e962887 HTTP/1.0" 202 Accepted 2026-04-15 08:42:28,722 - lava_callback - INFO - Starting async job submit for node 69df4f5606e8e7b15e962887 2026-04-15 08:42:28,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:42:28,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4f5606e8e7b15e962887 HTTP/1.1" 200 None 2026-04-15 08:42:28,763 - lava_callback - DEBUG - Processing node 69df4f5606e8e7b15e962887: baseline-arm 2026-04-15 08:42:28,773 - lava_callback - WARNING - Failed to upload log 2026-04-15 08:42:28,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:42:29,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:42:29,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df4f5606e8e7b15e962887/lava-logs.yaml 2026-04-15 08:42:29,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:42:29,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:42:29,434 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df4f5606e8e7b15e962887/lava_callback.json.gz 2026-04-15 08:42:29,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:42:29,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4f5606e8e7b15e962887 HTTP/1.1" 200 None 2026-04-15 08:42:29,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:42:29,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:42:29,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:42:29,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4f5606e8e7b15e962887 HTTP/1.1" 200 None 2026-04-15 08:42:29,534 - lava_callback - INFO - Completed processing callback for node 69df4f5606e8e7b15e962887 INFO: 172.20.0.1:40772 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:42:36,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:42:36,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52404 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:43:20,463 - lava_callback - INFO - Received callback for node 69dcaca43c1e37dfe2f89d71 INFO: 172.20.0.1:52986 - "POST /node/69dcaca43c1e37dfe2f89d71 HTTP/1.0" 202 Accepted 2026-04-15 08:43:20,471 - lava_callback - INFO - Starting async job submit for node 69dcaca43c1e37dfe2f89d71 2026-04-15 08:43:20,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:43:20,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaca43c1e37dfe2f89d71 HTTP/1.1" 200 None 2026-04-15 08:43:20,491 - lava_callback - DEBUG - Processing node 69dcaca43c1e37dfe2f89d71: baseline-arm64-baylibre 2026-04-15 08:43:20,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcaca43c1e37dfe2f89d71 2026-04-15 08:43:20,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:43:20,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaca43c1e37dfe2f89d71 HTTP/1.1" 200 None 2026-04-15 08:43:20,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:43:20,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 08:43:20,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:43:20,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcaca43c1e37dfe2f89d71 HTTP/1.1" 200 None 2026-04-15 08:43:20,549 - lava_callback - ERROR - Error processing callback for node 69dcaca43c1e37dfe2f89d71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44322 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:44:24,052 - lava_callback - INFO - Received callback for node 69df4f2f06e8e7b15e962854 INFO: 172.20.0.1:46792 - "POST /node/69df4f2f06e8e7b15e962854 HTTP/1.0" 202 Accepted 2026-04-15 08:44:24,064 - lava_callback - INFO - Starting async job submit for node 69df4f2f06e8e7b15e962854 2026-04-15 08:44:24,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:44:24,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4f2f06e8e7b15e962854 HTTP/1.1" 200 None 2026-04-15 08:44:24,137 - lava_callback - DEBUG - Processing node 69df4f2f06e8e7b15e962854: ltp-syscalls 2026-04-15 08:44:25,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:44:26,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:44:26,084 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69df4f2f06e8e7b15e962854/log.txt.gz INFO: 172.20.0.1:46800 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:44:26,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:44:28,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:44:28,038 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69df4f2f06e8e7b15e962854/lava-logs.yaml 2026-04-15 08:44:28,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:44:28,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:44:28,749 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69df4f2f06e8e7b15e962854/lava_callback.json.gz 2026-04-15 08:44:28,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:44:28,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4f2f06e8e7b15e962854 HTTP/1.1" 200 None 2026-04-15 08:44:28,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:44:28,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:44:28,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:44:28,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4f2f06e8e7b15e962854 HTTP/1.1" 200 None 2026-04-15 08:44:28,880 - lava_callback - INFO - Completed processing callback for node 69df4f2f06e8e7b15e962854 INFO: 172.20.0.1:55086 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:44:36,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:44:36,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42846 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:44:47,622 - lava_callback - INFO - Received callback for node 69dcacef3c1e37dfe2f89ddb INFO: 172.20.0.1:42862 - "POST /node/69dcacef3c1e37dfe2f89ddb HTTP/1.0" 202 Accepted 2026-04-15 08:44:47,632 - lava_callback - INFO - Starting async job submit for node 69dcacef3c1e37dfe2f89ddb 2026-04-15 08:44:47,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:44:47,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcacef3c1e37dfe2f89ddb HTTP/1.1" 200 None 2026-04-15 08:44:47,656 - lava_callback - DEBUG - Processing node 69dcacef3c1e37dfe2f89ddb: baseline-arm64-clabbe 2026-04-15 08:44:47,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcacef3c1e37dfe2f89ddb 2026-04-15 08:44:47,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:44:47,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcacef3c1e37dfe2f89ddb HTTP/1.1" 200 None 2026-04-15 08:44:47,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:44:47,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 08:44:47,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:44:47,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcacef3c1e37dfe2f89ddb HTTP/1.1" 200 None 2026-04-15 08:44:47,764 - lava_callback - ERROR - Error processing callback for node 69dcacef3c1e37dfe2f89ddb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55746 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:45:00,494 - lava_callback - INFO - Received callback for node 69df4ff406e8e7b15e962920 INFO: 172.20.0.1:36646 - "POST /node/69df4ff406e8e7b15e962920 HTTP/1.0" 202 Accepted 2026-04-15 08:45:00,504 - lava_callback - INFO - Starting async job submit for node 69df4ff406e8e7b15e962920 2026-04-15 08:45:00,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:00,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ff406e8e7b15e962920 HTTP/1.1" 200 None 2026-04-15 08:45:00,574 - lava_callback - DEBUG - Processing node 69df4ff406e8e7b15e962920: baseline-arm64 2026-04-15 08:45:00,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:01,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:01,114 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff406e8e7b15e962920/log.txt.gz 2026-04-15 08:45:01,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:01,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:01,946 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff406e8e7b15e962920/lava-logs.yaml 2026-04-15 08:45:01,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:02,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:02,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff406e8e7b15e962920/lava_callback.json.gz 2026-04-15 08:45:02,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:02,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ff406e8e7b15e962920 HTTP/1.1" 200 None 2026-04-15 08:45:02,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:02,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:45:02,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:02,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4ff406e8e7b15e962920 HTTP/1.1" 200 None 2026-04-15 08:45:02,571 - lava_callback - INFO - Completed processing callback for node 69df4ff406e8e7b15e962920 2026-04-15 08:45:04,079 - lava_callback - INFO - Received callback for node 69df4d5706e8e7b15e962694 INFO: 172.20.0.1:36660 - "POST /node/69df4d5706e8e7b15e962694 HTTP/1.0" 202 Accepted 2026-04-15 08:45:04,090 - lava_callback - INFO - Starting async job submit for node 69df4d5706e8e7b15e962694 2026-04-15 08:45:04,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:04,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d5706e8e7b15e962694 HTTP/1.1" 200 None 2026-04-15 08:45:04,162 - lava_callback - DEBUG - Processing node 69df4d5706e8e7b15e962694: ltp-watchqueue 2026-04-15 08:45:04,418 - lava_callback - INFO - Received callback for node 69df4ea106e8e7b15e9627d5 INFO: 172.20.0.1:36674 - "POST /node/69df4ea106e8e7b15e9627d5 HTTP/1.0" 202 Accepted 2026-04-15 08:45:04,446 - lava_callback - INFO - Starting async job submit for node 69df4ea106e8e7b15e9627d5 2026-04-15 08:45:04,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:04,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ea106e8e7b15e9627d5 HTTP/1.1" 200 None 2026-04-15 08:45:04,628 - lava_callback - DEBUG - Processing node 69df4ea106e8e7b15e9627d5: ltp-cve 2026-04-15 08:45:05,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:05,714 - lava_callback - INFO - Received callback for node 69df4ec206e8e7b15e9627f1 INFO: 172.20.0.1:36678 - "POST /node/69df4ec206e8e7b15e9627f1 HTTP/1.0" 202 Accepted 2026-04-15 08:45:05,741 - lava_callback - INFO - Starting async job submit for node 69df4ec206e8e7b15e9627f1 2026-04-15 08:45:05,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:05,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ec206e8e7b15e9627f1 HTTP/1.1" 200 None 2026-04-15 08:45:05,924 - lava_callback - DEBUG - Processing node 69df4ec206e8e7b15e9627f1: ltp-fs_bind 2026-04-15 08:45:05,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:05,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69df4d5706e8e7b15e962694/log.txt.gz 2026-04-15 08:45:05,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:36690 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:45:06,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:06,674 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69df4ea106e8e7b15e9627d5/log.txt.gz 2026-04-15 08:45:06,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:06,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:06,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 08:45:07,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:07,651 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69df4d5706e8e7b15e962694/lava-logs.yaml 2026-04-15 08:45:07,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:07,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:07,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:08,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:08,233 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69df4ec206e8e7b15e9627f1/log.txt.gz 2026-04-15 08:45:08,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:08,322 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69df4d5706e8e7b15e962694/lava_callback.json.gz 2026-04-15 08:45:08,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:08,435 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69df4ea106e8e7b15e9627d5/lava-logs.yaml 2026-04-15 08:45:08,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:08,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:08,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d5706e8e7b15e962694 HTTP/1.1" 200 None 2026-04-15 08:45:08,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:08,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:45:08,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:08,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d5706e8e7b15e962694 HTTP/1.1" 200 None 2026-04-15 08:45:08,712 - lava_callback - INFO - Completed processing callback for node 69df4d5706e8e7b15e962694 2026-04-15 08:45:08,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:09,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:09,155 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69df4ea106e8e7b15e9627d5/lava_callback.json.gz 2026-04-15 08:45:09,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:09,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ea106e8e7b15e9627d5 HTTP/1.1" 200 None 2026-04-15 08:45:09,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:09,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:45:09,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:09,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4ea106e8e7b15e9627d5 HTTP/1.1" 200 None 2026-04-15 08:45:09,297 - lava_callback - INFO - Completed processing callback for node 69df4ea106e8e7b15e9627d5 2026-04-15 08:45:09,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:09,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69df4ec206e8e7b15e9627f1/lava-logs.yaml 2026-04-15 08:45:09,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:10,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:10,089 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69df4ec206e8e7b15e9627f1/lava_callback.json.gz 2026-04-15 08:45:10,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:10,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ec206e8e7b15e9627f1 HTTP/1.1" 200 None 2026-04-15 08:45:10,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:10,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:45:10,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:10,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4ec206e8e7b15e9627f1 HTTP/1.1" 200 None 2026-04-15 08:45:10,253 - lava_callback - INFO - Completed processing callback for node 69df4ec206e8e7b15e9627f1 INFO: 172.20.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43198 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:45:30,677 - lava_callback - INFO - Received callback for node 69df500306e8e7b15e962942 INFO: 172.20.0.1:43566 - "POST /node/69df500306e8e7b15e962942 HTTP/1.0" 202 Accepted 2026-04-15 08:45:30,687 - lava_callback - INFO - Starting async job submit for node 69df500306e8e7b15e962942 2026-04-15 08:45:30,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:30,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500306e8e7b15e962942 HTTP/1.1" 200 None 2026-04-15 08:45:30,722 - lava_callback - DEBUG - Processing node 69df500306e8e7b15e962942: baseline-arm64 2026-04-15 08:45:30,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:31,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:31,179 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500306e8e7b15e962942/log.txt.gz 2026-04-15 08:45:31,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:31,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:31,549 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500306e8e7b15e962942/lava-logs.yaml 2026-04-15 08:45:31,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:31,561 - lava_callback - INFO - Received callback for node 69df501706e8e7b15e962999 INFO: 172.20.0.1:43570 - "POST /node/69df501706e8e7b15e962999 HTTP/1.0" 202 Accepted 2026-04-15 08:45:31,567 - lava_callback - INFO - Starting async job submit for node 69df501706e8e7b15e962999 2026-04-15 08:45:31,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:31,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501706e8e7b15e962999 HTTP/1.1" 200 None 2026-04-15 08:45:31,585 - lava_callback - DEBUG - Processing node 69df501706e8e7b15e962999: baseline-nfs-arm64 2026-04-15 08:45:31,586 - lava_callback - WARNING - Failed to upload log 2026-04-15 08:45:31,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:31,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:31,800 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500306e8e7b15e962942/lava_callback.json.gz 2026-04-15 08:45:31,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:31,862 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501706e8e7b15e962999/lava-logs.yaml 2026-04-15 08:45:31,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:31,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:31,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500306e8e7b15e962942 HTTP/1.1" 200 None 2026-04-15 08:45:31,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:31,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:45:31,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:32,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df500306e8e7b15e962942 HTTP/1.1" 200 None 2026-04-15 08:45:32,049 - lava_callback - INFO - Completed processing callback for node 69df500306e8e7b15e962942 2026-04-15 08:45:32,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:32,367 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501706e8e7b15e962999/lava_callback.json.gz 2026-04-15 08:45:32,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:32,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501706e8e7b15e962999 HTTP/1.1" 200 None 2026-04-15 08:45:32,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:32,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:45:32,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:32,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df501706e8e7b15e962999 HTTP/1.1" 200 None 2026-04-15 08:45:32,447 - lava_callback - INFO - Completed processing callback for node 69df501706e8e7b15e962999 INFO: 172.20.0.1:43582 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:45:36,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:37,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 08:45:39,134 - lava_callback - INFO - Received callback for node 69df4ff606e8e7b15e962926 INFO: 172.20.0.1:43588 - "POST /node/69df4ff606e8e7b15e962926 HTTP/1.0" 202 Accepted 2026-04-15 08:45:39,148 - lava_callback - INFO - Starting async job submit for node 69df4ff606e8e7b15e962926 2026-04-15 08:45:39,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:39,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ff606e8e7b15e962926 HTTP/1.1" 200 None 2026-04-15 08:45:39,253 - lava_callback - DEBUG - Processing node 69df4ff606e8e7b15e962926: baseline-arm64 2026-04-15 08:45:39,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:40,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:40,177 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff606e8e7b15e962926/log.txt.gz 2026-04-15 08:45:40,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:40,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:40,767 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff606e8e7b15e962926/lava-logs.yaml 2026-04-15 08:45:40,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:45:40,832 - lava_callback - INFO - Received callback for node 69dcad303c1e37dfe2f89e1d INFO: 172.20.0.1:35580 - "POST /node/69dcad303c1e37dfe2f89e1d HTTP/1.0" 202 Accepted 2026-04-15 08:45:40,841 - lava_callback - INFO - Starting async job submit for node 69dcad303c1e37dfe2f89e1d 2026-04-15 08:45:40,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:40,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcad303c1e37dfe2f89e1d HTTP/1.1" 200 None 2026-04-15 08:45:40,870 - lava_callback - DEBUG - Processing node 69dcad303c1e37dfe2f89e1d: baseline-arm64-baylibre 2026-04-15 08:45:40,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcad303c1e37dfe2f89e1d 2026-04-15 08:45:40,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:40,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcad303c1e37dfe2f89e1d HTTP/1.1" 200 None 2026-04-15 08:45:40,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:40,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 08:45:40,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:41,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcad303c1e37dfe2f89e1d HTTP/1.1" 200 None 2026-04-15 08:45:41,031 - lava_callback - ERROR - Error processing callback for node 69dcad303c1e37dfe2f89e1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 08:45:41,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:45:41,317 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff606e8e7b15e962926/lava_callback.json.gz 2026-04-15 08:45:41,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:41,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ff606e8e7b15e962926 HTTP/1.1" 200 None 2026-04-15 08:45:41,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:41,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:45:41,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:45:41,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4ff606e8e7b15e962926 HTTP/1.1" 200 None 2026-04-15 08:45:41,453 - lava_callback - INFO - Completed processing callback for node 69df4ff606e8e7b15e962926 INFO: 172.20.0.1:35582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59868 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:46:05,654 - lava_callback - INFO - Received callback for node 69df4ff506e8e7b15e962923 INFO: 172.20.0.1:37902 - "POST /node/69df4ff506e8e7b15e962923 HTTP/1.0" 202 Accepted 2026-04-15 08:46:05,660 - lava_callback - INFO - Starting async job submit for node 69df4ff506e8e7b15e962923 2026-04-15 08:46:05,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:05,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ff506e8e7b15e962923 HTTP/1.1" 200 None 2026-04-15 08:46:05,711 - lava_callback - DEBUG - Processing node 69df4ff506e8e7b15e962923: baseline-arm64 2026-04-15 08:46:06,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:06,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:06,400 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff506e8e7b15e962923/log.txt.gz INFO: 172.20.0.1:37916 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:46:06,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:07,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:07,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 08:46:07,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:07,125 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff506e8e7b15e962923/lava-logs.yaml 2026-04-15 08:46:07,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:07,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:07,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff506e8e7b15e962923/lava_callback.json.gz 2026-04-15 08:46:07,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:07,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ff506e8e7b15e962923 HTTP/1.1" 200 None 2026-04-15 08:46:07,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:07,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:46:07,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:07,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4ff506e8e7b15e962923 HTTP/1.1" 200 None 2026-04-15 08:46:07,397 - lava_callback - INFO - Completed processing callback for node 69df4ff506e8e7b15e962923 2026-04-15 08:46:10,879 - lava_callback - INFO - Received callback for node 69df4ff906e8e7b15e96292c INFO: 172.20.0.1:59320 - "POST /node/69df4ff906e8e7b15e96292c HTTP/1.0" 202 Accepted 2026-04-15 08:46:10,891 - lava_callback - INFO - Starting async job submit for node 69df4ff906e8e7b15e96292c 2026-04-15 08:46:10,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:10,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ff906e8e7b15e96292c HTTP/1.1" 200 None 2026-04-15 08:46:10,964 - lava_callback - DEBUG - Processing node 69df4ff906e8e7b15e96292c: baseline-arm64 2026-04-15 08:46:11,174 - lava_callback - WARNING - Failed to upload log 2026-04-15 08:46:11,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:11,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:11,617 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff906e8e7b15e96292c/lava-logs.yaml 2026-04-15 08:46:11,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:11,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:11,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff906e8e7b15e96292c/lava_callback.json.gz 2026-04-15 08:46:11,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:11,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ff906e8e7b15e96292c HTTP/1.1" 200 None 2026-04-15 08:46:11,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:11,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:46:11,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:11,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4ff906e8e7b15e96292c HTTP/1.1" 200 None 2026-04-15 08:46:11,888 - lava_callback - INFO - Completed processing callback for node 69df4ff906e8e7b15e96292c INFO: 172.20.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59362 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:46:24,076 - lava_callback - INFO - Received callback for node 69df4ee706e8e7b15e96280e INFO: 172.20.0.1:41192 - "POST /node/69df4ee706e8e7b15e96280e HTTP/1.0" 202 Accepted 2026-04-15 08:46:24,086 - lava_callback - INFO - Starting async job submit for node 69df4ee706e8e7b15e96280e 2026-04-15 08:46:24,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:24,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ee706e8e7b15e96280e HTTP/1.1" 200 None 2026-04-15 08:46:24,167 - lava_callback - DEBUG - Processing node 69df4ee706e8e7b15e96280e: ltp-input 2026-04-15 08:46:24,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:25,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:25,199 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69df4ee706e8e7b15e96280e/log.txt.gz 2026-04-15 08:46:25,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:25,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:25,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69df4ee706e8e7b15e96280e/lava-logs.yaml 2026-04-15 08:46:25,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:26,039 - lava_callback - INFO - Received callback for node 69df500a06e8e7b15e96296e INFO: 172.20.0.1:41196 - "POST /node/69df500a06e8e7b15e96296e HTTP/1.0" 202 Accepted 2026-04-15 08:46:26,050 - lava_callback - INFO - Starting async job submit for node 69df500a06e8e7b15e96296e 2026-04-15 08:46:26,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:26,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500a06e8e7b15e96296e HTTP/1.1" 200 None 2026-04-15 08:46:26,134 - lava_callback - DEBUG - Processing node 69df500a06e8e7b15e96296e: baseline-arm64 2026-04-15 08:46:26,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:26,354 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69df4ee706e8e7b15e96280e/lava_callback.json.gz 2026-04-15 08:46:26,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:41206 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:46:26,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ee706e8e7b15e96280e HTTP/1.1" 200 None 2026-04-15 08:46:26,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:26,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:46:26,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:26,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4ee706e8e7b15e96280e HTTP/1.1" 200 None 2026-04-15 08:46:26,721 - lava_callback - INFO - Completed processing callback for node 69df4ee706e8e7b15e96280e 2026-04-15 08:46:26,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:27,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:27,198 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500a06e8e7b15e96296e/log.txt.gz 2026-04-15 08:46:27,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:27,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:27,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500a06e8e7b15e96296e/lava-logs.yaml 2026-04-15 08:46:27,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:28,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:28,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500a06e8e7b15e96296e/lava_callback.json.gz 2026-04-15 08:46:28,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:28,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500a06e8e7b15e96296e HTTP/1.1" 200 None 2026-04-15 08:46:28,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:28,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:46:28,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:28,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df500a06e8e7b15e96296e HTTP/1.1" 200 None 2026-04-15 08:46:28,161 - lava_callback - INFO - Completed processing callback for node 69df500a06e8e7b15e96296e INFO: 172.20.0.1:55074 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:46:37,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:37,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 08:46:44,291 - lava_callback - INFO - Received callback for node 69df502d06e8e7b15e9629f5 INFO: 172.20.0.1:60282 - "POST /node/69df502d06e8e7b15e9629f5 HTTP/1.0" 202 Accepted 2026-04-15 08:46:44,300 - lava_callback - INFO - Starting async job submit for node 69df502d06e8e7b15e9629f5 2026-04-15 08:46:44,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:44,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df502d06e8e7b15e9629f5 HTTP/1.1" 200 None 2026-04-15 08:46:44,374 - lava_callback - DEBUG - Processing node 69df502d06e8e7b15e9629f5: baseline-arm64-broonie 2026-04-15 08:46:44,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:45,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:45,183 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df502d06e8e7b15e9629f5/log.txt.gz 2026-04-15 08:46:45,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:46,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:46,191 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df502d06e8e7b15e9629f5/lava-logs.yaml 2026-04-15 08:46:46,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:46:46,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:46:46,452 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df502d06e8e7b15e9629f5/lava_callback.json.gz 2026-04-15 08:46:46,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:46,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df502d06e8e7b15e9629f5 HTTP/1.1" 200 None 2026-04-15 08:46:46,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:60290 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:46:46,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:46:46,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:46,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df502d06e8e7b15e9629f5 HTTP/1.1" 200 None 2026-04-15 08:46:46,618 - lava_callback - INFO - Completed processing callback for node 69df502d06e8e7b15e9629f5 INFO: 172.20.0.1:35848 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:46:59,817 - lava_callback - INFO - Received callback for node 69df4ffd06e8e7b15e962935 INFO: 172.20.0.1:48426 - "POST /node/69df4ffd06e8e7b15e962935 HTTP/1.0" 202 Accepted 2026-04-15 08:46:59,827 - lava_callback - INFO - Starting async job submit for node 69df4ffd06e8e7b15e962935 2026-04-15 08:46:59,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:46:59,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ffd06e8e7b15e962935 HTTP/1.1" 200 None 2026-04-15 08:46:59,918 - lava_callback - DEBUG - Processing node 69df4ffd06e8e7b15e962935: baseline-arm64 2026-04-15 08:47:00,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:00,490 - lava_callback - INFO - Received callback for node 69df504c06e8e7b15e962a6b INFO: 172.20.0.1:48436 - "POST /node/69df504c06e8e7b15e962a6b HTTP/1.0" 202 Accepted 2026-04-15 08:47:00,501 - lava_callback - INFO - Starting async job submit for node 69df504c06e8e7b15e962a6b 2026-04-15 08:47:00,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:00,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504c06e8e7b15e962a6b HTTP/1.1" 200 None 2026-04-15 08:47:00,562 - lava_callback - DEBUG - Processing node 69df504c06e8e7b15e962a6b: baseline-arm64-foundriesio 2026-04-15 08:47:00,613 - lava_callback - INFO - Received callback for node 69df504d06e8e7b15e962a6e INFO: 172.20.0.1:48448 - "POST /node/69df504d06e8e7b15e962a6e HTTP/1.0" 202 Accepted 2026-04-15 08:47:00,630 - lava_callback - INFO - Starting async job submit for node 69df504d06e8e7b15e962a6e 2026-04-15 08:47:00,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:00,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504d06e8e7b15e962a6e HTTP/1.1" 200 None 2026-04-15 08:47:00,810 - lava_callback - DEBUG - Processing node 69df504d06e8e7b15e962a6e: baseline-arm64-foundriesio 2026-04-15 08:47:01,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:01,255 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ffd06e8e7b15e962935/log.txt.gz 2026-04-15 08:47:01,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:01,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:02,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:02,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:02,155 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df504c06e8e7b15e962a6b/log.txt.gz 2026-04-15 08:47:02,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:02,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:02,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df504d06e8e7b15e962a6e/log.txt.gz 2026-04-15 08:47:02,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:02,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ffd06e8e7b15e962935/lava-logs.yaml 2026-04-15 08:47:02,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:03,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:03,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:03,585 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df504c06e8e7b15e962a6b/lava-logs.yaml 2026-04-15 08:47:03,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:03,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:03,619 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ffd06e8e7b15e962935/lava_callback.json.gz 2026-04-15 08:47:03,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:03,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ffd06e8e7b15e962935 HTTP/1.1" 200 None 2026-04-15 08:47:03,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:03,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:03,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:03,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4ffd06e8e7b15e962935 HTTP/1.1" 200 None 2026-04-15 08:47:03,756 - lava_callback - INFO - Completed processing callback for node 69df4ffd06e8e7b15e962935 2026-04-15 08:47:04,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:04,214 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df504d06e8e7b15e962a6e/lava-logs.yaml 2026-04-15 08:47:04,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:04,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:04,262 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df504c06e8e7b15e962a6b/lava_callback.json.gz 2026-04-15 08:47:04,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:04,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504c06e8e7b15e962a6b HTTP/1.1" 200 None 2026-04-15 08:47:04,326 - lava_callback - INFO - Received callback for node 69df503606e8e7b15e962a17 2026-04-15 08:47:04,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:48454 - "POST /node/69df503606e8e7b15e962a17 HTTP/1.0" 202 Accepted 2026-04-15 08:47:04,342 - lava_callback - INFO - Starting async job submit for node 69df503606e8e7b15e962a17 2026-04-15 08:47:04,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:04,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:04,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:04,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df504c06e8e7b15e962a6b HTTP/1.1" 200 None 2026-04-15 08:47:04,448 - lava_callback - INFO - Completed processing callback for node 69df504c06e8e7b15e962a6b 2026-04-15 08:47:04,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df503606e8e7b15e962a17 HTTP/1.1" 200 None 2026-04-15 08:47:04,469 - lava_callback - DEBUG - Processing node 69df503606e8e7b15e962a17: baseline-arm64-broonie 2026-04-15 08:47:04,659 - lava_callback - INFO - Received callback for node 69df504806e8e7b15e962a62 INFO: 172.20.0.1:48460 - "POST /node/69df504806e8e7b15e962a62 HTTP/1.0" 202 Accepted 2026-04-15 08:47:04,669 - lava_callback - INFO - Starting async job submit for node 69df504806e8e7b15e962a62 2026-04-15 08:47:04,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:04,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504806e8e7b15e962a62 HTTP/1.1" 200 None 2026-04-15 08:47:04,844 - lava_callback - DEBUG - Processing node 69df504806e8e7b15e962a62: baseline-arm64-pengutronix 2026-04-15 08:47:05,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:05,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:05,717 - lava_callback - INFO - Received callback for node 69df504706e8e7b15e962a5f 2026-04-15 08:47:05,727 - lava_callback - INFO - Starting async job submit for node 69df504706e8e7b15e962a5f INFO: 172.20.0.1:48468 - "POST /node/69df504706e8e7b15e962a5f HTTP/1.0" 202 Accepted 2026-04-15 08:47:05,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:05,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504706e8e7b15e962a5f HTTP/1.1" 200 None 2026-04-15 08:47:05,804 - lava_callback - DEBUG - Processing node 69df504706e8e7b15e962a5f: baseline-arm64-kontron 2026-04-15 08:47:05,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:05,972 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69df504d06e8e7b15e962a6e/lava_callback.json.gz 2026-04-15 08:47:06,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:06,059 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df503606e8e7b15e962a17/log.txt.gz 2026-04-15 08:47:06,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:06,100 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69df504806e8e7b15e962a62/log.txt.gz 2026-04-15 08:47:06,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:06,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504d06e8e7b15e962a6e HTTP/1.1" 200 None 2026-04-15 08:47:06,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:06,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:06,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:48476 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:47:06,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df504d06e8e7b15e962a6e HTTP/1.1" 200 None 2026-04-15 08:47:06,635 - lava_callback - INFO - Completed processing callback for node 69df504d06e8e7b15e962a6e 2026-04-15 08:47:06,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:06,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:06,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:07,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:07,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 08:47:07,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:07,383 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69df504706e8e7b15e962a5f/log.txt.gz 2026-04-15 08:47:07,616 - lava_callback - INFO - Received callback for node 69dcad763c1e37dfe2f89e7b INFO: 172.20.0.1:48484 - "POST /node/69dcad763c1e37dfe2f89e7b HTTP/1.0" 202 Accepted 2026-04-15 08:47:07,633 - lava_callback - INFO - Starting async job submit for node 69dcad763c1e37dfe2f89e7b 2026-04-15 08:47:07,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:07,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:07,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcad763c1e37dfe2f89e7b HTTP/1.1" 200 None 2026-04-15 08:47:07,685 - lava_callback - DEBUG - Processing node 69dcad763c1e37dfe2f89e7b: baseline-arm64-clabbe 2026-04-15 08:47:07,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcad763c1e37dfe2f89e7b 2026-04-15 08:47:07,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:07,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcad763c1e37dfe2f89e7b HTTP/1.1" 200 None 2026-04-15 08:47:07,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:07,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 08:47:07,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:07,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcad763c1e37dfe2f89e7b HTTP/1.1" 200 None 2026-04-15 08:47:07,796 - lava_callback - ERROR - Error processing callback for node 69dcad763c1e37dfe2f89e7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 08:47:08,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:08,033 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df503606e8e7b15e962a17/lava-logs.yaml 2026-04-15 08:47:08,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:08,038 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69df504806e8e7b15e962a62/lava-logs.yaml 2026-04-15 08:47:08,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:08,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:08,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:08,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df503606e8e7b15e962a17/lava_callback.json.gz 2026-04-15 08:47:08,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:08,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df503606e8e7b15e962a17 HTTP/1.1" 200 None 2026-04-15 08:47:08,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:08,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:08,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:08,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df503606e8e7b15e962a17 HTTP/1.1" 200 None 2026-04-15 08:47:08,649 - lava_callback - INFO - Completed processing callback for node 69df503606e8e7b15e962a17 2026-04-15 08:47:08,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:08,913 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69df504706e8e7b15e962a5f/lava-logs.yaml 2026-04-15 08:47:08,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:08,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69df504806e8e7b15e962a62/lava_callback.json.gz 2026-04-15 08:47:08,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:09,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:09,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504806e8e7b15e962a62 HTTP/1.1" 200 None 2026-04-15 08:47:09,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:09,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:09,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:09,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df504806e8e7b15e962a62 HTTP/1.1" 200 None 2026-04-15 08:47:09,111 - lava_callback - INFO - Completed processing callback for node 69df504806e8e7b15e962a62 2026-04-15 08:47:09,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:09,530 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69df504706e8e7b15e962a5f/lava_callback.json.gz 2026-04-15 08:47:09,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:09,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504706e8e7b15e962a5f HTTP/1.1" 200 None 2026-04-15 08:47:09,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:09,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:09,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:09,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df504706e8e7b15e962a5f HTTP/1.1" 200 None 2026-04-15 08:47:09,697 - lava_callback - INFO - Completed processing callback for node 69df504706e8e7b15e962a5f 2026-04-15 08:47:10,965 - lava_callback - INFO - Received callback for node 69df504906e8e7b15e962a65 INFO: 172.20.0.1:45298 - "POST /node/69df504906e8e7b15e962a65 HTTP/1.0" 202 Accepted 2026-04-15 08:47:10,974 - lava_callback - INFO - Starting async job submit for node 69df504906e8e7b15e962a65 2026-04-15 08:47:11,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:11,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504906e8e7b15e962a65 HTTP/1.1" 200 None 2026-04-15 08:47:11,048 - lava_callback - DEBUG - Processing node 69df504906e8e7b15e962a65: baseline-arm64-pengutronix 2026-04-15 08:47:11,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:11,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:11,979 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69df504906e8e7b15e962a65/log.txt.gz 2026-04-15 08:47:12,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:13,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:13,042 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69df504906e8e7b15e962a65/lava-logs.yaml 2026-04-15 08:47:13,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:13,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:13,654 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69df504906e8e7b15e962a65/lava_callback.json.gz 2026-04-15 08:47:13,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:13,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504906e8e7b15e962a65 HTTP/1.1" 200 None 2026-04-15 08:47:13,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:13,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:13,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:13,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df504906e8e7b15e962a65 HTTP/1.1" 200 None 2026-04-15 08:47:13,791 - lava_callback - INFO - Completed processing callback for node 69df504906e8e7b15e962a65 INFO: 172.20.0.1:45312 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:47:14,328 - lava_callback - INFO - Received callback for node 69df4ff706e8e7b15e962929 INFO: 172.20.0.1:45326 - "POST /node/69df4ff706e8e7b15e962929 HTTP/1.0" 202 Accepted 2026-04-15 08:47:14,349 - lava_callback - INFO - Starting async job submit for node 69df4ff706e8e7b15e962929 2026-04-15 08:47:14,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:14,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ff706e8e7b15e962929 HTTP/1.1" 200 None 2026-04-15 08:47:14,434 - lava_callback - DEBUG - Processing node 69df4ff706e8e7b15e962929: baseline-arm64 2026-04-15 08:47:14,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:45338 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 08:47:15,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:15,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff706e8e7b15e962929/log.txt.gz 2026-04-15 08:47:15,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:45352 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:47:16,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:16,582 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff706e8e7b15e962929/lava-logs.yaml 2026-04-15 08:47:16,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:16,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:16,967 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ff706e8e7b15e962929/lava_callback.json.gz 2026-04-15 08:47:17,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:17,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ff706e8e7b15e962929 HTTP/1.1" 200 None 2026-04-15 08:47:17,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:17,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:17,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:17,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4ff706e8e7b15e962929 HTTP/1.1" 200 None 2026-04-15 08:47:17,115 - lava_callback - INFO - Completed processing callback for node 69df4ff706e8e7b15e962929 2026-04-15 08:47:18,196 - lava_callback - INFO - Received callback for node 69df504b06e8e7b15e962a68 INFO: 172.20.0.1:45362 - "POST /node/69df504b06e8e7b15e962a68 HTTP/1.0" 202 Accepted 2026-04-15 08:47:18,206 - lava_callback - INFO - Starting async job submit for node 69df504b06e8e7b15e962a68 2026-04-15 08:47:18,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:18,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504b06e8e7b15e962a68 HTTP/1.1" 200 None 2026-04-15 08:47:18,285 - lava_callback - DEBUG - Processing node 69df504b06e8e7b15e962a68: baseline-arm64-pengutronix 2026-04-15 08:47:18,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:19,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:19,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69df504b06e8e7b15e962a68/log.txt.gz 2026-04-15 08:47:19,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:19,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:19,850 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69df504b06e8e7b15e962a68/lava-logs.yaml 2026-04-15 08:47:19,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:20,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:20,304 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69df504b06e8e7b15e962a68/lava_callback.json.gz 2026-04-15 08:47:20,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:20,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504b06e8e7b15e962a68 HTTP/1.1" 200 None 2026-04-15 08:47:20,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:20,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:20,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:20,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df504b06e8e7b15e962a68 HTTP/1.1" 200 None 2026-04-15 08:47:20,453 - lava_callback - INFO - Completed processing callback for node 69df504b06e8e7b15e962a68 2026-04-15 08:47:21,068 - lava_callback - INFO - Received callback for node 69df4ffa06e8e7b15e96292f INFO: 172.20.0.1:59008 - "POST /node/69df4ffa06e8e7b15e96292f HTTP/1.0" 202 Accepted 2026-04-15 08:47:21,080 - lava_callback - INFO - Starting async job submit for node 69df4ffa06e8e7b15e96292f 2026-04-15 08:47:21,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:21,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ffa06e8e7b15e96292f HTTP/1.1" 200 None 2026-04-15 08:47:21,158 - lava_callback - DEBUG - Processing node 69df4ffa06e8e7b15e96292f: baseline-arm64 2026-04-15 08:47:21,529 - lava_callback - WARNING - Failed to upload log 2026-04-15 08:47:21,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:22,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:22,189 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ffa06e8e7b15e96292f/lava-logs.yaml 2026-04-15 08:47:22,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:22,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:22,537 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ffa06e8e7b15e96292f/lava_callback.json.gz 2026-04-15 08:47:22,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:22,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ffa06e8e7b15e96292f HTTP/1.1" 200 None 2026-04-15 08:47:22,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:22,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:22,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:22,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4ffa06e8e7b15e96292f HTTP/1.1" 200 None 2026-04-15 08:47:22,785 - lava_callback - INFO - Completed processing callback for node 69df4ffa06e8e7b15e96292f 2026-04-15 08:47:24,016 - lava_callback - INFO - Received callback for node 69df503206e8e7b15e962a08 INFO: 172.20.0.1:59018 - "POST /node/69df503206e8e7b15e962a08 HTTP/1.0" 202 Accepted 2026-04-15 08:47:24,027 - lava_callback - INFO - Starting async job submit for node 69df503206e8e7b15e962a08 2026-04-15 08:47:24,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:24,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df503206e8e7b15e962a08 HTTP/1.1" 200 None 2026-04-15 08:47:24,104 - lava_callback - DEBUG - Processing node 69df503206e8e7b15e962a08: baseline-arm64-broonie 2026-04-15 08:47:24,573 - lava_callback - INFO - Received callback for node 69df4bf606e8e7b15e962539 INFO: 172.20.0.1:59032 - "POST /node/69df4bf606e8e7b15e962539 HTTP/1.0" 202 Accepted 2026-04-15 08:47:24,589 - lava_callback - INFO - Starting async job submit for node 69df4bf606e8e7b15e962539 2026-04-15 08:47:24,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:24,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:24,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4bf606e8e7b15e962539 HTTP/1.1" 200 None 2026-04-15 08:47:24,731 - lava_callback - DEBUG - Processing node 69df4bf606e8e7b15e962539: ltp-smoke 2026-04-15 08:47:25,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:25,026 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df503206e8e7b15e962a08/log.txt.gz 2026-04-15 08:47:25,579 - lava_callback - INFO - Received callback for node 69df503306e8e7b15e962a0b INFO: 172.20.0.1:59036 - "POST /node/69df503306e8e7b15e962a0b HTTP/1.0" 202 Accepted 2026-04-15 08:47:25,616 - lava_callback - INFO - Starting async job submit for node 69df503306e8e7b15e962a0b 2026-04-15 08:47:25,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:25,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:25,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df503306e8e7b15e962a0b HTTP/1.1" 200 None 2026-04-15 08:47:25,795 - lava_callback - DEBUG - Processing node 69df503306e8e7b15e962a0b: baseline-arm64-broonie 2026-04-15 08:47:25,813 - lava_callback - INFO - Received callback for node 69df504506e8e7b15e962a5c INFO: 172.20.0.1:59046 - "POST /node/69df504506e8e7b15e962a5c HTTP/1.0" 202 Accepted 2026-04-15 08:47:25,895 - lava_callback - INFO - Starting async job submit for node 69df504506e8e7b15e962a5c 2026-04-15 08:47:26,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:26,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504506e8e7b15e962a5c HTTP/1.1" 200 None 2026-04-15 08:47:26,209 - lava_callback - DEBUG - Processing node 69df504506e8e7b15e962a5c: baseline-arm64-kontron 2026-04-15 08:47:26,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:26,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:26,460 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df503206e8e7b15e962a08/lava-logs.yaml 2026-04-15 08:47:26,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:59060 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:47:26,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:26,857 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69df4bf606e8e7b15e962539/log.txt.gz 2026-04-15 08:47:26,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:27,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:27,076 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df503206e8e7b15e962a08/lava_callback.json.gz 2026-04-15 08:47:27,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:27,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:27,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df503206e8e7b15e962a08 HTTP/1.1" 200 None 2026-04-15 08:47:27,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:27,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:27,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:27,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:27,495 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df503306e8e7b15e962a0b/log.txt.gz 2026-04-15 08:47:27,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df503206e8e7b15e962a08 HTTP/1.1" 200 None 2026-04-15 08:47:27,620 - lava_callback - INFO - Completed processing callback for node 69df503206e8e7b15e962a08 2026-04-15 08:47:27,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:27,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69df504506e8e7b15e962a5c/log.txt.gz 2026-04-15 08:47:28,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:28,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:28,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:28,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:28,822 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69df4bf606e8e7b15e962539/lava-logs.yaml 2026-04-15 08:47:28,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:28,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:28,863 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df503306e8e7b15e962a0b/lava-logs.yaml 2026-04-15 08:47:28,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:28,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:28,927 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69df504506e8e7b15e962a5c/lava-logs.yaml 2026-04-15 08:47:28,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:29,263 - lava_callback - INFO - Received callback for node 69df500706e8e7b15e962964 INFO: 172.20.0.1:59072 - "POST /node/69df500706e8e7b15e962964 HTTP/1.0" 202 Accepted 2026-04-15 08:47:29,273 - lava_callback - INFO - Starting async job submit for node 69df500706e8e7b15e962964 2026-04-15 08:47:29,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:29,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500706e8e7b15e962964 HTTP/1.1" 200 None 2026-04-15 08:47:29,348 - lava_callback - DEBUG - Processing node 69df500706e8e7b15e962964: baseline-arm64 2026-04-15 08:47:29,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:29,438 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df503306e8e7b15e962a0b/lava_callback.json.gz 2026-04-15 08:47:29,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:29,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:29,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:29,524 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69df504506e8e7b15e962a5c/lava_callback.json.gz 2026-04-15 08:47:29,524 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69df4bf606e8e7b15e962539/lava_callback.json.gz 2026-04-15 08:47:29,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df503306e8e7b15e962a0b HTTP/1.1" 200 None 2026-04-15 08:47:29,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:29,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:29,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df504506e8e7b15e962a5c HTTP/1.1" 200 None 2026-04-15 08:47:29,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:29,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:29,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:30,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df503306e8e7b15e962a0b HTTP/1.1" 200 None 2026-04-15 08:47:30,061 - lava_callback - INFO - Completed processing callback for node 69df503306e8e7b15e962a0b 2026-04-15 08:47:30,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:30,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:30,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df504506e8e7b15e962a5c HTTP/1.1" 200 None 2026-04-15 08:47:30,217 - lava_callback - INFO - Completed processing callback for node 69df504506e8e7b15e962a5c 2026-04-15 08:47:30,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:30,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4bf606e8e7b15e962539 HTTP/1.1" 200 None 2026-04-15 08:47:30,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:30,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499906e8e7b15e9624b4 HTTP/1.1" 200 None 2026-04-15 08:47:30,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:30,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:30,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4bf606e8e7b15e962539 HTTP/1.1" 200 None 2026-04-15 08:47:30,717 - lava_callback - INFO - Completed processing callback for node 69df4bf606e8e7b15e962539 2026-04-15 08:47:31,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:31,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500706e8e7b15e962964/log.txt.gz 2026-04-15 08:47:31,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:32,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:32,130 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500706e8e7b15e962964/lava-logs.yaml 2026-04-15 08:47:32,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:32,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:32,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500706e8e7b15e962964/lava_callback.json.gz 2026-04-15 08:47:32,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:32,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500706e8e7b15e962964 HTTP/1.1" 200 None 2026-04-15 08:47:32,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:32,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:32,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:32,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df500706e8e7b15e962964 HTTP/1.1" 200 None 2026-04-15 08:47:32,661 - lava_callback - INFO - Completed processing callback for node 69df500706e8e7b15e962964 2026-04-15 08:47:33,937 - lava_callback - INFO - Received callback for node 69df500106e8e7b15e96293f INFO: 172.20.0.1:48694 - "POST /node/69df500106e8e7b15e96293f HTTP/1.0" 202 Accepted 2026-04-15 08:47:33,947 - lava_callback - INFO - Starting async job submit for node 69df500106e8e7b15e96293f 2026-04-15 08:47:34,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:34,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500106e8e7b15e96293f HTTP/1.1" 200 None 2026-04-15 08:47:34,028 - lava_callback - DEBUG - Processing node 69df500106e8e7b15e96293f: baseline-arm64 2026-04-15 08:47:34,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:35,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:35,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500106e8e7b15e96293f/log.txt.gz 2026-04-15 08:47:35,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:36,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:36,140 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500106e8e7b15e96293f/lava-logs.yaml 2026-04-15 08:47:36,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:48706 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:47:36,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:36,543 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500106e8e7b15e96293f/lava_callback.json.gz 2026-04-15 08:47:36,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:36,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500106e8e7b15e96293f HTTP/1.1" 200 None 2026-04-15 08:47:36,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:36,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:36,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:36,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df500106e8e7b15e96293f HTTP/1.1" 200 None 2026-04-15 08:47:36,730 - lava_callback - INFO - Completed processing callback for node 69df500106e8e7b15e96293f 2026-04-15 08:47:37,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:37,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 08:47:40,542 - lava_callback - INFO - Received callback for node 69df4ffe06e8e7b15e962938 INFO: 172.20.0.1:34898 - "POST /node/69df4ffe06e8e7b15e962938 HTTP/1.0" 202 Accepted 2026-04-15 08:47:40,552 - lava_callback - INFO - Starting async job submit for node 69df4ffe06e8e7b15e962938 2026-04-15 08:47:40,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:40,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ffe06e8e7b15e962938 HTTP/1.1" 200 None 2026-04-15 08:47:40,634 - lava_callback - DEBUG - Processing node 69df4ffe06e8e7b15e962938: baseline-arm64 2026-04-15 08:47:41,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:41,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:41,539 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ffe06e8e7b15e962938/log.txt.gz 2026-04-15 08:47:41,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:42,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:42,442 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ffe06e8e7b15e962938/lava-logs.yaml 2026-04-15 08:47:42,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:42,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:42,870 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ffe06e8e7b15e962938/lava_callback.json.gz 2026-04-15 08:47:42,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:42,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ffe06e8e7b15e962938 HTTP/1.1" 200 None 2026-04-15 08:47:42,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:42,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:42,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:43,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4ffe06e8e7b15e962938 HTTP/1.1" 200 None 2026-04-15 08:47:43,024 - lava_callback - INFO - Completed processing callback for node 69df4ffe06e8e7b15e962938 2026-04-15 08:47:44,046 - lava_callback - INFO - Received callback for node 69df503806e8e7b15e962a1a INFO: 172.20.0.1:34902 - "POST /node/69df503806e8e7b15e962a1a HTTP/1.0" 202 Accepted 2026-04-15 08:47:44,058 - lava_callback - INFO - Starting async job submit for node 69df503806e8e7b15e962a1a 2026-04-15 08:47:44,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:44,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df503806e8e7b15e962a1a HTTP/1.1" 200 None 2026-04-15 08:47:44,125 - lava_callback - DEBUG - Processing node 69df503806e8e7b15e962a1a: baseline-arm64-broonie 2026-04-15 08:47:44,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:44,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:44,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df503806e8e7b15e962a1a/log.txt.gz 2026-04-15 08:47:45,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:45,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:45,791 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df503806e8e7b15e962a1a/lava-logs.yaml 2026-04-15 08:47:45,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:46,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:46,248 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df503806e8e7b15e962a1a/lava_callback.json.gz 2026-04-15 08:47:46,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:46,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df503806e8e7b15e962a1a HTTP/1.1" 200 None 2026-04-15 08:47:46,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:46,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:46,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:46,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df503806e8e7b15e962a1a HTTP/1.1" 200 None 2026-04-15 08:47:46,421 - lava_callback - INFO - Completed processing callback for node 69df503806e8e7b15e962a1a INFO: 172.20.0.1:34918 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:47:55,644 - lava_callback - INFO - Received callback for node 69df501406e8e7b15e962987 INFO: 172.20.0.1:42642 - "POST /node/69df501406e8e7b15e962987 HTTP/1.0" 202 Accepted 2026-04-15 08:47:55,656 - lava_callback - INFO - Starting async job submit for node 69df501406e8e7b15e962987 2026-04-15 08:47:55,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:55,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501406e8e7b15e962987 HTTP/1.1" 200 None 2026-04-15 08:47:55,745 - lava_callback - DEBUG - Processing node 69df501406e8e7b15e962987: baseline-nfs-arm64 INFO: 172.20.0.1:42658 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:47:56,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:57,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:57,292 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501406e8e7b15e962987/log.txt.gz 2026-04-15 08:47:57,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:58,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:58,962 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501406e8e7b15e962987/lava-logs.yaml 2026-04-15 08:47:58,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:47:59,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:47:59,889 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501406e8e7b15e962987/lava_callback.json.gz 2026-04-15 08:47:59,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:59,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501406e8e7b15e962987 HTTP/1.1" 200 None 2026-04-15 08:47:59,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:47:59,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:47:59,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:00,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df501406e8e7b15e962987 HTTP/1.1" 200 None 2026-04-15 08:48:00,035 - lava_callback - INFO - Completed processing callback for node 69df501406e8e7b15e962987 2026-04-15 08:48:00,739 - lava_callback - INFO - Received callback for node 69dcadb33c1e37dfe2f89edc INFO: 172.20.0.1:57564 - "POST /node/69dcadb33c1e37dfe2f89edc HTTP/1.0" 202 Accepted 2026-04-15 08:48:00,747 - lava_callback - INFO - Starting async job submit for node 69dcadb33c1e37dfe2f89edc 2026-04-15 08:48:00,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:00,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcadb33c1e37dfe2f89edc HTTP/1.1" 200 None 2026-04-15 08:48:00,772 - lava_callback - DEBUG - Processing node 69dcadb33c1e37dfe2f89edc: baseline-arm64-baylibre 2026-04-15 08:48:00,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcadb33c1e37dfe2f89edc 2026-04-15 08:48:00,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:00,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcadb33c1e37dfe2f89edc HTTP/1.1" 200 None 2026-04-15 08:48:00,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:00,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 08:48:00,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:00,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcadb33c1e37dfe2f89edc HTTP/1.1" 200 None 2026-04-15 08:48:00,882 - lava_callback - ERROR - Error processing callback for node 69dcadb33c1e37dfe2f89edc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 08:48:00,916 - lava_callback - INFO - Received callback for node 69df50b506e8e7b15e962b64 INFO: 172.20.0.1:57576 - "POST /node/69df50b506e8e7b15e962b64 HTTP/1.0" 202 Accepted 2026-04-15 08:48:00,942 - lava_callback - INFO - Starting async job submit for node 69df50b506e8e7b15e962b64 2026-04-15 08:48:00,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:01,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df50b506e8e7b15e962b64 HTTP/1.1" 200 None 2026-04-15 08:48:01,008 - lava_callback - DEBUG - Processing node 69df50b506e8e7b15e962b64: baseline-arm 2026-04-15 08:48:01,022 - lava_callback - WARNING - Failed to upload log 2026-04-15 08:48:01,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:48:01,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:01,401 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df50b506e8e7b15e962b64/lava-logs.yaml 2026-04-15 08:48:01,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:48:02,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:02,106 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df50b506e8e7b15e962b64/lava_callback.json.gz 2026-04-15 08:48:02,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:02,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df50b506e8e7b15e962b64 HTTP/1.1" 200 None 2026-04-15 08:48:02,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:02,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:48:02,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:02,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df50b506e8e7b15e962b64 HTTP/1.1" 200 None 2026-04-15 08:48:02,260 - lava_callback - INFO - Completed processing callback for node 69df50b506e8e7b15e962b64 2026-04-15 08:48:04,607 - lava_callback - INFO - Received callback for node 69df502f06e8e7b15e9629f8 INFO: 172.20.0.1:57588 - "POST /node/69df502f06e8e7b15e9629f8 HTTP/1.0" 202 Accepted 2026-04-15 08:48:04,617 - lava_callback - INFO - Starting async job submit for node 69df502f06e8e7b15e9629f8 2026-04-15 08:48:04,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:04,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df502f06e8e7b15e9629f8 HTTP/1.1" 200 None 2026-04-15 08:48:04,691 - lava_callback - DEBUG - Processing node 69df502f06e8e7b15e9629f8: baseline-arm64-broonie 2026-04-15 08:48:05,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:48:05,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:05,537 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df502f06e8e7b15e9629f8/log.txt.gz 2026-04-15 08:48:05,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:57594 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:48:06,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:06,645 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df502f06e8e7b15e9629f8/lava-logs.yaml 2026-04-15 08:48:06,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:48:07,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:07,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 08:48:07,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:07,391 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df502f06e8e7b15e9629f8/lava_callback.json.gz 2026-04-15 08:48:07,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:07,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df502f06e8e7b15e9629f8 HTTP/1.1" 200 None 2026-04-15 08:48:07,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:07,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:48:07,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:07,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df502f06e8e7b15e9629f8 HTTP/1.1" 200 None 2026-04-15 08:48:07,486 - lava_callback - INFO - Completed processing callback for node 69df502f06e8e7b15e9629f8 2026-04-15 08:48:09,254 - lava_callback - INFO - Received callback for node 69df501606e8e7b15e962996 INFO: 172.20.0.1:57610 - "POST /node/69df501606e8e7b15e962996 HTTP/1.0" 202 Accepted 2026-04-15 08:48:09,266 - lava_callback - INFO - Starting async job submit for node 69df501606e8e7b15e962996 2026-04-15 08:48:09,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:09,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501606e8e7b15e962996 HTTP/1.1" 200 None 2026-04-15 08:48:09,349 - lava_callback - DEBUG - Processing node 69df501606e8e7b15e962996: baseline-nfs-arm64 2026-04-15 08:48:09,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:48:10,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:10,542 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501606e8e7b15e962996/log.txt.gz 2026-04-15 08:48:10,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:48:11,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:11,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501606e8e7b15e962996/lava-logs.yaml 2026-04-15 08:48:11,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:48:11,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:11,480 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501606e8e7b15e962996/lava_callback.json.gz 2026-04-15 08:48:11,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:11,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501606e8e7b15e962996 HTTP/1.1" 200 None 2026-04-15 08:48:11,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:11,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:48:11,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:11,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df501606e8e7b15e962996 HTTP/1.1" 200 None 2026-04-15 08:48:11,556 - lava_callback - INFO - Completed processing callback for node 69df501606e8e7b15e962996 INFO: 172.20.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50966 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:48:17,883 - lava_callback - INFO - Received callback for node 69df500006e8e7b15e96293c INFO: 172.20.0.1:50970 - "POST /node/69df500006e8e7b15e96293c HTTP/1.0" 202 Accepted 2026-04-15 08:48:17,968 - lava_callback - INFO - Starting async job submit for node 69df500006e8e7b15e96293c 2026-04-15 08:48:18,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:18,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500006e8e7b15e96293c HTTP/1.1" 200 None 2026-04-15 08:48:18,037 - lava_callback - DEBUG - Processing node 69df500006e8e7b15e96293c: baseline-arm64 INFO: 172.20.0.1:41254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50620 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:48:37,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:37,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 08:48:38,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:48:39,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:39,219 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500006e8e7b15e96293c/log.txt.gz INFO: 172.20.0.1:39096 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:48:47,417 - lava_callback - INFO - Received callback for node 69df500f06e8e7b15e96297b INFO: 172.20.0.1:39098 - "POST /node/69df500f06e8e7b15e96297b HTTP/1.0" 202 Accepted 2026-04-15 08:48:47,450 - lava_callback - INFO - Starting async job submit for node 69df500f06e8e7b15e96297b 2026-04-15 08:48:47,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:47,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500f06e8e7b15e96297b HTTP/1.1" 200 None 2026-04-15 08:48:47,595 - lava_callback - DEBUG - Processing node 69df500f06e8e7b15e96297b: baseline-nfs-arm64 2026-04-15 08:48:48,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:48:49,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:49,413 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df500f06e8e7b15e96297b/log.txt.gz 2026-04-15 08:48:50,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:48:50,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:50,534 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df500f06e8e7b15e96297b/lava-logs.yaml 2026-04-15 08:48:50,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:48:51,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:51,152 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df500f06e8e7b15e96297b/lava_callback.json.gz 2026-04-15 08:48:51,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:51,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500f06e8e7b15e96297b HTTP/1.1" 200 None 2026-04-15 08:48:51,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:51,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:48:51,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:51,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df500f06e8e7b15e96297b HTTP/1.1" 200 None 2026-04-15 08:48:51,485 - lava_callback - INFO - Completed processing callback for node 69df500f06e8e7b15e96297b 2026-04-15 08:48:52,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:48:53,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:53,626 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500006e8e7b15e96293c/lava-logs.yaml 2026-04-15 08:48:53,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:48:54,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:48:54,242 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500006e8e7b15e96293c/lava_callback.json.gz 2026-04-15 08:48:54,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:54,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500006e8e7b15e96293c HTTP/1.1" 200 None 2026-04-15 08:48:54,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:54,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:48:54,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:48:54,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df500006e8e7b15e96293c HTTP/1.1" 200 None 2026-04-15 08:48:54,356 - lava_callback - INFO - Completed processing callback for node 69df500006e8e7b15e96293c INFO: 172.20.0.1:50016 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:49:04,799 - lava_callback - INFO - Received callback for node 69df4f0c06e8e7b15e962828 INFO: 172.20.0.1:50708 - "POST /node/69df4f0c06e8e7b15e962828 HTTP/1.0" 202 Accepted 2026-04-15 08:49:04,805 - lava_callback - INFO - Starting async job submit for node 69df4f0c06e8e7b15e962828 2026-04-15 08:49:04,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:04,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4f0c06e8e7b15e962828 HTTP/1.1" 200 None 2026-04-15 08:49:04,849 - lava_callback - DEBUG - Processing node 69df4f0c06e8e7b15e962828: ltp-smoke 2026-04-15 08:49:05,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:05,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:05,663 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69df4f0c06e8e7b15e962828/log.txt.gz 2026-04-15 08:49:05,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:06,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:06,316 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69df4f0c06e8e7b15e962828/lava-logs.yaml 2026-04-15 08:49:06,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:06,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:06,475 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69df4f0c06e8e7b15e962828/lava_callback.json.gz 2026-04-15 08:49:06,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:50722 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:49:06,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4f0c06e8e7b15e962828 HTTP/1.1" 200 None 2026-04-15 08:49:06,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:06,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:49:06,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:06,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4f0c06e8e7b15e962828 HTTP/1.1" 200 None 2026-04-15 08:49:06,576 - lava_callback - INFO - Completed processing callback for node 69df4f0c06e8e7b15e962828 2026-04-15 08:49:07,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:07,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49168 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:49:23,481 - lava_callback - INFO - Received callback for node 69df501c06e8e7b15e9629a2 INFO: 172.20.0.1:54282 - "POST /node/69df501c06e8e7b15e9629a2 HTTP/1.0" 202 Accepted 2026-04-15 08:49:23,494 - lava_callback - INFO - Starting async job submit for node 69df501c06e8e7b15e9629a2 2026-04-15 08:49:23,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:23,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501c06e8e7b15e9629a2 HTTP/1.1" 200 None 2026-04-15 08:49:23,572 - lava_callback - DEBUG - Processing node 69df501c06e8e7b15e9629a2: baseline-nfs-arm64 2026-04-15 08:49:23,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:24,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:24,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501c06e8e7b15e9629a2/log.txt.gz 2026-04-15 08:49:24,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:25,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:25,123 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501c06e8e7b15e9629a2/lava-logs.yaml 2026-04-15 08:49:25,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:25,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:25,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501c06e8e7b15e9629a2/lava_callback.json.gz 2026-04-15 08:49:25,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:25,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501c06e8e7b15e9629a2 HTTP/1.1" 200 None 2026-04-15 08:49:25,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:25,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:49:25,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:25,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df501c06e8e7b15e9629a2 HTTP/1.1" 200 None 2026-04-15 08:49:25,390 - lava_callback - INFO - Completed processing callback for node 69df501c06e8e7b15e9629a2 INFO: 172.20.0.1:54286 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:49:27,768 - lava_callback - INFO - Received callback for node 69dcae013c1e37dfe2f89f23 INFO: 172.20.0.1:54292 - "POST /node/69dcae013c1e37dfe2f89f23 HTTP/1.0" 202 Accepted 2026-04-15 08:49:27,777 - lava_callback - INFO - Starting async job submit for node 69dcae013c1e37dfe2f89f23 2026-04-15 08:49:27,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:27,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcae013c1e37dfe2f89f23 HTTP/1.1" 200 None 2026-04-15 08:49:27,810 - lava_callback - DEBUG - Processing node 69dcae013c1e37dfe2f89f23: baseline-arm64-clabbe 2026-04-15 08:49:27,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcae013c1e37dfe2f89f23 2026-04-15 08:49:27,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:27,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcae013c1e37dfe2f89f23 HTTP/1.1" 200 None 2026-04-15 08:49:27,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:27,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 08:49:27,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:27,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcae013c1e37dfe2f89f23 HTTP/1.1" 200 None 2026-04-15 08:49:27,899 - lava_callback - ERROR - Error processing callback for node 69dcae013c1e37dfe2f89f23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 08:49:30,192 - lava_callback - INFO - Received callback for node 69df4d0f06e8e7b15e962571 INFO: 172.20.0.1:59556 - "POST /node/69df4d0f06e8e7b15e962571 HTTP/1.0" 202 Accepted 2026-04-15 08:49:30,202 - lava_callback - INFO - Starting async job submit for node 69df4d0f06e8e7b15e962571 2026-04-15 08:49:30,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:30,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d0f06e8e7b15e962571 HTTP/1.1" 200 None 2026-04-15 08:49:30,285 - lava_callback - DEBUG - Processing node 69df4d0f06e8e7b15e962571: baseline-arm 2026-04-15 08:49:31,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:31,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:31,600 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d0f06e8e7b15e962571/log.txt.gz 2026-04-15 08:49:31,914 - lava_callback - INFO - Received callback for node 69df4ffb06e8e7b15e962932 INFO: 172.20.0.1:59570 - "POST /node/69df4ffb06e8e7b15e962932 HTTP/1.0" 202 Accepted 2026-04-15 08:49:31,930 - lava_callback - INFO - Starting async job submit for node 69df4ffb06e8e7b15e962932 2026-04-15 08:49:31,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:32,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ffb06e8e7b15e962932 HTTP/1.1" 200 None 2026-04-15 08:49:32,037 - lava_callback - DEBUG - Processing node 69df4ffb06e8e7b15e962932: baseline-arm64 2026-04-15 08:49:32,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:32,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:32,708 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d0f06e8e7b15e962571/lava-logs.yaml 2026-04-15 08:49:32,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:32,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:32,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:32,869 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ffb06e8e7b15e962932/log.txt.gz 2026-04-15 08:49:32,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:32,989 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df4d0f06e8e7b15e962571/lava_callback.json.gz DEBUG: Setup failed for 69df4d0f06e8e7b15e962571. Transitting job node result: incomplete -> fail 2026-04-15 08:49:33,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:33,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:33,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d0f06e8e7b15e962571 HTTP/1.1" 200 None 2026-04-15 08:49:33,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:33,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:49:33,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:33,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d0f06e8e7b15e962571 HTTP/1.1" 200 None 2026-04-15 08:49:33,376 - lava_callback - INFO - Completed processing callback for node 69df4d0f06e8e7b15e962571 2026-04-15 08:49:33,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:33,478 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ffb06e8e7b15e962932/lava-logs.yaml 2026-04-15 08:49:33,484 - lava_callback - INFO - Received callback for node 69df501e06e8e7b15e9629a9 INFO: 172.20.0.1:59572 - "POST /node/69df501e06e8e7b15e9629a9 HTTP/1.0" 202 Accepted 2026-04-15 08:49:33,492 - lava_callback - INFO - Starting async job submit for node 69df501e06e8e7b15e9629a9 2026-04-15 08:49:33,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:33,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:33,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501e06e8e7b15e9629a9 HTTP/1.1" 200 None 2026-04-15 08:49:33,532 - lava_callback - DEBUG - Processing node 69df501e06e8e7b15e9629a9: baseline-nfs-arm64 2026-04-15 08:49:33,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:33,781 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df4ffb06e8e7b15e962932/lava_callback.json.gz 2026-04-15 08:49:33,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:33,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4ffb06e8e7b15e962932 HTTP/1.1" 200 None 2026-04-15 08:49:33,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:33,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:34,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:49:34,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:34,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4ffb06e8e7b15e962932 HTTP/1.1" 200 None 2026-04-15 08:49:34,114 - lava_callback - INFO - Completed processing callback for node 69df4ffb06e8e7b15e962932 2026-04-15 08:49:34,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:34,210 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501e06e8e7b15e9629a9/log.txt.gz 2026-04-15 08:49:34,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:34,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:34,686 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501e06e8e7b15e9629a9/lava-logs.yaml 2026-04-15 08:49:34,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:34,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:34,883 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501e06e8e7b15e9629a9/lava_callback.json.gz 2026-04-15 08:49:34,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:34,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501e06e8e7b15e9629a9 HTTP/1.1" 200 None 2026-04-15 08:49:34,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:34,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:49:34,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:35,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df501e06e8e7b15e9629a9 HTTP/1.1" 200 None 2026-04-15 08:49:35,017 - lava_callback - INFO - Completed processing callback for node 69df501e06e8e7b15e9629a9 INFO: 172.20.0.1:59586 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:49:37,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:37,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-15 08:49:42,428 - lava_callback - INFO - Received callback for node 69df501006e8e7b15e96297e INFO: 172.20.0.1:39646 - "POST /node/69df501006e8e7b15e96297e HTTP/1.0" 202 Accepted 2026-04-15 08:49:42,440 - lava_callback - INFO - Starting async job submit for node 69df501006e8e7b15e96297e 2026-04-15 08:49:42,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:42,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501006e8e7b15e96297e HTTP/1.1" 200 None 2026-04-15 08:49:42,480 - lava_callback - DEBUG - Processing node 69df501006e8e7b15e96297e: baseline-nfs-arm64 2026-04-15 08:49:42,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:42,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:42,931 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501006e8e7b15e96297e/log.txt.gz 2026-04-15 08:49:43,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:43,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:43,302 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501006e8e7b15e96297e/lava-logs.yaml 2026-04-15 08:49:43,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:43,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:43,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501006e8e7b15e96297e/lava_callback.json.gz 2026-04-15 08:49:43,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:43,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501006e8e7b15e96297e HTTP/1.1" 200 None 2026-04-15 08:49:43,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:43,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:49:43,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:43,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df501006e8e7b15e96297e HTTP/1.1" 200 None 2026-04-15 08:49:43,547 - lava_callback - INFO - Completed processing callback for node 69df501006e8e7b15e96297e 2026-04-15 08:49:44,918 - lava_callback - INFO - Received callback for node 69df500d06e8e7b15e962974 INFO: 172.20.0.1:39658 - "POST /node/69df500d06e8e7b15e962974 HTTP/1.0" 202 Accepted 2026-04-15 08:49:44,924 - lava_callback - INFO - Starting async job submit for node 69df500d06e8e7b15e962974 2026-04-15 08:49:44,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:44,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500d06e8e7b15e962974 HTTP/1.1" 200 None 2026-04-15 08:49:44,963 - lava_callback - DEBUG - Processing node 69df500d06e8e7b15e962974: baseline-nfs-arm64 2026-04-15 08:49:45,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:45,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:45,495 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df500d06e8e7b15e962974/log.txt.gz 2026-04-15 08:49:45,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:45,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:45,894 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df500d06e8e7b15e962974/lava-logs.yaml 2026-04-15 08:49:45,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:49:46,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:49:46,053 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df500d06e8e7b15e962974/lava_callback.json.gz 2026-04-15 08:49:46,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:46,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500d06e8e7b15e962974 HTTP/1.1" 200 None 2026-04-15 08:49:46,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:46,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:49:46,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:49:46,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df500d06e8e7b15e962974 HTTP/1.1" 200 None 2026-04-15 08:49:46,144 - lava_callback - INFO - Completed processing callback for node 69df500d06e8e7b15e962974 INFO: 172.20.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52244 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:50:07,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:50:07,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57746 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:50:20,878 - lava_callback - INFO - Received callback for node 69dcae463c1e37dfe2f89f5c INFO: 172.20.0.1:33814 - "POST /node/69dcae463c1e37dfe2f89f5c HTTP/1.0" 202 Accepted 2026-04-15 08:50:20,884 - lava_callback - INFO - Starting async job submit for node 69dcae463c1e37dfe2f89f5c 2026-04-15 08:50:20,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:50:20,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcae463c1e37dfe2f89f5c HTTP/1.1" 200 None 2026-04-15 08:50:20,899 - lava_callback - DEBUG - Processing node 69dcae463c1e37dfe2f89f5c: baseline-arm64-baylibre 2026-04-15 08:50:20,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcae463c1e37dfe2f89f5c 2026-04-15 08:50:20,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:50:20,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcae463c1e37dfe2f89f5c HTTP/1.1" 200 None 2026-04-15 08:50:20,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:50:20,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 08:50:20,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:50:20,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcae463c1e37dfe2f89f5c HTTP/1.1" 200 None 2026-04-15 08:50:20,956 - lava_callback - ERROR - Error processing callback for node 69dcae463c1e37dfe2f89f5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37622 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:51:47,855 - lava_callback - INFO - Received callback for node 69dcae903c1e37dfe2f89fce INFO: 172.20.0.1:37628 - "POST /node/69dcae903c1e37dfe2f89fce HTTP/1.0" 202 Accepted 2026-04-15 08:51:47,860 - lava_callback - INFO - Starting async job submit for node 69dcae903c1e37dfe2f89fce 2026-04-15 08:51:47,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:51:47,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcae903c1e37dfe2f89fce HTTP/1.1" 200 None 2026-04-15 08:51:47,876 - lava_callback - DEBUG - Processing node 69dcae903c1e37dfe2f89fce: baseline-arm64-clabbe 2026-04-15 08:51:47,876 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcae903c1e37dfe2f89fce 2026-04-15 08:51:47,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:51:47,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcae903c1e37dfe2f89fce HTTP/1.1" 200 None 2026-04-15 08:51:47,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:51:47,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 08:51:47,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:51:47,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcae903c1e37dfe2f89fce HTTP/1.1" 200 None 2026-04-15 08:51:47,932 - lava_callback - ERROR - Error processing callback for node 69dcae903c1e37dfe2f89fce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53110 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:52:47,908 - lava_callback - INFO - Received callback for node 69dcaeda3c1e37dfe2f89ff7 INFO: 172.20.0.1:53118 - "POST /node/69dcaeda3c1e37dfe2f89ff7 HTTP/1.0" 202 Accepted 2026-04-15 08:52:47,913 - lava_callback - INFO - Starting async job submit for node 69dcaeda3c1e37dfe2f89ff7 2026-04-15 08:52:47,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:52:47,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaeda3c1e37dfe2f89ff7 HTTP/1.1" 200 None 2026-04-15 08:52:47,930 - lava_callback - DEBUG - Processing node 69dcaeda3c1e37dfe2f89ff7: baseline-arm64-clabbe 2026-04-15 08:52:47,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcaeda3c1e37dfe2f89ff7 2026-04-15 08:52:47,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:52:47,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaeda3c1e37dfe2f89ff7 HTTP/1.1" 200 None 2026-04-15 08:52:47,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:52:47,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 08:52:47,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:52:47,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcaeda3c1e37dfe2f89ff7 HTTP/1.1" 200 None 2026-04-15 08:52:47,988 - lava_callback - ERROR - Error processing callback for node 69dcaeda3c1e37dfe2f89ff7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49268 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:54:07,975 - lava_callback - INFO - Received callback for node 69dcaf203c1e37dfe2f8a04a INFO: 172.20.0.1:49272 - "POST /node/69dcaf203c1e37dfe2f8a04a HTTP/1.0" 202 Accepted 2026-04-15 08:54:07,983 - lava_callback - INFO - Starting async job submit for node 69dcaf203c1e37dfe2f8a04a 2026-04-15 08:54:07,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:54:08,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaf203c1e37dfe2f8a04a HTTP/1.1" 200 None 2026-04-15 08:54:08,008 - lava_callback - DEBUG - Processing node 69dcaf203c1e37dfe2f8a04a: baseline-arm64-clabbe 2026-04-15 08:54:08,008 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcaf203c1e37dfe2f8a04a 2026-04-15 08:54:08,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:54:08,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaf203c1e37dfe2f8a04a HTTP/1.1" 200 None 2026-04-15 08:54:08,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:54:08,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 08:54:08,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:54:08,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcaf203c1e37dfe2f8a04a HTTP/1.1" 200 None 2026-04-15 08:54:08,080 - lava_callback - ERROR - Error processing callback for node 69dcaf203c1e37dfe2f8a04a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40724 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:54:30,749 - lava_callback - INFO - Received callback for node 69df522f06e8e7b15e962d64 INFO: 172.20.0.1:52980 - "POST /node/69df522f06e8e7b15e962d64 HTTP/1.0" 202 Accepted 2026-04-15 08:54:30,755 - lava_callback - INFO - Starting async job submit for node 69df522f06e8e7b15e962d64 2026-04-15 08:54:30,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:54:30,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df522f06e8e7b15e962d64 HTTP/1.1" 200 None 2026-04-15 08:54:30,774 - lava_callback - DEBUG - Processing node 69df522f06e8e7b15e962d64: baseline-nfs-arm64 2026-04-15 08:54:30,775 - lava_callback - WARNING - Failed to upload log 2026-04-15 08:54:30,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:54:31,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:54:31,303 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df522f06e8e7b15e962d64/lava-logs.yaml 2026-04-15 08:54:31,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:54:31,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:54:31,617 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df522f06e8e7b15e962d64/lava_callback.json.gz 2026-04-15 08:54:31,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:54:31,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df522f06e8e7b15e962d64 HTTP/1.1" 200 None 2026-04-15 08:54:31,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:54:31,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:54:31,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:54:31,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df522f06e8e7b15e962d64 HTTP/1.1" 200 None 2026-04-15 08:54:31,672 - lava_callback - INFO - Completed processing callback for node 69df522f06e8e7b15e962d64 INFO: 172.20.0.1:52992 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:54:37,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:54:37,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34784 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:55:01,084 - lava_callback - INFO - Received callback for node 69dcaf543c1e37dfe2f8a062 INFO: 172.20.0.1:53618 - "POST /node/69dcaf543c1e37dfe2f8a062 HTTP/1.0" 202 Accepted 2026-04-15 08:55:01,089 - lava_callback - INFO - Starting async job submit for node 69dcaf543c1e37dfe2f8a062 2026-04-15 08:55:01,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:55:01,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaf543c1e37dfe2f8a062 HTTP/1.1" 200 None 2026-04-15 08:55:01,107 - lava_callback - DEBUG - Processing node 69dcaf543c1e37dfe2f8a062: baseline-arm-baylibre 2026-04-15 08:55:01,107 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcaf543c1e37dfe2f8a062 2026-04-15 08:55:01,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:55:01,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaf543c1e37dfe2f8a062 HTTP/1.1" 200 None 2026-04-15 08:55:01,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:55:01,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 08:55:01,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:55:01,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcaf543c1e37dfe2f8a062 HTTP/1.1" 200 None 2026-04-15 08:55:01,173 - lava_callback - ERROR - Error processing callback for node 69dcaf543c1e37dfe2f8a062: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34962 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:55:47,977 - lava_callback - INFO - Received callback for node 69dcaf893c1e37dfe2f8a09b INFO: 172.20.0.1:34974 - "POST /node/69dcaf893c1e37dfe2f8a09b HTTP/1.0" 202 Accepted 2026-04-15 08:55:47,983 - lava_callback - INFO - Starting async job submit for node 69dcaf893c1e37dfe2f8a09b 2026-04-15 08:55:47,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:55:47,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaf893c1e37dfe2f8a09b HTTP/1.1" 200 None 2026-04-15 08:55:47,999 - lava_callback - DEBUG - Processing node 69dcaf893c1e37dfe2f8a09b: baseline-arm64-clabbe 2026-04-15 08:55:48,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcaf893c1e37dfe2f8a09b 2026-04-15 08:55:48,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:55:48,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcaf893c1e37dfe2f8a09b HTTP/1.1" 200 None 2026-04-15 08:55:48,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:55:48,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 08:55:48,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:55:48,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcaf893c1e37dfe2f8a09b HTTP/1.1" 200 None 2026-04-15 08:55:48,049 - lava_callback - ERROR - Error processing callback for node 69dcaf893c1e37dfe2f8a09b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45400 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:56:31,285 - lava_callback - INFO - Received callback for node 69df500b06e8e7b15e962971 INFO: 172.20.0.1:41044 - "POST /node/69df500b06e8e7b15e962971 HTTP/1.0" 202 Accepted 2026-04-15 08:56:31,293 - lava_callback - INFO - Starting async job submit for node 69df500b06e8e7b15e962971 2026-04-15 08:56:31,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:56:31,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500b06e8e7b15e962971 HTTP/1.1" 200 None 2026-04-15 08:56:31,344 - lava_callback - DEBUG - Processing node 69df500b06e8e7b15e962971: baseline-arm64 2026-04-15 08:56:31,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:56:31,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:56:31,884 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500b06e8e7b15e962971/log.txt.gz 2026-04-15 08:56:32,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:56:32,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:56:32,318 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500b06e8e7b15e962971/lava-logs.yaml 2026-04-15 08:56:32,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:56:32,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:56:32,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500b06e8e7b15e962971/lava_callback.json.gz DEBUG: Setup failed for 69df500b06e8e7b15e962971. Transitting job node result: incomplete -> fail 2026-04-15 08:56:32,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:56:32,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500b06e8e7b15e962971 HTTP/1.1" 200 None 2026-04-15 08:56:32,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:56:32,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:56:32,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:56:32,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df500b06e8e7b15e962971 HTTP/1.1" 200 None 2026-04-15 08:56:32,695 - lava_callback - INFO - Completed processing callback for node 69df500b06e8e7b15e962971 INFO: 172.20.0.1:41058 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:56:37,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:56:37,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33046 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:56:48,055 - lava_callback - INFO - Received callback for node 69dcafcb3c1e37dfe2f8a0fe INFO: 172.20.0.1:33052 - "POST /node/69dcafcb3c1e37dfe2f8a0fe HTTP/1.0" 202 Accepted 2026-04-15 08:56:48,061 - lava_callback - INFO - Starting async job submit for node 69dcafcb3c1e37dfe2f8a0fe 2026-04-15 08:56:48,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:56:48,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcafcb3c1e37dfe2f8a0fe HTTP/1.1" 200 None 2026-04-15 08:56:48,077 - lava_callback - DEBUG - Processing node 69dcafcb3c1e37dfe2f8a0fe: baseline-arm64-clabbe 2026-04-15 08:56:48,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcafcb3c1e37dfe2f8a0fe 2026-04-15 08:56:48,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:56:48,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcafcb3c1e37dfe2f8a0fe HTTP/1.1" 200 None 2026-04-15 08:56:48,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:56:48,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 08:56:48,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:56:48,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcafcb3c1e37dfe2f8a0fe HTTP/1.1" 200 None 2026-04-15 08:56:48,148 - lava_callback - ERROR - Error processing callback for node 69dcafcb3c1e37dfe2f8a0fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39016 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:58:08,121 - lava_callback - INFO - Received callback for node 69dcb00c3c1e37dfe2f8a151 INFO: 172.20.0.1:39020 - "POST /node/69dcb00c3c1e37dfe2f8a151 HTTP/1.0" 202 Accepted 2026-04-15 08:58:08,126 - lava_callback - INFO - Starting async job submit for node 69dcb00c3c1e37dfe2f8a151 2026-04-15 08:58:08,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:58:08,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb00c3c1e37dfe2f8a151 HTTP/1.1" 200 None 2026-04-15 08:58:08,142 - lava_callback - DEBUG - Processing node 69dcb00c3c1e37dfe2f8a151: baseline-arm64-clabbe 2026-04-15 08:58:08,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb00c3c1e37dfe2f8a151 2026-04-15 08:58:08,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:58:08,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb00c3c1e37dfe2f8a151 HTTP/1.1" 200 None 2026-04-15 08:58:08,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:58:08,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 08:58:08,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:58:08,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb00c3c1e37dfe2f8a151 HTTP/1.1" 200 None 2026-04-15 08:58:08,215 - lava_callback - ERROR - Error processing callback for node 69dcb00c3c1e37dfe2f8a151: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41124 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:58:24,440 - lava_callback - INFO - Received callback for node 69df52cb06e8e7b15e962e09 INFO: 172.20.0.1:39310 - "POST /node/69df52cb06e8e7b15e962e09 HTTP/1.0" 202 Accepted 2026-04-15 08:58:24,446 - lava_callback - INFO - Starting async job submit for node 69df52cb06e8e7b15e962e09 2026-04-15 08:58:24,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:58:24,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df52cb06e8e7b15e962e09 HTTP/1.1" 200 None 2026-04-15 08:58:24,484 - lava_callback - DEBUG - Processing node 69df52cb06e8e7b15e962e09: baseline-arm64-broonie 2026-04-15 08:58:24,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:58:24,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:58:24,892 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df52cb06e8e7b15e962e09/log.txt.gz 2026-04-15 08:58:25,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:58:25,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:58:25,232 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df52cb06e8e7b15e962e09/lava-logs.yaml 2026-04-15 08:58:25,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:58:25,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:58:25,396 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df52cb06e8e7b15e962e09/lava_callback.json.gz 2026-04-15 08:58:25,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:58:25,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df52cb06e8e7b15e962e09 HTTP/1.1" 200 None 2026-04-15 08:58:25,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:58:25,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:58:25,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:58:25,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df52cb06e8e7b15e962e09 HTTP/1.1" 200 None 2026-04-15 08:58:25,478 - lava_callback - INFO - Completed processing callback for node 69df52cb06e8e7b15e962e09 INFO: 172.20.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36194 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:58:37,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:58:37,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 08:58:44,368 - lava_callback - INFO - Received callback for node 69df4d4d06e8e7b15e962650 INFO: 172.20.0.1:41590 - "POST /node/69df4d4d06e8e7b15e962650 HTTP/1.0" 202 Accepted 2026-04-15 08:58:44,417 - lava_callback - INFO - Starting async job submit for node 69df4d4d06e8e7b15e962650 2026-04-15 08:58:44,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:58:44,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4d06e8e7b15e962650 HTTP/1.1" 200 None 2026-04-15 08:58:44,457 - lava_callback - DEBUG - Processing node 69df4d4d06e8e7b15e962650: ltp-ipc 2026-04-15 08:58:44,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:58:44,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:58:44,707 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69df4d4d06e8e7b15e962650/log.txt.gz 2026-04-15 08:58:44,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:58:44,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:58:44,905 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69df4d4d06e8e7b15e962650/lava-logs.yaml 2026-04-15 08:58:44,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:58:45,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:58:45,028 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69df4d4d06e8e7b15e962650/lava_callback.json.gz 2026-04-15 08:58:45,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:58:45,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df4d4d06e8e7b15e962650 HTTP/1.1" 200 None 2026-04-15 08:58:45,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:58:45,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 08:58:45,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:58:45,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df4d4d06e8e7b15e962650 HTTP/1.1" 200 None 2026-04-15 08:58:45,163 - lava_callback - INFO - Completed processing callback for node 69df4d4d06e8e7b15e962650 INFO: 172.20.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54222 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:59:01,283 - lava_callback - INFO - Received callback for node 69dcb0433c1e37dfe2f8a176 INFO: 172.20.0.1:60926 - "POST /node/69dcb0433c1e37dfe2f8a176 HTTP/1.0" 202 Accepted 2026-04-15 08:59:01,289 - lava_callback - INFO - Starting async job submit for node 69dcb0433c1e37dfe2f8a176 2026-04-15 08:59:01,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:01,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb0433c1e37dfe2f8a176 HTTP/1.1" 200 None 2026-04-15 08:59:01,305 - lava_callback - DEBUG - Processing node 69dcb0433c1e37dfe2f8a176: baseline-arm-baylibre 2026-04-15 08:59:01,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb0433c1e37dfe2f8a176 2026-04-15 08:59:01,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:01,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb0433c1e37dfe2f8a176 HTTP/1.1" 200 None 2026-04-15 08:59:01,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:01,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 08:59:01,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:01,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb0433c1e37dfe2f8a176 HTTP/1.1" 200 None 2026-04-15 08:59:01,358 - lava_callback - ERROR - Error processing callback for node 69dcb0433c1e37dfe2f8a176: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60940 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:59:06,977 - lava_callback - INFO - Received callback for node 69df528206e8e7b15e962dbb INFO: 172.20.0.1:60956 - "POST /node/69df528206e8e7b15e962dbb HTTP/1.0" 202 Accepted 2026-04-15 08:59:06,983 - lava_callback - INFO - Starting async job submit for node 69df528206e8e7b15e962dbb 2026-04-15 08:59:07,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:07,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df528206e8e7b15e962dbb HTTP/1.1" 200 None 2026-04-15 08:59:07,023 - lava_callback - DEBUG - Processing node 69df528206e8e7b15e962dbb: baseline-arm64-broonie 2026-04-15 08:59:07,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:59:07,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:07,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 08:59:07,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:59:07,447 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df528206e8e7b15e962dbb/log.txt.gz 2026-04-15 08:59:07,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:59:07,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:59:07,803 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df528206e8e7b15e962dbb/lava-logs.yaml 2026-04-15 08:59:07,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 08:59:07,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 08:59:07,935 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df528206e8e7b15e962dbb/lava_callback.json.gz 2026-04-15 08:59:07,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:07,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df528206e8e7b15e962dbb HTTP/1.1" 200 None 2026-04-15 08:59:07,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:07,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 08:59:07,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:08,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df528206e8e7b15e962dbb HTTP/1.1" 200 None 2026-04-15 08:59:08,013 - lava_callback - INFO - Completed processing callback for node 69df528206e8e7b15e962dbb INFO: 172.20.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44580 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:59:21,257 - lava_callback - INFO - Received callback for node 69dcb0623c1e37dfe2f8a196 INFO: 172.20.0.1:41078 - "POST /node/69dcb0623c1e37dfe2f8a196 HTTP/1.0" 202 Accepted 2026-04-15 08:59:21,263 - lava_callback - INFO - Starting async job submit for node 69dcb0623c1e37dfe2f8a196 2026-04-15 08:59:21,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:21,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb0623c1e37dfe2f8a196 HTTP/1.1" 200 None 2026-04-15 08:59:21,294 - lava_callback - DEBUG - Processing node 69dcb0623c1e37dfe2f8a196: baseline-arm-baylibre 2026-04-15 08:59:21,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb0623c1e37dfe2f8a196 2026-04-15 08:59:21,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:21,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb0623c1e37dfe2f8a196 HTTP/1.1" 200 None 2026-04-15 08:59:21,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:21,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 08:59:21,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:21,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb0623c1e37dfe2f8a196 HTTP/1.1" 200 None 2026-04-15 08:59:21,369 - lava_callback - ERROR - Error processing callback for node 69dcb0623c1e37dfe2f8a196: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46578 - "GET / HTTP/1.0" 200 OK 2026-04-15 08:59:37,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 08:59:37,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41226 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:00:01,296 - lava_callback - INFO - Received callback for node 69dcb0853c1e37dfe2f8a1c0 INFO: 172.20.0.1:54308 - "POST /node/69dcb0853c1e37dfe2f8a1c0 HTTP/1.0" 202 Accepted 2026-04-15 09:00:01,301 - lava_callback - INFO - Starting async job submit for node 69dcb0853c1e37dfe2f8a1c0 2026-04-15 09:00:01,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:01,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb0853c1e37dfe2f8a1c0 HTTP/1.1" 200 None 2026-04-15 09:00:01,318 - lava_callback - DEBUG - Processing node 69dcb0853c1e37dfe2f8a1c0: baseline-arm-baylibre 2026-04-15 09:00:01,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb0853c1e37dfe2f8a1c0 2026-04-15 09:00:01,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:01,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb0853c1e37dfe2f8a1c0 HTTP/1.1" 200 None 2026-04-15 09:00:01,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:01,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 09:00:01,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:01,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb0853c1e37dfe2f8a1c0 HTTP/1.1" 200 None 2026-04-15 09:00:01,372 - lava_callback - ERROR - Error processing callback for node 69dcb0853c1e37dfe2f8a1c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53670 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 09:00:15,645 - lava_callback - INFO - Received callback for node 69df534206e8e7b15e962ead INFO: 172.20.0.1:53674 - "POST /node/69df534206e8e7b15e962ead HTTP/1.0" 202 Accepted 2026-04-15 09:00:15,653 - lava_callback - INFO - Starting async job submit for node 69df534206e8e7b15e962ead 2026-04-15 09:00:15,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:15,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df534206e8e7b15e962ead HTTP/1.1" 200 None 2026-04-15 09:00:15,701 - lava_callback - DEBUG - Processing node 69df534206e8e7b15e962ead: baseline-arm64 2026-04-15 09:00:15,838 - lava_callback - WARNING - Failed to upload log 2026-04-15 09:00:15,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:00:16,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:00:16,260 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df534206e8e7b15e962ead/lava-logs.yaml 2026-04-15 09:00:16,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:00:16,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:00:16,400 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df534206e8e7b15e962ead/lava_callback.json.gz 2026-04-15 09:00:16,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:16,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df534206e8e7b15e962ead HTTP/1.1" 200 None 2026-04-15 09:00:16,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:16,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:00:16,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:16,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df534206e8e7b15e962ead HTTP/1.1" 200 None INFO: 172.20.0.1:53686 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:00:16,578 - lava_callback - INFO - Completed processing callback for node 69df534206e8e7b15e962ead INFO: 172.20.0.1:52120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52260 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:00:37,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:37,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41936 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:00:48,495 - lava_callback - INFO - Received callback for node 69dcb0b43c1e37dfe2f8a1fb INFO: 172.20.0.1:41946 - "POST /node/69dcb0b43c1e37dfe2f8a1fb HTTP/1.0" 202 Accepted 2026-04-15 09:00:48,501 - lava_callback - INFO - Starting async job submit for node 69dcb0b43c1e37dfe2f8a1fb 2026-04-15 09:00:48,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:48,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb0b43c1e37dfe2f8a1fb HTTP/1.1" 200 None 2026-04-15 09:00:48,518 - lava_callback - DEBUG - Processing node 69dcb0b43c1e37dfe2f8a1fb: baseline-arm64-clabbe 2026-04-15 09:00:48,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb0b43c1e37dfe2f8a1fb 2026-04-15 09:00:48,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:48,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb0b43c1e37dfe2f8a1fb HTTP/1.1" 200 None 2026-04-15 09:00:48,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:48,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 09:00:48,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:48,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb0b43c1e37dfe2f8a1fb HTTP/1.1" 200 None 2026-04-15 09:00:48,575 - lava_callback - ERROR - Error processing callback for node 69dcb0b43c1e37dfe2f8a1fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32992 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:00:59,523 - lava_callback - INFO - Received callback for node 69df538a06e8e7b15e962f01 INFO: 172.20.0.1:33004 - "POST /node/69df538a06e8e7b15e962f01 HTTP/1.0" 202 Accepted 2026-04-15 09:00:59,530 - lava_callback - INFO - Starting async job submit for node 69df538a06e8e7b15e962f01 2026-04-15 09:00:59,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:00:59,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df538a06e8e7b15e962f01 HTTP/1.1" 200 None 2026-04-15 09:00:59,578 - lava_callback - DEBUG - Processing node 69df538a06e8e7b15e962f01: baseline-arm64 2026-04-15 09:00:59,723 - lava_callback - WARNING - Failed to upload log 2026-04-15 09:00:59,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:01:00,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:01:00,024 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df538a06e8e7b15e962f01/lava-logs.yaml 2026-04-15 09:01:00,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:01:00,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:01:00,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df538a06e8e7b15e962f01/lava_callback.json.gz 2026-04-15 09:01:00,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:01:00,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df538a06e8e7b15e962f01 HTTP/1.1" 200 None 2026-04-15 09:01:00,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:01:00,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:01:00,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:01:00,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df538a06e8e7b15e962f01 HTTP/1.1" 200 None 2026-04-15 09:01:00,319 - lava_callback - INFO - Completed processing callback for node 69df538a06e8e7b15e962f01 INFO: 172.20.0.1:50234 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:01:07,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:01:07,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46574 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:01:41,471 - lava_callback - INFO - Received callback for node 69dcb0ec3c1e37dfe2f8a244 INFO: 172.20.0.1:58438 - "POST /node/69dcb0ec3c1e37dfe2f8a244 HTTP/1.0" 202 Accepted 2026-04-15 09:01:41,477 - lava_callback - INFO - Starting async job submit for node 69dcb0ec3c1e37dfe2f8a244 2026-04-15 09:01:41,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:01:41,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb0ec3c1e37dfe2f8a244 HTTP/1.1" 200 None 2026-04-15 09:01:41,497 - lava_callback - DEBUG - Processing node 69dcb0ec3c1e37dfe2f8a244: baseline-arm-baylibre 2026-04-15 09:01:41,497 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb0ec3c1e37dfe2f8a244 2026-04-15 09:01:41,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:01:41,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb0ec3c1e37dfe2f8a244 HTTP/1.1" 200 None 2026-04-15 09:01:41,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:01:41,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 09:01:41,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:01:41,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb0ec3c1e37dfe2f8a244 HTTP/1.1" 200 None 2026-04-15 09:01:41,546 - lava_callback - ERROR - Error processing callback for node 69dcb0ec3c1e37dfe2f8a244: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51936 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:02:08,290 - lava_callback - INFO - Received callback for node 69dcb10b3c1e37dfe2f8a273 INFO: 172.20.0.1:51940 - "POST /node/69dcb10b3c1e37dfe2f8a273 HTTP/1.0" 202 Accepted 2026-04-15 09:02:08,296 - lava_callback - INFO - Starting async job submit for node 69dcb10b3c1e37dfe2f8a273 2026-04-15 09:02:08,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:08,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb10b3c1e37dfe2f8a273 HTTP/1.1" 200 None 2026-04-15 09:02:08,313 - lava_callback - DEBUG - Processing node 69dcb10b3c1e37dfe2f8a273: baseline-arm-clabbe 2026-04-15 09:02:08,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb10b3c1e37dfe2f8a273 2026-04-15 09:02:08,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:08,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb10b3c1e37dfe2f8a273 HTTP/1.1" 200 None 2026-04-15 09:02:08,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:08,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 09:02:08,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:08,361 - lava_callback - INFO - Received callback for node 69df53f806e8e7b15e962f71 2026-04-15 09:02:08,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb10b3c1e37dfe2f8a273 HTTP/1.1" 200 None 2026-04-15 09:02:08,377 - lava_callback - INFO - Starting async job submit for node 69df53f806e8e7b15e962f71 INFO: 172.20.0.1:51950 - "POST /node/69df53f806e8e7b15e962f71 HTTP/1.0" 202 Accepted 2026-04-15 09:02:08,415 - lava_callback - ERROR - Error processing callback for node 69dcb10b3c1e37dfe2f8a273: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 09:02:08,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:08,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53f806e8e7b15e962f71 HTTP/1.1" 200 None 2026-04-15 09:02:08,462 - lava_callback - DEBUG - Processing node 69df53f806e8e7b15e962f71: baseline-x86 2026-04-15 09:02:08,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:02:08,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:02:08,807 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df53f806e8e7b15e962f71/log.txt.gz 2026-04-15 09:02:08,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:02:09,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:02:09,119 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df53f806e8e7b15e962f71/lava-logs.yaml 2026-04-15 09:02:09,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:02:09,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:02:09,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df53f806e8e7b15e962f71/lava_callback.json.gz 2026-04-15 09:02:09,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:09,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53f806e8e7b15e962f71 HTTP/1.1" 200 None 2026-04-15 09:02:09,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:09,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49c106e8e7b15e9624ed HTTP/1.1" 200 None 2026-04-15 09:02:09,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:09,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df53f806e8e7b15e962f71 HTTP/1.1" 200 None 2026-04-15 09:02:09,349 - lava_callback - INFO - Completed processing callback for node 69df53f806e8e7b15e962f71 2026-04-15 09:02:12,969 - lava_callback - INFO - Received callback for node 69df53f606e8e7b15e962f68 INFO: 172.20.0.1:35086 - "POST /node/69df53f606e8e7b15e962f68 HTTP/1.0" 202 Accepted 2026-04-15 09:02:12,975 - lava_callback - INFO - Starting async job submit for node 69df53f606e8e7b15e962f68 2026-04-15 09:02:12,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:13,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53f606e8e7b15e962f68 HTTP/1.1" 200 None 2026-04-15 09:02:13,013 - lava_callback - DEBUG - Processing node 69df53f606e8e7b15e962f68: baseline-x86 2026-04-15 09:02:13,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:02:13,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:02:13,335 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df53f606e8e7b15e962f68/log.txt.gz 2026-04-15 09:02:13,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:02:13,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:02:13,599 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df53f606e8e7b15e962f68/lava-logs.yaml 2026-04-15 09:02:13,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:02:13,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:02:13,758 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df53f606e8e7b15e962f68/lava_callback.json.gz 2026-04-15 09:02:13,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:13,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53f606e8e7b15e962f68 HTTP/1.1" 200 None 2026-04-15 09:02:13,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:13,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49c106e8e7b15e9624ed HTTP/1.1" 200 None 2026-04-15 09:02:13,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:13,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df53f606e8e7b15e962f68 HTTP/1.1" 200 None 2026-04-15 09:02:13,864 - lava_callback - INFO - Completed processing callback for node 69df53f606e8e7b15e962f68 INFO: 172.20.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34932 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:02:35,599 - lava_callback - INFO - Received callback for node 69df53d906e8e7b15e962f51 INFO: 172.20.0.1:49878 - "POST /node/69df53d906e8e7b15e962f51 HTTP/1.0" 202 Accepted 2026-04-15 09:02:35,605 - lava_callback - INFO - Starting async job submit for node 69df53d906e8e7b15e962f51 2026-04-15 09:02:35,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:35,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53d906e8e7b15e962f51 HTTP/1.1" 200 None 2026-04-15 09:02:35,646 - lava_callback - DEBUG - Processing node 69df53d906e8e7b15e962f51: baseline-arm64 2026-04-15 09:02:35,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:02:36,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:02:36,090 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df53d906e8e7b15e962f51/log.txt.gz 2026-04-15 09:02:36,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:02:36,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:02:36,467 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df53d906e8e7b15e962f51/lava-logs.yaml 2026-04-15 09:02:36,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:49880 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:02:36,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:02:36,617 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df53d906e8e7b15e962f51/lava_callback.json.gz 2026-04-15 09:02:36,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:36,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53d906e8e7b15e962f51 HTTP/1.1" 200 None 2026-04-15 09:02:36,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:36,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:02:36,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:36,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df53d906e8e7b15e962f51 HTTP/1.1" 200 None 2026-04-15 09:02:36,771 - lava_callback - INFO - Completed processing callback for node 69df53d906e8e7b15e962f51 2026-04-15 09:02:37,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:02:37,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55712 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:03:08,334 - lava_callback - INFO - Received callback for node 69dcb13b3c1e37dfe2f8a28f INFO: 172.20.0.1:55716 - "POST /node/69dcb13b3c1e37dfe2f8a28f HTTP/1.0" 202 Accepted 2026-04-15 09:03:08,340 - lava_callback - INFO - Starting async job submit for node 69dcb13b3c1e37dfe2f8a28f 2026-04-15 09:03:08,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:03:08,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb13b3c1e37dfe2f8a28f HTTP/1.1" 200 None 2026-04-15 09:03:08,356 - lava_callback - DEBUG - Processing node 69dcb13b3c1e37dfe2f8a28f: baseline-arm64-clabbe 2026-04-15 09:03:08,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb13b3c1e37dfe2f8a28f 2026-04-15 09:03:08,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:03:08,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb13b3c1e37dfe2f8a28f HTTP/1.1" 200 None 2026-04-15 09:03:08,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:03:08,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 09:03:08,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:03:08,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb13b3c1e37dfe2f8a28f HTTP/1.1" 200 None 2026-04-15 09:03:08,404 - lava_callback - ERROR - Error processing callback for node 69dcb13b3c1e37dfe2f8a28f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 09:03:11,863 - lava_callback - INFO - Received callback for node 69df53f606e8e7b15e962f6b INFO: 172.20.0.1:45896 - "POST /node/69df53f606e8e7b15e962f6b HTTP/1.0" 202 Accepted 2026-04-15 09:03:11,868 - lava_callback - INFO - Starting async job submit for node 69df53f606e8e7b15e962f6b 2026-04-15 09:03:11,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:03:11,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53f606e8e7b15e962f6b HTTP/1.1" 200 None 2026-04-15 09:03:11,902 - lava_callback - DEBUG - Processing node 69df53f606e8e7b15e962f6b: baseline-x86 2026-04-15 09:03:12,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:03:12,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:03:12,323 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df53f606e8e7b15e962f6b/log.txt.gz 2026-04-15 09:03:12,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:03:12,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:03:12,677 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df53f606e8e7b15e962f6b/lava-logs.yaml 2026-04-15 09:03:12,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:03:12,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:03:12,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df53f606e8e7b15e962f6b/lava_callback.json.gz 2026-04-15 09:03:12,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:03:12,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53f606e8e7b15e962f6b HTTP/1.1" 200 None 2026-04-15 09:03:12,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:03:12,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49c106e8e7b15e9624ed HTTP/1.1" 200 None 2026-04-15 09:03:12,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:03:12,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df53f606e8e7b15e962f6b HTTP/1.1" 200 None 2026-04-15 09:03:12,913 - lava_callback - INFO - Completed processing callback for node 69df53f606e8e7b15e962f6b INFO: 172.20.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36786 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:03:37,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:03:37,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57632 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:04:08,451 - lava_callback - INFO - Received callback for node 69dcb1733c1e37dfe2f8a2cb INFO: 172.20.0.1:57634 - "POST /node/69dcb1733c1e37dfe2f8a2cb HTTP/1.0" 202 Accepted 2026-04-15 09:04:08,456 - lava_callback - INFO - Starting async job submit for node 69dcb1733c1e37dfe2f8a2cb 2026-04-15 09:04:08,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:04:08,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb1733c1e37dfe2f8a2cb HTTP/1.1" 200 None 2026-04-15 09:04:08,473 - lava_callback - DEBUG - Processing node 69dcb1733c1e37dfe2f8a2cb: baseline-arm-clabbe 2026-04-15 09:04:08,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb1733c1e37dfe2f8a2cb 2026-04-15 09:04:08,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:04:08,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb1733c1e37dfe2f8a2cb HTTP/1.1" 200 None 2026-04-15 09:04:08,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:04:08,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 09:04:08,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:04:08,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb1733c1e37dfe2f8a2cb HTTP/1.1" 200 None 2026-04-15 09:04:08,529 - lava_callback - ERROR - Error processing callback for node 69dcb1733c1e37dfe2f8a2cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 09:04:11,338 - lava_callback - INFO - Received callback for node 69df53f706e8e7b15e962f6e INFO: 172.20.0.1:59764 - "POST /node/69df53f706e8e7b15e962f6e HTTP/1.0" 202 Accepted 2026-04-15 09:04:11,344 - lava_callback - INFO - Starting async job submit for node 69df53f706e8e7b15e962f6e 2026-04-15 09:04:11,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:04:11,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53f706e8e7b15e962f6e HTTP/1.1" 200 None 2026-04-15 09:04:11,380 - lava_callback - DEBUG - Processing node 69df53f706e8e7b15e962f6e: baseline-x86 2026-04-15 09:04:11,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:04:11,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:04:11,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df53f706e8e7b15e962f6e/log.txt.gz 2026-04-15 09:04:11,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:04:12,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:04:12,091 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df53f706e8e7b15e962f6e/lava-logs.yaml 2026-04-15 09:04:12,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:04:12,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:04:12,230 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df53f706e8e7b15e962f6e/lava_callback.json.gz 2026-04-15 09:04:12,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:04:12,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53f706e8e7b15e962f6e HTTP/1.1" 200 None 2026-04-15 09:04:12,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:04:12,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49c106e8e7b15e9624ed HTTP/1.1" 200 None 2026-04-15 09:04:12,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:04:12,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df53f706e8e7b15e962f6e HTTP/1.1" 200 None 2026-04-15 09:04:12,368 - lava_callback - INFO - Completed processing callback for node 69df53f706e8e7b15e962f6e INFO: 172.20.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54490 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:04:28,369 - lava_callback - INFO - Received callback for node 69dcb18f3c1e37dfe2f8a32c INFO: 172.20.0.1:54494 - "POST /node/69dcb18f3c1e37dfe2f8a32c HTTP/1.0" 202 Accepted 2026-04-15 09:04:28,374 - lava_callback - INFO - Starting async job submit for node 69dcb18f3c1e37dfe2f8a32c 2026-04-15 09:04:28,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:04:28,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb18f3c1e37dfe2f8a32c HTTP/1.1" 200 None 2026-04-15 09:04:28,390 - lava_callback - DEBUG - Processing node 69dcb18f3c1e37dfe2f8a32c: baseline-arm-clabbe 2026-04-15 09:04:28,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb18f3c1e37dfe2f8a32c 2026-04-15 09:04:28,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:04:28,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb18f3c1e37dfe2f8a32c HTTP/1.1" 200 None 2026-04-15 09:04:28,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:04:28,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 09:04:28,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:04:28,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb18f3c1e37dfe2f8a32c HTTP/1.1" 200 None 2026-04-15 09:04:28,446 - lava_callback - ERROR - Error processing callback for node 69dcb18f3c1e37dfe2f8a32c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59896 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:04:37,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:04:37,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52232 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:05:08,473 - lava_callback - INFO - Received callback for node 69dcb1bb3c1e37dfe2f8a363 INFO: 172.20.0.1:52234 - "POST /node/69dcb1bb3c1e37dfe2f8a363 HTTP/1.0" 202 Accepted 2026-04-15 09:05:08,478 - lava_callback - INFO - Starting async job submit for node 69dcb1bb3c1e37dfe2f8a363 2026-04-15 09:05:08,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:05:08,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb1bb3c1e37dfe2f8a363 HTTP/1.1" 200 None 2026-04-15 09:05:08,494 - lava_callback - DEBUG - Processing node 69dcb1bb3c1e37dfe2f8a363: baseline-arm64-clabbe 2026-04-15 09:05:08,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb1bb3c1e37dfe2f8a363 2026-04-15 09:05:08,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:05:08,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb1bb3c1e37dfe2f8a363 HTTP/1.1" 200 None 2026-04-15 09:05:08,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:05:08,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 09:05:08,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:05:08,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb1bb3c1e37dfe2f8a363 HTTP/1.1" 200 None 2026-04-15 09:05:08,548 - lava_callback - ERROR - Error processing callback for node 69dcb1bb3c1e37dfe2f8a363: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37018 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:06:08,512 - lava_callback - INFO - Received callback for node 69dcb1f33c1e37dfe2f8a3a5 INFO: 172.20.0.1:37026 - "POST /node/69dcb1f33c1e37dfe2f8a3a5 HTTP/1.0" 202 Accepted 2026-04-15 09:06:08,517 - lava_callback - INFO - Starting async job submit for node 69dcb1f33c1e37dfe2f8a3a5 2026-04-15 09:06:08,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:08,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb1f33c1e37dfe2f8a3a5 HTTP/1.1" 200 None 2026-04-15 09:06:08,538 - lava_callback - DEBUG - Processing node 69dcb1f33c1e37dfe2f8a3a5: baseline-arm-clabbe 2026-04-15 09:06:08,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb1f33c1e37dfe2f8a3a5 2026-04-15 09:06:08,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:08,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb1f33c1e37dfe2f8a3a5 HTTP/1.1" 200 None 2026-04-15 09:06:08,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:08,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 09:06:08,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:08,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb1f33c1e37dfe2f8a3a5 HTTP/1.1" 200 None 2026-04-15 09:06:08,595 - lava_callback - ERROR - Error processing callback for node 69dcb1f33c1e37dfe2f8a3a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 09:06:10,202 - lava_callback - INFO - Received callback for node 69df544406e8e7b15e962fec INFO: 172.20.0.1:33708 - "POST /node/69df544406e8e7b15e962fec HTTP/1.0" 202 Accepted 2026-04-15 09:06:10,208 - lava_callback - INFO - Starting async job submit for node 69df544406e8e7b15e962fec 2026-04-15 09:06:10,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:10,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df544406e8e7b15e962fec HTTP/1.1" 200 None 2026-04-15 09:06:10,242 - lava_callback - DEBUG - Processing node 69df544406e8e7b15e962fec: baseline-arm64 2026-04-15 09:06:10,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:06:10,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:06:10,754 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df544406e8e7b15e962fec/log.txt.gz 2026-04-15 09:06:10,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:06:11,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:06:11,151 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df544406e8e7b15e962fec/lava-logs.yaml 2026-04-15 09:06:11,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:06:11,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:06:11,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df544406e8e7b15e962fec/lava_callback.json.gz 2026-04-15 09:06:11,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:11,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df544406e8e7b15e962fec HTTP/1.1" 200 None 2026-04-15 09:06:11,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:11,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:06:11,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:11,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df544406e8e7b15e962fec HTTP/1.1" 200 None 2026-04-15 09:06:11,435 - lava_callback - INFO - Completed processing callback for node 69df544406e8e7b15e962fec INFO: 172.20.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40250 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:06:37,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:37,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 09:06:38,007 - lava_callback - INFO - Received callback for node 69df501206e8e7b15e962981 INFO: 172.20.0.1:40254 - "POST /node/69df501206e8e7b15e962981 HTTP/1.0" 202 Accepted 2026-04-15 09:06:38,015 - lava_callback - INFO - Starting async job submit for node 69df501206e8e7b15e962981 2026-04-15 09:06:38,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:38,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501206e8e7b15e962981 HTTP/1.1" 200 None 2026-04-15 09:06:38,074 - lava_callback - DEBUG - Processing node 69df501206e8e7b15e962981: baseline-nfs-arm64 2026-04-15 09:06:39,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:06:39,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:06:39,268 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501206e8e7b15e962981/log.txt.gz 2026-04-15 09:06:39,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:06:40,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:06:40,016 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501206e8e7b15e962981/lava-logs.yaml 2026-04-15 09:06:40,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:06:40,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:06:40,224 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501206e8e7b15e962981/lava_callback.json.gz DEBUG: Setup failed for 69df501206e8e7b15e962981. Transitting job node result: incomplete -> fail 2026-04-15 09:06:40,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:40,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501206e8e7b15e962981 HTTP/1.1" 200 None 2026-04-15 09:06:40,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:40,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:06:40,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:40,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df501206e8e7b15e962981 HTTP/1.1" 200 None 2026-04-15 09:06:40,496 - lava_callback - INFO - Completed processing callback for node 69df501206e8e7b15e962981 INFO: 172.20.0.1:47000 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:06:48,461 - lava_callback - INFO - Received callback for node 69dcb2163c1e37dfe2f8a3b3 INFO: 172.20.0.1:47012 - "POST /node/69dcb2163c1e37dfe2f8a3b3 HTTP/1.0" 202 Accepted 2026-04-15 09:06:48,466 - lava_callback - INFO - Starting async job submit for node 69dcb2163c1e37dfe2f8a3b3 2026-04-15 09:06:48,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:48,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb2163c1e37dfe2f8a3b3 HTTP/1.1" 200 None 2026-04-15 09:06:48,482 - lava_callback - DEBUG - Processing node 69dcb2163c1e37dfe2f8a3b3: baseline-arm-clabbe 2026-04-15 09:06:48,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb2163c1e37dfe2f8a3b3 2026-04-15 09:06:48,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:48,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb2163c1e37dfe2f8a3b3 HTTP/1.1" 200 None 2026-04-15 09:06:48,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:48,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 09:06:48,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:06:48,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb2163c1e37dfe2f8a3b3 HTTP/1.1" 200 None 2026-04-15 09:06:48,545 - lava_callback - ERROR - Error processing callback for node 69dcb2163c1e37dfe2f8a3b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37610 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:07:07,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:07:07,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52992 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:07:28,557 - lava_callback - INFO - Received callback for node 69dcb2453c1e37dfe2f8a3d6 INFO: 172.20.0.1:53006 - "POST /node/69dcb2453c1e37dfe2f8a3d6 HTTP/1.0" 202 Accepted 2026-04-15 09:07:28,563 - lava_callback - INFO - Starting async job submit for node 69dcb2453c1e37dfe2f8a3d6 2026-04-15 09:07:28,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:07:28,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb2453c1e37dfe2f8a3d6 HTTP/1.1" 200 None 2026-04-15 09:07:28,578 - lava_callback - DEBUG - Processing node 69dcb2453c1e37dfe2f8a3d6: baseline-arm64-clabbe 2026-04-15 09:07:28,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb2453c1e37dfe2f8a3d6 2026-04-15 09:07:28,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:07:28,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb2453c1e37dfe2f8a3d6 HTTP/1.1" 200 None 2026-04-15 09:07:28,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:07:28,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d6e102262f331647aec27f HTTP/1.1" 200 None 2026-04-15 09:07:28,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:07:28,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb2453c1e37dfe2f8a3d6 HTTP/1.1" 200 None 2026-04-15 09:07:28,627 - lava_callback - ERROR - Error processing callback for node 69dcb2453c1e37dfe2f8a3d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36962 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:08:11,047 - lava_callback - INFO - Received callback for node 69df556806e8e7b15e96311c INFO: 172.20.0.1:43382 - "POST /node/69df556806e8e7b15e96311c HTTP/1.0" 202 Accepted 2026-04-15 09:08:11,053 - lava_callback - INFO - Starting async job submit for node 69df556806e8e7b15e96311c 2026-04-15 09:08:11,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:08:11,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df556806e8e7b15e96311c HTTP/1.1" 200 None 2026-04-15 09:08:11,070 - lava_callback - DEBUG - Processing node 69df556806e8e7b15e96311c: baseline-nfs-arm64 2026-04-15 09:08:11,072 - lava_callback - WARNING - Failed to upload log 2026-04-15 09:08:11,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:08:11,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:08:11,400 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df556806e8e7b15e96311c/lava-logs.yaml 2026-04-15 09:08:11,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:08:11,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:08:11,551 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df556806e8e7b15e96311c/lava_callback.json.gz 2026-04-15 09:08:11,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:08:11,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df556806e8e7b15e96311c HTTP/1.1" 200 None 2026-04-15 09:08:11,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:08:11,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:08:11,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:08:11,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df556806e8e7b15e96311c HTTP/1.1" 200 None 2026-04-15 09:08:11,609 - lava_callback - INFO - Completed processing callback for node 69df556806e8e7b15e96311c INFO: 172.20.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42178 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:08:28,641 - lava_callback - INFO - Received callback for node 69dcb27a3c1e37dfe2f8a419 INFO: 172.20.0.1:42190 - "POST /node/69dcb27a3c1e37dfe2f8a419 HTTP/1.0" 202 Accepted 2026-04-15 09:08:28,647 - lava_callback - INFO - Starting async job submit for node 69dcb27a3c1e37dfe2f8a419 2026-04-15 09:08:28,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:08:28,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb27a3c1e37dfe2f8a419 HTTP/1.1" 200 None 2026-04-15 09:08:28,668 - lava_callback - DEBUG - Processing node 69dcb27a3c1e37dfe2f8a419: baseline-arm-clabbe 2026-04-15 09:08:28,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb27a3c1e37dfe2f8a419 2026-04-15 09:08:28,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:08:28,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb27a3c1e37dfe2f8a419 HTTP/1.1" 200 None 2026-04-15 09:08:28,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:08:28,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 09:08:28,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:08:28,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb27a3c1e37dfe2f8a419 HTTP/1.1" 200 None 2026-04-15 09:08:28,716 - lava_callback - ERROR - Error processing callback for node 69dcb27a3c1e37dfe2f8a419: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50492 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:08:37,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:08:37,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58694 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:08:48,573 - lava_callback - INFO - Received callback for node 69dcb2993c1e37dfe2f8a44a INFO: 172.20.0.1:58698 - "POST /node/69dcb2993c1e37dfe2f8a44a HTTP/1.0" 202 Accepted 2026-04-15 09:08:48,579 - lava_callback - INFO - Starting async job submit for node 69dcb2993c1e37dfe2f8a44a 2026-04-15 09:08:48,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:08:48,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb2993c1e37dfe2f8a44a HTTP/1.1" 200 None 2026-04-15 09:08:48,611 - lava_callback - DEBUG - Processing node 69dcb2993c1e37dfe2f8a44a: baseline-arm-clabbe 2026-04-15 09:08:48,611 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb2993c1e37dfe2f8a44a 2026-04-15 09:08:48,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:08:48,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb2993c1e37dfe2f8a44a HTTP/1.1" 200 None 2026-04-15 09:08:48,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:08:48,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 09:08:48,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:08:48,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb2993c1e37dfe2f8a44a HTTP/1.1" 200 None 2026-04-15 09:08:48,659 - lava_callback - ERROR - Error processing callback for node 69dcb2993c1e37dfe2f8a44a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60442 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:09:28,695 - lava_callback - INFO - Received callback for node 69dcb2bc3c1e37dfe2f8a47a INFO: 172.20.0.1:60452 - "POST /node/69dcb2bc3c1e37dfe2f8a47a HTTP/1.0" 202 Accepted 2026-04-15 09:09:28,701 - lava_callback - INFO - Starting async job submit for node 69dcb2bc3c1e37dfe2f8a47a 2026-04-15 09:09:28,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:09:28,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb2bc3c1e37dfe2f8a47a HTTP/1.1" 200 None 2026-04-15 09:09:28,718 - lava_callback - DEBUG - Processing node 69dcb2bc3c1e37dfe2f8a47a: baseline-arm-clabbe 2026-04-15 09:09:28,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb2bc3c1e37dfe2f8a47a 2026-04-15 09:09:28,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:09:28,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb2bc3c1e37dfe2f8a47a HTTP/1.1" 200 None 2026-04-15 09:09:28,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:09:28,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 09:09:28,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:09:28,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb2bc3c1e37dfe2f8a47a HTTP/1.1" 200 None 2026-04-15 09:09:28,774 - lava_callback - ERROR - Error processing callback for node 69dcb2bc3c1e37dfe2f8a47a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41204 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:10:02,399 - lava_callback - INFO - Received callback for node 69dcb2d93c1e37dfe2f8a489 INFO: 172.20.0.1:47794 - "POST /node/69dcb2d93c1e37dfe2f8a489 HTTP/1.0" 202 Accepted 2026-04-15 09:10:02,404 - lava_callback - INFO - Starting async job submit for node 69dcb2d93c1e37dfe2f8a489 2026-04-15 09:10:02,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:10:02,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb2d93c1e37dfe2f8a489 HTTP/1.1" 200 None 2026-04-15 09:10:02,429 - lava_callback - DEBUG - Processing node 69dcb2d93c1e37dfe2f8a489: baseline-arm-baylibre 2026-04-15 09:10:02,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb2d93c1e37dfe2f8a489 2026-04-15 09:10:02,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:10:02,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb2d93c1e37dfe2f8a489 HTTP/1.1" 200 None 2026-04-15 09:10:02,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:10:02,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 09:10:02,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:10:02,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb2d93c1e37dfe2f8a489 HTTP/1.1" 200 None 2026-04-15 09:10:02,480 - lava_callback - ERROR - Error processing callback for node 69dcb2d93c1e37dfe2f8a489: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51610 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:10:21,873 - lava_callback - INFO - Received callback for node 69dcb2fb3c1e37dfe2f8a4a7 INFO: 172.20.0.1:38210 - "POST /node/69dcb2fb3c1e37dfe2f8a4a7 HTTP/1.0" 202 Accepted 2026-04-15 09:10:21,878 - lava_callback - INFO - Starting async job submit for node 69dcb2fb3c1e37dfe2f8a4a7 2026-04-15 09:10:21,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:10:21,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb2fb3c1e37dfe2f8a4a7 HTTP/1.1" 200 None 2026-04-15 09:10:21,893 - lava_callback - DEBUG - Processing node 69dcb2fb3c1e37dfe2f8a4a7: baseline-arm-baylibre 2026-04-15 09:10:21,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb2fb3c1e37dfe2f8a4a7 2026-04-15 09:10:21,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:10:21,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb2fb3c1e37dfe2f8a4a7 HTTP/1.1" 200 None 2026-04-15 09:10:21,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:10:21,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 09:10:21,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:10:21,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb2fb3c1e37dfe2f8a4a7 HTTP/1.1" 200 None 2026-04-15 09:10:21,940 - lava_callback - ERROR - Error processing callback for node 69dcb2fb3c1e37dfe2f8a4a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39818 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:11:08,698 - lava_callback - INFO - Received callback for node 69dcb31f3c1e37dfe2f8a4d7 INFO: 172.20.0.1:39826 - "POST /node/69dcb31f3c1e37dfe2f8a4d7 HTTP/1.0" 202 Accepted 2026-04-15 09:11:08,705 - lava_callback - INFO - Starting async job submit for node 69dcb31f3c1e37dfe2f8a4d7 2026-04-15 09:11:08,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:11:08,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb31f3c1e37dfe2f8a4d7 HTTP/1.1" 200 None 2026-04-15 09:11:08,736 - lava_callback - DEBUG - Processing node 69dcb31f3c1e37dfe2f8a4d7: baseline-arm-clabbe 2026-04-15 09:11:08,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb31f3c1e37dfe2f8a4d7 2026-04-15 09:11:08,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:11:08,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb31f3c1e37dfe2f8a4d7 HTTP/1.1" 200 None 2026-04-15 09:11:08,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:11:08,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd6a932ecfe2320a100c HTTP/1.1" 200 None 2026-04-15 09:11:08,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:11:08,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb31f3c1e37dfe2f8a4d7 HTTP/1.1" 200 None 2026-04-15 09:11:08,820 - lava_callback - ERROR - Error processing callback for node 69dcb31f3c1e37dfe2f8a4d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47642 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:11:41,951 - lava_callback - INFO - Received callback for node 69dcb33b3c1e37dfe2f8a505 INFO: 172.20.0.1:40112 - "POST /node/69dcb33b3c1e37dfe2f8a505 HTTP/1.0" 202 Accepted 2026-04-15 09:11:41,958 - lava_callback - INFO - Starting async job submit for node 69dcb33b3c1e37dfe2f8a505 2026-04-15 09:11:41,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:11:41,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb33b3c1e37dfe2f8a505 HTTP/1.1" 200 None 2026-04-15 09:11:41,977 - lava_callback - DEBUG - Processing node 69dcb33b3c1e37dfe2f8a505: baseline-arm-baylibre 2026-04-15 09:11:41,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb33b3c1e37dfe2f8a505 2026-04-15 09:11:41,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:11:41,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb33b3c1e37dfe2f8a505 HTTP/1.1" 200 None 2026-04-15 09:11:41,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:11:42,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 09:11:42,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:11:42,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb33b3c1e37dfe2f8a505 HTTP/1.1" 200 None 2026-04-15 09:11:42,032 - lava_callback - ERROR - Error processing callback for node 69dcb33b3c1e37dfe2f8a505: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33494 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:12:01,953 - lava_callback - INFO - Received callback for node 69dcb35c3c1e37dfe2f8a526 INFO: 172.20.0.1:58338 - "POST /node/69dcb35c3c1e37dfe2f8a526 HTTP/1.0" 202 Accepted 2026-04-15 09:12:01,959 - lava_callback - INFO - Starting async job submit for node 69dcb35c3c1e37dfe2f8a526 2026-04-15 09:12:01,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:01,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb35c3c1e37dfe2f8a526 HTTP/1.1" 200 None 2026-04-15 09:12:01,975 - lava_callback - DEBUG - Processing node 69dcb35c3c1e37dfe2f8a526: baseline-arm-baylibre 2026-04-15 09:12:01,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb35c3c1e37dfe2f8a526 2026-04-15 09:12:01,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:01,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb35c3c1e37dfe2f8a526 HTTP/1.1" 200 None 2026-04-15 09:12:01,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:02,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 09:12:02,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:02,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb35c3c1e37dfe2f8a526 HTTP/1.1" 200 None 2026-04-15 09:12:02,026 - lava_callback - ERROR - Error processing callback for node 69dcb35c3c1e37dfe2f8a526: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 09:12:06,253 - lava_callback - INFO - Received callback for node 69df55ff06e8e7b15e9631f2 INFO: 172.20.0.1:58350 - "POST /node/69df55ff06e8e7b15e9631f2 HTTP/1.0" 202 Accepted 2026-04-15 09:12:06,259 - lava_callback - INFO - Starting async job submit for node 69df55ff06e8e7b15e9631f2 2026-04-15 09:12:06,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:06,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df55ff06e8e7b15e9631f2 HTTP/1.1" 200 None 2026-04-15 09:12:06,299 - lava_callback - DEBUG - Processing node 69df55ff06e8e7b15e9631f2: baseline-arm64-broonie INFO: 172.20.0.1:58352 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:12:06,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:12:06,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:12:06,929 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df55ff06e8e7b15e9631f2/log.txt.gz 2026-04-15 09:12:07,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:12:07,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:12:07,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df55ff06e8e7b15e9631f2/lava-logs.yaml 2026-04-15 09:12:07,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:12:07,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:12:07,639 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69df55ff06e8e7b15e9631f2/lava_callback.json.gz 2026-04-15 09:12:07,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:07,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df55ff06e8e7b15e9631f2 HTTP/1.1" 200 None 2026-04-15 09:12:07,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:07,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:12:07,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:07,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df55ff06e8e7b15e9631f2 HTTP/1.1" 200 None 2026-04-15 09:12:07,734 - lava_callback - INFO - Completed processing callback for node 69df55ff06e8e7b15e9631f2 INFO: 172.20.0.1:48560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33098 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:12:37,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:37,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41900 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:12:47,144 - lava_callback - INFO - Received callback for node 69df565406e8e7b15e96321e INFO: 172.20.0.1:41904 - "POST /node/69df565406e8e7b15e96321e HTTP/1.0" 202 Accepted 2026-04-15 09:12:47,152 - lava_callback - INFO - Starting async job submit for node 69df565406e8e7b15e96321e 2026-04-15 09:12:47,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:47,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df565406e8e7b15e96321e HTTP/1.1" 200 None 2026-04-15 09:12:47,225 - lava_callback - DEBUG - Processing node 69df565406e8e7b15e96321e: baseline-arm64 2026-04-15 09:12:47,362 - lava_callback - WARNING - Failed to upload log 2026-04-15 09:12:47,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:12:47,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:12:47,631 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df565406e8e7b15e96321e/lava-logs.yaml 2026-04-15 09:12:47,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:12:47,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:12:47,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df565406e8e7b15e96321e/lava_callback.json.gz 2026-04-15 09:12:47,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:47,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df565406e8e7b15e96321e HTTP/1.1" 200 None 2026-04-15 09:12:47,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:47,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:12:47,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:47,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df565406e8e7b15e96321e HTTP/1.1" 200 None 2026-04-15 09:12:47,893 - lava_callback - INFO - Completed processing callback for node 69df565406e8e7b15e96321e 2026-04-15 09:12:48,779 - lava_callback - INFO - Received callback for node 69dcb3803c1e37dfe2f8a53c INFO: 172.20.0.1:41912 - "POST /node/69dcb3803c1e37dfe2f8a53c HTTP/1.0" 202 Accepted 2026-04-15 09:12:48,785 - lava_callback - INFO - Starting async job submit for node 69dcb3803c1e37dfe2f8a53c 2026-04-15 09:12:48,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:48,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb3803c1e37dfe2f8a53c HTTP/1.1" 200 None 2026-04-15 09:12:48,802 - lava_callback - DEBUG - Processing node 69dcb3803c1e37dfe2f8a53c: baseline-arm-clabbe 2026-04-15 09:12:48,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb3803c1e37dfe2f8a53c 2026-04-15 09:12:48,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:48,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb3803c1e37dfe2f8a53c HTTP/1.1" 200 None 2026-04-15 09:12:48,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:48,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 09:12:48,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:12:48,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb3803c1e37dfe2f8a53c HTTP/1.1" 200 None 2026-04-15 09:12:48,866 - lava_callback - ERROR - Error processing callback for node 69dcb3803c1e37dfe2f8a53c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55930 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:13:07,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:13:07,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 09:13:08,766 - lava_callback - INFO - Received callback for node 69dcb39f3c1e37dfe2f8a55e INFO: 172.20.0.1:55940 - "POST /node/69dcb39f3c1e37dfe2f8a55e HTTP/1.0" 202 Accepted 2026-04-15 09:13:08,771 - lava_callback - INFO - Starting async job submit for node 69dcb39f3c1e37dfe2f8a55e 2026-04-15 09:13:08,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:13:08,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb39f3c1e37dfe2f8a55e HTTP/1.1" 200 None 2026-04-15 09:13:08,788 - lava_callback - DEBUG - Processing node 69dcb39f3c1e37dfe2f8a55e: baseline-arm-clabbe 2026-04-15 09:13:08,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb39f3c1e37dfe2f8a55e 2026-04-15 09:13:08,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:13:08,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb39f3c1e37dfe2f8a55e HTTP/1.1" 200 None 2026-04-15 09:13:08,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:13:08,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 09:13:08,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:13:08,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb39f3c1e37dfe2f8a55e HTTP/1.1" 200 None 2026-04-15 09:13:08,838 - lava_callback - ERROR - Error processing callback for node 69dcb39f3c1e37dfe2f8a55e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48432 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:13:48,811 - lava_callback - INFO - Received callback for node 69dcb3bd3c1e37dfe2f8a58f INFO: 172.20.0.1:48448 - "POST /node/69dcb3bd3c1e37dfe2f8a58f HTTP/1.0" 202 Accepted 2026-04-15 09:13:48,817 - lava_callback - INFO - Starting async job submit for node 69dcb3bd3c1e37dfe2f8a58f 2026-04-15 09:13:48,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:13:48,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb3bd3c1e37dfe2f8a58f HTTP/1.1" 200 None 2026-04-15 09:13:48,832 - lava_callback - DEBUG - Processing node 69dcb3bd3c1e37dfe2f8a58f: baseline-arm-clabbe 2026-04-15 09:13:48,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb3bd3c1e37dfe2f8a58f 2026-04-15 09:13:48,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:13:48,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb3bd3c1e37dfe2f8a58f HTTP/1.1" 200 None 2026-04-15 09:13:48,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:13:48,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 09:13:48,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:13:48,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb3bd3c1e37dfe2f8a58f HTTP/1.1" 200 None 2026-04-15 09:13:48,884 - lava_callback - ERROR - Error processing callback for node 69dcb3bd3c1e37dfe2f8a58f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40872 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:14:13,641 - lava_callback - INFO - Received callback for node 69df569a06e8e7b15e9632b5 INFO: 172.20.0.1:35804 - "POST /node/69df569a06e8e7b15e9632b5 HTTP/1.0" 202 Accepted 2026-04-15 09:14:13,648 - lava_callback - INFO - Starting async job submit for node 69df569a06e8e7b15e9632b5 2026-04-15 09:14:13,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:14:13,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df569a06e8e7b15e9632b5 HTTP/1.1" 200 None 2026-04-15 09:14:13,692 - lava_callback - DEBUG - Processing node 69df569a06e8e7b15e9632b5: baseline-arm64 2026-04-15 09:14:13,905 - lava_callback - WARNING - Failed to upload log 2026-04-15 09:14:14,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:14:14,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:14:14,228 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df569a06e8e7b15e9632b5/lava-logs.yaml 2026-04-15 09:14:14,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:14:14,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:14:14,371 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df569a06e8e7b15e9632b5/lava_callback.json.gz 2026-04-15 09:14:14,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:14:14,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df569a06e8e7b15e9632b5 HTTP/1.1" 200 None 2026-04-15 09:14:14,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:14:14,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:14:14,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:14:14,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df569a06e8e7b15e9632b5 HTTP/1.1" 200 None 2026-04-15 09:14:14,523 - lava_callback - INFO - Completed processing callback for node 69df569a06e8e7b15e9632b5 INFO: 172.20.0.1:35806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35864 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:14:28,815 - lava_callback - INFO - Received callback for node 69dcb3e13c1e37dfe2f8a5a6 INFO: 172.20.0.1:35872 - "POST /node/69dcb3e13c1e37dfe2f8a5a6 HTTP/1.0" 202 Accepted 2026-04-15 09:14:28,821 - lava_callback - INFO - Starting async job submit for node 69dcb3e13c1e37dfe2f8a5a6 2026-04-15 09:14:28,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:14:28,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb3e13c1e37dfe2f8a5a6 HTTP/1.1" 200 None 2026-04-15 09:14:28,837 - lava_callback - DEBUG - Processing node 69dcb3e13c1e37dfe2f8a5a6: baseline-arm-clabbe 2026-04-15 09:14:28,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb3e13c1e37dfe2f8a5a6 2026-04-15 09:14:28,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:14:28,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb3e13c1e37dfe2f8a5a6 HTTP/1.1" 200 None 2026-04-15 09:14:28,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:14:28,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 09:14:28,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:14:28,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb3e13c1e37dfe2f8a5a6 HTTP/1.1" 200 None 2026-04-15 09:14:28,884 - lava_callback - ERROR - Error processing callback for node 69dcb3e13c1e37dfe2f8a5a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39498 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:14:37,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:14:37,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56900 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:14:48,824 - lava_callback - INFO - Received callback for node 69dcb4003c1e37dfe2f8a5c8 INFO: 172.20.0.1:56916 - "POST /node/69dcb4003c1e37dfe2f8a5c8 HTTP/1.0" 202 Accepted 2026-04-15 09:14:48,829 - lava_callback - INFO - Starting async job submit for node 69dcb4003c1e37dfe2f8a5c8 2026-04-15 09:14:48,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:14:48,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb4003c1e37dfe2f8a5c8 HTTP/1.1" 200 None 2026-04-15 09:14:48,846 - lava_callback - DEBUG - Processing node 69dcb4003c1e37dfe2f8a5c8: baseline-arm-clabbe 2026-04-15 09:14:48,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb4003c1e37dfe2f8a5c8 2026-04-15 09:14:48,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:14:48,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb4003c1e37dfe2f8a5c8 HTTP/1.1" 200 None 2026-04-15 09:14:48,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:14:48,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 09:14:48,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:14:48,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb4003c1e37dfe2f8a5c8 HTTP/1.1" 200 None 2026-04-15 09:14:48,893 - lava_callback - ERROR - Error processing callback for node 69dcb4003c1e37dfe2f8a5c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53060 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:15:28,829 - lava_callback - INFO - Received callback for node 69dcb41b3c1e37dfe2f8a601 INFO: 172.20.0.1:53072 - "POST /node/69dcb41b3c1e37dfe2f8a601 HTTP/1.0" 202 Accepted 2026-04-15 09:15:28,835 - lava_callback - INFO - Starting async job submit for node 69dcb41b3c1e37dfe2f8a601 2026-04-15 09:15:28,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:15:28,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb41b3c1e37dfe2f8a601 HTTP/1.1" 200 None 2026-04-15 09:15:28,850 - lava_callback - DEBUG - Processing node 69dcb41b3c1e37dfe2f8a601: baseline-arm-clabbe 2026-04-15 09:15:28,851 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb41b3c1e37dfe2f8a601 2026-04-15 09:15:28,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:15:28,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb41b3c1e37dfe2f8a601 HTTP/1.1" 200 None 2026-04-15 09:15:28,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:15:28,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 09:15:28,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:15:28,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb41b3c1e37dfe2f8a601 HTTP/1.1" 200 None 2026-04-15 09:15:28,912 - lava_callback - ERROR - Error processing callback for node 69dcb41b3c1e37dfe2f8a601: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51380 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:15:48,882 - lava_callback - INFO - Received callback for node 69dcb43d3c1e37dfe2f8a635 INFO: 172.20.0.1:51396 - "POST /node/69dcb43d3c1e37dfe2f8a635 HTTP/1.0" 202 Accepted 2026-04-15 09:15:48,888 - lava_callback - INFO - Starting async job submit for node 69dcb43d3c1e37dfe2f8a635 2026-04-15 09:15:48,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:15:48,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb43d3c1e37dfe2f8a635 HTTP/1.1" 200 None 2026-04-15 09:15:48,904 - lava_callback - DEBUG - Processing node 69dcb43d3c1e37dfe2f8a635: baseline-arm-clabbe 2026-04-15 09:15:48,904 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb43d3c1e37dfe2f8a635 2026-04-15 09:15:48,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:15:48,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb43d3c1e37dfe2f8a635 HTTP/1.1" 200 None 2026-04-15 09:15:48,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:15:48,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 09:15:48,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:15:48,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb43d3c1e37dfe2f8a635 HTTP/1.1" 200 None 2026-04-15 09:15:48,953 - lava_callback - ERROR - Error processing callback for node 69dcb43d3c1e37dfe2f8a635: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37938 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:16:08,952 - lava_callback - INFO - Received callback for node 69df572806e8e7b15e9632f9 INFO: 172.20.0.1:37944 - "POST /node/69df572806e8e7b15e9632f9 HTTP/1.0" 202 Accepted 2026-04-15 09:16:08,959 - lava_callback - INFO - Starting async job submit for node 69df572806e8e7b15e9632f9 2026-04-15 09:16:08,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:16:08,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df572806e8e7b15e9632f9 HTTP/1.1" 200 None 2026-04-15 09:16:08,996 - lava_callback - DEBUG - Processing node 69df572806e8e7b15e9632f9: baseline-arm64 2026-04-15 09:16:09,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:16:09,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:16:09,454 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df572806e8e7b15e9632f9/log.txt.gz 2026-04-15 09:16:09,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:16:09,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:16:09,863 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df572806e8e7b15e9632f9/lava-logs.yaml 2026-04-15 09:16:09,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:16:10,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:16:10,022 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df572806e8e7b15e9632f9/lava_callback.json.gz 2026-04-15 09:16:10,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:16:10,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df572806e8e7b15e9632f9 HTTP/1.1" 200 None 2026-04-15 09:16:10,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:16:10,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:16:10,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:16:10,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df572806e8e7b15e9632f9 HTTP/1.1" 200 None 2026-04-15 09:16:10,107 - lava_callback - INFO - Completed processing callback for node 69df572806e8e7b15e9632f9 INFO: 172.20.0.1:40164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35320 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:16:28,110 - lava_callback - INFO - Received callback for node 69df55ad06e8e7b15e963181 INFO: 172.20.0.1:35334 - "POST /node/69df55ad06e8e7b15e963181 HTTP/1.0" 202 Accepted 2026-04-15 09:16:28,117 - lava_callback - INFO - Starting async job submit for node 69df55ad06e8e7b15e963181 2026-04-15 09:16:28,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:16:28,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df55ad06e8e7b15e963181 HTTP/1.1" 200 None 2026-04-15 09:16:28,172 - lava_callback - DEBUG - Processing node 69df55ad06e8e7b15e963181: baseline-arm64 2026-04-15 09:16:28,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:16:28,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:16:28,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df55ad06e8e7b15e963181/log.txt.gz 2026-04-15 09:16:28,894 - lava_callback - INFO - Received callback for node 69dcb45f3c1e37dfe2f8a647 INFO: 172.20.0.1:35346 - "POST /node/69dcb45f3c1e37dfe2f8a647 HTTP/1.0" 202 Accepted 2026-04-15 09:16:28,906 - lava_callback - INFO - Starting async job submit for node 69dcb45f3c1e37dfe2f8a647 2026-04-15 09:16:28,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:16:28,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:16:28,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb45f3c1e37dfe2f8a647 HTTP/1.1" 200 None 2026-04-15 09:16:28,961 - lava_callback - DEBUG - Processing node 69dcb45f3c1e37dfe2f8a647: baseline-arm-clabbe 2026-04-15 09:16:28,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb45f3c1e37dfe2f8a647 2026-04-15 09:16:28,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:16:28,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb45f3c1e37dfe2f8a647 HTTP/1.1" 200 None 2026-04-15 09:16:28,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:16:28,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 09:16:28,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:16:29,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb45f3c1e37dfe2f8a647 HTTP/1.1" 200 None 2026-04-15 09:16:29,020 - lava_callback - ERROR - Error processing callback for node 69dcb45f3c1e37dfe2f8a647: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 09:16:29,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:16:29,217 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df55ad06e8e7b15e963181/lava-logs.yaml 2026-04-15 09:16:29,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:16:29,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:16:29,413 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df55ad06e8e7b15e963181/lava_callback.json.gz DEBUG: Setup failed for 69df55ad06e8e7b15e963181. Transitting job node result: incomplete -> fail 2026-04-15 09:16:29,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:16:29,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df55ad06e8e7b15e963181 HTTP/1.1" 200 None 2026-04-15 09:16:29,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:16:29,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:16:29,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:16:29,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df55ad06e8e7b15e963181 HTTP/1.1" 200 None 2026-04-15 09:16:29,627 - lava_callback - INFO - Completed processing callback for node 69df55ad06e8e7b15e963181 INFO: 172.20.0.1:52968 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:16:37,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:16:37,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46574 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:17:08,947 - lava_callback - INFO - Received callback for node 69dcb4803c1e37dfe2f8a66d INFO: 172.20.0.1:46580 - "POST /node/69dcb4803c1e37dfe2f8a66d HTTP/1.0" 202 Accepted 2026-04-15 09:17:08,953 - lava_callback - INFO - Starting async job submit for node 69dcb4803c1e37dfe2f8a66d 2026-04-15 09:17:08,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:17:08,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb4803c1e37dfe2f8a66d HTTP/1.1" 200 None 2026-04-15 09:17:08,968 - lava_callback - DEBUG - Processing node 69dcb4803c1e37dfe2f8a66d: baseline-arm-clabbe 2026-04-15 09:17:08,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb4803c1e37dfe2f8a66d 2026-04-15 09:17:08,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:17:08,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb4803c1e37dfe2f8a66d HTTP/1.1" 200 None 2026-04-15 09:17:08,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:17:08,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702c150e7993d3c143347 HTTP/1.1" 200 None 2026-04-15 09:17:08,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:17:09,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb4803c1e37dfe2f8a66d HTTP/1.1" 200 None 2026-04-15 09:17:09,017 - lava_callback - ERROR - Error processing callback for node 69dcb4803c1e37dfe2f8a66d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35400 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:17:42,361 - lava_callback - INFO - Received callback for node 69dcb4a73c1e37dfe2f8a6a8 INFO: 172.20.0.1:59034 - "POST /node/69dcb4a73c1e37dfe2f8a6a8 HTTP/1.0" 202 Accepted 2026-04-15 09:17:42,367 - lava_callback - INFO - Starting async job submit for node 69dcb4a73c1e37dfe2f8a6a8 2026-04-15 09:17:42,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:17:42,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb4a73c1e37dfe2f8a6a8 HTTP/1.1" 200 None 2026-04-15 09:17:42,383 - lava_callback - DEBUG - Processing node 69dcb4a73c1e37dfe2f8a6a8: baseline-arm64-baylibre 2026-04-15 09:17:42,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb4a73c1e37dfe2f8a6a8 2026-04-15 09:17:42,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:17:42,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb4a73c1e37dfe2f8a6a8 HTTP/1.1" 200 None 2026-04-15 09:17:42,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:17:42,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 09:17:42,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:17:42,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb4a73c1e37dfe2f8a6a8 HTTP/1.1" 200 None 2026-04-15 09:17:42,431 - lava_callback - ERROR - Error processing callback for node 69dcb4a73c1e37dfe2f8a6a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43420 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:18:42,332 - lava_callback - INFO - Received callback for node 69dcb4e73c1e37dfe2f8a70a INFO: 172.20.0.1:35930 - "POST /node/69dcb4e73c1e37dfe2f8a70a HTTP/1.0" 202 Accepted 2026-04-15 09:18:42,338 - lava_callback - INFO - Starting async job submit for node 69dcb4e73c1e37dfe2f8a70a 2026-04-15 09:18:42,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:18:42,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb4e73c1e37dfe2f8a70a HTTP/1.1" 200 None 2026-04-15 09:18:42,359 - lava_callback - DEBUG - Processing node 69dcb4e73c1e37dfe2f8a70a: baseline-arm64-baylibre 2026-04-15 09:18:42,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb4e73c1e37dfe2f8a70a 2026-04-15 09:18:42,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:18:42,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb4e73c1e37dfe2f8a70a HTTP/1.1" 200 None 2026-04-15 09:18:42,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:18:42,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 09:18:42,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:18:42,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb4e73c1e37dfe2f8a70a HTTP/1.1" 200 None 2026-04-15 09:18:42,408 - lava_callback - ERROR - Error processing callback for node 69dcb4e73c1e37dfe2f8a70a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 09:18:45,617 - lava_callback - INFO - Received callback for node 69df53d406e8e7b15e962f4e INFO: 172.20.0.1:35938 - "POST /node/69df53d406e8e7b15e962f4e HTTP/1.0" 202 Accepted 2026-04-15 09:18:45,624 - lava_callback - INFO - Starting async job submit for node 69df53d406e8e7b15e962f4e 2026-04-15 09:18:45,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:18:45,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53d406e8e7b15e962f4e HTTP/1.1" 200 None 2026-04-15 09:18:45,698 - lava_callback - DEBUG - Processing node 69df53d406e8e7b15e962f4e: ltp-smoke 2026-04-15 09:18:46,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:18:46,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:18:46,381 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69df53d406e8e7b15e962f4e/log.txt.gz INFO: 172.20.0.1:35954 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:18:46,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:18:46,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:18:46,876 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69df53d406e8e7b15e962f4e/lava-logs.yaml 2026-04-15 09:18:46,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:18:47,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:18:47,081 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69df53d406e8e7b15e962f4e/lava_callback.json.gz 2026-04-15 09:18:47,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:18:47,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53d406e8e7b15e962f4e HTTP/1.1" 200 None 2026-04-15 09:18:47,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:18:47,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499906e8e7b15e9624b4 HTTP/1.1" 200 None 2026-04-15 09:18:47,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:18:47,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df53d406e8e7b15e962f4e HTTP/1.1" 200 None 2026-04-15 09:18:47,354 - lava_callback - INFO - Completed processing callback for node 69df53d406e8e7b15e962f4e INFO: 172.20.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41554 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:19:07,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:07,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49546 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 09:19:16,130 - lava_callback - INFO - Received callback for node 69df501906e8e7b15e96299c INFO: 172.20.0.1:49552 - "POST /node/69df501906e8e7b15e96299c HTTP/1.0" 202 Accepted 2026-04-15 09:19:16,136 - lava_callback - INFO - Starting async job submit for node 69df501906e8e7b15e96299c 2026-04-15 09:19:16,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:16,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501906e8e7b15e96299c HTTP/1.1" 200 None 2026-04-15 09:19:16,174 - lava_callback - DEBUG - Processing node 69df501906e8e7b15e96299c: baseline-nfs-arm64 2026-04-15 09:19:16,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:49556 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:19:16,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:19:16,652 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501906e8e7b15e96299c/log.txt.gz 2026-04-15 09:19:16,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:19:17,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:19:17,059 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501906e8e7b15e96299c/lava-logs.yaml 2026-04-15 09:19:17,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:19:17,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:19:17,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501906e8e7b15e96299c/lava_callback.json.gz 2026-04-15 09:19:17,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:17,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501906e8e7b15e96299c HTTP/1.1" 200 None 2026-04-15 09:19:17,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:17,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:19:17,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:17,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df501906e8e7b15e96299c HTTP/1.1" 200 None 2026-04-15 09:19:17,503 - lava_callback - INFO - Completed processing callback for node 69df501906e8e7b15e96299c 2026-04-15 09:19:18,063 - lava_callback - INFO - Received callback for node 69df500406e8e7b15e96295e INFO: 172.20.0.1:49568 - "POST /node/69df500406e8e7b15e96295e HTTP/1.0" 202 Accepted 2026-04-15 09:19:18,069 - lava_callback - INFO - Starting async job submit for node 69df500406e8e7b15e96295e 2026-04-15 09:19:18,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:18,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500406e8e7b15e96295e HTTP/1.1" 200 None 2026-04-15 09:19:18,107 - lava_callback - DEBUG - Processing node 69df500406e8e7b15e96295e: baseline-arm64 2026-04-15 09:19:18,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:19:18,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:19:18,469 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500406e8e7b15e96295e/log.txt.gz 2026-04-15 09:19:18,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:19:18,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:19:18,808 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500406e8e7b15e96295e/lava-logs.yaml 2026-04-15 09:19:18,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:19:18,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:19:18,978 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500406e8e7b15e96295e/lava_callback.json.gz 2026-04-15 09:19:18,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:19,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500406e8e7b15e96295e HTTP/1.1" 200 None 2026-04-15 09:19:19,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:19,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:19:19,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:19,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df500406e8e7b15e96295e HTTP/1.1" 200 None 2026-04-15 09:19:19,051 - lava_callback - INFO - Completed processing callback for node 69df500406e8e7b15e96295e INFO: 172.20.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57924 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:19:37,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:37,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 09:19:42,367 - lava_callback - INFO - Received callback for node 69dcb5263c1e37dfe2f8a76d INFO: 172.20.0.1:60514 - "POST /node/69dcb5263c1e37dfe2f8a76d HTTP/1.0" 202 Accepted 2026-04-15 09:19:42,372 - lava_callback - INFO - Starting async job submit for node 69dcb5263c1e37dfe2f8a76d 2026-04-15 09:19:42,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:42,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb5263c1e37dfe2f8a76d HTTP/1.1" 200 None 2026-04-15 09:19:42,388 - lava_callback - DEBUG - Processing node 69dcb5263c1e37dfe2f8a76d: baseline-arm64-baylibre 2026-04-15 09:19:42,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb5263c1e37dfe2f8a76d 2026-04-15 09:19:42,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:42,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb5263c1e37dfe2f8a76d HTTP/1.1" 200 None 2026-04-15 09:19:42,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:42,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 09:19:42,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:19:42,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb5263c1e37dfe2f8a76d HTTP/1.1" 200 None 2026-04-15 09:19:42,446 - lava_callback - ERROR - Error processing callback for node 69dcb5263c1e37dfe2f8a76d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58424 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:20:29,178 - lava_callback - INFO - Received callback for node 69df542106e8e7b15e962fc3 INFO: 172.20.0.1:58432 - "POST /node/69df542106e8e7b15e962fc3 HTTP/1.0" 202 Accepted 2026-04-15 09:20:29,185 - lava_callback - INFO - Starting async job submit for node 69df542106e8e7b15e962fc3 2026-04-15 09:20:29,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:20:29,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df542106e8e7b15e962fc3 HTTP/1.1" 200 None 2026-04-15 09:20:29,256 - lava_callback - DEBUG - Processing node 69df542106e8e7b15e962fc3: baseline-arm 2026-04-15 09:20:29,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:20:30,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:20:30,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69df542106e8e7b15e962fc3/log.txt.gz 2026-04-15 09:20:30,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:20:30,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:20:30,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df542106e8e7b15e962fc3/lava-logs.yaml 2026-04-15 09:20:30,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:20:31,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:20:31,125 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df542106e8e7b15e962fc3/lava_callback.json.gz DEBUG: Setup failed for 69df542106e8e7b15e962fc3. Transitting job node result: incomplete -> fail 2026-04-15 09:20:31,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:20:31,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df542106e8e7b15e962fc3 HTTP/1.1" 200 None 2026-04-15 09:20:31,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:20:31,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 09:20:31,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:20:31,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df542106e8e7b15e962fc3 HTTP/1.1" 200 None 2026-04-15 09:20:31,416 - lava_callback - INFO - Completed processing callback for node 69df542106e8e7b15e962fc3 INFO: 172.20.0.1:56020 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:20:37,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:20:37,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35088 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:21:02,498 - lava_callback - INFO - Received callback for node 69dcb5723c1e37dfe2f8a795 INFO: 172.20.0.1:43936 - "POST /node/69dcb5723c1e37dfe2f8a795 HTTP/1.0" 202 Accepted 2026-04-15 09:21:02,503 - lava_callback - INFO - Starting async job submit for node 69dcb5723c1e37dfe2f8a795 2026-04-15 09:21:02,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:21:02,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb5723c1e37dfe2f8a795 HTTP/1.1" 200 None 2026-04-15 09:21:02,521 - lava_callback - DEBUG - Processing node 69dcb5723c1e37dfe2f8a795: baseline-arm64-baylibre 2026-04-15 09:21:02,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb5723c1e37dfe2f8a795 2026-04-15 09:21:02,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:21:02,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb5723c1e37dfe2f8a795 HTTP/1.1" 200 None 2026-04-15 09:21:02,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:21:02,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 09:21:02,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:21:02,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb5723c1e37dfe2f8a795 HTTP/1.1" 200 None 2026-04-15 09:21:02,578 - lava_callback - ERROR - Error processing callback for node 69dcb5723c1e37dfe2f8a795: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56512 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:21:45,846 - lava_callback - INFO - Received callback for node 69df584a06e8e7b15e9633fb INFO: 172.20.0.1:42350 - "POST /node/69df584a06e8e7b15e9633fb HTTP/1.0" 202 Accepted 2026-04-15 09:21:45,851 - lava_callback - INFO - Starting async job submit for node 69df584a06e8e7b15e9633fb 2026-04-15 09:21:45,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:21:45,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df584a06e8e7b15e9633fb HTTP/1.1" 200 None 2026-04-15 09:21:45,886 - lava_callback - DEBUG - Processing node 69df584a06e8e7b15e9633fb: baseline-x86 2026-04-15 09:21:46,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:21:46,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:21:46,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df584a06e8e7b15e9633fb/log.txt.gz 2026-04-15 09:21:46,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:42360 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:21:46,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:21:46,704 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df584a06e8e7b15e9633fb/lava-logs.yaml 2026-04-15 09:21:46,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:21:46,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:21:46,879 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df584a06e8e7b15e9633fb/lava_callback.json.gz 2026-04-15 09:21:46,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:21:46,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df584a06e8e7b15e9633fb HTTP/1.1" 200 None 2026-04-15 09:21:46,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:21:46,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49c106e8e7b15e9624ed HTTP/1.1" 200 None 2026-04-15 09:21:46,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:21:46,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df584a06e8e7b15e9633fb HTTP/1.1" 200 None 2026-04-15 09:21:46,950 - lava_callback - INFO - Completed processing callback for node 69df584a06e8e7b15e9633fb INFO: 172.20.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49004 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:22:07,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:22:07,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45048 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:22:22,548 - lava_callback - INFO - Received callback for node 69dcb5b93c1e37dfe2f8a7cd INFO: 172.20.0.1:39838 - "POST /node/69dcb5b93c1e37dfe2f8a7cd HTTP/1.0" 202 Accepted 2026-04-15 09:22:22,554 - lava_callback - INFO - Starting async job submit for node 69dcb5b93c1e37dfe2f8a7cd 2026-04-15 09:22:22,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:22:22,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb5b93c1e37dfe2f8a7cd HTTP/1.1" 200 None 2026-04-15 09:22:22,570 - lava_callback - DEBUG - Processing node 69dcb5b93c1e37dfe2f8a7cd: baseline-arm64-baylibre 2026-04-15 09:22:22,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb5b93c1e37dfe2f8a7cd 2026-04-15 09:22:22,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:22:22,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb5b93c1e37dfe2f8a7cd HTTP/1.1" 200 None 2026-04-15 09:22:22,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:22:22,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 09:22:22,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:22:22,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb5b93c1e37dfe2f8a7cd HTTP/1.1" 200 None 2026-04-15 09:22:22,627 - lava_callback - ERROR - Error processing callback for node 69dcb5b93c1e37dfe2f8a7cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55606 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:22:54,613 - lava_callback - INFO - Received callback for node 69de95e3d105963562bb39db INFO: 172.20.0.1:45394 - "POST /node/69de95e3d105963562bb39db HTTP/1.0" 202 Accepted 2026-04-15 09:22:54,622 - lava_callback - INFO - Starting async job submit for node 69de95e3d105963562bb39db 2026-04-15 09:22:54,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:22:54,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95e3d105963562bb39db HTTP/1.1" 200 None 2026-04-15 09:22:54,674 - lava_callback - DEBUG - Processing node 69de95e3d105963562bb39db: baseline-nfs-arm64 2026-04-15 09:22:55,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:22:55,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:22:55,352 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69de95e3d105963562bb39db/log.txt.gz 2026-04-15 09:22:55,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:22:55,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:22:55,892 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69de95e3d105963562bb39db/lava-logs.yaml 2026-04-15 09:22:55,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:22:56,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:22:56,259 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69de95e3d105963562bb39db/lava_callback.json.gz 2026-04-15 09:22:56,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:22:56,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de95e3d105963562bb39db HTTP/1.1" 200 None 2026-04-15 09:22:56,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:22:56,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-15 09:22:56,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:22:56,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de95e3d105963562bb39db HTTP/1.1" 200 None 2026-04-15 09:22:56,411 - lava_callback - INFO - Completed processing callback for node 69de95e3d105963562bb39db INFO: 172.20.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56636 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:23:07,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:23:07,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46832 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:23:22,644 - lava_callback - INFO - Received callback for node 69dcb6033c1e37dfe2f8a7f6 INFO: 172.20.0.1:38950 - "POST /node/69dcb6033c1e37dfe2f8a7f6 HTTP/1.0" 202 Accepted 2026-04-15 09:23:22,649 - lava_callback - INFO - Starting async job submit for node 69dcb6033c1e37dfe2f8a7f6 2026-04-15 09:23:22,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:23:22,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb6033c1e37dfe2f8a7f6 HTTP/1.1" 200 None 2026-04-15 09:23:22,667 - lava_callback - DEBUG - Processing node 69dcb6033c1e37dfe2f8a7f6: baseline-arm64-baylibre 2026-04-15 09:23:22,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb6033c1e37dfe2f8a7f6 2026-04-15 09:23:22,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:23:22,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb6033c1e37dfe2f8a7f6 HTTP/1.1" 200 None 2026-04-15 09:23:22,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:23:22,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 09:23:22,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:23:22,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb6033c1e37dfe2f8a7f6 HTTP/1.1" 200 None 2026-04-15 09:23:22,722 - lava_callback - ERROR - Error processing callback for node 69dcb6033c1e37dfe2f8a7f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42122 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:24:46,982 - lava_callback - INFO - Received callback for node 69dea0e37a8aab7fee69d714 INFO: 172.20.0.1:42134 - "POST /node/69dea0e37a8aab7fee69d714 HTTP/1.0" 202 Accepted 2026-04-15 09:24:46,989 - lava_callback - INFO - Starting async job submit for node 69dea0e37a8aab7fee69d714 2026-04-15 09:24:47,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:24:47,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dea0e37a8aab7fee69d714 HTTP/1.1" 200 None 2026-04-15 09:24:47,029 - lava_callback - DEBUG - Processing node 69dea0e37a8aab7fee69d714: baseline-arm64 2026-04-15 09:24:47,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:24:47,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:24:47,841 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69dea0e37a8aab7fee69d714/log.txt.gz 2026-04-15 09:24:48,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:24:48,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:24:48,368 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69dea0e37a8aab7fee69d714/lava-logs.yaml 2026-04-15 09:24:48,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:24:48,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:24:48,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69dea0e37a8aab7fee69d714/lava_callback.json.gz 2026-04-15 09:24:48,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:24:48,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dea0e37a8aab7fee69d714 HTTP/1.1" 200 None 2026-04-15 09:24:48,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:24:48,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-15 09:24:48,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:24:48,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dea0e37a8aab7fee69d714 HTTP/1.1" 200 None 2026-04-15 09:24:48,725 - lava_callback - INFO - Completed processing callback for node 69dea0e37a8aab7fee69d714 2026-04-15 09:24:49,281 - lava_callback - INFO - Received callback for node 69dcb64c3c1e37dfe2f8a85a INFO: 172.20.0.1:42150 - "POST /node/69dcb64c3c1e37dfe2f8a85a HTTP/1.0" 202 Accepted 2026-04-15 09:24:49,286 - lava_callback - INFO - Starting async job submit for node 69dcb64c3c1e37dfe2f8a85a 2026-04-15 09:24:49,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:24:49,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb64c3c1e37dfe2f8a85a HTTP/1.1" 200 None 2026-04-15 09:24:49,302 - lava_callback - DEBUG - Processing node 69dcb64c3c1e37dfe2f8a85a: baseline-arm64-clabbe 2026-04-15 09:24:49,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb64c3c1e37dfe2f8a85a 2026-04-15 09:24:49,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:24:49,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb64c3c1e37dfe2f8a85a HTTP/1.1" 200 None 2026-04-15 09:24:49,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:24:49,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 09:24:49,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:24:49,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb64c3c1e37dfe2f8a85a HTTP/1.1" 200 None 2026-04-15 09:24:49,350 - lava_callback - ERROR - Error processing callback for node 69dcb64c3c1e37dfe2f8a85a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34458 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:25:07,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:25:07,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49268 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:25:49,361 - lava_callback - INFO - Received callback for node 69dcb6903c1e37dfe2f8a89a INFO: 172.20.0.1:49282 - "POST /node/69dcb6903c1e37dfe2f8a89a HTTP/1.0" 202 Accepted 2026-04-15 09:25:49,367 - lava_callback - INFO - Starting async job submit for node 69dcb6903c1e37dfe2f8a89a 2026-04-15 09:25:49,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:25:49,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb6903c1e37dfe2f8a89a HTTP/1.1" 200 None 2026-04-15 09:25:49,386 - lava_callback - DEBUG - Processing node 69dcb6903c1e37dfe2f8a89a: baseline-arm64-clabbe 2026-04-15 09:25:49,386 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb6903c1e37dfe2f8a89a 2026-04-15 09:25:49,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:25:49,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb6903c1e37dfe2f8a89a HTTP/1.1" 200 None 2026-04-15 09:25:49,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:25:49,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 09:25:49,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:25:49,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb6903c1e37dfe2f8a89a HTTP/1.1" 200 None 2026-04-15 09:25:49,439 - lava_callback - ERROR - Error processing callback for node 69dcb6903c1e37dfe2f8a89a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50586 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:26:49,445 - lava_callback - INFO - Received callback for node 69dcb6d23c1e37dfe2f8a8f3 INFO: 172.20.0.1:50598 - "POST /node/69dcb6d23c1e37dfe2f8a8f3 HTTP/1.0" 202 Accepted 2026-04-15 09:26:49,450 - lava_callback - INFO - Starting async job submit for node 69dcb6d23c1e37dfe2f8a8f3 2026-04-15 09:26:49,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:26:49,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb6d23c1e37dfe2f8a8f3 HTTP/1.1" 200 None 2026-04-15 09:26:49,467 - lava_callback - DEBUG - Processing node 69dcb6d23c1e37dfe2f8a8f3: baseline-arm64-clabbe 2026-04-15 09:26:49,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb6d23c1e37dfe2f8a8f3 2026-04-15 09:26:49,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:26:49,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb6d23c1e37dfe2f8a8f3 HTTP/1.1" 200 None 2026-04-15 09:26:49,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:26:49,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 09:26:49,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:26:49,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb6d23c1e37dfe2f8a8f3 HTTP/1.1" 200 None 2026-04-15 09:26:49,527 - lava_callback - ERROR - Error processing callback for node 69dcb6d23c1e37dfe2f8a8f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37144 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:27:31,928 - lava_callback - INFO - Received callback for node 69df59f906e8e7b15e9635da INFO: 172.20.0.1:45236 - "POST /node/69df59f906e8e7b15e9635da HTTP/1.0" 202 Accepted 2026-04-15 09:27:31,934 - lava_callback - INFO - Starting async job submit for node 69df59f906e8e7b15e9635da 2026-04-15 09:27:31,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:27:31,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df59f906e8e7b15e9635da HTTP/1.1" 200 None 2026-04-15 09:27:31,950 - lava_callback - DEBUG - Processing node 69df59f906e8e7b15e9635da: baseline-nfs-arm64 2026-04-15 09:27:31,952 - lava_callback - WARNING - Failed to upload log 2026-04-15 09:27:31,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:27:32,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:27:32,122 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df59f906e8e7b15e9635da/lava-logs.yaml 2026-04-15 09:27:32,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:27:32,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:27:32,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df59f906e8e7b15e9635da/lava_callback.json.gz 2026-04-15 09:27:32,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:27:32,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df59f906e8e7b15e9635da HTTP/1.1" 200 None 2026-04-15 09:27:32,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:27:32,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:27:32,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:27:32,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df59f906e8e7b15e9635da HTTP/1.1" 200 None 2026-04-15 09:27:32,334 - lava_callback - INFO - Completed processing callback for node 69df59f906e8e7b15e9635da INFO: 172.20.0.1:45250 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:27:37,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:27:37,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39690 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:29:09,454 - lava_callback - INFO - Received callback for node 69dcb7613c1e37dfe2f8a95f INFO: 172.20.0.1:39704 - "POST /node/69dcb7613c1e37dfe2f8a95f HTTP/1.0" 202 Accepted 2026-04-15 09:29:09,460 - lava_callback - INFO - Starting async job submit for node 69dcb7613c1e37dfe2f8a95f 2026-04-15 09:29:09,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:29:09,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb7613c1e37dfe2f8a95f HTTP/1.1" 200 None 2026-04-15 09:29:09,476 - lava_callback - DEBUG - Processing node 69dcb7613c1e37dfe2f8a95f: baseline-arm64-clabbe 2026-04-15 09:29:09,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb7613c1e37dfe2f8a95f 2026-04-15 09:29:09,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:29:09,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb7613c1e37dfe2f8a95f HTTP/1.1" 200 None 2026-04-15 09:29:09,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:29:09,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 09:29:09,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:29:09,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb7613c1e37dfe2f8a95f HTTP/1.1" 200 None 2026-04-15 09:29:09,528 - lava_callback - ERROR - Error processing callback for node 69dcb7613c1e37dfe2f8a95f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42404 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42426 - "GET /login HTTP/1.0" 404 Not Found INFO: 172.20.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52398 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:30:29,478 - lava_callback - INFO - Received callback for node 69dcb7a93c1e37dfe2f8a99a INFO: 172.20.0.1:52412 - "POST /node/69dcb7a93c1e37dfe2f8a99a HTTP/1.0" 202 Accepted 2026-04-15 09:30:29,484 - lava_callback - INFO - Starting async job submit for node 69dcb7a93c1e37dfe2f8a99a 2026-04-15 09:30:29,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:30:29,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb7a93c1e37dfe2f8a99a HTTP/1.1" 200 None 2026-04-15 09:30:29,510 - lava_callback - DEBUG - Processing node 69dcb7a93c1e37dfe2f8a99a: baseline-arm64-clabbe 2026-04-15 09:30:29,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb7a93c1e37dfe2f8a99a 2026-04-15 09:30:29,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:30:29,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb7a93c1e37dfe2f8a99a HTTP/1.1" 200 None 2026-04-15 09:30:29,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:30:29,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 09:30:29,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:30:29,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb7a93c1e37dfe2f8a99a HTTP/1.1" 200 None 2026-04-15 09:30:29,584 - lava_callback - ERROR - Error processing callback for node 69dcb7a93c1e37dfe2f8a99a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58934 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:31:29,506 - lava_callback - INFO - Received callback for node 69dcb7ed3c1e37dfe2f8a9ec INFO: 172.20.0.1:58940 - "POST /node/69dcb7ed3c1e37dfe2f8a9ec HTTP/1.0" 202 Accepted 2026-04-15 09:31:29,512 - lava_callback - INFO - Starting async job submit for node 69dcb7ed3c1e37dfe2f8a9ec 2026-04-15 09:31:29,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:31:29,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb7ed3c1e37dfe2f8a9ec HTTP/1.1" 200 None 2026-04-15 09:31:29,528 - lava_callback - DEBUG - Processing node 69dcb7ed3c1e37dfe2f8a9ec: baseline-arm64-clabbe 2026-04-15 09:31:29,528 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb7ed3c1e37dfe2f8a9ec 2026-04-15 09:31:29,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:31:29,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb7ed3c1e37dfe2f8a9ec HTTP/1.1" 200 None 2026-04-15 09:31:29,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:31:29,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 09:31:29,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:31:29,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb7ed3c1e37dfe2f8a9ec HTTP/1.1" 200 None 2026-04-15 09:31:29,576 - lava_callback - ERROR - Error processing callback for node 69dcb7ed3c1e37dfe2f8a9ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36054 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:32:08,003 - lava_callback - INFO - Received callback for node 69df5ae406e8e7b15e9636e6 INFO: 172.20.0.1:36064 - "POST /node/69df5ae406e8e7b15e9636e6 HTTP/1.0" 202 Accepted 2026-04-15 09:32:08,010 - lava_callback - INFO - Starting async job submit for node 69df5ae406e8e7b15e9636e6 2026-04-15 09:32:08,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:32:08,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5ae406e8e7b15e9636e6 HTTP/1.1" 200 None 2026-04-15 09:32:08,054 - lava_callback - DEBUG - Processing node 69df5ae406e8e7b15e9636e6: baseline-arm64 2026-04-15 09:32:08,184 - lava_callback - WARNING - Failed to upload log 2026-04-15 09:32:08,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:32:08,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:32:08,476 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df5ae406e8e7b15e9636e6/lava-logs.yaml 2026-04-15 09:32:08,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:32:08,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:32:08,621 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df5ae406e8e7b15e9636e6/lava_callback.json.gz 2026-04-15 09:32:08,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:32:08,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5ae406e8e7b15e9636e6 HTTP/1.1" 200 None 2026-04-15 09:32:08,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:32:08,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:32:08,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:32:08,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df5ae406e8e7b15e9636e6 HTTP/1.1" 200 None 2026-04-15 09:32:08,789 - lava_callback - INFO - Completed processing callback for node 69df5ae406e8e7b15e9636e6 INFO: 172.20.0.1:33842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53530 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:32:37,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:32:37,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43564 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:32:49,525 - lava_callback - INFO - Received callback for node 69dcb8323c1e37dfe2f8aa3b INFO: 172.20.0.1:43570 - "POST /node/69dcb8323c1e37dfe2f8aa3b HTTP/1.0" 202 Accepted 2026-04-15 09:32:49,531 - lava_callback - INFO - Starting async job submit for node 69dcb8323c1e37dfe2f8aa3b 2026-04-15 09:32:49,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:32:49,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb8323c1e37dfe2f8aa3b HTTP/1.1" 200 None 2026-04-15 09:32:49,551 - lava_callback - DEBUG - Processing node 69dcb8323c1e37dfe2f8aa3b: baseline-arm64-clabbe 2026-04-15 09:32:49,551 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb8323c1e37dfe2f8aa3b 2026-04-15 09:32:49,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:32:49,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb8323c1e37dfe2f8aa3b HTTP/1.1" 200 None 2026-04-15 09:32:49,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:32:49,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d702db50e7993d3c143361 HTTP/1.1" 200 None 2026-04-15 09:32:49,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:32:49,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb8323c1e37dfe2f8aa3b HTTP/1.1" 200 None 2026-04-15 09:32:49,603 - lava_callback - ERROR - Error processing callback for node 69dcb8323c1e37dfe2f8aa3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51498 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:34:28,218 - lava_callback - INFO - Received callback for node 69df5b6c06e8e7b15e9637a6 INFO: 172.20.0.1:51510 - "POST /node/69df5b6c06e8e7b15e9637a6 HTTP/1.0" 202 Accepted 2026-04-15 09:34:28,225 - lava_callback - INFO - Starting async job submit for node 69df5b6c06e8e7b15e9637a6 2026-04-15 09:34:28,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:34:28,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5b6c06e8e7b15e9637a6 HTTP/1.1" 200 None 2026-04-15 09:34:28,270 - lava_callback - DEBUG - Processing node 69df5b6c06e8e7b15e9637a6: baseline-arm64 2026-04-15 09:34:28,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:34:28,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:34:28,551 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df5b6c06e8e7b15e9637a6/log.txt.gz 2026-04-15 09:34:28,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:34:28,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:34:28,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df5b6c06e8e7b15e9637a6/lava-logs.yaml 2026-04-15 09:34:28,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:34:28,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:34:29,001 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df5b6c06e8e7b15e9637a6/lava_callback.json.gz 2026-04-15 09:34:29,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:34:29,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5b6c06e8e7b15e9637a6 HTTP/1.1" 200 None 2026-04-15 09:34:29,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:34:29,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:34:29,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:34:29,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df5b6c06e8e7b15e9637a6 HTTP/1.1" 200 None 2026-04-15 09:34:29,158 - lava_callback - INFO - Completed processing callback for node 69df5b6c06e8e7b15e9637a6 INFO: 172.20.0.1:51840 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:34:37,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:34:37,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44142 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:35:03,273 - lava_callback - INFO - Received callback for node 69dcb8be3c1e37dfe2f8aa81 INFO: 172.20.0.1:33846 - "POST /node/69dcb8be3c1e37dfe2f8aa81 HTTP/1.0" 202 Accepted 2026-04-15 09:35:03,278 - lava_callback - INFO - Starting async job submit for node 69dcb8be3c1e37dfe2f8aa81 2026-04-15 09:35:03,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:35:03,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb8be3c1e37dfe2f8aa81 HTTP/1.1" 200 None 2026-04-15 09:35:03,294 - lava_callback - DEBUG - Processing node 69dcb8be3c1e37dfe2f8aa81: baseline-arm64-baylibre 2026-04-15 09:35:03,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb8be3c1e37dfe2f8aa81 2026-04-15 09:35:03,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:35:03,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb8be3c1e37dfe2f8aa81 HTTP/1.1" 200 None 2026-04-15 09:35:03,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:35:03,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-15 09:35:03,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:35:03,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb8be3c1e37dfe2f8aa81 HTTP/1.1" 200 None 2026-04-15 09:35:03,347 - lava_callback - ERROR - Error processing callback for node 69dcb8be3c1e37dfe2f8aa81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60400 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:36:23,331 - lava_callback - INFO - Received callback for node 69dcb9083c1e37dfe2f8aaa5 INFO: 172.20.0.1:57216 - "POST /node/69dcb9083c1e37dfe2f8aaa5 HTTP/1.0" 202 Accepted 2026-04-15 09:36:23,337 - lava_callback - INFO - Starting async job submit for node 69dcb9083c1e37dfe2f8aaa5 2026-04-15 09:36:23,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:36:23,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb9083c1e37dfe2f8aaa5 HTTP/1.1" 200 None 2026-04-15 09:36:23,352 - lava_callback - DEBUG - Processing node 69dcb9083c1e37dfe2f8aaa5: baseline-arm64-baylibre 2026-04-15 09:36:23,353 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb9083c1e37dfe2f8aaa5 2026-04-15 09:36:23,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:36:23,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb9083c1e37dfe2f8aaa5 HTTP/1.1" 200 None 2026-04-15 09:36:23,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:36:23,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-15 09:36:23,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:36:23,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb9083c1e37dfe2f8aaa5 HTTP/1.1" 200 None 2026-04-15 09:36:23,406 - lava_callback - ERROR - Error processing callback for node 69dcb9083c1e37dfe2f8aaa5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41068 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:37:23,317 - lava_callback - INFO - Received callback for node 69dcb94c3c1e37dfe2f8aadf INFO: 172.20.0.1:42658 - "POST /node/69dcb94c3c1e37dfe2f8aadf HTTP/1.0" 202 Accepted 2026-04-15 09:37:23,323 - lava_callback - INFO - Starting async job submit for node 69dcb94c3c1e37dfe2f8aadf 2026-04-15 09:37:23,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:37:23,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb94c3c1e37dfe2f8aadf HTTP/1.1" 200 None 2026-04-15 09:37:23,338 - lava_callback - DEBUG - Processing node 69dcb94c3c1e37dfe2f8aadf: baseline-arm64-baylibre 2026-04-15 09:37:23,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb94c3c1e37dfe2f8aadf 2026-04-15 09:37:23,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:37:23,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb94c3c1e37dfe2f8aadf HTTP/1.1" 200 None 2026-04-15 09:37:23,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:37:23,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-15 09:37:23,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:37:23,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb94c3c1e37dfe2f8aadf HTTP/1.1" 200 None 2026-04-15 09:37:23,389 - lava_callback - ERROR - Error processing callback for node 69dcb94c3c1e37dfe2f8aadf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41918 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:38:43,428 - lava_callback - INFO - Received callback for node 69dcb9953c1e37dfe2f8ab1b INFO: 172.20.0.1:34650 - "POST /node/69dcb9953c1e37dfe2f8ab1b HTTP/1.0" 202 Accepted 2026-04-15 09:38:43,433 - lava_callback - INFO - Starting async job submit for node 69dcb9953c1e37dfe2f8ab1b 2026-04-15 09:38:43,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:38:43,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb9953c1e37dfe2f8ab1b HTTP/1.1" 200 None 2026-04-15 09:38:43,450 - lava_callback - DEBUG - Processing node 69dcb9953c1e37dfe2f8ab1b: baseline-arm64-baylibre 2026-04-15 09:38:43,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb9953c1e37dfe2f8ab1b 2026-04-15 09:38:43,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:38:43,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb9953c1e37dfe2f8ab1b HTTP/1.1" 200 None 2026-04-15 09:38:43,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:38:43,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-15 09:38:43,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:38:43,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb9953c1e37dfe2f8ab1b HTTP/1.1" 200 None 2026-04-15 09:38:43,502 - lava_callback - ERROR - Error processing callback for node 69dcb9953c1e37dfe2f8ab1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45296 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:39:43,426 - lava_callback - INFO - Received callback for node 69dcb9da3c1e37dfe2f8ab66 INFO: 172.20.0.1:48126 - "POST /node/69dcb9da3c1e37dfe2f8ab66 HTTP/1.0" 202 Accepted 2026-04-15 09:39:43,432 - lava_callback - INFO - Starting async job submit for node 69dcb9da3c1e37dfe2f8ab66 2026-04-15 09:39:43,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:39:43,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb9da3c1e37dfe2f8ab66 HTTP/1.1" 200 None 2026-04-15 09:39:43,451 - lava_callback - DEBUG - Processing node 69dcb9da3c1e37dfe2f8ab66: baseline-arm64-baylibre 2026-04-15 09:39:43,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcb9da3c1e37dfe2f8ab66 2026-04-15 09:39:43,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:39:43,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcb9da3c1e37dfe2f8ab66 HTTP/1.1" 200 None 2026-04-15 09:39:43,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:39:43,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-15 09:39:43,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:39:43,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcb9da3c1e37dfe2f8ab66 HTTP/1.1" 200 None 2026-04-15 09:39:43,499 - lava_callback - ERROR - Error processing callback for node 69dcb9da3c1e37dfe2f8ab66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50038 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:41:03,598 - lava_callback - INFO - Received callback for node 69dcba243c1e37dfe2f8ab82 INFO: 172.20.0.1:35804 - "POST /node/69dcba243c1e37dfe2f8ab82 HTTP/1.0" 202 Accepted 2026-04-15 09:41:03,604 - lava_callback - INFO - Starting async job submit for node 69dcba243c1e37dfe2f8ab82 2026-04-15 09:41:03,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:41:03,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcba243c1e37dfe2f8ab82 HTTP/1.1" 200 None 2026-04-15 09:41:03,619 - lava_callback - DEBUG - Processing node 69dcba243c1e37dfe2f8ab82: baseline-arm64-baylibre 2026-04-15 09:41:03,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcba243c1e37dfe2f8ab82 2026-04-15 09:41:03,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:41:03,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcba243c1e37dfe2f8ab82 HTTP/1.1" 200 None 2026-04-15 09:41:03,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:41:03,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-15 09:41:03,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:41:03,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcba243c1e37dfe2f8ab82 HTTP/1.1" 200 None 2026-04-15 09:41:03,675 - lava_callback - ERROR - Error processing callback for node 69dcba243c1e37dfe2f8ab82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42178 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:42:09,969 - lava_callback - INFO - Received callback for node 69dcba6c3c1e37dfe2f8abd5 INFO: 172.20.0.1:35590 - "POST /node/69dcba6c3c1e37dfe2f8abd5 HTTP/1.0" 202 Accepted 2026-04-15 09:42:09,975 - lava_callback - INFO - Starting async job submit for node 69dcba6c3c1e37dfe2f8abd5 2026-04-15 09:42:09,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:42:09,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcba6c3c1e37dfe2f8abd5 HTTP/1.1" 200 None 2026-04-15 09:42:09,995 - lava_callback - DEBUG - Processing node 69dcba6c3c1e37dfe2f8abd5: baseline-arm64-clabbe 2026-04-15 09:42:09,995 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcba6c3c1e37dfe2f8abd5 2026-04-15 09:42:09,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:42:10,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcba6c3c1e37dfe2f8abd5 HTTP/1.1" 200 None 2026-04-15 09:42:10,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:42:10,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-15 09:42:10,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:42:10,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcba6c3c1e37dfe2f8abd5 HTTP/1.1" 200 None 2026-04-15 09:42:10,061 - lava_callback - ERROR - Error processing callback for node 69dcba6c3c1e37dfe2f8abd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58468 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:43:30,011 - lava_callback - INFO - Received callback for node 69dcbab93c1e37dfe2f8abfa INFO: 172.20.0.1:34796 - "POST /node/69dcbab93c1e37dfe2f8abfa HTTP/1.0" 202 Accepted 2026-04-15 09:43:30,017 - lava_callback - INFO - Starting async job submit for node 69dcbab93c1e37dfe2f8abfa 2026-04-15 09:43:30,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:43:30,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcbab93c1e37dfe2f8abfa HTTP/1.1" 200 None 2026-04-15 09:43:30,033 - lava_callback - DEBUG - Processing node 69dcbab93c1e37dfe2f8abfa: baseline-arm64-clabbe 2026-04-15 09:43:30,033 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcbab93c1e37dfe2f8abfa 2026-04-15 09:43:30,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:43:30,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcbab93c1e37dfe2f8abfa HTTP/1.1" 200 None 2026-04-15 09:43:30,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:43:30,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-15 09:43:30,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:43:30,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcbab93c1e37dfe2f8abfa HTTP/1.1" 200 None 2026-04-15 09:43:30,116 - lava_callback - ERROR - Error processing callback for node 69dcbab93c1e37dfe2f8abfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60362 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:43:59,669 - lava_callback - INFO - Received callback for node 69df592806e8e7b15e9634e3 INFO: 172.20.0.1:60366 - "POST /node/69df592806e8e7b15e9634e3 HTTP/1.0" 202 Accepted 2026-04-15 09:43:59,677 - lava_callback - INFO - Starting async job submit for node 69df592806e8e7b15e9634e3 2026-04-15 09:43:59,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:43:59,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df592806e8e7b15e9634e3 HTTP/1.1" 200 None 2026-04-15 09:43:59,750 - lava_callback - DEBUG - Processing node 69df592806e8e7b15e9634e3: baseline-nfs-arm64 2026-04-15 09:44:00,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:44:00,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:44:00,931 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df592806e8e7b15e9634e3/log.txt.gz 2026-04-15 09:44:01,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:44:01,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:44:01,781 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df592806e8e7b15e9634e3/lava-logs.yaml 2026-04-15 09:44:01,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:44:01,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:44:01,994 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df592806e8e7b15e9634e3/lava_callback.json.gz DEBUG: Setup failed for 69df592806e8e7b15e9634e3. Transitting job node result: incomplete -> fail 2026-04-15 09:44:02,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:44:02,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df592806e8e7b15e9634e3 HTTP/1.1" 200 None 2026-04-15 09:44:02,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:44:02,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:44:02,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:44:02,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df592806e8e7b15e9634e3 HTTP/1.1" 200 None 2026-04-15 09:44:02,229 - lava_callback - INFO - Completed processing callback for node 69df592806e8e7b15e9634e3 INFO: 172.20.0.1:52614 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:44:07,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:44:07,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53432 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:44:39,612 - lava_callback - INFO - Received callback for node 69dea0f47a8aab7fee69d744 INFO: 172.20.0.1:53436 - "POST /node/69dea0f47a8aab7fee69d744 HTTP/1.0" 202 Accepted 2026-04-15 09:44:39,623 - lava_callback - INFO - Starting async job submit for node 69dea0f47a8aab7fee69d744 2026-04-15 09:44:39,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:44:39,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dea0f47a8aab7fee69d744 HTTP/1.1" 200 None 2026-04-15 09:44:39,668 - lava_callback - DEBUG - Processing node 69dea0f47a8aab7fee69d744: baseline-nfs-arm64 2026-04-15 09:44:40,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:44:40,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:44:40,345 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dea0f47a8aab7fee69d744/log.txt.gz 2026-04-15 09:44:40,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:44:40,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:44:40,847 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dea0f47a8aab7fee69d744/lava-logs.yaml 2026-04-15 09:44:40,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:44:41,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:44:41,199 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69dea0f47a8aab7fee69d744/lava_callback.json.gz 2026-04-15 09:44:41,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:44:41,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dea0f47a8aab7fee69d744 HTTP/1.1" 200 None 2026-04-15 09:44:41,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:44:41,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-15 09:44:41,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:44:41,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dea0f47a8aab7fee69d744 HTTP/1.1" 200 None 2026-04-15 09:44:41,331 - lava_callback - INFO - Completed processing callback for node 69dea0f47a8aab7fee69d744 INFO: 172.20.0.1:40516 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:44:50,324 - lava_callback - INFO - Received callback for node 69dcbb033c1e37dfe2f8ac22 INFO: 172.20.0.1:39386 - "POST /node/69dcbb033c1e37dfe2f8ac22 HTTP/1.0" 202 Accepted 2026-04-15 09:44:50,330 - lava_callback - INFO - Starting async job submit for node 69dcbb033c1e37dfe2f8ac22 2026-04-15 09:44:50,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:44:50,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcbb033c1e37dfe2f8ac22 HTTP/1.1" 200 None 2026-04-15 09:44:50,346 - lava_callback - DEBUG - Processing node 69dcbb033c1e37dfe2f8ac22: baseline-arm64-clabbe 2026-04-15 09:44:50,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcbb033c1e37dfe2f8ac22 2026-04-15 09:44:50,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:44:50,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcbb033c1e37dfe2f8ac22 HTTP/1.1" 200 None 2026-04-15 09:44:50,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:44:50,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-15 09:44:50,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:44:50,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcbb033c1e37dfe2f8ac22 HTTP/1.1" 200 None 2026-04-15 09:44:50,398 - lava_callback - ERROR - Error processing callback for node 69dcbb033c1e37dfe2f8ac22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34138 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:45:07,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:45:07,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50210 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:45:39,465 - lava_callback - INFO - Received callback for node 69df5c8006e8e7b15e9638a1 INFO: 172.20.0.1:50220 - "POST /node/69df5c8006e8e7b15e9638a1 HTTP/1.0" 202 Accepted 2026-04-15 09:45:39,472 - lava_callback - INFO - Starting async job submit for node 69df5c8006e8e7b15e9638a1 2026-04-15 09:45:39,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:45:39,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5c8006e8e7b15e9638a1 HTTP/1.1" 200 None 2026-04-15 09:45:39,532 - lava_callback - DEBUG - Processing node 69df5c8006e8e7b15e9638a1: baseline-arm64 2026-04-15 09:45:39,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:45:40,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:45:40,114 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df5c8006e8e7b15e9638a1/log.txt.gz 2026-04-15 09:45:40,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:45:40,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:45:40,568 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df5c8006e8e7b15e9638a1/lava-logs.yaml 2026-04-15 09:45:40,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:45:40,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:45:40,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df5c8006e8e7b15e9638a1/lava_callback.json.gz DEBUG: Setup failed for 69df5c8006e8e7b15e9638a1. Transitting job node result: incomplete -> fail 2026-04-15 09:45:40,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:45:40,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5c8006e8e7b15e9638a1 HTTP/1.1" 200 None 2026-04-15 09:45:40,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:45:40,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:45:40,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:45:40,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df5c8006e8e7b15e9638a1 HTTP/1.1" 200 None 2026-04-15 09:45:40,986 - lava_callback - INFO - Completed processing callback for node 69df5c8006e8e7b15e9638a1 INFO: 172.20.0.1:41798 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:45:50,107 - lava_callback - INFO - Received callback for node 69dcbb4b3c1e37dfe2f8ac5f INFO: 172.20.0.1:46814 - "POST /node/69dcbb4b3c1e37dfe2f8ac5f HTTP/1.0" 202 Accepted 2026-04-15 09:45:50,112 - lava_callback - INFO - Starting async job submit for node 69dcbb4b3c1e37dfe2f8ac5f 2026-04-15 09:45:50,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:45:50,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcbb4b3c1e37dfe2f8ac5f HTTP/1.1" 200 None 2026-04-15 09:45:50,128 - lava_callback - DEBUG - Processing node 69dcbb4b3c1e37dfe2f8ac5f: baseline-arm64-clabbe 2026-04-15 09:45:50,129 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcbb4b3c1e37dfe2f8ac5f 2026-04-15 09:45:50,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:45:50,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcbb4b3c1e37dfe2f8ac5f HTTP/1.1" 200 None 2026-04-15 09:45:50,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:45:50,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-15 09:45:50,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:45:50,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcbb4b3c1e37dfe2f8ac5f HTTP/1.1" 200 None 2026-04-15 09:45:50,187 - lava_callback - ERROR - Error processing callback for node 69dcbb4b3c1e37dfe2f8ac5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39910 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:46:07,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:46:07,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45374 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:47:10,149 - lava_callback - INFO - Received callback for node 69dcbb903c1e37dfe2f8acbc INFO: 172.20.0.1:60334 - "POST /node/69dcbb903c1e37dfe2f8acbc HTTP/1.0" 202 Accepted 2026-04-15 09:47:10,155 - lava_callback - INFO - Starting async job submit for node 69dcbb903c1e37dfe2f8acbc 2026-04-15 09:47:10,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:47:10,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcbb903c1e37dfe2f8acbc HTTP/1.1" 200 None 2026-04-15 09:47:10,171 - lava_callback - DEBUG - Processing node 69dcbb903c1e37dfe2f8acbc: baseline-arm64-clabbe 2026-04-15 09:47:10,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcbb903c1e37dfe2f8acbc 2026-04-15 09:47:10,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:47:10,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcbb903c1e37dfe2f8acbc HTTP/1.1" 200 None 2026-04-15 09:47:10,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:47:10,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-15 09:47:10,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:47:10,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcbb903c1e37dfe2f8acbc HTTP/1.1" 200 None 2026-04-15 09:47:10,226 - lava_callback - ERROR - Error processing callback for node 69dcbb903c1e37dfe2f8acbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56756 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:48:30,254 - lava_callback - INFO - Received callback for node 69dcbbd83c1e37dfe2f8acfb INFO: 172.20.0.1:47368 - "POST /node/69dcbbd83c1e37dfe2f8acfb HTTP/1.0" 202 Accepted 2026-04-15 09:48:30,263 - lava_callback - INFO - Starting async job submit for node 69dcbbd83c1e37dfe2f8acfb 2026-04-15 09:48:30,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:48:30,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcbbd83c1e37dfe2f8acfb HTTP/1.1" 200 None 2026-04-15 09:48:30,279 - lava_callback - DEBUG - Processing node 69dcbbd83c1e37dfe2f8acfb: baseline-arm64-clabbe 2026-04-15 09:48:30,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcbbd83c1e37dfe2f8acfb 2026-04-15 09:48:30,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:48:30,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcbbd83c1e37dfe2f8acfb HTTP/1.1" 200 None 2026-04-15 09:48:30,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:48:30,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-15 09:48:30,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:48:30,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcbbd83c1e37dfe2f8acfb HTTP/1.1" 200 None 2026-04-15 09:48:30,333 - lava_callback - ERROR - Error processing callback for node 69dcbbd83c1e37dfe2f8acfb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34298 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:53638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40362 - "GET /security.txt HTTP/1.0" 404 Not Found INFO: 172.20.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58474 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:49:30,244 - lava_callback - INFO - Received callback for node 69dcbc1f3c1e37dfe2f8ad32 INFO: 172.20.0.1:57352 - "POST /node/69dcbc1f3c1e37dfe2f8ad32 HTTP/1.0" 202 Accepted 2026-04-15 09:49:30,249 - lava_callback - INFO - Starting async job submit for node 69dcbc1f3c1e37dfe2f8ad32 2026-04-15 09:49:30,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:49:30,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcbc1f3c1e37dfe2f8ad32 HTTP/1.1" 200 None 2026-04-15 09:49:30,265 - lava_callback - DEBUG - Processing node 69dcbc1f3c1e37dfe2f8ad32: baseline-arm64-clabbe 2026-04-15 09:49:30,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcbc1f3c1e37dfe2f8ad32 2026-04-15 09:49:30,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:49:30,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcbc1f3c1e37dfe2f8ad32 HTTP/1.1" 200 None 2026-04-15 09:49:30,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:49:30,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d4bd79932ecfe2320a1022 HTTP/1.1" 200 None 2026-04-15 09:49:30,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:49:30,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcbc1f3c1e37dfe2f8ad32 HTTP/1.1" 200 None 2026-04-15 09:49:30,323 - lava_callback - ERROR - Error processing callback for node 69dcbc1f3c1e37dfe2f8ad32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36736 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:52:38,438 - lava_callback - INFO - Received callback for node 69df500606e8e7b15e962961 INFO: 172.20.0.1:36744 - "POST /node/69df500606e8e7b15e962961 HTTP/1.0" 202 Accepted 2026-04-15 09:52:38,444 - lava_callback - INFO - Starting async job submit for node 69df500606e8e7b15e962961 2026-04-15 09:52:38,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:52:38,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500606e8e7b15e962961 HTTP/1.1" 200 None 2026-04-15 09:52:38,485 - lava_callback - DEBUG - Processing node 69df500606e8e7b15e962961: baseline-arm64 2026-04-15 09:52:38,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:52:39,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:52:39,126 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500606e8e7b15e962961/log.txt.gz 2026-04-15 09:52:39,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:52:39,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:52:39,639 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500606e8e7b15e962961/lava-logs.yaml 2026-04-15 09:52:39,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:52:39,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:52:39,846 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df500606e8e7b15e962961/lava_callback.json.gz 2026-04-15 09:52:39,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:52:39,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df500606e8e7b15e962961 HTTP/1.1" 200 None 2026-04-15 09:52:39,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:52:39,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:52:39,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:52:39,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df500606e8e7b15e962961 HTTP/1.1" 200 None 2026-04-15 09:52:39,996 - lava_callback - INFO - Completed processing callback for node 69df500606e8e7b15e962961 INFO: 172.20.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41452 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:53:07,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:53:07,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60388 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:56:26,919 - lava_callback - INFO - Received callback for node 69df5fde06e8e7b15e964140 INFO: 172.20.0.1:60402 - "POST /node/69df5fde06e8e7b15e964140 HTTP/1.0" 202 Accepted 2026-04-15 09:56:26,925 - lava_callback - INFO - Starting async job submit for node 69df5fde06e8e7b15e964140 2026-04-15 09:56:26,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:56:26,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5fde06e8e7b15e964140 HTTP/1.1" 200 None 2026-04-15 09:56:26,965 - lava_callback - DEBUG - Processing node 69df5fde06e8e7b15e964140: ltp-ipc 2026-04-15 09:56:27,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:56:27,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:56:27,520 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69df5fde06e8e7b15e964140/log.txt.gz 2026-04-15 09:56:27,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:56:27,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:56:27,965 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69df5fde06e8e7b15e964140/lava-logs.yaml 2026-04-15 09:56:27,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:56:28,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:56:28,175 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69df5fde06e8e7b15e964140/lava_callback.json.gz 2026-04-15 09:56:28,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:56:28,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5fde06e8e7b15e964140 HTTP/1.1" 200 None 2026-04-15 09:56:28,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:56:28,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 09:56:28,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:56:28,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df5fde06e8e7b15e964140 HTTP/1.1" 200 None 2026-04-15 09:56:28,267 - lava_callback - INFO - Completed processing callback for node 69df5fde06e8e7b15e964140 INFO: 172.20.0.1:46576 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:56:37,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:56:37,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-15 09:56:39,202 - lava_callback - INFO - Received callback for node 69df501a06e8e7b15e96299f INFO: 172.20.0.1:46578 - "POST /node/69df501a06e8e7b15e96299f HTTP/1.0" 202 Accepted 2026-04-15 09:56:39,209 - lava_callback - INFO - Starting async job submit for node 69df501a06e8e7b15e96299f 2026-04-15 09:56:39,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:56:39,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501a06e8e7b15e96299f HTTP/1.1" 200 None 2026-04-15 09:56:39,250 - lava_callback - DEBUG - Processing node 69df501a06e8e7b15e96299f: baseline-nfs-arm64 2026-04-15 09:56:39,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:56:39,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:56:39,921 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501a06e8e7b15e96299f/log.txt.gz 2026-04-15 09:56:40,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:56:40,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:56:40,433 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501a06e8e7b15e96299f/lava-logs.yaml 2026-04-15 09:56:40,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:56:40,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:56:40,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df501a06e8e7b15e96299f/lava_callback.json.gz 2026-04-15 09:56:40,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:56:40,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df501a06e8e7b15e96299f HTTP/1.1" 200 None 2026-04-15 09:56:40,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:56:40,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 09:56:40,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:56:40,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df501a06e8e7b15e96299f HTTP/1.1" 200 None 2026-04-15 09:56:40,721 - lava_callback - INFO - Completed processing callback for node 69df501a06e8e7b15e96299f INFO: 172.20.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38344 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:57:07,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:57:08,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42866 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:58:07,610 - lava_callback - INFO - Received callback for node 69df5d0d06e8e7b15e963ed0 INFO: 172.20.0.1:42882 - "POST /node/69df5d0d06e8e7b15e963ed0 HTTP/1.0" 202 Accepted 2026-04-15 09:58:07,622 - lava_callback - INFO - Starting async job submit for node 69df5d0d06e8e7b15e963ed0 2026-04-15 09:58:07,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:58:07,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5d0d06e8e7b15e963ed0 HTTP/1.1" 200 None 2026-04-15 09:58:07,696 - lava_callback - DEBUG - Processing node 69df5d0d06e8e7b15e963ed0: ltp-smoke 2026-04-15 09:58:08,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:58:08,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:58:08,351 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69df5d0d06e8e7b15e963ed0/log.txt.gz 2026-04-15 09:58:08,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:58:08,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:58:08,842 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69df5d0d06e8e7b15e963ed0/lava-logs.yaml 2026-04-15 09:58:08,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:58:09,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:58:09,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69df5d0d06e8e7b15e963ed0/lava_callback.json.gz 2026-04-15 09:58:09,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:58:09,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5d0d06e8e7b15e963ed0 HTTP/1.1" 200 None 2026-04-15 09:58:09,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:58:09,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499906e8e7b15e9624b4 HTTP/1.1" 200 None 2026-04-15 09:58:09,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:58:09,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df5d0d06e8e7b15e963ed0 HTTP/1.1" 200 None 2026-04-15 09:58:09,341 - lava_callback - INFO - Completed processing callback for node 69df5d0d06e8e7b15e963ed0 INFO: 172.20.0.1:56462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56826 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:58:38,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:58:38,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45234 - "GET / HTTP/1.0" 200 OK 2026-04-15 09:59:39,985 - lava_callback - INFO - Received callback for node 69df5da206e8e7b15e963f58 INFO: 172.20.0.1:34468 - "POST /node/69df5da206e8e7b15e963f58 HTTP/1.0" 202 Accepted 2026-04-15 09:59:39,992 - lava_callback - INFO - Starting async job submit for node 69df5da206e8e7b15e963f58 2026-04-15 09:59:40,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:59:40,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5da206e8e7b15e963f58 HTTP/1.1" 200 None 2026-04-15 09:59:40,061 - lava_callback - DEBUG - Processing node 69df5da206e8e7b15e963f58: baseline-arm 2026-04-15 09:59:40,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:59:40,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:59:40,861 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69df5da206e8e7b15e963f58/log.txt.gz 2026-04-15 09:59:41,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:59:41,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:59:41,464 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df5da206e8e7b15e963f58/lava-logs.yaml 2026-04-15 09:59:41,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 09:59:41,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 09:59:41,833 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df5da206e8e7b15e963f58/lava_callback.json.gz DEBUG: Setup failed for 69df5da206e8e7b15e963f58. Transitting job node result: incomplete -> fail 2026-04-15 09:59:41,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:59:41,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5da206e8e7b15e963f58 HTTP/1.1" 200 None 2026-04-15 09:59:41,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:59:41,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 09:59:41,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 09:59:42,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df5da206e8e7b15e963f58 HTTP/1.1" 200 None 2026-04-15 09:59:42,148 - lava_callback - INFO - Completed processing callback for node 69df5da206e8e7b15e963f58 INFO: 172.20.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33238 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:00:08,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:00:08,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46604 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:09:47,717 - lava_callback - INFO - Received callback for node 69df60c006e8e7b15e9641fd INFO: 172.20.0.1:46610 - "POST /node/69df60c006e8e7b15e9641fd HTTP/1.0" 202 Accepted 2026-04-15 10:09:47,725 - lava_callback - INFO - Starting async job submit for node 69df60c006e8e7b15e9641fd 2026-04-15 10:09:47,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:09:47,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df60c006e8e7b15e9641fd HTTP/1.1" 200 None 2026-04-15 10:09:47,811 - lava_callback - DEBUG - Processing node 69df60c006e8e7b15e9641fd: baseline-arm64 2026-04-15 10:09:48,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:09:48,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:09:48,371 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df60c006e8e7b15e9641fd/log.txt.gz 2026-04-15 10:09:48,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:09:48,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:09:48,815 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df60c006e8e7b15e9641fd/lava-logs.yaml 2026-04-15 10:09:48,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:09:49,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:09:49,022 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df60c006e8e7b15e9641fd/lava_callback.json.gz DEBUG: Setup failed for 69df60c006e8e7b15e9641fd. Transitting job node result: incomplete -> fail 2026-04-15 10:09:49,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:09:49,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df60c006e8e7b15e9641fd HTTP/1.1" 200 None 2026-04-15 10:09:49,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:09:49,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 10:09:49,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:09:49,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df60c006e8e7b15e9641fd HTTP/1.1" 200 None 2026-04-15 10:09:49,224 - lava_callback - INFO - Completed processing callback for node 69df60c006e8e7b15e9641fd INFO: 172.20.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48608 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:10:08,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:10:08,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36890 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:13:56,194 - lava_callback - INFO - Received callback for node 69df603306e8e7b15e96416d INFO: 172.20.0.1:49728 - "POST /node/69df603306e8e7b15e96416d HTTP/1.0" 202 Accepted 2026-04-15 10:13:56,202 - lava_callback - INFO - Starting async job submit for node 69df603306e8e7b15e96416d 2026-04-15 10:13:56,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:13:56,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df603306e8e7b15e96416d HTTP/1.1" 200 None 2026-04-15 10:13:56,261 - lava_callback - DEBUG - Processing node 69df603306e8e7b15e96416d: baseline-nfs-arm64 INFO: 172.20.0.1:49738 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:13:57,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:13:57,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:13:57,693 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df603306e8e7b15e96416d/log.txt.gz 2026-04-15 10:13:58,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:13:58,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:13:58,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df603306e8e7b15e96416d/lava-logs.yaml 2026-04-15 10:13:58,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:13:58,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:13:58,749 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df603306e8e7b15e96416d/lava_callback.json.gz DEBUG: Setup failed for 69df603306e8e7b15e96416d. Transitting job node result: incomplete -> fail 2026-04-15 10:13:58,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:13:58,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df603306e8e7b15e96416d HTTP/1.1" 200 None 2026-04-15 10:13:58,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:13:58,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 10:13:58,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:13:58,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df603306e8e7b15e96416d HTTP/1.1" 200 None 2026-04-15 10:13:58,974 - lava_callback - INFO - Completed processing callback for node 69df603306e8e7b15e96416d INFO: 172.20.0.1:58908 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:14:08,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:14:08,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51772 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:16:18,947 - lava_callback - INFO - Received callback for node 69df61a106e8e7b15e9642e2 INFO: 172.20.0.1:51778 - "POST /node/69df61a106e8e7b15e9642e2 HTTP/1.0" 202 Accepted 2026-04-15 10:16:18,954 - lava_callback - INFO - Starting async job submit for node 69df61a106e8e7b15e9642e2 2026-04-15 10:16:19,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:16:19,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df61a106e8e7b15e9642e2 HTTP/1.1" 200 None 2026-04-15 10:16:19,031 - lava_callback - DEBUG - Processing node 69df61a106e8e7b15e9642e2: baseline-arm 2026-04-15 10:16:19,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:16:19,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:16:19,816 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69df61a106e8e7b15e9642e2/log.txt.gz 2026-04-15 10:16:20,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:16:20,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:16:20,615 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69df61a106e8e7b15e9642e2/lava-logs.yaml 2026-04-15 10:16:20,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:16:20,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:16:20,816 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69df61a106e8e7b15e9642e2/lava_callback.json.gz DEBUG: Setup failed for 69df61a106e8e7b15e9642e2. Transitting job node result: incomplete -> fail 2026-04-15 10:16:20,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:16:20,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df61a106e8e7b15e9642e2 HTTP/1.1" 200 None 2026-04-15 10:16:20,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:16:20,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499006e8e7b15e9624a9 HTTP/1.1" 200 None 2026-04-15 10:16:20,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:16:20,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df61a106e8e7b15e9642e2 HTTP/1.1" 200 None 2026-04-15 10:16:21,072 - lava_callback - INFO - Completed processing callback for node 69df61a106e8e7b15e9642e2 INFO: 172.20.0.1:46826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50506 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:16:38,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:16:38,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55482 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:17:29,859 - lava_callback - INFO - Received callback for node 69df619f06e8e7b15e9642df INFO: 172.20.0.1:44518 - "POST /node/69df619f06e8e7b15e9642df HTTP/1.0" 202 Accepted 2026-04-15 10:17:29,866 - lava_callback - INFO - Starting async job submit for node 69df619f06e8e7b15e9642df 2026-04-15 10:17:29,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:17:29,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df619f06e8e7b15e9642df HTTP/1.1" 200 None 2026-04-15 10:17:29,960 - lava_callback - DEBUG - Processing node 69df619f06e8e7b15e9642df: ltp-smoke 2026-04-15 10:17:30,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:17:30,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:17:30,607 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69df619f06e8e7b15e9642df/log.txt.gz 2026-04-15 10:17:30,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:17:31,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:17:31,106 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69df619f06e8e7b15e9642df/lava-logs.yaml 2026-04-15 10:17:31,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:17:31,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:17:31,467 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69df619f06e8e7b15e9642df/lava_callback.json.gz 2026-04-15 10:17:31,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:17:31,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df619f06e8e7b15e9642df HTTP/1.1" 200 None 2026-04-15 10:17:31,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:17:31,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df499906e8e7b15e9624b4 HTTP/1.1" 200 None 2026-04-15 10:17:31,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:17:31,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df619f06e8e7b15e9642df HTTP/1.1" 200 None 2026-04-15 10:17:31,732 - lava_callback - INFO - Completed processing callback for node 69df619f06e8e7b15e9642df INFO: 172.20.0.1:44532 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:17:38,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:17:38,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48170 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:30:19,233 - lava_callback - INFO - Received callback for node 69df5e1306e8e7b15e963fac INFO: 172.20.0.1:48178 - "POST /node/69df5e1306e8e7b15e963fac HTTP/1.0" 202 Accepted 2026-04-15 10:30:19,240 - lava_callback - INFO - Starting async job submit for node 69df5e1306e8e7b15e963fac 2026-04-15 10:30:19,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:30:19,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5e1306e8e7b15e963fac HTTP/1.1" 200 None 2026-04-15 10:30:19,286 - lava_callback - DEBUG - Processing node 69df5e1306e8e7b15e963fac: baseline-nfs-arm64 2026-04-15 10:30:19,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:30:19,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:30:19,998 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df5e1306e8e7b15e963fac/log.txt.gz 2026-04-15 10:30:20,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:30:20,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:30:20,471 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df5e1306e8e7b15e963fac/lava-logs.yaml 2026-04-15 10:30:20,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:30:20,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:30:20,667 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df5e1306e8e7b15e963fac/lava_callback.json.gz 2026-04-15 10:30:20,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:30:20,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5e1306e8e7b15e963fac HTTP/1.1" 200 None 2026-04-15 10:30:20,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:30:20,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-15 10:30:20,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:30:20,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df5e1306e8e7b15e963fac HTTP/1.1" 200 None 2026-04-15 10:30:20,806 - lava_callback - INFO - Completed processing callback for node 69df5e1306e8e7b15e963fac INFO: 172.20.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40114 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:30:38,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:30:38,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52530 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:31:38,714 - lava_callback - INFO - Received callback for node 69df5ee206e8e7b15e964091 INFO: 172.20.0.1:52542 - "POST /node/69df5ee206e8e7b15e964091 HTTP/1.0" 202 Accepted 2026-04-15 10:31:38,721 - lava_callback - INFO - Starting async job submit for node 69df5ee206e8e7b15e964091 2026-04-15 10:31:38,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:31:38,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5ee206e8e7b15e964091 HTTP/1.1" 200 None 2026-04-15 10:31:38,760 - lava_callback - DEBUG - Processing node 69df5ee206e8e7b15e964091: baseline-arm64 2026-04-15 10:31:39,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:31:39,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:31:39,475 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df5ee206e8e7b15e964091/log.txt.gz 2026-04-15 10:31:39,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:31:39,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:31:39,926 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df5ee206e8e7b15e964091/lava-logs.yaml 2026-04-15 10:31:39,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:31:40,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:31:40,109 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df5ee206e8e7b15e964091/lava_callback.json.gz 2026-04-15 10:31:40,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:31:40,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df5ee206e8e7b15e964091 HTTP/1.1" 200 None 2026-04-15 10:31:40,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:31:40,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-15 10:31:40,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:31:40,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df5ee206e8e7b15e964091 HTTP/1.1" 200 None 2026-04-15 10:31:40,276 - lava_callback - INFO - Completed processing callback for node 69df5ee206e8e7b15e964091 INFO: 172.20.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35732 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:32:08,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:32:08,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55490 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:33:19,990 - lava_callback - INFO - Received callback for node 69df607d06e8e7b15e9641bb INFO: 172.20.0.1:58202 - "POST /node/69df607d06e8e7b15e9641bb HTTP/1.0" 202 Accepted 2026-04-15 10:33:20,000 - lava_callback - INFO - Starting async job submit for node 69df607d06e8e7b15e9641bb 2026-04-15 10:33:20,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:33:20,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df607d06e8e7b15e9641bb HTTP/1.1" 200 None 2026-04-15 10:33:20,060 - lava_callback - DEBUG - Processing node 69df607d06e8e7b15e9641bb: baseline-nfs-arm64 2026-04-15 10:33:20,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:33:20,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:33:20,792 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df607d06e8e7b15e9641bb/log.txt.gz 2026-04-15 10:33:21,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:33:21,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:33:21,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df607d06e8e7b15e9641bb/lava-logs.yaml 2026-04-15 10:33:21,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:33:21,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:33:21,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df607d06e8e7b15e9641bb/lava_callback.json.gz 2026-04-15 10:33:21,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:33:21,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df607d06e8e7b15e9641bb HTTP/1.1" 200 None 2026-04-15 10:33:21,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:33:21,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-15 10:33:21,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:33:21,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df607d06e8e7b15e9641bb HTTP/1.1" 200 None 2026-04-15 10:33:21,636 - lava_callback - INFO - Completed processing callback for node 69df607d06e8e7b15e9641bb INFO: 172.20.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44794 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:33:38,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:33:38,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55852 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:34:00,940 - lava_callback - INFO - Received callback for node 69df64f006e8e7b15e964336 INFO: 172.20.0.1:57298 - "POST /node/69df64f006e8e7b15e964336 HTTP/1.0" 202 Accepted 2026-04-15 10:34:00,950 - lava_callback - INFO - Starting async job submit for node 69df64f006e8e7b15e964336 2026-04-15 10:34:00,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:34:01,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df64f006e8e7b15e964336 HTTP/1.1" 200 None 2026-04-15 10:34:01,016 - lava_callback - DEBUG - Processing node 69df64f006e8e7b15e964336: baseline-nfs-arm64 2026-04-15 10:34:02,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:34:02,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:34:02,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df64f006e8e7b15e964336/log.txt.gz 2026-04-15 10:34:02,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:34:03,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:34:03,009 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df64f006e8e7b15e964336/lava-logs.yaml 2026-04-15 10:34:03,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:34:03,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:34:03,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df64f006e8e7b15e964336/lava_callback.json.gz DEBUG: Setup failed for 69df64f006e8e7b15e964336. Transitting job node result: incomplete -> fail 2026-04-15 10:34:03,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:34:03,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df64f006e8e7b15e964336 HTTP/1.1" 200 None 2026-04-15 10:34:03,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:34:03,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 10:34:03,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:34:03,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df64f006e8e7b15e964336 HTTP/1.1" 200 None 2026-04-15 10:34:03,472 - lava_callback - INFO - Completed processing callback for node 69df64f006e8e7b15e964336 INFO: 172.20.0.1:57308 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:34:08,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:34:08,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37940 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:43:04,837 - lava_callback - INFO - Received callback for node 69df611606e8e7b15e96423c INFO: 172.20.0.1:59130 - "POST /node/69df611606e8e7b15e96423c HTTP/1.0" 202 Accepted 2026-04-15 10:43:04,844 - lava_callback - INFO - Starting async job submit for node 69df611606e8e7b15e96423c 2026-04-15 10:43:04,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:43:04,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df611606e8e7b15e96423c HTTP/1.1" 200 None 2026-04-15 10:43:04,884 - lava_callback - DEBUG - Processing node 69df611606e8e7b15e96423c: baseline-arm64 2026-04-15 10:43:05,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:43:05,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:43:05,626 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df611606e8e7b15e96423c/log.txt.gz 2026-04-15 10:43:05,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:43:06,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:43:06,104 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df611606e8e7b15e96423c/lava-logs.yaml 2026-04-15 10:43:06,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:43:06,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:43:06,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df611606e8e7b15e96423c/lava_callback.json.gz 2026-04-15 10:43:06,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:43:06,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df611606e8e7b15e96423c HTTP/1.1" 200 None 2026-04-15 10:43:06,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:43:06,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 10:43:06,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:43:06,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df611606e8e7b15e96423c HTTP/1.1" 200 None 2026-04-15 10:43:06,417 - lava_callback - INFO - Completed processing callback for node 69df611606e8e7b15e96423c INFO: 172.20.0.1:59134 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:43:08,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:43:08,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36472 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:43:47,165 - lava_callback - INFO - Received callback for node 69dcc8db3c1e37dfe2f8ae78 INFO: 172.20.0.1:36482 - "POST /node/69dcc8db3c1e37dfe2f8ae78 HTTP/1.0" 202 Accepted 2026-04-15 10:43:47,170 - lava_callback - INFO - Starting async job submit for node 69dcc8db3c1e37dfe2f8ae78 2026-04-15 10:43:47,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:43:47,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcc8db3c1e37dfe2f8ae78 HTTP/1.1" 200 None 2026-04-15 10:43:47,189 - lava_callback - DEBUG - Processing node 69dcc8db3c1e37dfe2f8ae78: baseline-arm-baylibre 2026-04-15 10:43:47,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcc8db3c1e37dfe2f8ae78 2026-04-15 10:43:47,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:43:47,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcc8db3c1e37dfe2f8ae78 HTTP/1.1" 200 None 2026-04-15 10:43:47,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:43:47,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:43:47,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:43:47,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcc8db3c1e37dfe2f8ae78 HTTP/1.1" 200 None 2026-04-15 10:43:47,267 - lava_callback - ERROR - Error processing callback for node 69dcc8db3c1e37dfe2f8ae78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52908 - "GET /node/69c80502123b47fd2376ff90%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45674 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:44:47,023 - lava_callback - INFO - Received callback for node 69dcc9143c1e37dfe2f8aeab INFO: 172.20.0.1:45690 - "POST /node/69dcc9143c1e37dfe2f8aeab HTTP/1.0" 202 Accepted 2026-04-15 10:44:47,029 - lava_callback - INFO - Starting async job submit for node 69dcc9143c1e37dfe2f8aeab 2026-04-15 10:44:47,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:44:47,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcc9143c1e37dfe2f8aeab HTTP/1.1" 200 None 2026-04-15 10:44:47,048 - lava_callback - DEBUG - Processing node 69dcc9143c1e37dfe2f8aeab: baseline-arm-baylibre 2026-04-15 10:44:47,049 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcc9143c1e37dfe2f8aeab 2026-04-15 10:44:47,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:44:47,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcc9143c1e37dfe2f8aeab HTTP/1.1" 200 None 2026-04-15 10:44:47,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:44:47,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:44:47,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:44:47,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcc9143c1e37dfe2f8aeab HTTP/1.1" 200 None 2026-04-15 10:44:47,101 - lava_callback - ERROR - Error processing callback for node 69dcc9143c1e37dfe2f8aeab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-15 10:44:56,172 - lava_callback - INFO - Received callback for node 69df616006e8e7b15e96429f INFO: 172.20.0.1:36976 - "POST /node/69df616006e8e7b15e96429f HTTP/1.0" 202 Accepted 2026-04-15 10:44:56,179 - lava_callback - INFO - Starting async job submit for node 69df616006e8e7b15e96429f 2026-04-15 10:44:56,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:44:56,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df616006e8e7b15e96429f HTTP/1.1" 200 None 2026-04-15 10:44:56,225 - lava_callback - DEBUG - Processing node 69df616006e8e7b15e96429f: baseline-nfs-arm64 INFO: 172.20.0.1:36980 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:44:56,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:44:56,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:44:56,927 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df616006e8e7b15e96429f/log.txt.gz 2026-04-15 10:44:57,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:44:57,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:44:57,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df616006e8e7b15e96429f/lava-logs.yaml 2026-04-15 10:44:57,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:44:57,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:44:57,606 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df616006e8e7b15e96429f/lava_callback.json.gz 2026-04-15 10:44:57,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:44:57,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df616006e8e7b15e96429f HTTP/1.1" 200 None 2026-04-15 10:44:57,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:44:57,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 10:44:57,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:44:57,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df616006e8e7b15e96429f HTTP/1.1" 200 None 2026-04-15 10:44:57,735 - lava_callback - INFO - Completed processing callback for node 69df616006e8e7b15e96429f INFO: 172.20.0.1:34964 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:45:08,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:45:08,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51474 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:45:22,874 - lava_callback - INFO - Received callback for node 69df68e406e8e7b15e964420 INFO: 172.20.0.1:47066 - "POST /node/69df68e406e8e7b15e964420 HTTP/1.0" 202 Accepted 2026-04-15 10:45:22,881 - lava_callback - INFO - Starting async job submit for node 69df68e406e8e7b15e964420 2026-04-15 10:45:22,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:45:22,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df68e406e8e7b15e964420 HTTP/1.1" 200 None 2026-04-15 10:45:22,927 - lava_callback - DEBUG - Processing node 69df68e406e8e7b15e964420: baseline-nfs-arm64 2026-04-15 10:45:23,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:45:23,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:45:23,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df68e406e8e7b15e964420/log.txt.gz 2026-04-15 10:45:23,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:45:24,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:45:24,149 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df68e406e8e7b15e964420/lava-logs.yaml 2026-04-15 10:45:24,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 10:45:24,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 10:45:24,311 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df68e406e8e7b15e964420/lava_callback.json.gz 2026-04-15 10:45:24,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:45:24,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df68e406e8e7b15e964420 HTTP/1.1" 200 None 2026-04-15 10:45:24,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:45:24,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68bcf6535ffd5b3ed8c4 HTTP/1.1" 200 None 2026-04-15 10:45:24,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:45:24,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df68e406e8e7b15e964420 HTTP/1.1" 200 None 2026-04-15 10:45:24,456 - lava_callback - INFO - Completed processing callback for node 69df68e406e8e7b15e964420 INFO: 172.20.0.1:47080 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:45:27,463 - lava_callback - INFO - Received callback for node 69dcc9363c1e37dfe2f8aebb INFO: 172.20.0.1:47096 - "POST /node/69dcc9363c1e37dfe2f8aebb HTTP/1.0" 202 Accepted 2026-04-15 10:45:27,468 - lava_callback - INFO - Starting async job submit for node 69dcc9363c1e37dfe2f8aebb 2026-04-15 10:45:27,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:45:27,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcc9363c1e37dfe2f8aebb HTTP/1.1" 200 None 2026-04-15 10:45:27,486 - lava_callback - DEBUG - Processing node 69dcc9363c1e37dfe2f8aebb: baseline-arm-baylibre 2026-04-15 10:45:27,486 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcc9363c1e37dfe2f8aebb 2026-04-15 10:45:27,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:45:27,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcc9363c1e37dfe2f8aebb HTTP/1.1" 200 None 2026-04-15 10:45:27,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:45:27,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:45:27,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:45:27,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcc9363c1e37dfe2f8aebb HTTP/1.1" 200 None 2026-04-15 10:45:27,538 - lava_callback - ERROR - Error processing callback for node 69dcc9363c1e37dfe2f8aebb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55520 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:45:38,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:45:38,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36244 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:46:47,191 - lava_callback - INFO - Received callback for node 69dcc98f3c1e37dfe2f8aef9 INFO: 172.20.0.1:36248 - "POST /node/69dcc98f3c1e37dfe2f8aef9 HTTP/1.0" 202 Accepted 2026-04-15 10:46:47,196 - lava_callback - INFO - Starting async job submit for node 69dcc98f3c1e37dfe2f8aef9 2026-04-15 10:46:47,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:46:47,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcc98f3c1e37dfe2f8aef9 HTTP/1.1" 200 None 2026-04-15 10:46:47,212 - lava_callback - DEBUG - Processing node 69dcc98f3c1e37dfe2f8aef9: baseline-arm-baylibre 2026-04-15 10:46:47,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcc98f3c1e37dfe2f8aef9 2026-04-15 10:46:47,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:46:47,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcc98f3c1e37dfe2f8aef9 HTTP/1.1" 200 None 2026-04-15 10:46:47,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:46:47,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:46:47,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:46:47,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcc98f3c1e37dfe2f8aef9 HTTP/1.1" 200 None 2026-04-15 10:46:47,297 - lava_callback - ERROR - Error processing callback for node 69dcc98f3c1e37dfe2f8aef9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47930 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:47:27,175 - lava_callback - INFO - Received callback for node 69dcc9ad3c1e37dfe2f8af1f INFO: 172.20.0.1:47944 - "POST /node/69dcc9ad3c1e37dfe2f8af1f HTTP/1.0" 202 Accepted 2026-04-15 10:47:27,181 - lava_callback - INFO - Starting async job submit for node 69dcc9ad3c1e37dfe2f8af1f 2026-04-15 10:47:27,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:47:27,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcc9ad3c1e37dfe2f8af1f HTTP/1.1" 200 None 2026-04-15 10:47:27,196 - lava_callback - DEBUG - Processing node 69dcc9ad3c1e37dfe2f8af1f: baseline-arm-baylibre 2026-04-15 10:47:27,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcc9ad3c1e37dfe2f8af1f 2026-04-15 10:47:27,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:47:27,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcc9ad3c1e37dfe2f8af1f HTTP/1.1" 200 None 2026-04-15 10:47:27,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:47:27,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:47:27,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:47:27,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcc9ad3c1e37dfe2f8af1f HTTP/1.1" 200 None 2026-04-15 10:47:27,246 - lava_callback - ERROR - Error processing callback for node 69dcc9ad3c1e37dfe2f8af1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35550 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:49:32,911 - lava_callback - INFO - Received callback for node 69dcca293c1e37dfe2f8af81 INFO: 172.20.0.1:60588 - "POST /node/69dcca293c1e37dfe2f8af81 HTTP/1.0" 202 Accepted 2026-04-15 10:49:32,917 - lava_callback - INFO - Starting async job submit for node 69dcca293c1e37dfe2f8af81 2026-04-15 10:49:32,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:49:32,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcca293c1e37dfe2f8af81 HTTP/1.1" 200 None 2026-04-15 10:49:32,932 - lava_callback - DEBUG - Processing node 69dcca293c1e37dfe2f8af81: baseline-arm-clabbe 2026-04-15 10:49:32,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcca293c1e37dfe2f8af81 2026-04-15 10:49:32,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:49:32,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcca293c1e37dfe2f8af81 HTTP/1.1" 200 None 2026-04-15 10:49:32,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:49:32,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:49:32,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:49:32,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcca293c1e37dfe2f8af81 HTTP/1.1" 200 None 2026-04-15 10:49:32,980 - lava_callback - ERROR - Error processing callback for node 69dcca293c1e37dfe2f8af81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48006 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:49:52,818 - lava_callback - INFO - Received callback for node 69dcca4c3c1e37dfe2f8afa6 INFO: 172.20.0.1:44748 - "POST /node/69dcca4c3c1e37dfe2f8afa6 HTTP/1.0" 202 Accepted 2026-04-15 10:49:52,827 - lava_callback - INFO - Starting async job submit for node 69dcca4c3c1e37dfe2f8afa6 2026-04-15 10:49:52,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:49:52,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcca4c3c1e37dfe2f8afa6 HTTP/1.1" 200 None 2026-04-15 10:49:52,846 - lava_callback - DEBUG - Processing node 69dcca4c3c1e37dfe2f8afa6: baseline-arm-clabbe 2026-04-15 10:49:52,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcca4c3c1e37dfe2f8afa6 2026-04-15 10:49:52,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:49:52,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcca4c3c1e37dfe2f8afa6 HTTP/1.1" 200 None 2026-04-15 10:49:52,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:49:52,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:49:52,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:49:52,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcca4c3c1e37dfe2f8afa6 HTTP/1.1" 200 None 2026-04-15 10:49:52,913 - lava_callback - ERROR - Error processing callback for node 69dcca4c3c1e37dfe2f8afa6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47394 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:50:52,911 - lava_callback - INFO - Received callback for node 69dcca823c1e37dfe2f8afde INFO: 172.20.0.1:39128 - "POST /node/69dcca823c1e37dfe2f8afde HTTP/1.0" 202 Accepted 2026-04-15 10:50:52,917 - lava_callback - INFO - Starting async job submit for node 69dcca823c1e37dfe2f8afde 2026-04-15 10:50:52,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:50:52,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcca823c1e37dfe2f8afde HTTP/1.1" 200 None 2026-04-15 10:50:52,933 - lava_callback - DEBUG - Processing node 69dcca823c1e37dfe2f8afde: baseline-arm-clabbe 2026-04-15 10:50:52,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcca823c1e37dfe2f8afde 2026-04-15 10:50:52,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:50:52,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcca823c1e37dfe2f8afde HTTP/1.1" 200 None 2026-04-15 10:50:52,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:50:52,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:50:52,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:50:52,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcca823c1e37dfe2f8afde HTTP/1.1" 200 None 2026-04-15 10:50:52,982 - lava_callback - ERROR - Error processing callback for node 69dcca823c1e37dfe2f8afde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59968 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:51:32,920 - lava_callback - INFO - Received callback for node 69dccaa33c1e37dfe2f8aff1 INFO: 172.20.0.1:34894 - "POST /node/69dccaa33c1e37dfe2f8aff1 HTTP/1.0" 202 Accepted 2026-04-15 10:51:32,926 - lava_callback - INFO - Starting async job submit for node 69dccaa33c1e37dfe2f8aff1 2026-04-15 10:51:32,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:51:32,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dccaa33c1e37dfe2f8aff1 HTTP/1.1" 200 None 2026-04-15 10:51:32,942 - lava_callback - DEBUG - Processing node 69dccaa33c1e37dfe2f8aff1: baseline-arm-clabbe 2026-04-15 10:51:32,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dccaa33c1e37dfe2f8aff1 2026-04-15 10:51:32,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:51:32,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dccaa33c1e37dfe2f8aff1 HTTP/1.1" 200 None 2026-04-15 10:51:32,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:51:32,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:51:32,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:51:32,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dccaa33c1e37dfe2f8aff1 HTTP/1.1" 200 None 2026-04-15 10:51:32,995 - lava_callback - ERROR - Error processing callback for node 69dccaa33c1e37dfe2f8aff1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45700 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:51:52,917 - lava_callback - INFO - Received callback for node 69dccac23c1e37dfe2f8b018 INFO: 172.20.0.1:59556 - "POST /node/69dccac23c1e37dfe2f8b018 HTTP/1.0" 202 Accepted 2026-04-15 10:51:52,923 - lava_callback - INFO - Starting async job submit for node 69dccac23c1e37dfe2f8b018 2026-04-15 10:51:52,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:51:52,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dccac23c1e37dfe2f8b018 HTTP/1.1" 200 None 2026-04-15 10:51:52,939 - lava_callback - DEBUG - Processing node 69dccac23c1e37dfe2f8b018: baseline-arm-clabbe 2026-04-15 10:51:52,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dccac23c1e37dfe2f8b018 2026-04-15 10:51:52,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:51:52,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dccac23c1e37dfe2f8b018 HTTP/1.1" 200 None 2026-04-15 10:51:52,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:51:52,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:51:52,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:51:52,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dccac23c1e37dfe2f8b018 HTTP/1.1" 200 None 2026-04-15 10:51:52,986 - lava_callback - ERROR - Error processing callback for node 69dccac23c1e37dfe2f8b018: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57770 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:52:32,946 - lava_callback - INFO - Received callback for node 69dccae33c1e37dfe2f8b04e INFO: 172.20.0.1:60462 - "POST /node/69dccae33c1e37dfe2f8b04e HTTP/1.0" 202 Accepted 2026-04-15 10:52:32,951 - lava_callback - INFO - Starting async job submit for node 69dccae33c1e37dfe2f8b04e 2026-04-15 10:52:32,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:52:32,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dccae33c1e37dfe2f8b04e HTTP/1.1" 200 None 2026-04-15 10:52:32,967 - lava_callback - DEBUG - Processing node 69dccae33c1e37dfe2f8b04e: baseline-arm-clabbe 2026-04-15 10:52:32,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dccae33c1e37dfe2f8b04e 2026-04-15 10:52:32,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:52:32,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dccae33c1e37dfe2f8b04e HTTP/1.1" 200 None 2026-04-15 10:52:32,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:52:32,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:52:33,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:52:33,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dccae33c1e37dfe2f8b04e HTTP/1.1" 200 None 2026-04-15 10:52:33,019 - lava_callback - ERROR - Error processing callback for node 69dccae33c1e37dfe2f8b04e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38406 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:53:13,073 - lava_callback - INFO - Received callback for node 69dccb033c1e37dfe2f8b07b INFO: 172.20.0.1:38828 - "POST /node/69dccb033c1e37dfe2f8b07b HTTP/1.0" 202 Accepted 2026-04-15 10:53:13,079 - lava_callback - INFO - Starting async job submit for node 69dccb033c1e37dfe2f8b07b 2026-04-15 10:53:13,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:53:13,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dccb033c1e37dfe2f8b07b HTTP/1.1" 200 None 2026-04-15 10:53:13,100 - lava_callback - DEBUG - Processing node 69dccb033c1e37dfe2f8b07b: baseline-arm-clabbe 2026-04-15 10:53:13,100 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dccb033c1e37dfe2f8b07b 2026-04-15 10:53:13,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:53:13,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dccb033c1e37dfe2f8b07b HTTP/1.1" 200 None 2026-04-15 10:53:13,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:53:13,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:53:13,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:53:13,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dccb033c1e37dfe2f8b07b HTTP/1.1" 200 None 2026-04-15 10:53:13,153 - lava_callback - ERROR - Error processing callback for node 69dccb033c1e37dfe2f8b07b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57202 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:53:32,977 - lava_callback - INFO - Received callback for node 69dccb273c1e37dfe2f8b0ad INFO: 172.20.0.1:47542 - "POST /node/69dccb273c1e37dfe2f8b0ad HTTP/1.0" 202 Accepted 2026-04-15 10:53:32,983 - lava_callback - INFO - Starting async job submit for node 69dccb273c1e37dfe2f8b0ad 2026-04-15 10:53:32,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:53:32,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dccb273c1e37dfe2f8b0ad HTTP/1.1" 200 None 2026-04-15 10:53:32,999 - lava_callback - DEBUG - Processing node 69dccb273c1e37dfe2f8b0ad: baseline-arm-clabbe 2026-04-15 10:53:32,999 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dccb273c1e37dfe2f8b0ad 2026-04-15 10:53:33,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:53:33,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dccb273c1e37dfe2f8b0ad HTTP/1.1" 200 None 2026-04-15 10:53:33,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:53:33,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:53:33,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:53:33,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dccb273c1e37dfe2f8b0ad HTTP/1.1" 200 None 2026-04-15 10:53:33,050 - lava_callback - ERROR - Error processing callback for node 69dccb273c1e37dfe2f8b0ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51602 - "GET / HTTP/1.0" 200 OK 2026-04-15 10:54:13,067 - lava_callback - INFO - Received callback for node 69dccb4b3c1e37dfe2f8b0c3 INFO: 172.20.0.1:46452 - "POST /node/69dccb4b3c1e37dfe2f8b0c3 HTTP/1.0" 202 Accepted 2026-04-15 10:54:13,072 - lava_callback - INFO - Starting async job submit for node 69dccb4b3c1e37dfe2f8b0c3 2026-04-15 10:54:13,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:54:13,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dccb4b3c1e37dfe2f8b0c3 HTTP/1.1" 200 None 2026-04-15 10:54:13,094 - lava_callback - DEBUG - Processing node 69dccb4b3c1e37dfe2f8b0c3: baseline-arm-clabbe 2026-04-15 10:54:13,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dccb4b3c1e37dfe2f8b0c3 2026-04-15 10:54:13,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:54:13,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dccb4b3c1e37dfe2f8b0c3 HTTP/1.1" 200 None 2026-04-15 10:54:13,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:54:13,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc5726a0b8baac20ccc54 HTTP/1.1" 200 None 2026-04-15 10:54:13,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 10:54:13,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dccb4b3c1e37dfe2f8b0c3 HTTP/1.1" 200 None 2026-04-15 10:54:13,162 - lava_callback - ERROR - Error processing callback for node 69dccb4b3c1e37dfe2f8b0c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40738 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:24:26,392 - lava_callback - INFO - Received callback for node 69df698306e8e7b15e9644cd INFO: 172.20.0.1:51368 - "POST /node/69df698306e8e7b15e9644cd HTTP/1.0" 202 Accepted 2026-04-15 11:24:26,399 - lava_callback - INFO - Starting async job submit for node 69df698306e8e7b15e9644cd 2026-04-15 11:24:26,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:24:26,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df698306e8e7b15e9644cd HTTP/1.1" 200 None 2026-04-15 11:24:26,438 - lava_callback - DEBUG - Processing node 69df698306e8e7b15e9644cd: baseline-arm64 INFO: 172.20.0.1:51376 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:24:26,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 11:24:27,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 11:24:27,268 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df698306e8e7b15e9644cd/log.txt.gz 2026-04-15 11:24:27,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 11:24:27,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 11:24:27,749 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df698306e8e7b15e9644cd/lava-logs.yaml 2026-04-15 11:24:27,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 11:24:27,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 11:24:27,924 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df698306e8e7b15e9644cd/lava_callback.json.gz 2026-04-15 11:24:27,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:24:27,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df698306e8e7b15e9644cd HTTP/1.1" 200 None 2026-04-15 11:24:27,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:24:27,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-15 11:24:27,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:24:28,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df698306e8e7b15e9644cd HTTP/1.1" 200 None 2026-04-15 11:24:28,062 - lava_callback - INFO - Completed processing callback for node 69df698306e8e7b15e9644cd INFO: 172.20.0.1:41608 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:24:38,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:24:38,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49802 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:32:02,711 - lava_callback - INFO - Received callback for node 69df6a1006e8e7b15e964571 INFO: 172.20.0.1:51770 - "POST /node/69df6a1006e8e7b15e964571 HTTP/1.0" 202 Accepted 2026-04-15 11:32:02,718 - lava_callback - INFO - Starting async job submit for node 69df6a1006e8e7b15e964571 2026-04-15 11:32:02,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:32:02,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df6a1006e8e7b15e964571 HTTP/1.1" 200 None 2026-04-15 11:32:02,758 - lava_callback - DEBUG - Processing node 69df6a1006e8e7b15e964571: baseline-nfs-arm64 2026-04-15 11:32:03,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 11:32:03,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 11:32:03,443 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df6a1006e8e7b15e964571/log.txt.gz 2026-04-15 11:32:03,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 11:32:03,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 11:32:03,934 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df6a1006e8e7b15e964571/lava-logs.yaml 2026-04-15 11:32:03,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 11:32:04,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 11:32:04,290 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df6a1006e8e7b15e964571/lava_callback.json.gz 2026-04-15 11:32:04,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:32:04,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df6a1006e8e7b15e964571 HTTP/1.1" 200 None 2026-04-15 11:32:04,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:32:04,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-15 11:32:04,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:32:04,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df6a1006e8e7b15e964571 HTTP/1.1" 200 None 2026-04-15 11:32:04,429 - lava_callback - INFO - Completed processing callback for node 69df6a1006e8e7b15e964571 INFO: 172.20.0.1:51774 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:32:08,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:32:08,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40202 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:37:06,724 - lava_callback - INFO - Received callback for node 69df6bbf06e8e7b15e9646e0 INFO: 172.20.0.1:40204 - "POST /node/69df6bbf06e8e7b15e9646e0 HTTP/1.0" 202 Accepted 2026-04-15 11:37:06,731 - lava_callback - INFO - Starting async job submit for node 69df6bbf06e8e7b15e9646e0 2026-04-15 11:37:06,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:37:06,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df6bbf06e8e7b15e9646e0 HTTP/1.1" 200 None 2026-04-15 11:37:06,771 - lava_callback - DEBUG - Processing node 69df6bbf06e8e7b15e9646e0: baseline-arm64 2026-04-15 11:37:07,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 11:37:07,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 11:37:07,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df6bbf06e8e7b15e9646e0/log.txt.gz 2026-04-15 11:37:07,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 11:37:07,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 11:37:07,959 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df6bbf06e8e7b15e9646e0/lava-logs.yaml 2026-04-15 11:37:07,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 11:37:08,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 11:37:08,174 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df6bbf06e8e7b15e9646e0/lava_callback.json.gz 2026-04-15 11:37:08,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:37:08,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df6bbf06e8e7b15e9646e0 HTTP/1.1" 200 None 2026-04-15 11:37:08,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:37:08,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 11:37:08,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:37:08,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df6bbf06e8e7b15e9646e0 HTTP/1.1" 200 None 2026-04-15 11:37:08,299 - lava_callback - INFO - Completed processing callback for node 69df6bbf06e8e7b15e9646e0 2026-04-15 11:37:08,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:37:08,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35360 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:48:10,481 - lava_callback - INFO - Received callback for node 69dcd7f73c1e37dfe2f8b295 INFO: 172.20.0.1:55544 - "POST /node/69dcd7f73c1e37dfe2f8b295 HTTP/1.0" 202 Accepted 2026-04-15 11:48:10,487 - lava_callback - INFO - Starting async job submit for node 69dcd7f73c1e37dfe2f8b295 2026-04-15 11:48:10,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:48:10,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd7f73c1e37dfe2f8b295 HTTP/1.1" 200 None 2026-04-15 11:48:10,503 - lava_callback - DEBUG - Processing node 69dcd7f73c1e37dfe2f8b295: baseline-arm64-baylibre 2026-04-15 11:48:10,503 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcd7f73c1e37dfe2f8b295 2026-04-15 11:48:10,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:48:10,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd7f73c1e37dfe2f8b295 HTTP/1.1" 200 None 2026-04-15 11:48:10,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:48:10,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 11:48:10,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:48:10,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcd7f73c1e37dfe2f8b295 HTTP/1.1" 200 None 2026-04-15 11:48:10,551 - lava_callback - ERROR - Error processing callback for node 69dcd7f73c1e37dfe2f8b295: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47966 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:49:30,522 - lava_callback - INFO - Received callback for node 69dcd8413c1e37dfe2f8b2e1 INFO: 172.20.0.1:46444 - "POST /node/69dcd8413c1e37dfe2f8b2e1 HTTP/1.0" 202 Accepted 2026-04-15 11:49:30,528 - lava_callback - INFO - Starting async job submit for node 69dcd8413c1e37dfe2f8b2e1 2026-04-15 11:49:30,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:49:30,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd8413c1e37dfe2f8b2e1 HTTP/1.1" 200 None 2026-04-15 11:49:30,547 - lava_callback - DEBUG - Processing node 69dcd8413c1e37dfe2f8b2e1: baseline-arm64-baylibre 2026-04-15 11:49:30,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcd8413c1e37dfe2f8b2e1 2026-04-15 11:49:30,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:49:30,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd8413c1e37dfe2f8b2e1 HTTP/1.1" 200 None 2026-04-15 11:49:30,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:49:30,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 11:49:30,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:49:30,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcd8413c1e37dfe2f8b2e1 HTTP/1.1" 200 None 2026-04-15 11:49:30,639 - lava_callback - ERROR - Error processing callback for node 69dcd8413c1e37dfe2f8b2e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42370 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:51:10,612 - lava_callback - INFO - Received callback for node 69dcd89e3c1e37dfe2f8b353 INFO: 172.20.0.1:40228 - "POST /node/69dcd89e3c1e37dfe2f8b353 HTTP/1.0" 202 Accepted 2026-04-15 11:51:10,617 - lava_callback - INFO - Starting async job submit for node 69dcd89e3c1e37dfe2f8b353 2026-04-15 11:51:10,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:51:10,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd89e3c1e37dfe2f8b353 HTTP/1.1" 200 None 2026-04-15 11:51:10,634 - lava_callback - DEBUG - Processing node 69dcd89e3c1e37dfe2f8b353: baseline-arm64-baylibre 2026-04-15 11:51:10,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcd89e3c1e37dfe2f8b353 2026-04-15 11:51:10,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:51:10,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd89e3c1e37dfe2f8b353 HTTP/1.1" 200 None 2026-04-15 11:51:10,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:51:10,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 11:51:10,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:51:10,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcd89e3c1e37dfe2f8b353 HTTP/1.1" 200 None 2026-04-15 11:51:10,709 - lava_callback - ERROR - Error processing callback for node 69dcd89e3c1e37dfe2f8b353: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59598 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:52:30,666 - lava_callback - INFO - Received callback for node 69dcd8e93c1e37dfe2f8b38f INFO: 172.20.0.1:57090 - "POST /node/69dcd8e93c1e37dfe2f8b38f HTTP/1.0" 202 Accepted 2026-04-15 11:52:30,672 - lava_callback - INFO - Starting async job submit for node 69dcd8e93c1e37dfe2f8b38f 2026-04-15 11:52:30,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:52:30,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd8e93c1e37dfe2f8b38f HTTP/1.1" 200 None 2026-04-15 11:52:30,688 - lava_callback - DEBUG - Processing node 69dcd8e93c1e37dfe2f8b38f: baseline-arm64-baylibre 2026-04-15 11:52:30,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcd8e93c1e37dfe2f8b38f 2026-04-15 11:52:30,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:52:30,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd8e93c1e37dfe2f8b38f HTTP/1.1" 200 None 2026-04-15 11:52:30,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:52:30,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 11:52:30,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:52:30,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcd8e93c1e37dfe2f8b38f HTTP/1.1" 200 None 2026-04-15 11:52:30,761 - lava_callback - ERROR - Error processing callback for node 69dcd8e93c1e37dfe2f8b38f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36248 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:53:30,856 - lava_callback - INFO - Received callback for node 69dcd92f3c1e37dfe2f8b3d9 INFO: 172.20.0.1:40448 - "POST /node/69dcd92f3c1e37dfe2f8b3d9 HTTP/1.0" 202 Accepted 2026-04-15 11:53:30,862 - lava_callback - INFO - Starting async job submit for node 69dcd92f3c1e37dfe2f8b3d9 2026-04-15 11:53:30,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:53:30,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd92f3c1e37dfe2f8b3d9 HTTP/1.1" 200 None 2026-04-15 11:53:30,893 - lava_callback - DEBUG - Processing node 69dcd92f3c1e37dfe2f8b3d9: baseline-arm64-baylibre 2026-04-15 11:53:30,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcd92f3c1e37dfe2f8b3d9 2026-04-15 11:53:30,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:53:30,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd92f3c1e37dfe2f8b3d9 HTTP/1.1" 200 None 2026-04-15 11:53:30,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:53:30,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 11:53:30,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:53:30,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcd92f3c1e37dfe2f8b3d9 HTTP/1.1" 200 None 2026-04-15 11:53:30,951 - lava_callback - ERROR - Error processing callback for node 69dcd92f3c1e37dfe2f8b3d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52972 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:54:50,781 - lava_callback - INFO - Received callback for node 69dcd9783c1e37dfe2f8b415 INFO: 172.20.0.1:40340 - "POST /node/69dcd9783c1e37dfe2f8b415 HTTP/1.0" 202 Accepted 2026-04-15 11:54:50,787 - lava_callback - INFO - Starting async job submit for node 69dcd9783c1e37dfe2f8b415 2026-04-15 11:54:50,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:54:50,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd9783c1e37dfe2f8b415 HTTP/1.1" 200 None 2026-04-15 11:54:50,803 - lava_callback - DEBUG - Processing node 69dcd9783c1e37dfe2f8b415: baseline-arm64-baylibre 2026-04-15 11:54:50,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcd9783c1e37dfe2f8b415 2026-04-15 11:54:50,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:54:50,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd9783c1e37dfe2f8b415 HTTP/1.1" 200 None 2026-04-15 11:54:50,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:54:50,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 11:54:50,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:54:50,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcd9783c1e37dfe2f8b415 HTTP/1.1" 200 None 2026-04-15 11:54:50,856 - lava_callback - ERROR - Error processing callback for node 69dcd9783c1e37dfe2f8b415: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42628 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:55:55,680 - lava_callback - INFO - Received callback for node 69dcd9c33c1e37dfe2f8b467 INFO: 172.20.0.1:49388 - "POST /node/69dcd9c33c1e37dfe2f8b467 HTTP/1.0" 202 Accepted 2026-04-15 11:55:55,685 - lava_callback - INFO - Starting async job submit for node 69dcd9c33c1e37dfe2f8b467 2026-04-15 11:55:55,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:55:55,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd9c33c1e37dfe2f8b467 HTTP/1.1" 200 None 2026-04-15 11:55:55,702 - lava_callback - DEBUG - Processing node 69dcd9c33c1e37dfe2f8b467: baseline-arm64-clabbe 2026-04-15 11:55:55,702 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcd9c33c1e37dfe2f8b467 2026-04-15 11:55:55,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:55:55,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcd9c33c1e37dfe2f8b467 HTTP/1.1" 200 None 2026-04-15 11:55:55,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:55:55,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 11:55:55,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:55:55,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcd9c33c1e37dfe2f8b467 HTTP/1.1" 200 None 2026-04-15 11:55:55,762 - lava_callback - ERROR - Error processing callback for node 69dcd9c33c1e37dfe2f8b467: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56818 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 11:57:15,671 - lava_callback - INFO - Received callback for node 69dcda0c3c1e37dfe2f8b494 INFO: 172.20.0.1:56822 - "POST /node/69dcda0c3c1e37dfe2f8b494 HTTP/1.0" 202 Accepted 2026-04-15 11:57:15,680 - lava_callback - INFO - Starting async job submit for node 69dcda0c3c1e37dfe2f8b494 2026-04-15 11:57:15,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:57:15,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcda0c3c1e37dfe2f8b494 HTTP/1.1" 200 None 2026-04-15 11:57:15,696 - lava_callback - DEBUG - Processing node 69dcda0c3c1e37dfe2f8b494: baseline-arm64-clabbe 2026-04-15 11:57:15,696 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcda0c3c1e37dfe2f8b494 2026-04-15 11:57:15,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:57:15,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcda0c3c1e37dfe2f8b494 HTTP/1.1" 200 None 2026-04-15 11:57:15,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:57:15,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 11:57:15,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:57:15,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcda0c3c1e37dfe2f8b494 HTTP/1.1" 200 None 2026-04-15 11:57:15,757 - lava_callback - ERROR - Error processing callback for node 69dcda0c3c1e37dfe2f8b494: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58856 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:58:35,756 - lava_callback - INFO - Received callback for node 69dcda573c1e37dfe2f8b4d0 INFO: 172.20.0.1:50740 - "POST /node/69dcda573c1e37dfe2f8b4d0 HTTP/1.0" 202 Accepted 2026-04-15 11:58:35,764 - lava_callback - INFO - Starting async job submit for node 69dcda573c1e37dfe2f8b4d0 2026-04-15 11:58:35,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:58:35,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcda573c1e37dfe2f8b4d0 HTTP/1.1" 200 None 2026-04-15 11:58:35,804 - lava_callback - DEBUG - Processing node 69dcda573c1e37dfe2f8b4d0: baseline-arm64-clabbe 2026-04-15 11:58:35,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcda573c1e37dfe2f8b4d0 2026-04-15 11:58:35,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:58:35,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcda573c1e37dfe2f8b4d0 HTTP/1.1" 200 None 2026-04-15 11:58:35,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:58:35,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 11:58:35,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:58:35,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcda573c1e37dfe2f8b4d0 HTTP/1.1" 200 None 2026-04-15 11:58:35,868 - lava_callback - ERROR - Error processing callback for node 69dcda573c1e37dfe2f8b4d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37708 - "GET / HTTP/1.0" 200 OK 2026-04-15 11:59:35,808 - lava_callback - INFO - Received callback for node 69dcdaa13c1e37dfe2f8b513 INFO: 172.20.0.1:33468 - "POST /node/69dcdaa13c1e37dfe2f8b513 HTTP/1.0" 202 Accepted 2026-04-15 11:59:35,814 - lava_callback - INFO - Starting async job submit for node 69dcdaa13c1e37dfe2f8b513 2026-04-15 11:59:35,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:59:35,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcdaa13c1e37dfe2f8b513 HTTP/1.1" 200 None 2026-04-15 11:59:35,830 - lava_callback - DEBUG - Processing node 69dcdaa13c1e37dfe2f8b513: baseline-arm64-clabbe 2026-04-15 11:59:35,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcdaa13c1e37dfe2f8b513 2026-04-15 11:59:35,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:59:35,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcdaa13c1e37dfe2f8b513 HTTP/1.1" 200 None 2026-04-15 11:59:35,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:59:35,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 11:59:35,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 11:59:35,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcdaa13c1e37dfe2f8b513 HTTP/1.1" 200 None 2026-04-15 11:59:35,883 - lava_callback - ERROR - Error processing callback for node 69dcdaa13c1e37dfe2f8b513: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43170 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:00:55,877 - lava_callback - INFO - Received callback for node 69dcdaeb3c1e37dfe2f8b542 INFO: 172.20.0.1:35120 - "POST /node/69dcdaeb3c1e37dfe2f8b542 HTTP/1.0" 202 Accepted 2026-04-15 12:00:55,883 - lava_callback - INFO - Starting async job submit for node 69dcdaeb3c1e37dfe2f8b542 2026-04-15 12:00:55,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:00:55,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcdaeb3c1e37dfe2f8b542 HTTP/1.1" 200 None 2026-04-15 12:00:55,904 - lava_callback - DEBUG - Processing node 69dcdaeb3c1e37dfe2f8b542: baseline-arm64-clabbe 2026-04-15 12:00:55,904 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcdaeb3c1e37dfe2f8b542 2026-04-15 12:00:55,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:00:55,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcdaeb3c1e37dfe2f8b542 HTTP/1.1" 200 None 2026-04-15 12:00:55,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:00:55,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 12:00:55,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:00:55,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcdaeb3c1e37dfe2f8b542 HTTP/1.1" 200 None 2026-04-15 12:00:55,981 - lava_callback - ERROR - Error processing callback for node 69dcdaeb3c1e37dfe2f8b542: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60706 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:01:55,936 - lava_callback - INFO - Received callback for node 69dcdb2d3c1e37dfe2f8b5a9 INFO: 172.20.0.1:60656 - "POST /node/69dcdb2d3c1e37dfe2f8b5a9 HTTP/1.0" 202 Accepted 2026-04-15 12:01:55,941 - lava_callback - INFO - Starting async job submit for node 69dcdb2d3c1e37dfe2f8b5a9 2026-04-15 12:01:55,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:01:55,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcdb2d3c1e37dfe2f8b5a9 HTTP/1.1" 200 None 2026-04-15 12:01:55,957 - lava_callback - DEBUG - Processing node 69dcdb2d3c1e37dfe2f8b5a9: baseline-arm64-clabbe 2026-04-15 12:01:55,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcdb2d3c1e37dfe2f8b5a9 2026-04-15 12:01:55,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:01:55,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcdb2d3c1e37dfe2f8b5a9 HTTP/1.1" 200 None 2026-04-15 12:01:55,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:01:55,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 12:01:55,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:01:56,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcdb2d3c1e37dfe2f8b5a9 HTTP/1.1" 200 None 2026-04-15 12:01:56,009 - lava_callback - ERROR - Error processing callback for node 69dcdb2d3c1e37dfe2f8b5a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41080 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 12:03:15,978 - lava_callback - INFO - Received callback for node 69dcdb7a3c1e37dfe2f8b5cf INFO: 172.20.0.1:41082 - "POST /node/69dcdb7a3c1e37dfe2f8b5cf HTTP/1.0" 202 Accepted 2026-04-15 12:03:15,984 - lava_callback - INFO - Starting async job submit for node 69dcdb7a3c1e37dfe2f8b5cf 2026-04-15 12:03:15,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:03:16,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcdb7a3c1e37dfe2f8b5cf HTTP/1.1" 200 None 2026-04-15 12:03:16,006 - lava_callback - DEBUG - Processing node 69dcdb7a3c1e37dfe2f8b5cf: baseline-arm64-clabbe 2026-04-15 12:03:16,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcdb7a3c1e37dfe2f8b5cf 2026-04-15 12:03:16,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:03:16,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcdb7a3c1e37dfe2f8b5cf HTTP/1.1" 200 None 2026-04-15 12:03:16,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:03:16,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dbc57e6a0b8baac20ccc63 HTTP/1.1" 200 None 2026-04-15 12:03:16,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:03:16,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcdb7a3c1e37dfe2f8b5cf HTTP/1.1" 200 None 2026-04-15 12:03:16,075 - lava_callback - ERROR - Error processing callback for node 69dcdb7a3c1e37dfe2f8b5cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44058 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:06:59,541 - lava_callback - INFO - Received callback for node 69df6c3406e8e7b15e96474d INFO: 172.20.0.1:44074 - "POST /node/69df6c3406e8e7b15e96474d HTTP/1.0" 202 Accepted 2026-04-15 12:06:59,548 - lava_callback - INFO - Starting async job submit for node 69df6c3406e8e7b15e96474d 2026-04-15 12:06:59,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:06:59,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df6c3406e8e7b15e96474d HTTP/1.1" 200 None 2026-04-15 12:06:59,597 - lava_callback - DEBUG - Processing node 69df6c3406e8e7b15e96474d: baseline-nfs-arm64 2026-04-15 12:07:00,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:07:00,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:07:00,423 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df6c3406e8e7b15e96474d/log.txt.gz 2026-04-15 12:07:00,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:07:00,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:07:00,920 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df6c3406e8e7b15e96474d/lava-logs.yaml 2026-04-15 12:07:00,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:07:01,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:07:01,134 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df6c3406e8e7b15e96474d/lava_callback.json.gz 2026-04-15 12:07:01,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:07:01,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df6c3406e8e7b15e96474d HTTP/1.1" 200 None 2026-04-15 12:07:01,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:07:01,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 12:07:01,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:07:01,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df6c3406e8e7b15e96474d HTTP/1.1" 200 None 2026-04-15 12:07:01,306 - lava_callback - INFO - Completed processing callback for node 69df6c3406e8e7b15e96474d INFO: 172.20.0.1:46218 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:07:08,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:07:08,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47772 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:10:03,627 - lava_callback - INFO - Received callback for node 69df757206e8e7b15e9647fd INFO: 172.20.0.1:35054 - "POST /node/69df757206e8e7b15e9647fd HTTP/1.0" 202 Accepted 2026-04-15 12:10:03,634 - lava_callback - INFO - Starting async job submit for node 69df757206e8e7b15e9647fd 2026-04-15 12:10:03,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:10:03,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df757206e8e7b15e9647fd HTTP/1.1" 200 None 2026-04-15 12:10:03,677 - lava_callback - DEBUG - Processing node 69df757206e8e7b15e9647fd: baseline-arm64 2026-04-15 12:10:04,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:10:04,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:10:04,341 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df757206e8e7b15e9647fd/log.txt.gz 2026-04-15 12:10:04,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:10:04,729 - lava_callback - INFO - Received callback for node 69df773f06e8e7b15e964848 INFO: 172.20.0.1:35056 - "POST /node/69df773f06e8e7b15e964848 HTTP/1.0" 202 Accepted 2026-04-15 12:10:04,737 - lava_callback - INFO - Starting async job submit for node 69df773f06e8e7b15e964848 2026-04-15 12:10:04,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:10:04,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df773f06e8e7b15e964848 HTTP/1.1" 200 None 2026-04-15 12:10:04,778 - lava_callback - DEBUG - Processing node 69df773f06e8e7b15e964848: baseline-nfs-arm64 2026-04-15 12:10:04,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:10:04,930 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df757206e8e7b15e9647fd/lava-logs.yaml 2026-04-15 12:10:05,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:10:05,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:10:05,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:10:05,442 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df757206e8e7b15e9647fd/lava_callback.json.gz 2026-04-15 12:10:05,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:10:05,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:10:05,469 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df773f06e8e7b15e964848/log.txt.gz 2026-04-15 12:10:05,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df757206e8e7b15e9647fd HTTP/1.1" 200 None 2026-04-15 12:10:05,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:10:05,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-15 12:10:05,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:10:05,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:10:05,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df757206e8e7b15e9647fd HTTP/1.1" 200 None 2026-04-15 12:10:05,828 - lava_callback - INFO - Completed processing callback for node 69df757206e8e7b15e9647fd 2026-04-15 12:10:06,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:10:06,016 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df773f06e8e7b15e964848/lava-logs.yaml 2026-04-15 12:10:06,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:10:06,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:10:06,203 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df773f06e8e7b15e964848/lava_callback.json.gz 2026-04-15 12:10:06,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:10:06,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df773f06e8e7b15e964848 HTTP/1.1" 200 None 2026-04-15 12:10:06,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:10:06,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9610d105963562bb3a33 HTTP/1.1" 200 None 2026-04-15 12:10:06,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:10:06,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df773f06e8e7b15e964848 HTTP/1.1" 200 None 2026-04-15 12:10:06,361 - lava_callback - INFO - Completed processing callback for node 69df773f06e8e7b15e964848 INFO: 172.20.0.1:35058 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:10:08,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:10:08,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51920 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:19:48,066 - lava_callback - INFO - Received callback for node 69df786a06e8e7b15e964894 INFO: 172.20.0.1:51934 - "POST /node/69df786a06e8e7b15e964894 HTTP/1.0" 202 Accepted 2026-04-15 12:19:48,072 - lava_callback - INFO - Starting async job submit for node 69df786a06e8e7b15e964894 2026-04-15 12:19:48,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:19:48,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df786a06e8e7b15e964894 HTTP/1.1" 200 None 2026-04-15 12:19:48,119 - lava_callback - DEBUG - Processing node 69df786a06e8e7b15e964894: baseline-arm64 2026-04-15 12:19:48,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:19:48,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:19:48,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69df786a06e8e7b15e964894/log.txt.gz 2026-04-15 12:19:49,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:19:49,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:19:49,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69df786a06e8e7b15e964894/lava-logs.yaml 2026-04-15 12:19:49,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:19:49,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:19:49,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69df786a06e8e7b15e964894/lava_callback.json.gz 2026-04-15 12:19:49,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:19:49,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df786a06e8e7b15e964894 HTTP/1.1" 200 None 2026-04-15 12:19:49,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:19:49,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 12:19:49,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:19:49,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df786a06e8e7b15e964894 HTTP/1.1" 200 None 2026-04-15 12:19:49,657 - lava_callback - INFO - Completed processing callback for node 69df786a06e8e7b15e964894 INFO: 172.20.0.1:54652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39728 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:20:08,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:20:08,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58154 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:22:59,645 - lava_callback - INFO - Received callback for node 69df7f7006e8e7b15e964909 INFO: 172.20.0.1:58166 - "POST /node/69df7f7006e8e7b15e964909 HTTP/1.0" 202 Accepted 2026-04-15 12:22:59,652 - lava_callback - INFO - Starting async job submit for node 69df7f7006e8e7b15e964909 2026-04-15 12:22:59,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:22:59,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df7f7006e8e7b15e964909 HTTP/1.1" 200 None 2026-04-15 12:22:59,694 - lava_callback - DEBUG - Processing node 69df7f7006e8e7b15e964909: baseline-nfs-arm64 2026-04-15 12:23:00,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:23:00,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:23:00,381 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df7f7006e8e7b15e964909/log.txt.gz 2026-04-15 12:23:00,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:23:00,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:23:00,893 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df7f7006e8e7b15e964909/lava-logs.yaml 2026-04-15 12:23:00,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-15 12:23:01,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-15 12:23:01,072 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69df7f7006e8e7b15e964909/lava_callback.json.gz 2026-04-15 12:23:01,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:23:01,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df7f7006e8e7b15e964909 HTTP/1.1" 200 None 2026-04-15 12:23:01,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:23:01,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49a606e8e7b15e9624bd HTTP/1.1" 200 None 2026-04-15 12:23:01,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:23:01,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df7f7006e8e7b15e964909 HTTP/1.1" 200 None 2026-04-15 12:23:01,219 - lava_callback - INFO - Completed processing callback for node 69df7f7006e8e7b15e964909 INFO: 172.20.0.1:47268 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:23:08,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:23:08,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37912 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:38:53,291 - lava_callback - INFO - Received callback for node 69dce3d73c1e37dfe2f8b63f INFO: 172.20.0.1:55960 - "POST /node/69dce3d73c1e37dfe2f8b63f HTTP/1.0" 202 Accepted 2026-04-15 12:38:53,296 - lava_callback - INFO - Starting async job submit for node 69dce3d73c1e37dfe2f8b63f 2026-04-15 12:38:53,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:38:53,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce3d73c1e37dfe2f8b63f HTTP/1.1" 200 None 2026-04-15 12:38:53,316 - lava_callback - DEBUG - Processing node 69dce3d73c1e37dfe2f8b63f: baseline-arm-baylibre 2026-04-15 12:38:53,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce3d73c1e37dfe2f8b63f 2026-04-15 12:38:53,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:38:53,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce3d73c1e37dfe2f8b63f HTTP/1.1" 200 None 2026-04-15 12:38:53,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:38:53,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:38:53,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:38:53,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce3d73c1e37dfe2f8b63f HTTP/1.1" 200 None 2026-04-15 12:38:53,364 - lava_callback - ERROR - Error processing callback for node 69dce3d73c1e37dfe2f8b63f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41746 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:39:53,238 - lava_callback - INFO - Received callback for node 69dce4123c1e37dfe2f8b65b INFO: 172.20.0.1:51482 - "POST /node/69dce4123c1e37dfe2f8b65b HTTP/1.0" 202 Accepted 2026-04-15 12:39:53,243 - lava_callback - INFO - Starting async job submit for node 69dce4123c1e37dfe2f8b65b 2026-04-15 12:39:53,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:39:53,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce4123c1e37dfe2f8b65b HTTP/1.1" 200 None 2026-04-15 12:39:53,272 - lava_callback - DEBUG - Processing node 69dce4123c1e37dfe2f8b65b: baseline-arm-baylibre 2026-04-15 12:39:53,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce4123c1e37dfe2f8b65b 2026-04-15 12:39:53,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:39:53,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce4123c1e37dfe2f8b65b HTTP/1.1" 200 None 2026-04-15 12:39:53,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:39:53,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:39:53,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:39:53,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce4123c1e37dfe2f8b65b HTTP/1.1" 200 None 2026-04-15 12:39:53,319 - lava_callback - ERROR - Error processing callback for node 69dce4123c1e37dfe2f8b65b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45660 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:40:33,324 - lava_callback - INFO - Received callback for node 69dce43c3c1e37dfe2f8b673 INFO: 172.20.0.1:38962 - "POST /node/69dce43c3c1e37dfe2f8b673 HTTP/1.0" 202 Accepted 2026-04-15 12:40:33,330 - lava_callback - INFO - Starting async job submit for node 69dce43c3c1e37dfe2f8b673 2026-04-15 12:40:33,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:40:33,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce43c3c1e37dfe2f8b673 HTTP/1.1" 200 None 2026-04-15 12:40:33,361 - lava_callback - DEBUG - Processing node 69dce43c3c1e37dfe2f8b673: baseline-arm-baylibre 2026-04-15 12:40:33,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce43c3c1e37dfe2f8b673 2026-04-15 12:40:33,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:40:33,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce43c3c1e37dfe2f8b673 HTTP/1.1" 200 None 2026-04-15 12:40:33,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:40:33,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:40:33,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:40:33,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce43c3c1e37dfe2f8b673 HTTP/1.1" 200 None 2026-04-15 12:40:33,447 - lava_callback - ERROR - Error processing callback for node 69dce43c3c1e37dfe2f8b673: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59484 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:41:13,292 - lava_callback - INFO - Received callback for node 69dce4613c1e37dfe2f8b68b INFO: 172.20.0.1:46422 - "POST /node/69dce4613c1e37dfe2f8b68b HTTP/1.0" 202 Accepted 2026-04-15 12:41:13,297 - lava_callback - INFO - Starting async job submit for node 69dce4613c1e37dfe2f8b68b 2026-04-15 12:41:13,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:41:13,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce4613c1e37dfe2f8b68b HTTP/1.1" 200 None 2026-04-15 12:41:13,319 - lava_callback - DEBUG - Processing node 69dce4613c1e37dfe2f8b68b: baseline-arm-baylibre 2026-04-15 12:41:13,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce4613c1e37dfe2f8b68b 2026-04-15 12:41:13,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:41:13,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce4613c1e37dfe2f8b68b HTTP/1.1" 200 None 2026-04-15 12:41:13,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:41:13,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:41:13,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:41:13,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce4613c1e37dfe2f8b68b HTTP/1.1" 200 None 2026-04-15 12:41:13,377 - lava_callback - ERROR - Error processing callback for node 69dce4613c1e37dfe2f8b68b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57152 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:42:33,652 - lava_callback - INFO - Received callback for node 69dce4ab3c1e37dfe2f8b6c3 INFO: 172.20.0.1:48524 - "POST /node/69dce4ab3c1e37dfe2f8b6c3 HTTP/1.0" 202 Accepted 2026-04-15 12:42:33,658 - lava_callback - INFO - Starting async job submit for node 69dce4ab3c1e37dfe2f8b6c3 2026-04-15 12:42:33,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:42:33,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce4ab3c1e37dfe2f8b6c3 HTTP/1.1" 200 None 2026-04-15 12:42:33,686 - lava_callback - DEBUG - Processing node 69dce4ab3c1e37dfe2f8b6c3: baseline-arm-baylibre 2026-04-15 12:42:33,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce4ab3c1e37dfe2f8b6c3 2026-04-15 12:42:33,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:42:33,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce4ab3c1e37dfe2f8b6c3 HTTP/1.1" 200 None 2026-04-15 12:42:33,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:42:33,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:42:33,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:42:33,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce4ab3c1e37dfe2f8b6c3 HTTP/1.1" 200 None 2026-04-15 12:42:33,735 - lava_callback - ERROR - Error processing callback for node 69dce4ab3c1e37dfe2f8b6c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49852 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:43:13,428 - lava_callback - INFO - Received callback for node 69dce4cc3c1e37dfe2f8b6d7 INFO: 172.20.0.1:46184 - "POST /node/69dce4cc3c1e37dfe2f8b6d7 HTTP/1.0" 202 Accepted 2026-04-15 12:43:13,433 - lava_callback - INFO - Starting async job submit for node 69dce4cc3c1e37dfe2f8b6d7 2026-04-15 12:43:13,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:43:13,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce4cc3c1e37dfe2f8b6d7 HTTP/1.1" 200 None 2026-04-15 12:43:13,449 - lava_callback - DEBUG - Processing node 69dce4cc3c1e37dfe2f8b6d7: baseline-arm-baylibre 2026-04-15 12:43:13,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce4cc3c1e37dfe2f8b6d7 2026-04-15 12:43:13,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:43:13,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce4cc3c1e37dfe2f8b6d7 HTTP/1.1" 200 None 2026-04-15 12:43:13,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:43:13,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:43:13,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:43:13,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce4cc3c1e37dfe2f8b6d7 HTTP/1.1" 200 None 2026-04-15 12:43:13,516 - lava_callback - ERROR - Error processing callback for node 69dce4cc3c1e37dfe2f8b6d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45644 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:43:33,471 - lava_callback - INFO - Received callback for node 69dce4ee3c1e37dfe2f8b71b INFO: 172.20.0.1:39972 - "POST /node/69dce4ee3c1e37dfe2f8b71b HTTP/1.0" 202 Accepted 2026-04-15 12:43:33,476 - lava_callback - INFO - Starting async job submit for node 69dce4ee3c1e37dfe2f8b71b 2026-04-15 12:43:33,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:43:33,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce4ee3c1e37dfe2f8b71b HTTP/1.1" 200 None 2026-04-15 12:43:33,492 - lava_callback - DEBUG - Processing node 69dce4ee3c1e37dfe2f8b71b: baseline-arm-baylibre 2026-04-15 12:43:33,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce4ee3c1e37dfe2f8b71b 2026-04-15 12:43:33,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:43:33,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce4ee3c1e37dfe2f8b71b HTTP/1.1" 200 None 2026-04-15 12:43:33,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:43:33,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:43:33,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:43:33,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce4ee3c1e37dfe2f8b71b HTTP/1.1" 200 None 2026-04-15 12:43:33,542 - lava_callback - ERROR - Error processing callback for node 69dce4ee3c1e37dfe2f8b71b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50912 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:45:13,638 - lava_callback - INFO - Received callback for node 69dce54c3c1e37dfe2f8b75b INFO: 172.20.0.1:35548 - "POST /node/69dce54c3c1e37dfe2f8b75b HTTP/1.0" 202 Accepted 2026-04-15 12:45:13,644 - lava_callback - INFO - Starting async job submit for node 69dce54c3c1e37dfe2f8b75b 2026-04-15 12:45:13,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:45:13,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce54c3c1e37dfe2f8b75b HTTP/1.1" 200 None 2026-04-15 12:45:13,664 - lava_callback - DEBUG - Processing node 69dce54c3c1e37dfe2f8b75b: baseline-arm-baylibre 2026-04-15 12:45:13,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce54c3c1e37dfe2f8b75b 2026-04-15 12:45:13,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:45:13,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce54c3c1e37dfe2f8b75b HTTP/1.1" 200 None 2026-04-15 12:45:13,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:45:13,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:45:13,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:45:13,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce54c3c1e37dfe2f8b75b HTTP/1.1" 200 None 2026-04-15 12:45:13,739 - lava_callback - ERROR - Error processing callback for node 69dce54c3c1e37dfe2f8b75b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53722 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:45:53,578 - lava_callback - INFO - Received callback for node 69dce56f3c1e37dfe2f8b782 INFO: 172.20.0.1:60456 - "POST /node/69dce56f3c1e37dfe2f8b782 HTTP/1.0" 202 Accepted 2026-04-15 12:45:53,584 - lava_callback - INFO - Starting async job submit for node 69dce56f3c1e37dfe2f8b782 2026-04-15 12:45:53,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:45:53,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce56f3c1e37dfe2f8b782 HTTP/1.1" 200 None 2026-04-15 12:45:53,604 - lava_callback - DEBUG - Processing node 69dce56f3c1e37dfe2f8b782: baseline-arm-baylibre 2026-04-15 12:45:53,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce56f3c1e37dfe2f8b782 2026-04-15 12:45:53,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:45:53,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce56f3c1e37dfe2f8b782 HTTP/1.1" 200 None 2026-04-15 12:45:53,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:45:53,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:45:53,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:45:53,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce56f3c1e37dfe2f8b782 HTTP/1.1" 200 None 2026-04-15 12:45:53,654 - lava_callback - ERROR - Error processing callback for node 69dce56f3c1e37dfe2f8b782: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54698 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:47:13,734 - lava_callback - INFO - Received callback for node 69dce5cd3c1e37dfe2f8b815 INFO: 172.20.0.1:46282 - "POST /node/69dce5cd3c1e37dfe2f8b815 HTTP/1.0" 202 Accepted 2026-04-15 12:47:13,740 - lava_callback - INFO - Starting async job submit for node 69dce5cd3c1e37dfe2f8b815 2026-04-15 12:47:13,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:47:13,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce5cd3c1e37dfe2f8b815 HTTP/1.1" 200 None 2026-04-15 12:47:13,756 - lava_callback - DEBUG - Processing node 69dce5cd3c1e37dfe2f8b815: baseline-arm-baylibre 2026-04-15 12:47:13,756 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce5cd3c1e37dfe2f8b815 2026-04-15 12:47:13,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:47:13,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce5cd3c1e37dfe2f8b815 HTTP/1.1" 200 None 2026-04-15 12:47:13,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:47:13,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:47:13,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:47:13,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce5cd3c1e37dfe2f8b815 HTTP/1.1" 200 None 2026-04-15 12:47:13,812 - lava_callback - ERROR - Error processing callback for node 69dce5cd3c1e37dfe2f8b815: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55670 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:48:13,676 - lava_callback - INFO - Received callback for node 69dce60c3c1e37dfe2f8b875 INFO: 172.20.0.1:40322 - "POST /node/69dce60c3c1e37dfe2f8b875 HTTP/1.0" 202 Accepted 2026-04-15 12:48:13,682 - lava_callback - INFO - Starting async job submit for node 69dce60c3c1e37dfe2f8b875 2026-04-15 12:48:13,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:48:13,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce60c3c1e37dfe2f8b875 HTTP/1.1" 200 None 2026-04-15 12:48:13,707 - lava_callback - DEBUG - Processing node 69dce60c3c1e37dfe2f8b875: baseline-arm-baylibre 2026-04-15 12:48:13,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce60c3c1e37dfe2f8b875 2026-04-15 12:48:13,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:48:13,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce60c3c1e37dfe2f8b875 HTTP/1.1" 200 None 2026-04-15 12:48:13,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:48:13,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:48:13,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:48:13,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce60c3c1e37dfe2f8b875 HTTP/1.1" 200 None 2026-04-15 12:48:13,762 - lava_callback - ERROR - Error processing callback for node 69dce60c3c1e37dfe2f8b875: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58922 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:48:57,840 - lava_callback - INFO - Received callback for node 69dce62b3c1e37dfe2f8b8ae INFO: 172.20.0.1:58928 - "POST /node/69dce62b3c1e37dfe2f8b8ae HTTP/1.0" 202 Accepted 2026-04-15 12:48:57,845 - lava_callback - INFO - Starting async job submit for node 69dce62b3c1e37dfe2f8b8ae 2026-04-15 12:48:57,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:48:57,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce62b3c1e37dfe2f8b8ae HTTP/1.1" 200 None 2026-04-15 12:48:57,862 - lava_callback - DEBUG - Processing node 69dce62b3c1e37dfe2f8b8ae: baseline-arm-clabbe 2026-04-15 12:48:57,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce62b3c1e37dfe2f8b8ae 2026-04-15 12:48:57,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:48:57,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce62b3c1e37dfe2f8b8ae HTTP/1.1" 200 None 2026-04-15 12:48:57,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:48:57,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:48:57,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:48:57,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce62b3c1e37dfe2f8b8ae HTTP/1.1" 200 None 2026-04-15 12:48:57,913 - lava_callback - ERROR - Error processing callback for node 69dce62b3c1e37dfe2f8b8ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59246 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:49:37,806 - lava_callback - INFO - Received callback for node 69dce64c3c1e37dfe2f8b8df INFO: 172.20.0.1:59250 - "POST /node/69dce64c3c1e37dfe2f8b8df HTTP/1.0" 202 Accepted 2026-04-15 12:49:37,811 - lava_callback - INFO - Starting async job submit for node 69dce64c3c1e37dfe2f8b8df 2026-04-15 12:49:37,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:49:37,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce64c3c1e37dfe2f8b8df HTTP/1.1" 200 None 2026-04-15 12:49:37,827 - lava_callback - DEBUG - Processing node 69dce64c3c1e37dfe2f8b8df: baseline-arm-clabbe 2026-04-15 12:49:37,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce64c3c1e37dfe2f8b8df 2026-04-15 12:49:37,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:49:37,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce64c3c1e37dfe2f8b8df HTTP/1.1" 200 None 2026-04-15 12:49:37,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:49:37,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:49:37,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:49:37,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce64c3c1e37dfe2f8b8df HTTP/1.1" 200 None 2026-04-15 12:49:37,876 - lava_callback - ERROR - Error processing callback for node 69dce64c3c1e37dfe2f8b8df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33072 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:51:17,857 - lava_callback - INFO - Received callback for node 69dce6b63c1e37dfe2f8b932 INFO: 172.20.0.1:33074 - "POST /node/69dce6b63c1e37dfe2f8b932 HTTP/1.0" 202 Accepted 2026-04-15 12:51:17,864 - lava_callback - INFO - Starting async job submit for node 69dce6b63c1e37dfe2f8b932 2026-04-15 12:51:17,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:33082 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:51:17,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce6b63c1e37dfe2f8b932 HTTP/1.1" 200 None 2026-04-15 12:51:17,888 - lava_callback - DEBUG - Processing node 69dce6b63c1e37dfe2f8b932: baseline-arm-clabbe 2026-04-15 12:51:17,888 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce6b63c1e37dfe2f8b932 2026-04-15 12:51:17,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:51:17,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce6b63c1e37dfe2f8b932 HTTP/1.1" 200 None 2026-04-15 12:51:17,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:51:17,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:51:17,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:51:17,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce6b63c1e37dfe2f8b932 HTTP/1.1" 200 None 2026-04-15 12:51:17,936 - lava_callback - ERROR - Error processing callback for node 69dce6b63c1e37dfe2f8b932: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54568 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:51:57,868 - lava_callback - INFO - Received callback for node 69dce6d83c1e37dfe2f8b955 INFO: 172.20.0.1:54572 - "POST /node/69dce6d83c1e37dfe2f8b955 HTTP/1.0" 202 Accepted 2026-04-15 12:51:57,873 - lava_callback - INFO - Starting async job submit for node 69dce6d83c1e37dfe2f8b955 2026-04-15 12:51:57,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:51:57,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce6d83c1e37dfe2f8b955 HTTP/1.1" 200 None 2026-04-15 12:51:57,889 - lava_callback - DEBUG - Processing node 69dce6d83c1e37dfe2f8b955: baseline-arm-clabbe 2026-04-15 12:51:57,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce6d83c1e37dfe2f8b955 2026-04-15 12:51:57,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:51:57,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce6d83c1e37dfe2f8b955 HTTP/1.1" 200 None 2026-04-15 12:51:57,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:51:57,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:51:57,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:51:57,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce6d83c1e37dfe2f8b955 HTTP/1.1" 200 None 2026-04-15 12:51:57,941 - lava_callback - ERROR - Error processing callback for node 69dce6d83c1e37dfe2f8b955: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55666 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:53:38,001 - lava_callback - INFO - Received callback for node 69dce7403c1e37dfe2f8b997 INFO: 172.20.0.1:55678 - "POST /node/69dce7403c1e37dfe2f8b997 HTTP/1.0" 202 Accepted 2026-04-15 12:53:38,007 - lava_callback - INFO - Starting async job submit for node 69dce7403c1e37dfe2f8b997 2026-04-15 12:53:38,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:53:38,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce7403c1e37dfe2f8b997 HTTP/1.1" 200 None 2026-04-15 12:53:38,022 - lava_callback - DEBUG - Processing node 69dce7403c1e37dfe2f8b997: baseline-arm-clabbe 2026-04-15 12:53:38,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce7403c1e37dfe2f8b997 2026-04-15 12:53:38,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:53:38,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce7403c1e37dfe2f8b997 HTTP/1.1" 200 None 2026-04-15 12:53:38,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:53:38,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:53:38,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:53:38,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce7403c1e37dfe2f8b997 HTTP/1.1" 200 None 2026-04-15 12:53:38,084 - lava_callback - ERROR - Error processing callback for node 69dce7403c1e37dfe2f8b997: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56888 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:53:57,991 - lava_callback - INFO - Received callback for node 69dce7603c1e37dfe2f8b9bc INFO: 172.20.0.1:56902 - "POST /node/69dce7603c1e37dfe2f8b9bc HTTP/1.0" 202 Accepted 2026-04-15 12:53:57,996 - lava_callback - INFO - Starting async job submit for node 69dce7603c1e37dfe2f8b9bc 2026-04-15 12:53:57,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:53:58,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce7603c1e37dfe2f8b9bc HTTP/1.1" 200 None 2026-04-15 12:53:58,015 - lava_callback - DEBUG - Processing node 69dce7603c1e37dfe2f8b9bc: baseline-arm-clabbe 2026-04-15 12:53:58,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce7603c1e37dfe2f8b9bc 2026-04-15 12:53:58,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:53:58,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce7603c1e37dfe2f8b9bc HTTP/1.1" 200 None 2026-04-15 12:53:58,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:53:58,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:53:58,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:53:58,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce7603c1e37dfe2f8b9bc HTTP/1.1" 200 None 2026-04-15 12:53:58,078 - lava_callback - ERROR - Error processing callback for node 69dce7603c1e37dfe2f8b9bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35504 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:55:37,990 - lava_callback - INFO - Received callback for node 69dce7c43c1e37dfe2f8ba5b INFO: 172.20.0.1:35518 - "POST /node/69dce7c43c1e37dfe2f8ba5b HTTP/1.0" 202 Accepted 2026-04-15 12:55:37,996 - lava_callback - INFO - Starting async job submit for node 69dce7c43c1e37dfe2f8ba5b 2026-04-15 12:55:37,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:55:38,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce7c43c1e37dfe2f8ba5b HTTP/1.1" 200 None 2026-04-15 12:55:38,013 - lava_callback - DEBUG - Processing node 69dce7c43c1e37dfe2f8ba5b: baseline-arm-clabbe 2026-04-15 12:55:38,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce7c43c1e37dfe2f8ba5b 2026-04-15 12:55:38,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:55:38,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce7c43c1e37dfe2f8ba5b HTTP/1.1" 200 None 2026-04-15 12:55:38,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:55:38,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:55:38,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:55:38,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce7c43c1e37dfe2f8ba5b HTTP/1.1" 200 None 2026-04-15 12:55:38,062 - lava_callback - ERROR - Error processing callback for node 69dce7c43c1e37dfe2f8ba5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41868 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:56:18,072 - lava_callback - INFO - Received callback for node 69dce7e43c1e37dfe2f8ba85 INFO: 172.20.0.1:41884 - "POST /node/69dce7e43c1e37dfe2f8ba85 HTTP/1.0" 202 Accepted 2026-04-15 12:56:18,078 - lava_callback - INFO - Starting async job submit for node 69dce7e43c1e37dfe2f8ba85 2026-04-15 12:56:18,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:56:18,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce7e43c1e37dfe2f8ba85 HTTP/1.1" 200 None 2026-04-15 12:56:18,096 - lava_callback - DEBUG - Processing node 69dce7e43c1e37dfe2f8ba85: baseline-arm-clabbe 2026-04-15 12:56:18,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce7e43c1e37dfe2f8ba85 2026-04-15 12:56:18,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:56:18,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce7e43c1e37dfe2f8ba85 HTTP/1.1" 200 None 2026-04-15 12:56:18,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:56:18,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:56:18,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:56:18,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce7e43c1e37dfe2f8ba85 HTTP/1.1" 200 None 2026-04-15 12:56:18,165 - lava_callback - ERROR - Error processing callback for node 69dce7e43c1e37dfe2f8ba85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47120 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:57:18,195 - lava_callback - INFO - Received callback for node 69dce8283c1e37dfe2f8bab7 INFO: 172.20.0.1:47132 - "POST /node/69dce8283c1e37dfe2f8bab7 HTTP/1.0" 202 Accepted 2026-04-15 12:57:18,201 - lava_callback - INFO - Starting async job submit for node 69dce8283c1e37dfe2f8bab7 2026-04-15 12:57:18,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:57:18,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce8283c1e37dfe2f8bab7 HTTP/1.1" 200 None 2026-04-15 12:57:18,217 - lava_callback - DEBUG - Processing node 69dce8283c1e37dfe2f8bab7: baseline-arm-clabbe 2026-04-15 12:57:18,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce8283c1e37dfe2f8bab7 2026-04-15 12:57:18,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:57:18,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce8283c1e37dfe2f8bab7 HTTP/1.1" 200 None 2026-04-15 12:57:18,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:57:18,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:57:18,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:57:18,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce8283c1e37dfe2f8bab7 HTTP/1.1" 200 None 2026-04-15 12:57:18,285 - lava_callback - ERROR - Error processing callback for node 69dce8283c1e37dfe2f8bab7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34590 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:57:58,148 - lava_callback - INFO - Received callback for node 69dce84d3c1e37dfe2f8bad4 INFO: 172.20.0.1:34606 - "POST /node/69dce84d3c1e37dfe2f8bad4 HTTP/1.0" 202 Accepted 2026-04-15 12:57:58,158 - lava_callback - INFO - Starting async job submit for node 69dce84d3c1e37dfe2f8bad4 2026-04-15 12:57:58,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:57:58,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce84d3c1e37dfe2f8bad4 HTTP/1.1" 200 None 2026-04-15 12:57:58,173 - lava_callback - DEBUG - Processing node 69dce84d3c1e37dfe2f8bad4: baseline-arm-clabbe 2026-04-15 12:57:58,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce84d3c1e37dfe2f8bad4 2026-04-15 12:57:58,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:57:58,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce84d3c1e37dfe2f8bad4 HTTP/1.1" 200 None 2026-04-15 12:57:58,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:57:58,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:57:58,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:57:58,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce84d3c1e37dfe2f8bad4 HTTP/1.1" 200 None 2026-04-15 12:57:58,223 - lava_callback - ERROR - Error processing callback for node 69dce84d3c1e37dfe2f8bad4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37262 - "GET / HTTP/1.0" 200 OK 2026-04-15 12:59:18,250 - lava_callback - INFO - Received callback for node 69dce8923c1e37dfe2f8bb15 INFO: 172.20.0.1:37276 - "POST /node/69dce8923c1e37dfe2f8bb15 HTTP/1.0" 202 Accepted 2026-04-15 12:59:18,256 - lava_callback - INFO - Starting async job submit for node 69dce8923c1e37dfe2f8bb15 2026-04-15 12:59:18,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:59:18,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce8923c1e37dfe2f8bb15 HTTP/1.1" 200 None 2026-04-15 12:59:18,275 - lava_callback - DEBUG - Processing node 69dce8923c1e37dfe2f8bb15: baseline-arm-clabbe 2026-04-15 12:59:18,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce8923c1e37dfe2f8bb15 2026-04-15 12:59:18,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:59:18,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce8923c1e37dfe2f8bb15 HTTP/1.1" 200 None 2026-04-15 12:59:18,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:59:18,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 12:59:18,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 12:59:18,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce8923c1e37dfe2f8bb15 HTTP/1.1" 200 None 2026-04-15 12:59:18,348 - lava_callback - ERROR - Error processing callback for node 69dce8923c1e37dfe2f8bb15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38582 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:00:34,435 - lava_callback - INFO - Received callback for node 69dce8f03c1e37dfe2f8bb80 INFO: 172.20.0.1:59858 - "POST /node/69dce8f03c1e37dfe2f8bb80 HTTP/1.0" 202 Accepted 2026-04-15 13:00:34,441 - lava_callback - INFO - Starting async job submit for node 69dce8f03c1e37dfe2f8bb80 2026-04-15 13:00:34,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:00:34,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce8f03c1e37dfe2f8bb80 HTTP/1.1" 200 None 2026-04-15 13:00:34,457 - lava_callback - DEBUG - Processing node 69dce8f03c1e37dfe2f8bb80: baseline-arm-baylibre 2026-04-15 13:00:34,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce8f03c1e37dfe2f8bb80 2026-04-15 13:00:34,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:00:34,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce8f03c1e37dfe2f8bb80 HTTP/1.1" 200 None 2026-04-15 13:00:34,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:00:34,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 13:00:34,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:00:34,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce8f03c1e37dfe2f8bb80 HTTP/1.1" 200 None 2026-04-15 13:00:34,528 - lava_callback - ERROR - Error processing callback for node 69dce8f03c1e37dfe2f8bb80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55568 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:02:18,442 - lava_callback - INFO - Received callback for node 69dce9533c1e37dfe2f8bbf3 INFO: 172.20.0.1:55580 - "POST /node/69dce9533c1e37dfe2f8bbf3 HTTP/1.0" 202 Accepted 2026-04-15 13:02:18,447 - lava_callback - INFO - Starting async job submit for node 69dce9533c1e37dfe2f8bbf3 2026-04-15 13:02:18,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:02:18,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce9533c1e37dfe2f8bbf3 HTTP/1.1" 200 None 2026-04-15 13:02:18,463 - lava_callback - DEBUG - Processing node 69dce9533c1e37dfe2f8bbf3: baseline-arm-clabbe 2026-04-15 13:02:18,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce9533c1e37dfe2f8bbf3 2026-04-15 13:02:18,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:02:18,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce9533c1e37dfe2f8bbf3 HTTP/1.1" 200 None 2026-04-15 13:02:18,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:02:18,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 13:02:18,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:02:18,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce9533c1e37dfe2f8bbf3 HTTP/1.1" 200 None 2026-04-15 13:02:18,517 - lava_callback - ERROR - Error processing callback for node 69dce9533c1e37dfe2f8bbf3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47836 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:02:58,387 - lava_callback - INFO - Received callback for node 69dce9743c1e37dfe2f8bc16 INFO: 172.20.0.1:47842 - "POST /node/69dce9743c1e37dfe2f8bc16 HTTP/1.0" 202 Accepted 2026-04-15 13:02:58,392 - lava_callback - INFO - Starting async job submit for node 69dce9743c1e37dfe2f8bc16 2026-04-15 13:02:58,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:02:58,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce9743c1e37dfe2f8bc16 HTTP/1.1" 200 None 2026-04-15 13:02:58,414 - lava_callback - DEBUG - Processing node 69dce9743c1e37dfe2f8bc16: baseline-arm-clabbe 2026-04-15 13:02:58,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce9743c1e37dfe2f8bc16 2026-04-15 13:02:58,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:02:58,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce9743c1e37dfe2f8bc16 HTTP/1.1" 200 None 2026-04-15 13:02:58,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:02:58,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 13:02:58,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:02:58,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce9743c1e37dfe2f8bc16 HTTP/1.1" 200 None 2026-04-15 13:02:58,480 - lava_callback - ERROR - Error processing callback for node 69dce9743c1e37dfe2f8bc16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37222 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:03:38,510 - lava_callback - INFO - Received callback for node 69dce9953c1e37dfe2f8bc4d INFO: 172.20.0.1:37228 - "POST /node/69dce9953c1e37dfe2f8bc4d HTTP/1.0" 202 Accepted 2026-04-15 13:03:38,515 - lava_callback - INFO - Starting async job submit for node 69dce9953c1e37dfe2f8bc4d 2026-04-15 13:03:38,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:03:38,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce9953c1e37dfe2f8bc4d HTTP/1.1" 200 None 2026-04-15 13:03:38,531 - lava_callback - DEBUG - Processing node 69dce9953c1e37dfe2f8bc4d: baseline-arm-clabbe 2026-04-15 13:03:38,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce9953c1e37dfe2f8bc4d 2026-04-15 13:03:38,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:03:38,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce9953c1e37dfe2f8bc4d HTTP/1.1" 200 None 2026-04-15 13:03:38,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:03:38,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 13:03:38,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:03:38,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce9953c1e37dfe2f8bc4d HTTP/1.1" 200 None 2026-04-15 13:03:38,591 - lava_callback - ERROR - Error processing callback for node 69dce9953c1e37dfe2f8bc4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59598 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:03:58,484 - lava_callback - INFO - Received callback for node 69dce9b63c1e37dfe2f8bc78 INFO: 172.20.0.1:59600 - "POST /node/69dce9b63c1e37dfe2f8bc78 HTTP/1.0" 202 Accepted 2026-04-15 13:03:58,489 - lava_callback - INFO - Starting async job submit for node 69dce9b63c1e37dfe2f8bc78 2026-04-15 13:03:58,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:03:58,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce9b63c1e37dfe2f8bc78 HTTP/1.1" 200 None 2026-04-15 13:03:58,505 - lava_callback - DEBUG - Processing node 69dce9b63c1e37dfe2f8bc78: baseline-arm-clabbe 2026-04-15 13:03:58,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce9b63c1e37dfe2f8bc78 2026-04-15 13:03:58,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:03:58,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce9b63c1e37dfe2f8bc78 HTTP/1.1" 200 None 2026-04-15 13:03:58,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:03:58,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 13:03:58,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:03:58,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce9b63c1e37dfe2f8bc78 HTTP/1.1" 200 None 2026-04-15 13:03:58,565 - lava_callback - ERROR - Error processing callback for node 69dce9b63c1e37dfe2f8bc78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41318 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:04:38,550 - lava_callback - INFO - Received callback for node 69dce9d43c1e37dfe2f8bca8 INFO: 172.20.0.1:41324 - "POST /node/69dce9d43c1e37dfe2f8bca8 HTTP/1.0" 202 Accepted 2026-04-15 13:04:38,556 - lava_callback - INFO - Starting async job submit for node 69dce9d43c1e37dfe2f8bca8 2026-04-15 13:04:38,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:04:38,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce9d43c1e37dfe2f8bca8 HTTP/1.1" 200 None 2026-04-15 13:04:38,573 - lava_callback - DEBUG - Processing node 69dce9d43c1e37dfe2f8bca8: baseline-arm-clabbe 2026-04-15 13:04:38,573 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce9d43c1e37dfe2f8bca8 2026-04-15 13:04:38,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:04:38,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce9d43c1e37dfe2f8bca8 HTTP/1.1" 200 None 2026-04-15 13:04:38,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:04:38,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 13:04:38,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:04:38,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce9d43c1e37dfe2f8bca8 HTTP/1.1" 200 None 2026-04-15 13:04:38,655 - lava_callback - ERROR - Error processing callback for node 69dce9d43c1e37dfe2f8bca8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37294 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:04:58,482 - lava_callback - INFO - Received callback for node 69dce9f13c1e37dfe2f8bd0e INFO: 172.20.0.1:37308 - "POST /node/69dce9f13c1e37dfe2f8bd0e HTTP/1.0" 202 Accepted 2026-04-15 13:04:58,488 - lava_callback - INFO - Starting async job submit for node 69dce9f13c1e37dfe2f8bd0e 2026-04-15 13:04:58,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:04:58,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce9f13c1e37dfe2f8bd0e HTTP/1.1" 200 None 2026-04-15 13:04:58,503 - lava_callback - DEBUG - Processing node 69dce9f13c1e37dfe2f8bd0e: baseline-arm-clabbe 2026-04-15 13:04:58,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dce9f13c1e37dfe2f8bd0e 2026-04-15 13:04:58,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:04:58,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dce9f13c1e37dfe2f8bd0e HTTP/1.1" 200 None 2026-04-15 13:04:58,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:04:58,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 13:04:58,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:04:58,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dce9f13c1e37dfe2f8bd0e HTTP/1.1" 200 None 2026-04-15 13:04:58,566 - lava_callback - ERROR - Error processing callback for node 69dce9f13c1e37dfe2f8bd0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48366 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:05:38,614 - lava_callback - INFO - Received callback for node 69dcea123c1e37dfe2f8bd1b INFO: 172.20.0.1:48374 - "POST /node/69dcea123c1e37dfe2f8bd1b HTTP/1.0" 202 Accepted 2026-04-15 13:05:38,620 - lava_callback - INFO - Starting async job submit for node 69dcea123c1e37dfe2f8bd1b 2026-04-15 13:05:38,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:05:38,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcea123c1e37dfe2f8bd1b HTTP/1.1" 200 None 2026-04-15 13:05:38,636 - lava_callback - DEBUG - Processing node 69dcea123c1e37dfe2f8bd1b: baseline-arm-clabbe 2026-04-15 13:05:38,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcea123c1e37dfe2f8bd1b 2026-04-15 13:05:38,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:05:38,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcea123c1e37dfe2f8bd1b HTTP/1.1" 200 None 2026-04-15 13:05:38,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:05:38,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 13:05:38,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:05:38,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcea123c1e37dfe2f8bd1b HTTP/1.1" 200 None 2026-04-15 13:05:38,695 - lava_callback - ERROR - Error processing callback for node 69dcea123c1e37dfe2f8bd1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37474 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:05:58,705 - lava_callback - INFO - Received callback for node 69dcea323c1e37dfe2f8bd47 INFO: 172.20.0.1:37478 - "POST /node/69dcea323c1e37dfe2f8bd47 HTTP/1.0" 202 Accepted 2026-04-15 13:05:58,710 - lava_callback - INFO - Starting async job submit for node 69dcea323c1e37dfe2f8bd47 2026-04-15 13:05:58,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:05:58,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcea323c1e37dfe2f8bd47 HTTP/1.1" 200 None 2026-04-15 13:05:58,726 - lava_callback - DEBUG - Processing node 69dcea323c1e37dfe2f8bd47: baseline-arm-clabbe 2026-04-15 13:05:58,727 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcea323c1e37dfe2f8bd47 2026-04-15 13:05:58,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:05:58,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcea323c1e37dfe2f8bd47 HTTP/1.1" 200 None 2026-04-15 13:05:58,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:05:58,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 13:05:58,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:05:58,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcea323c1e37dfe2f8bd47 HTTP/1.1" 200 None 2026-04-15 13:05:58,795 - lava_callback - ERROR - Error processing callback for node 69dcea323c1e37dfe2f8bd47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41324 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:06:38,655 - lava_callback - INFO - Received callback for node 69dcea563c1e37dfe2f8bd83 INFO: 172.20.0.1:41340 - "POST /node/69dcea563c1e37dfe2f8bd83 HTTP/1.0" 202 Accepted 2026-04-15 13:06:38,661 - lava_callback - INFO - Starting async job submit for node 69dcea563c1e37dfe2f8bd83 2026-04-15 13:06:38,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:06:38,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcea563c1e37dfe2f8bd83 HTTP/1.1" 200 None 2026-04-15 13:06:38,678 - lava_callback - DEBUG - Processing node 69dcea563c1e37dfe2f8bd83: baseline-arm-clabbe 2026-04-15 13:06:38,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcea563c1e37dfe2f8bd83 2026-04-15 13:06:38,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:06:38,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcea563c1e37dfe2f8bd83 HTTP/1.1" 200 None 2026-04-15 13:06:38,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:06:38,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc36005dbfa74e32f9687c HTTP/1.1" 200 None 2026-04-15 13:06:38,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:06:38,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcea563c1e37dfe2f8bd83 HTTP/1.1" 200 None 2026-04-15 13:06:38,727 - lava_callback - ERROR - Error processing callback for node 69dcea563c1e37dfe2f8bd83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37166 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:07:15,001 - lava_callback - INFO - Received callback for node 69dcea783c1e37dfe2f8bda4 INFO: 172.20.0.1:50880 - "POST /node/69dcea783c1e37dfe2f8bda4 HTTP/1.0" 202 Accepted 2026-04-15 13:07:15,006 - lava_callback - INFO - Starting async job submit for node 69dcea783c1e37dfe2f8bda4 2026-04-15 13:07:15,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:07:15,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcea783c1e37dfe2f8bda4 HTTP/1.1" 200 None 2026-04-15 13:07:15,023 - lava_callback - DEBUG - Processing node 69dcea783c1e37dfe2f8bda4: baseline-arm-baylibre 2026-04-15 13:07:15,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcea783c1e37dfe2f8bda4 2026-04-15 13:07:15,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:07:15,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcea783c1e37dfe2f8bda4 HTTP/1.1" 200 None 2026-04-15 13:07:15,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:07:15,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:07:15,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:07:15,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcea783c1e37dfe2f8bda4 HTTP/1.1" 200 None 2026-04-15 13:07:15,075 - lava_callback - ERROR - Error processing callback for node 69dcea783c1e37dfe2f8bda4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41542 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:07:58,735 - lava_callback - INFO - Received callback for node 69dcea9b3c1e37dfe2f8bdc7 INFO: 172.20.0.1:41558 - "POST /node/69dcea9b3c1e37dfe2f8bdc7 HTTP/1.0" 202 Accepted 2026-04-15 13:07:58,740 - lava_callback - INFO - Starting async job submit for node 69dcea9b3c1e37dfe2f8bdc7 2026-04-15 13:07:58,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:07:58,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcea9b3c1e37dfe2f8bdc7 HTTP/1.1" 200 None 2026-04-15 13:07:58,756 - lava_callback - DEBUG - Processing node 69dcea9b3c1e37dfe2f8bdc7: baseline-arm-clabbe 2026-04-15 13:07:58,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcea9b3c1e37dfe2f8bdc7 2026-04-15 13:07:58,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:07:58,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcea9b3c1e37dfe2f8bdc7 HTTP/1.1" 200 None 2026-04-15 13:07:58,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:07:58,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:07:58,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:07:58,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcea9b3c1e37dfe2f8bdc7 HTTP/1.1" 200 None 2026-04-15 13:07:58,809 - lava_callback - ERROR - Error processing callback for node 69dcea9b3c1e37dfe2f8bdc7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33048 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:08:18,667 - lava_callback - INFO - Received callback for node 69dceabf3c1e37dfe2f8bde3 INFO: 172.20.0.1:33060 - "POST /node/69dceabf3c1e37dfe2f8bde3 HTTP/1.0" 202 Accepted 2026-04-15 13:08:18,673 - lava_callback - INFO - Starting async job submit for node 69dceabf3c1e37dfe2f8bde3 2026-04-15 13:08:18,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:08:18,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceabf3c1e37dfe2f8bde3 HTTP/1.1" 200 None 2026-04-15 13:08:18,689 - lava_callback - DEBUG - Processing node 69dceabf3c1e37dfe2f8bde3: baseline-arm-clabbe 2026-04-15 13:08:18,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dceabf3c1e37dfe2f8bde3 2026-04-15 13:08:18,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:08:18,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceabf3c1e37dfe2f8bde3 HTTP/1.1" 200 None 2026-04-15 13:08:18,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:08:18,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:08:18,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:08:18,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dceabf3c1e37dfe2f8bde3 HTTP/1.1" 200 None 2026-04-15 13:08:18,738 - lava_callback - ERROR - Error processing callback for node 69dceabf3c1e37dfe2f8bde3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41072 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:08:58,783 - lava_callback - INFO - Received callback for node 69dceae43c1e37dfe2f8bdfc INFO: 172.20.0.1:41086 - "POST /node/69dceae43c1e37dfe2f8bdfc HTTP/1.0" 202 Accepted 2026-04-15 13:08:58,789 - lava_callback - INFO - Starting async job submit for node 69dceae43c1e37dfe2f8bdfc 2026-04-15 13:08:58,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:08:58,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceae43c1e37dfe2f8bdfc HTTP/1.1" 200 None 2026-04-15 13:08:58,805 - lava_callback - DEBUG - Processing node 69dceae43c1e37dfe2f8bdfc: baseline-arm-clabbe 2026-04-15 13:08:58,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dceae43c1e37dfe2f8bdfc 2026-04-15 13:08:58,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:08:58,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceae43c1e37dfe2f8bdfc HTTP/1.1" 200 None 2026-04-15 13:08:58,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:08:58,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:08:58,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:08:58,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dceae43c1e37dfe2f8bdfc HTTP/1.1" 200 None 2026-04-15 13:08:58,864 - lava_callback - ERROR - Error processing callback for node 69dceae43c1e37dfe2f8bdfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39436 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:09:38,765 - lava_callback - INFO - Received callback for node 69dceaff3c1e37dfe2f8be3f INFO: 172.20.0.1:39446 - "POST /node/69dceaff3c1e37dfe2f8be3f HTTP/1.0" 202 Accepted 2026-04-15 13:09:38,771 - lava_callback - INFO - Starting async job submit for node 69dceaff3c1e37dfe2f8be3f 2026-04-15 13:09:38,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:09:38,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceaff3c1e37dfe2f8be3f HTTP/1.1" 200 None 2026-04-15 13:09:38,795 - lava_callback - DEBUG - Processing node 69dceaff3c1e37dfe2f8be3f: baseline-arm-clabbe 2026-04-15 13:09:38,795 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dceaff3c1e37dfe2f8be3f 2026-04-15 13:09:38,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:09:38,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceaff3c1e37dfe2f8be3f HTTP/1.1" 200 None 2026-04-15 13:09:38,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:09:38,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:09:38,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:09:38,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dceaff3c1e37dfe2f8be3f HTTP/1.1" 200 None 2026-04-15 13:09:38,847 - lava_callback - ERROR - Error processing callback for node 69dceaff3c1e37dfe2f8be3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51920 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:10:18,841 - lava_callback - INFO - Received callback for node 69dceb243c1e37dfe2f8be5f INFO: 172.20.0.1:51932 - "POST /node/69dceb243c1e37dfe2f8be5f HTTP/1.0" 202 Accepted 2026-04-15 13:10:18,847 - lava_callback - INFO - Starting async job submit for node 69dceb243c1e37dfe2f8be5f 2026-04-15 13:10:18,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:10:18,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceb243c1e37dfe2f8be5f HTTP/1.1" 200 None 2026-04-15 13:10:18,863 - lava_callback - DEBUG - Processing node 69dceb243c1e37dfe2f8be5f: baseline-arm-clabbe 2026-04-15 13:10:18,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dceb243c1e37dfe2f8be5f 2026-04-15 13:10:18,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:10:18,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceb243c1e37dfe2f8be5f HTTP/1.1" 200 None 2026-04-15 13:10:18,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:10:18,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:10:18,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:10:18,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dceb243c1e37dfe2f8be5f HTTP/1.1" 200 None 2026-04-15 13:10:18,914 - lava_callback - ERROR - Error processing callback for node 69dceb243c1e37dfe2f8be5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33530 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:10:38,815 - lava_callback - INFO - Received callback for node 69dceb473c1e37dfe2f8be7d INFO: 172.20.0.1:33536 - "POST /node/69dceb473c1e37dfe2f8be7d HTTP/1.0" 202 Accepted 2026-04-15 13:10:38,820 - lava_callback - INFO - Starting async job submit for node 69dceb473c1e37dfe2f8be7d 2026-04-15 13:10:38,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:10:38,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceb473c1e37dfe2f8be7d HTTP/1.1" 200 None 2026-04-15 13:10:38,848 - lava_callback - DEBUG - Processing node 69dceb473c1e37dfe2f8be7d: baseline-arm-clabbe 2026-04-15 13:10:38,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dceb473c1e37dfe2f8be7d 2026-04-15 13:10:38,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:10:38,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceb473c1e37dfe2f8be7d HTTP/1.1" 200 None 2026-04-15 13:10:38,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:10:38,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:10:38,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:10:38,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dceb473c1e37dfe2f8be7d HTTP/1.1" 200 None 2026-04-15 13:10:38,899 - lava_callback - ERROR - Error processing callback for node 69dceb473c1e37dfe2f8be7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44696 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:11:18,834 - lava_callback - INFO - Received callback for node 69dceb6a3c1e37dfe2f8be99 INFO: 172.20.0.1:44706 - "POST /node/69dceb6a3c1e37dfe2f8be99 HTTP/1.0" 202 Accepted 2026-04-15 13:11:18,840 - lava_callback - INFO - Starting async job submit for node 69dceb6a3c1e37dfe2f8be99 2026-04-15 13:11:18,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:11:18,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceb6a3c1e37dfe2f8be99 HTTP/1.1" 200 None 2026-04-15 13:11:18,855 - lava_callback - DEBUG - Processing node 69dceb6a3c1e37dfe2f8be99: baseline-arm-clabbe 2026-04-15 13:11:18,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dceb6a3c1e37dfe2f8be99 2026-04-15 13:11:18,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:11:18,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceb6a3c1e37dfe2f8be99 HTTP/1.1" 200 None 2026-04-15 13:11:18,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:11:18,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:11:18,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:11:18,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dceb6a3c1e37dfe2f8be99 HTTP/1.1" 200 None 2026-04-15 13:11:18,913 - lava_callback - ERROR - Error processing callback for node 69dceb6a3c1e37dfe2f8be99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49006 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:11:55,391 - lava_callback - INFO - Received callback for node 69dceb933c1e37dfe2f8beaf INFO: 172.20.0.1:53508 - "POST /node/69dceb933c1e37dfe2f8beaf HTTP/1.0" 202 Accepted 2026-04-15 13:11:55,397 - lava_callback - INFO - Starting async job submit for node 69dceb933c1e37dfe2f8beaf 2026-04-15 13:11:55,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:11:55,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceb933c1e37dfe2f8beaf HTTP/1.1" 200 None 2026-04-15 13:11:55,422 - lava_callback - DEBUG - Processing node 69dceb933c1e37dfe2f8beaf: baseline-arm64-baylibre 2026-04-15 13:11:55,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dceb933c1e37dfe2f8beaf 2026-04-15 13:11:55,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:11:55,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceb933c1e37dfe2f8beaf HTTP/1.1" 200 None 2026-04-15 13:11:55,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:11:55,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:11:55,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:11:55,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dceb933c1e37dfe2f8beaf HTTP/1.1" 200 None 2026-04-15 13:11:55,476 - lava_callback - ERROR - Error processing callback for node 69dceb933c1e37dfe2f8beaf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48922 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:12:58,916 - lava_callback - INFO - Received callback for node 69dcebd63c1e37dfe2f8befe INFO: 172.20.0.1:48934 - "POST /node/69dcebd63c1e37dfe2f8befe HTTP/1.0" 202 Accepted 2026-04-15 13:12:58,922 - lava_callback - INFO - Starting async job submit for node 69dcebd63c1e37dfe2f8befe 2026-04-15 13:12:58,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:12:58,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcebd63c1e37dfe2f8befe HTTP/1.1" 200 None 2026-04-15 13:12:58,938 - lava_callback - DEBUG - Processing node 69dcebd63c1e37dfe2f8befe: baseline-arm-clabbe 2026-04-15 13:12:58,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcebd63c1e37dfe2f8befe 2026-04-15 13:12:58,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:12:58,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcebd63c1e37dfe2f8befe HTTP/1.1" 200 None 2026-04-15 13:12:58,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:12:58,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:12:58,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:12:58,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcebd63c1e37dfe2f8befe HTTP/1.1" 200 None 2026-04-15 13:12:58,988 - lava_callback - ERROR - Error processing callback for node 69dcebd63c1e37dfe2f8befe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40852 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:13:38,929 - lava_callback - INFO - Received callback for node 69dcebf63c1e37dfe2f8bf14 INFO: 172.20.0.1:40854 - "POST /node/69dcebf63c1e37dfe2f8bf14 HTTP/1.0" 202 Accepted 2026-04-15 13:13:38,934 - lava_callback - INFO - Starting async job submit for node 69dcebf63c1e37dfe2f8bf14 2026-04-15 13:13:38,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:13:38,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcebf63c1e37dfe2f8bf14 HTTP/1.1" 200 None 2026-04-15 13:13:38,950 - lava_callback - DEBUG - Processing node 69dcebf63c1e37dfe2f8bf14: baseline-arm-clabbe 2026-04-15 13:13:38,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcebf63c1e37dfe2f8bf14 2026-04-15 13:13:38,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:13:38,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcebf63c1e37dfe2f8bf14 HTTP/1.1" 200 None 2026-04-15 13:13:38,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:13:38,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:13:38,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:13:39,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcebf63c1e37dfe2f8bf14 HTTP/1.1" 200 None 2026-04-15 13:13:39,007 - lava_callback - ERROR - Error processing callback for node 69dcebf63c1e37dfe2f8bf14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42594 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:14:19,038 - lava_callback - INFO - Received callback for node 69dcec163c1e37dfe2f8bf70 INFO: 172.20.0.1:42606 - "POST /node/69dcec163c1e37dfe2f8bf70 HTTP/1.0" 202 Accepted 2026-04-15 13:14:19,044 - lava_callback - INFO - Starting async job submit for node 69dcec163c1e37dfe2f8bf70 2026-04-15 13:14:19,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:14:19,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcec163c1e37dfe2f8bf70 HTTP/1.1" 200 None 2026-04-15 13:14:19,060 - lava_callback - DEBUG - Processing node 69dcec163c1e37dfe2f8bf70: baseline-arm-clabbe 2026-04-15 13:14:19,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcec163c1e37dfe2f8bf70 2026-04-15 13:14:19,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:14:19,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcec163c1e37dfe2f8bf70 HTTP/1.1" 200 None 2026-04-15 13:14:19,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:14:19,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:14:19,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:14:19,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcec163c1e37dfe2f8bf70 HTTP/1.1" 200 None 2026-04-15 13:14:19,120 - lava_callback - ERROR - Error processing callback for node 69dcec163c1e37dfe2f8bf70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42614 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:14:38,975 - lava_callback - INFO - Received callback for node 69dcec3b3c1e37dfe2f8bf7e INFO: 172.20.0.1:42630 - "POST /node/69dcec3b3c1e37dfe2f8bf7e HTTP/1.0" 202 Accepted 2026-04-15 13:14:38,981 - lava_callback - INFO - Starting async job submit for node 69dcec3b3c1e37dfe2f8bf7e 2026-04-15 13:14:38,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:14:38,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcec3b3c1e37dfe2f8bf7e HTTP/1.1" 200 None 2026-04-15 13:14:38,997 - lava_callback - DEBUG - Processing node 69dcec3b3c1e37dfe2f8bf7e: baseline-arm-clabbe 2026-04-15 13:14:38,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcec3b3c1e37dfe2f8bf7e 2026-04-15 13:14:38,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:14:39,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcec3b3c1e37dfe2f8bf7e HTTP/1.1" 200 None 2026-04-15 13:14:39,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:14:39,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:14:39,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:14:39,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcec3b3c1e37dfe2f8bf7e HTTP/1.1" 200 None 2026-04-15 13:14:39,051 - lava_callback - ERROR - Error processing callback for node 69dcec3b3c1e37dfe2f8bf7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52636 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:15:35,283 - lava_callback - INFO - Received callback for node 69dcec6a3c1e37dfe2f8bf92 INFO: 172.20.0.1:39714 - "POST /node/69dcec6a3c1e37dfe2f8bf92 HTTP/1.0" 202 Accepted 2026-04-15 13:15:35,289 - lava_callback - INFO - Starting async job submit for node 69dcec6a3c1e37dfe2f8bf92 2026-04-15 13:15:35,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:15:35,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcec6a3c1e37dfe2f8bf92 HTTP/1.1" 200 None 2026-04-15 13:15:35,305 - lava_callback - DEBUG - Processing node 69dcec6a3c1e37dfe2f8bf92: baseline-arm64-baylibre 2026-04-15 13:15:35,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcec6a3c1e37dfe2f8bf92 2026-04-15 13:15:35,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:15:35,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcec6a3c1e37dfe2f8bf92 HTTP/1.1" 200 None 2026-04-15 13:15:35,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:15:35,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:15:35,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:15:35,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcec6a3c1e37dfe2f8bf92 HTTP/1.1" 200 None 2026-04-15 13:15:35,360 - lava_callback - ERROR - Error processing callback for node 69dcec6a3c1e37dfe2f8bf92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38172 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:16:39,127 - lava_callback - INFO - Received callback for node 69dceca93c1e37dfe2f8bfc4 INFO: 172.20.0.1:38176 - "POST /node/69dceca93c1e37dfe2f8bfc4 HTTP/1.0" 202 Accepted 2026-04-15 13:16:39,133 - lava_callback - INFO - Starting async job submit for node 69dceca93c1e37dfe2f8bfc4 2026-04-15 13:16:39,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:16:39,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceca93c1e37dfe2f8bfc4 HTTP/1.1" 200 None 2026-04-15 13:16:39,149 - lava_callback - DEBUG - Processing node 69dceca93c1e37dfe2f8bfc4: baseline-arm-clabbe 2026-04-15 13:16:39,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dceca93c1e37dfe2f8bfc4 2026-04-15 13:16:39,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:16:39,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceca93c1e37dfe2f8bfc4 HTTP/1.1" 200 None 2026-04-15 13:16:39,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:16:39,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:16:39,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:16:39,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dceca93c1e37dfe2f8bfc4 HTTP/1.1" 200 None 2026-04-15 13:16:39,199 - lava_callback - ERROR - Error processing callback for node 69dceca93c1e37dfe2f8bfc4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57726 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:17:19,116 - lava_callback - INFO - Received callback for node 69dcecca3c1e37dfe2f8c00b INFO: 172.20.0.1:57734 - "POST /node/69dcecca3c1e37dfe2f8c00b HTTP/1.0" 202 Accepted 2026-04-15 13:17:19,122 - lava_callback - INFO - Starting async job submit for node 69dcecca3c1e37dfe2f8c00b 2026-04-15 13:17:19,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:17:19,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcecca3c1e37dfe2f8c00b HTTP/1.1" 200 None 2026-04-15 13:17:19,145 - lava_callback - DEBUG - Processing node 69dcecca3c1e37dfe2f8c00b: baseline-arm-clabbe 2026-04-15 13:17:19,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcecca3c1e37dfe2f8c00b 2026-04-15 13:17:19,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:17:19,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcecca3c1e37dfe2f8c00b HTTP/1.1" 200 None 2026-04-15 13:17:19,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:17:19,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:17:19,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:17:19,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcecca3c1e37dfe2f8c00b HTTP/1.1" 200 None 2026-04-15 13:17:19,243 - lava_callback - ERROR - Error processing callback for node 69dcecca3c1e37dfe2f8c00b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54998 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:17:55,428 - lava_callback - INFO - Received callback for node 69dcecf43c1e37dfe2f8c022 INFO: 172.20.0.1:37300 - "POST /node/69dcecf43c1e37dfe2f8c022 HTTP/1.0" 202 Accepted 2026-04-15 13:17:55,434 - lava_callback - INFO - Starting async job submit for node 69dcecf43c1e37dfe2f8c022 2026-04-15 13:17:55,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:17:55,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcecf43c1e37dfe2f8c022 HTTP/1.1" 200 None 2026-04-15 13:17:55,449 - lava_callback - DEBUG - Processing node 69dcecf43c1e37dfe2f8c022: baseline-arm64-baylibre 2026-04-15 13:17:55,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcecf43c1e37dfe2f8c022 2026-04-15 13:17:55,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:17:55,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcecf43c1e37dfe2f8c022 HTTP/1.1" 200 None 2026-04-15 13:17:55,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:17:55,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:17:55,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:17:55,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcecf43c1e37dfe2f8c022 HTTP/1.1" 200 None 2026-04-15 13:17:55,514 - lava_callback - ERROR - Error processing callback for node 69dcecf43c1e37dfe2f8c022: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38926 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:18:59,255 - lava_callback - INFO - Received callback for node 69dced303c1e37dfe2f8c078 INFO: 172.20.0.1:38938 - "POST /node/69dced303c1e37dfe2f8c078 HTTP/1.0" 202 Accepted 2026-04-15 13:18:59,261 - lava_callback - INFO - Starting async job submit for node 69dced303c1e37dfe2f8c078 2026-04-15 13:18:59,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:18:59,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dced303c1e37dfe2f8c078 HTTP/1.1" 200 None 2026-04-15 13:18:59,277 - lava_callback - DEBUG - Processing node 69dced303c1e37dfe2f8c078: baseline-arm-clabbe 2026-04-15 13:18:59,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dced303c1e37dfe2f8c078 2026-04-15 13:18:59,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:18:59,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dced303c1e37dfe2f8c078 HTTP/1.1" 200 None 2026-04-15 13:18:59,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:18:59,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:18:59,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:18:59,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dced303c1e37dfe2f8c078 HTTP/1.1" 200 None 2026-04-15 13:18:59,324 - lava_callback - ERROR - Error processing callback for node 69dced303c1e37dfe2f8c078: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36714 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:19:39,208 - lava_callback - INFO - Received callback for node 69dced553c1e37dfe2f8c08d INFO: 172.20.0.1:36718 - "POST /node/69dced553c1e37dfe2f8c08d HTTP/1.0" 202 Accepted 2026-04-15 13:19:39,214 - lava_callback - INFO - Starting async job submit for node 69dced553c1e37dfe2f8c08d 2026-04-15 13:19:39,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:19:39,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dced553c1e37dfe2f8c08d HTTP/1.1" 200 None 2026-04-15 13:19:39,230 - lava_callback - DEBUG - Processing node 69dced553c1e37dfe2f8c08d: baseline-arm-clabbe 2026-04-15 13:19:39,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dced553c1e37dfe2f8c08d 2026-04-15 13:19:39,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:19:39,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dced553c1e37dfe2f8c08d HTTP/1.1" 200 None 2026-04-15 13:19:39,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:19:39,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:19:39,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:19:39,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dced553c1e37dfe2f8c08d HTTP/1.1" 200 None 2026-04-15 13:19:39,299 - lava_callback - ERROR - Error processing callback for node 69dced553c1e37dfe2f8c08d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52134 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 13:20:15,547 - lava_callback - INFO - Received callback for node 69dced7e3c1e37dfe2f8c0be INFO: 172.20.0.1:52142 - "POST /node/69dced7e3c1e37dfe2f8c0be HTTP/1.0" 202 Accepted 2026-04-15 13:20:15,552 - lava_callback - INFO - Starting async job submit for node 69dced7e3c1e37dfe2f8c0be 2026-04-15 13:20:15,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:20:15,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dced7e3c1e37dfe2f8c0be HTTP/1.1" 200 None 2026-04-15 13:20:15,569 - lava_callback - DEBUG - Processing node 69dced7e3c1e37dfe2f8c0be: baseline-arm64-baylibre 2026-04-15 13:20:15,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dced7e3c1e37dfe2f8c0be 2026-04-15 13:20:15,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:20:15,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dced7e3c1e37dfe2f8c0be HTTP/1.1" 200 None 2026-04-15 13:20:15,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:20:15,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:20:15,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:20:15,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dced7e3c1e37dfe2f8c0be HTTP/1.1" 200 None 2026-04-15 13:20:15,633 - lava_callback - ERROR - Error processing callback for node 69dced7e3c1e37dfe2f8c0be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49778 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:21:19,346 - lava_callback - INFO - Received callback for node 69dcedc13c1e37dfe2f8c0e4 INFO: 172.20.0.1:49784 - "POST /node/69dcedc13c1e37dfe2f8c0e4 HTTP/1.0" 202 Accepted 2026-04-15 13:21:19,353 - lava_callback - INFO - Starting async job submit for node 69dcedc13c1e37dfe2f8c0e4 2026-04-15 13:21:19,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:21:19,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcedc13c1e37dfe2f8c0e4 HTTP/1.1" 200 None 2026-04-15 13:21:19,380 - lava_callback - DEBUG - Processing node 69dcedc13c1e37dfe2f8c0e4: baseline-arm-clabbe 2026-04-15 13:21:19,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcedc13c1e37dfe2f8c0e4 2026-04-15 13:21:19,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:21:19,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcedc13c1e37dfe2f8c0e4 HTTP/1.1" 200 None 2026-04-15 13:21:19,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:21:19,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d993007e2a38af1be88a59 HTTP/1.1" 200 None 2026-04-15 13:21:19,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:21:19,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcedc13c1e37dfe2f8c0e4 HTTP/1.1" 200 None 2026-04-15 13:21:19,428 - lava_callback - ERROR - Error processing callback for node 69dcedc13c1e37dfe2f8c0e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56354 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:23:19,426 - lava_callback - INFO - Received callback for node 69dcee343c1e37dfe2f8c167 INFO: 172.20.0.1:56362 - "POST /node/69dcee343c1e37dfe2f8c167 HTTP/1.0" 202 Accepted 2026-04-15 13:23:19,434 - lava_callback - INFO - Starting async job submit for node 69dcee343c1e37dfe2f8c167 2026-04-15 13:23:19,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:23:19,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcee343c1e37dfe2f8c167 HTTP/1.1" 200 None 2026-04-15 13:23:19,452 - lava_callback - DEBUG - Processing node 69dcee343c1e37dfe2f8c167: baseline-arm64-clabbe 2026-04-15 13:23:19,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcee343c1e37dfe2f8c167 2026-04-15 13:23:19,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:23:19,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcee343c1e37dfe2f8c167 HTTP/1.1" 200 None 2026-04-15 13:23:19,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:23:19,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:23:19,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:23:19,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcee343c1e37dfe2f8c167 HTTP/1.1" 200 None 2026-04-15 13:23:19,503 - lava_callback - ERROR - Error processing callback for node 69dcee343c1e37dfe2f8c167: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41282 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:25:39,559 - lava_callback - INFO - Received callback for node 69dceec53c1e37dfe2f8c1dc INFO: 172.20.0.1:41286 - "POST /node/69dceec53c1e37dfe2f8c1dc HTTP/1.0" 202 Accepted 2026-04-15 13:25:39,565 - lava_callback - INFO - Starting async job submit for node 69dceec53c1e37dfe2f8c1dc 2026-04-15 13:25:39,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:25:39,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceec53c1e37dfe2f8c1dc HTTP/1.1" 200 None 2026-04-15 13:25:39,581 - lava_callback - DEBUG - Processing node 69dceec53c1e37dfe2f8c1dc: baseline-arm64-clabbe 2026-04-15 13:25:39,581 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dceec53c1e37dfe2f8c1dc 2026-04-15 13:25:39,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:25:39,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dceec53c1e37dfe2f8c1dc HTTP/1.1" 200 None 2026-04-15 13:25:39,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:25:39,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:25:39,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:25:39,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dceec53c1e37dfe2f8c1dc HTTP/1.1" 200 None 2026-04-15 13:25:39,631 - lava_callback - ERROR - Error processing callback for node 69dceec53c1e37dfe2f8c1dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40092 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:28:59,701 - lava_callback - INFO - Received callback for node 69dcef983c1e37dfe2f8c2c7 INFO: 172.20.0.1:51620 - "POST /node/69dcef983c1e37dfe2f8c2c7 HTTP/1.0" 202 Accepted 2026-04-15 13:28:59,706 - lava_callback - INFO - Starting async job submit for node 69dcef983c1e37dfe2f8c2c7 2026-04-15 13:28:59,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:28:59,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcef983c1e37dfe2f8c2c7 HTTP/1.1" 200 None 2026-04-15 13:28:59,731 - lava_callback - DEBUG - Processing node 69dcef983c1e37dfe2f8c2c7: baseline-arm64-clabbe 2026-04-15 13:28:59,731 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcef983c1e37dfe2f8c2c7 2026-04-15 13:28:59,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:28:59,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcef983c1e37dfe2f8c2c7 HTTP/1.1" 200 None 2026-04-15 13:28:59,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:28:59,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:28:59,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:28:59,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcef983c1e37dfe2f8c2c7 HTTP/1.1" 200 None 2026-04-15 13:28:59,778 - lava_callback - ERROR - Error processing callback for node 69dcef983c1e37dfe2f8c2c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50414 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:30:19,725 - lava_callback - INFO - Received callback for node 69dcefde3c1e37dfe2f8c31f INFO: 172.20.0.1:36622 - "POST /node/69dcefde3c1e37dfe2f8c31f HTTP/1.0" 202 Accepted 2026-04-15 13:30:19,731 - lava_callback - INFO - Starting async job submit for node 69dcefde3c1e37dfe2f8c31f 2026-04-15 13:30:19,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:30:19,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcefde3c1e37dfe2f8c31f HTTP/1.1" 200 None 2026-04-15 13:30:19,747 - lava_callback - DEBUG - Processing node 69dcefde3c1e37dfe2f8c31f: baseline-arm64-clabbe 2026-04-15 13:30:19,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcefde3c1e37dfe2f8c31f 2026-04-15 13:30:19,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:30:19,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcefde3c1e37dfe2f8c31f HTTP/1.1" 200 None 2026-04-15 13:30:19,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:30:19,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:30:19,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:30:19,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcefde3c1e37dfe2f8c31f HTTP/1.1" 200 None 2026-04-15 13:30:19,814 - lava_callback - ERROR - Error processing callback for node 69dcefde3c1e37dfe2f8c31f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54948 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:31:39,809 - lava_callback - INFO - Received callback for node 69dcf0293c1e37dfe2f8c35e INFO: 172.20.0.1:58540 - "POST /node/69dcf0293c1e37dfe2f8c35e HTTP/1.0" 202 Accepted 2026-04-15 13:31:39,815 - lava_callback - INFO - Starting async job submit for node 69dcf0293c1e37dfe2f8c35e 2026-04-15 13:31:39,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:31:39,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf0293c1e37dfe2f8c35e HTTP/1.1" 200 None 2026-04-15 13:31:39,831 - lava_callback - DEBUG - Processing node 69dcf0293c1e37dfe2f8c35e: baseline-arm64-clabbe 2026-04-15 13:31:39,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf0293c1e37dfe2f8c35e 2026-04-15 13:31:39,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:31:39,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf0293c1e37dfe2f8c35e HTTP/1.1" 200 None 2026-04-15 13:31:39,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:31:39,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:31:39,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:31:39,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf0293c1e37dfe2f8c35e HTTP/1.1" 200 None 2026-04-15 13:31:39,883 - lava_callback - ERROR - Error processing callback for node 69dcf0293c1e37dfe2f8c35e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50740 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:32:36,336 - lava_callback - INFO - Received callback for node 69dcf06e3c1e37dfe2f8c389 INFO: 172.20.0.1:34742 - "POST /node/69dcf06e3c1e37dfe2f8c389 HTTP/1.0" 202 Accepted 2026-04-15 13:32:36,342 - lava_callback - INFO - Starting async job submit for node 69dcf06e3c1e37dfe2f8c389 2026-04-15 13:32:36,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:32:36,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf06e3c1e37dfe2f8c389 HTTP/1.1" 200 None 2026-04-15 13:32:36,358 - lava_callback - DEBUG - Processing node 69dcf06e3c1e37dfe2f8c389: baseline-arm64-baylibre 2026-04-15 13:32:36,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf06e3c1e37dfe2f8c389 2026-04-15 13:32:36,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:34752 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:32:36,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf06e3c1e37dfe2f8c389 HTTP/1.1" 200 None 2026-04-15 13:32:36,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:32:36,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 13:32:36,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:32:36,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf06e3c1e37dfe2f8c389 HTTP/1.1" 200 None 2026-04-15 13:32:36,582 - lava_callback - ERROR - Error processing callback for node 69dcf06e3c1e37dfe2f8c389: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52148 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:33:56,218 - lava_callback - INFO - Received callback for node 69dcf0b13c1e37dfe2f8c3e5 INFO: 172.20.0.1:44460 - "POST /node/69dcf0b13c1e37dfe2f8c3e5 HTTP/1.0" 202 Accepted 2026-04-15 13:33:56,223 - lava_callback - INFO - Starting async job submit for node 69dcf0b13c1e37dfe2f8c3e5 2026-04-15 13:33:56,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:33:56,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf0b13c1e37dfe2f8c3e5 HTTP/1.1" 200 None 2026-04-15 13:33:56,247 - lava_callback - DEBUG - Processing node 69dcf0b13c1e37dfe2f8c3e5: baseline-arm64-baylibre 2026-04-15 13:33:56,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf0b13c1e37dfe2f8c3e5 2026-04-15 13:33:56,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:33:56,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf0b13c1e37dfe2f8c3e5 HTTP/1.1" 200 None 2026-04-15 13:33:56,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:33:56,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 13:33:56,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:33:56,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf0b13c1e37dfe2f8c3e5 HTTP/1.1" 200 None 2026-04-15 13:33:56,299 - lava_callback - ERROR - Error processing callback for node 69dcf0b13c1e37dfe2f8c3e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47544 - "GET /node/69ada7548fc97e5ba07d52b8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53114 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:34:59,939 - lava_callback - INFO - Received callback for node 69dcf0fe3c1e37dfe2f8c43e INFO: 172.20.0.1:59744 - "POST /node/69dcf0fe3c1e37dfe2f8c43e HTTP/1.0" 202 Accepted 2026-04-15 13:34:59,944 - lava_callback - INFO - Starting async job submit for node 69dcf0fe3c1e37dfe2f8c43e 2026-04-15 13:34:59,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:34:59,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf0fe3c1e37dfe2f8c43e HTTP/1.1" 200 None 2026-04-15 13:34:59,964 - lava_callback - DEBUG - Processing node 69dcf0fe3c1e37dfe2f8c43e: baseline-arm64-clabbe 2026-04-15 13:34:59,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf0fe3c1e37dfe2f8c43e 2026-04-15 13:34:59,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:34:59,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf0fe3c1e37dfe2f8c43e HTTP/1.1" 200 None 2026-04-15 13:34:59,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:34:59,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:34:59,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:35:00,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf0fe3c1e37dfe2f8c43e HTTP/1.1" 200 None 2026-04-15 13:35:00,015 - lava_callback - ERROR - Error processing callback for node 69dcf0fe3c1e37dfe2f8c43e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37906 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:36:20,269 - lava_callback - INFO - Received callback for node 69dcf1463c1e37dfe2f8c495 INFO: 172.20.0.1:58872 - "POST /node/69dcf1463c1e37dfe2f8c495 HTTP/1.0" 202 Accepted 2026-04-15 13:36:20,275 - lava_callback - INFO - Starting async job submit for node 69dcf1463c1e37dfe2f8c495 2026-04-15 13:36:20,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:36:20,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf1463c1e37dfe2f8c495 HTTP/1.1" 200 None 2026-04-15 13:36:20,292 - lava_callback - DEBUG - Processing node 69dcf1463c1e37dfe2f8c495: baseline-arm64-clabbe 2026-04-15 13:36:20,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf1463c1e37dfe2f8c495 2026-04-15 13:36:20,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:36:20,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf1463c1e37dfe2f8c495 HTTP/1.1" 200 None 2026-04-15 13:36:20,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:36:20,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:36:20,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:36:20,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf1463c1e37dfe2f8c495 HTTP/1.1" 200 None 2026-04-15 13:36:20,346 - lava_callback - ERROR - Error processing callback for node 69dcf1463c1e37dfe2f8c495: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59974 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-15 13:37:16,403 - lava_callback - INFO - Received callback for node 69dcf1883c1e37dfe2f8c4e3 INFO: 172.20.0.1:59980 - "POST /node/69dcf1883c1e37dfe2f8c4e3 HTTP/1.0" 202 Accepted 2026-04-15 13:37:16,408 - lava_callback - INFO - Starting async job submit for node 69dcf1883c1e37dfe2f8c4e3 2026-04-15 13:37:16,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:37:16,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf1883c1e37dfe2f8c4e3 HTTP/1.1" 200 None 2026-04-15 13:37:16,423 - lava_callback - DEBUG - Processing node 69dcf1883c1e37dfe2f8c4e3: baseline-arm64-baylibre 2026-04-15 13:37:16,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf1883c1e37dfe2f8c4e3 2026-04-15 13:37:16,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:37:16,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf1883c1e37dfe2f8c4e3 HTTP/1.1" 200 None 2026-04-15 13:37:16,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:37:16,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 13:37:16,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:37:16,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf1883c1e37dfe2f8c4e3 HTTP/1.1" 200 None 2026-04-15 13:37:16,478 - lava_callback - ERROR - Error processing callback for node 69dcf1883c1e37dfe2f8c4e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58538 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:38:36,570 - lava_callback - INFO - Received callback for node 69dcf1d23c1e37dfe2f8c526 INFO: 172.20.0.1:58548 - "POST /node/69dcf1d23c1e37dfe2f8c526 HTTP/1.0" 202 Accepted 2026-04-15 13:38:36,576 - lava_callback - INFO - Starting async job submit for node 69dcf1d23c1e37dfe2f8c526 2026-04-15 13:38:36,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:38:36,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf1d23c1e37dfe2f8c526 HTTP/1.1" 200 None 2026-04-15 13:38:36,596 - lava_callback - DEBUG - Processing node 69dcf1d23c1e37dfe2f8c526: baseline-arm64-baylibre 2026-04-15 13:38:36,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf1d23c1e37dfe2f8c526 2026-04-15 13:38:36,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:38:36,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf1d23c1e37dfe2f8c526 HTTP/1.1" 200 None 2026-04-15 13:38:36,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:38:36,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 13:38:36,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:38:36,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf1d23c1e37dfe2f8c526 HTTP/1.1" 200 None 2026-04-15 13:38:36,648 - lava_callback - ERROR - Error processing callback for node 69dcf1d23c1e37dfe2f8c526: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46214 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:39:56,536 - lava_callback - INFO - Received callback for node 69dcf2193c1e37dfe2f8c582 INFO: 172.20.0.1:46226 - "POST /node/69dcf2193c1e37dfe2f8c582 HTTP/1.0" 202 Accepted 2026-04-15 13:39:56,545 - lava_callback - INFO - Starting async job submit for node 69dcf2193c1e37dfe2f8c582 2026-04-15 13:39:56,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:39:56,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf2193c1e37dfe2f8c582 HTTP/1.1" 200 None 2026-04-15 13:39:56,565 - lava_callback - DEBUG - Processing node 69dcf2193c1e37dfe2f8c582: baseline-arm64-baylibre 2026-04-15 13:39:56,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf2193c1e37dfe2f8c582 2026-04-15 13:39:56,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:39:56,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf2193c1e37dfe2f8c582 HTTP/1.1" 200 None 2026-04-15 13:39:56,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:39:56,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 13:39:56,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:39:56,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf2193c1e37dfe2f8c582 HTTP/1.1" 200 None 2026-04-15 13:39:56,639 - lava_callback - ERROR - Error processing callback for node 69dcf2193c1e37dfe2f8c582: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56996 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:40:56,645 - lava_callback - INFO - Received callback for node 69dcf2603c1e37dfe2f8c5c4 INFO: 172.20.0.1:57012 - "POST /node/69dcf2603c1e37dfe2f8c5c4 HTTP/1.0" 202 Accepted 2026-04-15 13:40:56,651 - lava_callback - INFO - Starting async job submit for node 69dcf2603c1e37dfe2f8c5c4 2026-04-15 13:40:56,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:40:56,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf2603c1e37dfe2f8c5c4 HTTP/1.1" 200 None 2026-04-15 13:40:56,668 - lava_callback - DEBUG - Processing node 69dcf2603c1e37dfe2f8c5c4: baseline-arm64-baylibre 2026-04-15 13:40:56,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf2603c1e37dfe2f8c5c4 2026-04-15 13:40:56,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:40:56,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf2603c1e37dfe2f8c5c4 HTTP/1.1" 200 None 2026-04-15 13:40:56,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:40:56,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:40:56,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:40:56,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf2603c1e37dfe2f8c5c4 HTTP/1.1" 200 None 2026-04-15 13:40:56,718 - lava_callback - ERROR - Error processing callback for node 69dcf2603c1e37dfe2f8c5c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46918 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:42:20,223 - lava_callback - INFO - Received callback for node 69dcf2aa3c1e37dfe2f8c635 INFO: 172.20.0.1:41574 - "POST /node/69dcf2aa3c1e37dfe2f8c635 HTTP/1.0" 202 Accepted 2026-04-15 13:42:20,229 - lava_callback - INFO - Starting async job submit for node 69dcf2aa3c1e37dfe2f8c635 2026-04-15 13:42:20,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:42:20,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf2aa3c1e37dfe2f8c635 HTTP/1.1" 200 None 2026-04-15 13:42:20,248 - lava_callback - DEBUG - Processing node 69dcf2aa3c1e37dfe2f8c635: baseline-arm64-clabbe 2026-04-15 13:42:20,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf2aa3c1e37dfe2f8c635 2026-04-15 13:42:20,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:42:20,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf2aa3c1e37dfe2f8c635 HTTP/1.1" 200 None 2026-04-15 13:42:20,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:42:20,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 13:42:20,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:42:20,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf2aa3c1e37dfe2f8c635 HTTP/1.1" 200 None 2026-04-15 13:42:20,303 - lava_callback - ERROR - Error processing callback for node 69dcf2aa3c1e37dfe2f8c635: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39352 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:43:20,267 - lava_callback - INFO - Received callback for node 69dcf2f33c1e37dfe2f8c67a INFO: 172.20.0.1:59548 - "POST /node/69dcf2f33c1e37dfe2f8c67a HTTP/1.0" 202 Accepted 2026-04-15 13:43:20,273 - lava_callback - INFO - Starting async job submit for node 69dcf2f33c1e37dfe2f8c67a 2026-04-15 13:43:20,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:43:20,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf2f33c1e37dfe2f8c67a HTTP/1.1" 200 None 2026-04-15 13:43:20,289 - lava_callback - DEBUG - Processing node 69dcf2f33c1e37dfe2f8c67a: baseline-arm64-clabbe 2026-04-15 13:43:20,290 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf2f33c1e37dfe2f8c67a 2026-04-15 13:43:20,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:43:20,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf2f33c1e37dfe2f8c67a HTTP/1.1" 200 None 2026-04-15 13:43:20,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:43:20,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 13:43:20,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:43:20,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf2f33c1e37dfe2f8c67a HTTP/1.1" 200 None 2026-04-15 13:43:20,338 - lava_callback - ERROR - Error processing callback for node 69dcf2f33c1e37dfe2f8c67a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44780 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:44:40,326 - lava_callback - INFO - Received callback for node 69dcf3393c1e37dfe2f8c6c9 INFO: 172.20.0.1:43130 - "POST /node/69dcf3393c1e37dfe2f8c6c9 HTTP/1.0" 202 Accepted 2026-04-15 13:44:40,331 - lava_callback - INFO - Starting async job submit for node 69dcf3393c1e37dfe2f8c6c9 2026-04-15 13:44:40,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:44:40,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf3393c1e37dfe2f8c6c9 HTTP/1.1" 200 None 2026-04-15 13:44:40,348 - lava_callback - DEBUG - Processing node 69dcf3393c1e37dfe2f8c6c9: baseline-arm64-clabbe 2026-04-15 13:44:40,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf3393c1e37dfe2f8c6c9 2026-04-15 13:44:40,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:44:40,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf3393c1e37dfe2f8c6c9 HTTP/1.1" 200 None 2026-04-15 13:44:40,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:44:40,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 13:44:40,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:44:40,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf3393c1e37dfe2f8c6c9 HTTP/1.1" 200 None 2026-04-15 13:44:40,408 - lava_callback - ERROR - Error processing callback for node 69dcf3393c1e37dfe2f8c6c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38938 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:46:00,370 - lava_callback - INFO - Received callback for node 69dcf3833c1e37dfe2f8c71c INFO: 172.20.0.1:41968 - "POST /node/69dcf3833c1e37dfe2f8c71c HTTP/1.0" 202 Accepted 2026-04-15 13:46:00,378 - lava_callback - INFO - Starting async job submit for node 69dcf3833c1e37dfe2f8c71c 2026-04-15 13:46:00,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:46:00,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf3833c1e37dfe2f8c71c HTTP/1.1" 200 None 2026-04-15 13:46:00,397 - lava_callback - DEBUG - Processing node 69dcf3833c1e37dfe2f8c71c: baseline-arm64-clabbe 2026-04-15 13:46:00,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf3833c1e37dfe2f8c71c 2026-04-15 13:46:00,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:46:00,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf3833c1e37dfe2f8c71c HTTP/1.1" 200 None 2026-04-15 13:46:00,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:46:00,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 13:46:00,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:46:00,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf3833c1e37dfe2f8c71c HTTP/1.1" 200 None 2026-04-15 13:46:00,449 - lava_callback - ERROR - Error processing callback for node 69dcf3833c1e37dfe2f8c71c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37432 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:47:20,446 - lava_callback - INFO - Received callback for node 69dcf3d33c1e37dfe2f8c74f INFO: 172.20.0.1:39292 - "POST /node/69dcf3d33c1e37dfe2f8c74f HTTP/1.0" 202 Accepted 2026-04-15 13:47:20,452 - lava_callback - INFO - Starting async job submit for node 69dcf3d33c1e37dfe2f8c74f 2026-04-15 13:47:20,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:47:20,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf3d33c1e37dfe2f8c74f HTTP/1.1" 200 None 2026-04-15 13:47:20,469 - lava_callback - DEBUG - Processing node 69dcf3d33c1e37dfe2f8c74f: baseline-arm64-clabbe 2026-04-15 13:47:20,469 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf3d33c1e37dfe2f8c74f 2026-04-15 13:47:20,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:47:20,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf3d33c1e37dfe2f8c74f HTTP/1.1" 200 None 2026-04-15 13:47:20,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:47:20,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 13:47:20,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:47:20,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf3d33c1e37dfe2f8c74f HTTP/1.1" 200 None 2026-04-15 13:47:20,520 - lava_callback - ERROR - Error processing callback for node 69dcf3d33c1e37dfe2f8c74f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60756 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:48:20,477 - lava_callback - INFO - Received callback for node 69dcf4213c1e37dfe2f8c770 INFO: 172.20.0.1:39678 - "POST /node/69dcf4213c1e37dfe2f8c770 HTTP/1.0" 202 Accepted 2026-04-15 13:48:20,483 - lava_callback - INFO - Starting async job submit for node 69dcf4213c1e37dfe2f8c770 2026-04-15 13:48:20,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:48:20,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf4213c1e37dfe2f8c770 HTTP/1.1" 200 None 2026-04-15 13:48:20,499 - lava_callback - DEBUG - Processing node 69dcf4213c1e37dfe2f8c770: baseline-arm64-clabbe 2026-04-15 13:48:20,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf4213c1e37dfe2f8c770 2026-04-15 13:48:20,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:48:20,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf4213c1e37dfe2f8c770 HTTP/1.1" 200 None 2026-04-15 13:48:20,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:48:20,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 13:48:20,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:48:20,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf4213c1e37dfe2f8c770 HTTP/1.1" 200 None 2026-04-15 13:48:20,550 - lava_callback - ERROR - Error processing callback for node 69dcf4213c1e37dfe2f8c770: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40728 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:49:40,568 - lava_callback - INFO - Received callback for node 69dcf46a3c1e37dfe2f8c7bf INFO: 172.20.0.1:34448 - "POST /node/69dcf46a3c1e37dfe2f8c7bf HTTP/1.0" 202 Accepted 2026-04-15 13:49:40,577 - lava_callback - INFO - Starting async job submit for node 69dcf46a3c1e37dfe2f8c7bf 2026-04-15 13:49:40,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:49:40,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf46a3c1e37dfe2f8c7bf HTTP/1.1" 200 None 2026-04-15 13:49:40,597 - lava_callback - DEBUG - Processing node 69dcf46a3c1e37dfe2f8c7bf: baseline-arm64-clabbe 2026-04-15 13:49:40,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf46a3c1e37dfe2f8c7bf 2026-04-15 13:49:40,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:49:40,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf46a3c1e37dfe2f8c7bf HTTP/1.1" 200 None 2026-04-15 13:49:40,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:49:40,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dc360e5dbfa74e32f96891 HTTP/1.1" 200 None 2026-04-15 13:49:40,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:49:40,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf46a3c1e37dfe2f8c7bf HTTP/1.1" 200 None 2026-04-15 13:49:40,652 - lava_callback - ERROR - Error processing callback for node 69dcf46a3c1e37dfe2f8c7bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50238 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:50:57,373 - lava_callback - INFO - Received callback for node 69dcf4ad3c1e37dfe2f8c7ee INFO: 172.20.0.1:50248 - "POST /node/69dcf4ad3c1e37dfe2f8c7ee HTTP/1.0" 202 Accepted 2026-04-15 13:50:57,379 - lava_callback - INFO - Starting async job submit for node 69dcf4ad3c1e37dfe2f8c7ee 2026-04-15 13:50:57,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:50:57,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf4ad3c1e37dfe2f8c7ee HTTP/1.1" 200 None 2026-04-15 13:50:57,395 - lava_callback - DEBUG - Processing node 69dcf4ad3c1e37dfe2f8c7ee: baseline-arm64-baylibre 2026-04-15 13:50:57,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf4ad3c1e37dfe2f8c7ee 2026-04-15 13:50:57,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:50:57,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf4ad3c1e37dfe2f8c7ee HTTP/1.1" 200 None 2026-04-15 13:50:57,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:50:57,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:50:57,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:50:57,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf4ad3c1e37dfe2f8c7ee HTTP/1.1" 200 None 2026-04-15 13:50:57,455 - lava_callback - ERROR - Error processing callback for node 69dcf4ad3c1e37dfe2f8c7ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34104 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:51:57,169 - lava_callback - INFO - Received callback for node 69dcf4fb3c1e37dfe2f8c814 INFO: 172.20.0.1:34112 - "POST /node/69dcf4fb3c1e37dfe2f8c814 HTTP/1.0" 202 Accepted 2026-04-15 13:51:57,175 - lava_callback - INFO - Starting async job submit for node 69dcf4fb3c1e37dfe2f8c814 2026-04-15 13:51:57,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:51:57,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf4fb3c1e37dfe2f8c814 HTTP/1.1" 200 None 2026-04-15 13:51:57,191 - lava_callback - DEBUG - Processing node 69dcf4fb3c1e37dfe2f8c814: baseline-arm64-baylibre 2026-04-15 13:51:57,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf4fb3c1e37dfe2f8c814 2026-04-15 13:51:57,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:51:57,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf4fb3c1e37dfe2f8c814 HTTP/1.1" 200 None 2026-04-15 13:51:57,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:51:57,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:51:57,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:51:57,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf4fb3c1e37dfe2f8c814 HTTP/1.1" 200 None 2026-04-15 13:51:57,238 - lava_callback - ERROR - Error processing callback for node 69dcf4fb3c1e37dfe2f8c814: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55226 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:53:17,279 - lava_callback - INFO - Received callback for node 69dcf5473c1e37dfe2f8c851 INFO: 172.20.0.1:55234 - "POST /node/69dcf5473c1e37dfe2f8c851 HTTP/1.0" 202 Accepted 2026-04-15 13:53:17,285 - lava_callback - INFO - Starting async job submit for node 69dcf5473c1e37dfe2f8c851 2026-04-15 13:53:17,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:53:17,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf5473c1e37dfe2f8c851 HTTP/1.1" 200 None 2026-04-15 13:53:17,301 - lava_callback - DEBUG - Processing node 69dcf5473c1e37dfe2f8c851: baseline-arm64-baylibre 2026-04-15 13:53:17,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf5473c1e37dfe2f8c851 2026-04-15 13:53:17,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:53:17,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf5473c1e37dfe2f8c851 HTTP/1.1" 200 None 2026-04-15 13:53:17,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:53:17,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:53:17,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:53:17,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf5473c1e37dfe2f8c851 HTTP/1.1" 200 None 2026-04-15 13:53:17,355 - lava_callback - ERROR - Error processing callback for node 69dcf5473c1e37dfe2f8c851: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42466 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:54:37,354 - lava_callback - INFO - Received callback for node 69dcf5943c1e37dfe2f8c879 INFO: 172.20.0.1:42482 - "POST /node/69dcf5943c1e37dfe2f8c879 HTTP/1.0" 202 Accepted 2026-04-15 13:54:37,360 - lava_callback - INFO - Starting async job submit for node 69dcf5943c1e37dfe2f8c879 2026-04-15 13:54:37,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:54:37,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf5943c1e37dfe2f8c879 HTTP/1.1" 200 None 2026-04-15 13:54:37,380 - lava_callback - DEBUG - Processing node 69dcf5943c1e37dfe2f8c879: baseline-arm64-baylibre 2026-04-15 13:54:37,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf5943c1e37dfe2f8c879 2026-04-15 13:54:37,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:54:37,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf5943c1e37dfe2f8c879 HTTP/1.1" 200 None 2026-04-15 13:54:37,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:54:37,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:54:37,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:54:37,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf5943c1e37dfe2f8c879 HTTP/1.1" 200 None 2026-04-15 13:54:37,457 - lava_callback - ERROR - Error processing callback for node 69dcf5943c1e37dfe2f8c879: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59828 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:55:57,971 - lava_callback - INFO - Received callback for node 69dcf5da3c1e37dfe2f8c8d2 INFO: 172.20.0.1:59840 - "POST /node/69dcf5da3c1e37dfe2f8c8d2 HTTP/1.0" 202 Accepted 2026-04-15 13:55:57,976 - lava_callback - INFO - Starting async job submit for node 69dcf5da3c1e37dfe2f8c8d2 2026-04-15 13:55:57,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:55:57,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf5da3c1e37dfe2f8c8d2 HTTP/1.1" 200 None 2026-04-15 13:55:57,993 - lava_callback - DEBUG - Processing node 69dcf5da3c1e37dfe2f8c8d2: baseline-arm64-baylibre 2026-04-15 13:55:57,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf5da3c1e37dfe2f8c8d2 2026-04-15 13:55:57,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:55:58,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf5da3c1e37dfe2f8c8d2 HTTP/1.1" 200 None 2026-04-15 13:55:58,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:55:58,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:55:58,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:55:58,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf5da3c1e37dfe2f8c8d2 HTTP/1.1" 200 None 2026-04-15 13:55:58,061 - lava_callback - ERROR - Error processing callback for node 69dcf5da3c1e37dfe2f8c8d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56736 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:56:57,449 - lava_callback - INFO - Received callback for node 69dcf6203c1e37dfe2f8c922 INFO: 172.20.0.1:56740 - "POST /node/69dcf6203c1e37dfe2f8c922 HTTP/1.0" 202 Accepted 2026-04-15 13:56:57,455 - lava_callback - INFO - Starting async job submit for node 69dcf6203c1e37dfe2f8c922 2026-04-15 13:56:57,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:56:57,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf6203c1e37dfe2f8c922 HTTP/1.1" 200 None 2026-04-15 13:56:57,485 - lava_callback - DEBUG - Processing node 69dcf6203c1e37dfe2f8c922: baseline-arm64-baylibre 2026-04-15 13:56:57,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf6203c1e37dfe2f8c922 2026-04-15 13:56:57,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:56:57,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf6203c1e37dfe2f8c922 HTTP/1.1" 200 None 2026-04-15 13:56:57,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:56:57,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:56:57,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:56:57,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf6203c1e37dfe2f8c922 HTTP/1.1" 200 None 2026-04-15 13:56:57,544 - lava_callback - ERROR - Error processing callback for node 69dcf6203c1e37dfe2f8c922: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37412 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:58:20,972 - lava_callback - INFO - Received callback for node 69dcf6723c1e37dfe2f8c948 INFO: 172.20.0.1:42378 - "POST /node/69dcf6723c1e37dfe2f8c948 HTTP/1.0" 202 Accepted 2026-04-15 13:58:20,977 - lava_callback - INFO - Starting async job submit for node 69dcf6723c1e37dfe2f8c948 2026-04-15 13:58:20,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:58:20,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf6723c1e37dfe2f8c948 HTTP/1.1" 200 None 2026-04-15 13:58:20,993 - lava_callback - DEBUG - Processing node 69dcf6723c1e37dfe2f8c948: baseline-arm64-clabbe 2026-04-15 13:58:20,994 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf6723c1e37dfe2f8c948 2026-04-15 13:58:20,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:58:21,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf6723c1e37dfe2f8c948 HTTP/1.1" 200 None 2026-04-15 13:58:21,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:58:21,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:58:21,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:58:21,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf6723c1e37dfe2f8c948 HTTP/1.1" 200 None 2026-04-15 13:58:21,058 - lava_callback - ERROR - Error processing callback for node 69dcf6723c1e37dfe2f8c948: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36462 - "GET / HTTP/1.0" 200 OK 2026-04-15 13:59:37,638 - lava_callback - INFO - Received callback for node 69dcf6b53c1e37dfe2f8c98f INFO: 172.20.0.1:36470 - "POST /node/69dcf6b53c1e37dfe2f8c98f HTTP/1.0" 202 Accepted 2026-04-15 13:59:37,643 - lava_callback - INFO - Starting async job submit for node 69dcf6b53c1e37dfe2f8c98f 2026-04-15 13:59:37,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:59:37,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf6b53c1e37dfe2f8c98f HTTP/1.1" 200 None 2026-04-15 13:59:37,659 - lava_callback - DEBUG - Processing node 69dcf6b53c1e37dfe2f8c98f: baseline-arm64-baylibre 2026-04-15 13:59:37,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf6b53c1e37dfe2f8c98f 2026-04-15 13:59:37,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:59:37,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf6b53c1e37dfe2f8c98f HTTP/1.1" 200 None 2026-04-15 13:59:37,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:59:37,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 13:59:37,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 13:59:37,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf6b53c1e37dfe2f8c98f HTTP/1.1" 200 None 2026-04-15 13:59:37,719 - lava_callback - ERROR - Error processing callback for node 69dcf6b53c1e37dfe2f8c98f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40866 - "GET / HTTP/1.0" 200 OK 2026-04-15 14:00:41,116 - lava_callback - INFO - Received callback for node 69dcf7043c1e37dfe2f8c9dc INFO: 172.20.0.1:42654 - "POST /node/69dcf7043c1e37dfe2f8c9dc HTTP/1.0" 202 Accepted 2026-04-15 14:00:41,122 - lava_callback - INFO - Starting async job submit for node 69dcf7043c1e37dfe2f8c9dc 2026-04-15 14:00:41,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:00:41,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf7043c1e37dfe2f8c9dc HTTP/1.1" 200 None 2026-04-15 14:00:41,141 - lava_callback - DEBUG - Processing node 69dcf7043c1e37dfe2f8c9dc: baseline-arm64-clabbe 2026-04-15 14:00:41,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf7043c1e37dfe2f8c9dc 2026-04-15 14:00:41,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:00:41,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf7043c1e37dfe2f8c9dc HTTP/1.1" 200 None 2026-04-15 14:00:41,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:00:41,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 14:00:41,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:00:41,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf7043c1e37dfe2f8c9dc HTTP/1.1" 200 None 2026-04-15 14:00:41,192 - lava_callback - ERROR - Error processing callback for node 69dcf7043c1e37dfe2f8c9dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33668 - "GET / HTTP/1.0" 200 OK 2026-04-15 14:02:01,144 - lava_callback - INFO - Received callback for node 69dcf74e3c1e37dfe2f8ca15 INFO: 172.20.0.1:37588 - "POST /node/69dcf74e3c1e37dfe2f8ca15 HTTP/1.0" 202 Accepted 2026-04-15 14:02:01,150 - lava_callback - INFO - Starting async job submit for node 69dcf74e3c1e37dfe2f8ca15 2026-04-15 14:02:01,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:02:01,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf74e3c1e37dfe2f8ca15 HTTP/1.1" 200 None 2026-04-15 14:02:01,166 - lava_callback - DEBUG - Processing node 69dcf74e3c1e37dfe2f8ca15: baseline-arm64-clabbe 2026-04-15 14:02:01,166 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf74e3c1e37dfe2f8ca15 2026-04-15 14:02:01,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:02:01,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf74e3c1e37dfe2f8ca15 HTTP/1.1" 200 None 2026-04-15 14:02:01,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:02:01,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 14:02:01,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:02:01,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf74e3c1e37dfe2f8ca15 HTTP/1.1" 200 None 2026-04-15 14:02:01,230 - lava_callback - ERROR - Error processing callback for node 69dcf74e3c1e37dfe2f8ca15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50768 - "GET / HTTP/1.0" 200 OK 2026-04-15 14:03:21,148 - lava_callback - INFO - Received callback for node 69dcf7973c1e37dfe2f8ca63 INFO: 172.20.0.1:38686 - "POST /node/69dcf7973c1e37dfe2f8ca63 HTTP/1.0" 202 Accepted 2026-04-15 14:03:21,153 - lava_callback - INFO - Starting async job submit for node 69dcf7973c1e37dfe2f8ca63 2026-04-15 14:03:21,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:03:21,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf7973c1e37dfe2f8ca63 HTTP/1.1" 200 None 2026-04-15 14:03:21,181 - lava_callback - DEBUG - Processing node 69dcf7973c1e37dfe2f8ca63: baseline-arm64-clabbe 2026-04-15 14:03:21,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf7973c1e37dfe2f8ca63 2026-04-15 14:03:21,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:03:21,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf7973c1e37dfe2f8ca63 HTTP/1.1" 200 None 2026-04-15 14:03:21,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:03:21,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 14:03:21,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:03:21,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf7973c1e37dfe2f8ca63 HTTP/1.1" 200 None 2026-04-15 14:03:21,234 - lava_callback - ERROR - Error processing callback for node 69dcf7973c1e37dfe2f8ca63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41388 - "GET / HTTP/1.0" 200 OK 2026-04-15 14:04:21,205 - lava_callback - INFO - Received callback for node 69dcf7dd3c1e37dfe2f8caa7 INFO: 172.20.0.1:43688 - "POST /node/69dcf7dd3c1e37dfe2f8caa7 HTTP/1.0" 202 Accepted 2026-04-15 14:04:21,211 - lava_callback - INFO - Starting async job submit for node 69dcf7dd3c1e37dfe2f8caa7 2026-04-15 14:04:21,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:04:21,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf7dd3c1e37dfe2f8caa7 HTTP/1.1" 200 None 2026-04-15 14:04:21,226 - lava_callback - DEBUG - Processing node 69dcf7dd3c1e37dfe2f8caa7: baseline-arm64-clabbe 2026-04-15 14:04:21,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf7dd3c1e37dfe2f8caa7 2026-04-15 14:04:21,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:04:21,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf7dd3c1e37dfe2f8caa7 HTTP/1.1" 200 None 2026-04-15 14:04:21,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:04:21,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 14:04:21,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:04:21,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf7dd3c1e37dfe2f8caa7 HTTP/1.1" 200 None 2026-04-15 14:04:21,289 - lava_callback - ERROR - Error processing callback for node 69dcf7dd3c1e37dfe2f8caa7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38600 - "GET / HTTP/1.0" 200 OK 2026-04-15 14:05:41,301 - lava_callback - INFO - Received callback for node 69dcf8243c1e37dfe2f8cade INFO: 172.20.0.1:33718 - "POST /node/69dcf8243c1e37dfe2f8cade HTTP/1.0" 202 Accepted 2026-04-15 14:05:41,306 - lava_callback - INFO - Starting async job submit for node 69dcf8243c1e37dfe2f8cade 2026-04-15 14:05:41,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:05:41,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf8243c1e37dfe2f8cade HTTP/1.1" 200 None 2026-04-15 14:05:41,321 - lava_callback - DEBUG - Processing node 69dcf8243c1e37dfe2f8cade: baseline-arm64-clabbe 2026-04-15 14:05:41,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf8243c1e37dfe2f8cade 2026-04-15 14:05:41,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:05:41,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf8243c1e37dfe2f8cade HTTP/1.1" 200 None 2026-04-15 14:05:41,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:05:41,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 14:05:41,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:05:41,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf8243c1e37dfe2f8cade HTTP/1.1" 200 None 2026-04-15 14:05:41,384 - lava_callback - ERROR - Error processing callback for node 69dcf8243c1e37dfe2f8cade: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40334 - "GET / HTTP/1.0" 200 OK 2026-04-15 14:06:41,288 - lava_callback - INFO - Received callback for node 69dcf86d3c1e37dfe2f8cb37 INFO: 172.20.0.1:38456 - "POST /node/69dcf86d3c1e37dfe2f8cb37 HTTP/1.0" 202 Accepted 2026-04-15 14:06:41,293 - lava_callback - INFO - Starting async job submit for node 69dcf86d3c1e37dfe2f8cb37 2026-04-15 14:06:41,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:06:41,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf86d3c1e37dfe2f8cb37 HTTP/1.1" 200 None 2026-04-15 14:06:41,309 - lava_callback - DEBUG - Processing node 69dcf86d3c1e37dfe2f8cb37: baseline-arm64-clabbe 2026-04-15 14:06:41,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf86d3c1e37dfe2f8cb37 2026-04-15 14:06:41,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:06:41,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf86d3c1e37dfe2f8cb37 HTTP/1.1" 200 None 2026-04-15 14:06:41,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:06:41,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 14:06:41,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:06:41,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf86d3c1e37dfe2f8cb37 HTTP/1.1" 200 None 2026-04-15 14:06:41,357 - lava_callback - ERROR - Error processing callback for node 69dcf86d3c1e37dfe2f8cb37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34758 - "GET / HTTP/1.0" 200 OK 2026-04-15 14:08:01,377 - lava_callback - INFO - Received callback for node 69dcf8b93c1e37dfe2f8cb74 INFO: 172.20.0.1:42868 - "POST /node/69dcf8b93c1e37dfe2f8cb74 HTTP/1.0" 202 Accepted 2026-04-15 14:08:01,383 - lava_callback - INFO - Starting async job submit for node 69dcf8b93c1e37dfe2f8cb74 2026-04-15 14:08:01,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:08:01,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf8b93c1e37dfe2f8cb74 HTTP/1.1" 200 None 2026-04-15 14:08:01,398 - lava_callback - DEBUG - Processing node 69dcf8b93c1e37dfe2f8cb74: baseline-arm64-clabbe 2026-04-15 14:08:01,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf8b93c1e37dfe2f8cb74 2026-04-15 14:08:01,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:08:01,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf8b93c1e37dfe2f8cb74 HTTP/1.1" 200 None 2026-04-15 14:08:01,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:08:01,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 14:08:01,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:08:01,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf8b93c1e37dfe2f8cb74 HTTP/1.1" 200 None 2026-04-15 14:08:01,450 - lava_callback - ERROR - Error processing callback for node 69dcf8b93c1e37dfe2f8cb74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44296 - "GET / HTTP/1.0" 200 OK 2026-04-15 14:09:21,390 - lava_callback - INFO - Received callback for node 69dcf9083c1e37dfe2f8cbab INFO: 172.20.0.1:33828 - "POST /node/69dcf9083c1e37dfe2f8cbab HTTP/1.0" 202 Accepted 2026-04-15 14:09:21,396 - lava_callback - INFO - Starting async job submit for node 69dcf9083c1e37dfe2f8cbab 2026-04-15 14:09:21,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:09:21,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf9083c1e37dfe2f8cbab HTTP/1.1" 200 None 2026-04-15 14:09:21,424 - lava_callback - DEBUG - Processing node 69dcf9083c1e37dfe2f8cbab: baseline-arm64-clabbe 2026-04-15 14:09:21,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf9083c1e37dfe2f8cbab 2026-04-15 14:09:21,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:09:21,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf9083c1e37dfe2f8cbab HTTP/1.1" 200 None 2026-04-15 14:09:21,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:09:21,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 14:09:21,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:09:21,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf9083c1e37dfe2f8cbab HTTP/1.1" 200 None 2026-04-15 14:09:21,471 - lava_callback - ERROR - Error processing callback for node 69dcf9083c1e37dfe2f8cbab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49918 - "GET / HTTP/1.0" 200 OK 2026-04-15 14:10:41,474 - lava_callback - INFO - Received callback for node 69dcf9523c1e37dfe2f8cbfa INFO: 172.20.0.1:57028 - "POST /node/69dcf9523c1e37dfe2f8cbfa HTTP/1.0" 202 Accepted 2026-04-15 14:10:41,479 - lava_callback - INFO - Starting async job submit for node 69dcf9523c1e37dfe2f8cbfa 2026-04-15 14:10:41,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:10:41,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf9523c1e37dfe2f8cbfa HTTP/1.1" 200 None 2026-04-15 14:10:41,496 - lava_callback - DEBUG - Processing node 69dcf9523c1e37dfe2f8cbfa: baseline-arm64-clabbe 2026-04-15 14:10:41,497 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf9523c1e37dfe2f8cbfa 2026-04-15 14:10:41,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:10:41,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf9523c1e37dfe2f8cbfa HTTP/1.1" 200 None 2026-04-15 14:10:41,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:10:41,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 14:10:41,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:10:41,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf9523c1e37dfe2f8cbfa HTTP/1.1" 200 None 2026-04-15 14:10:41,558 - lava_callback - ERROR - Error processing callback for node 69dcf9523c1e37dfe2f8cbfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43812 - "GET / HTTP/1.0" 200 OK 2026-04-15 14:12:01,559 - lava_callback - INFO - Received callback for node 69dcf99e3c1e37dfe2f8cc37 INFO: 172.20.0.1:36258 - "POST /node/69dcf99e3c1e37dfe2f8cc37 HTTP/1.0" 202 Accepted 2026-04-15 14:12:01,565 - lava_callback - INFO - Starting async job submit for node 69dcf99e3c1e37dfe2f8cc37 2026-04-15 14:12:01,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:12:01,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf99e3c1e37dfe2f8cc37 HTTP/1.1" 200 None 2026-04-15 14:12:01,603 - lava_callback - DEBUG - Processing node 69dcf99e3c1e37dfe2f8cc37: baseline-arm64-clabbe 2026-04-15 14:12:01,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf99e3c1e37dfe2f8cc37 2026-04-15 14:12:01,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:12:01,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf99e3c1e37dfe2f8cc37 HTTP/1.1" 200 None 2026-04-15 14:12:01,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:12:01,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 14:12:01,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:12:01,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf99e3c1e37dfe2f8cc37 HTTP/1.1" 200 None 2026-04-15 14:12:01,651 - lava_callback - ERROR - Error processing callback for node 69dcf99e3c1e37dfe2f8cc37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36068 - "GET / HTTP/1.0" 200 OK 2026-04-15 14:13:01,579 - lava_callback - INFO - Received callback for node 69dcf9e83c1e37dfe2f8cc71 INFO: 172.20.0.1:36762 - "POST /node/69dcf9e83c1e37dfe2f8cc71 HTTP/1.0" 202 Accepted 2026-04-15 14:13:01,585 - lava_callback - INFO - Starting async job submit for node 69dcf9e83c1e37dfe2f8cc71 2026-04-15 14:13:01,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:13:01,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf9e83c1e37dfe2f8cc71 HTTP/1.1" 200 None 2026-04-15 14:13:01,602 - lava_callback - DEBUG - Processing node 69dcf9e83c1e37dfe2f8cc71: baseline-arm64-clabbe 2026-04-15 14:13:01,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcf9e83c1e37dfe2f8cc71 2026-04-15 14:13:01,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:13:01,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcf9e83c1e37dfe2f8cc71 HTTP/1.1" 200 None 2026-04-15 14:13:01,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:13:01,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 14:13:01,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:13:01,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcf9e83c1e37dfe2f8cc71 HTTP/1.1" 200 None 2026-04-15 14:13:01,655 - lava_callback - ERROR - Error processing callback for node 69dcf9e83c1e37dfe2f8cc71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48570 - "GET / HTTP/1.0" 200 OK 2026-04-15 14:14:21,706 - lava_callback - INFO - Received callback for node 69dcfa2c3c1e37dfe2f8ccc4 INFO: 172.20.0.1:33622 - "POST /node/69dcfa2c3c1e37dfe2f8ccc4 HTTP/1.0" 202 Accepted 2026-04-15 14:14:21,711 - lava_callback - INFO - Starting async job submit for node 69dcfa2c3c1e37dfe2f8ccc4 2026-04-15 14:14:21,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:14:21,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcfa2c3c1e37dfe2f8ccc4 HTTP/1.1" 200 None 2026-04-15 14:14:21,737 - lava_callback - DEBUG - Processing node 69dcfa2c3c1e37dfe2f8ccc4: baseline-arm64-clabbe 2026-04-15 14:14:21,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcfa2c3c1e37dfe2f8ccc4 2026-04-15 14:14:21,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:14:21,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcfa2c3c1e37dfe2f8ccc4 HTTP/1.1" 200 None 2026-04-15 14:14:21,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:14:21,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 14:14:21,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:14:21,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcfa2c3c1e37dfe2f8ccc4 HTTP/1.1" 200 None 2026-04-15 14:14:21,785 - lava_callback - ERROR - Error processing callback for node 69dcfa2c3c1e37dfe2f8ccc4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53546 - "GET / HTTP/1.0" 200 OK 2026-04-15 14:15:21,703 - lava_callback - INFO - Received callback for node 69dcfa6c3c1e37dfe2f8cd32 INFO: 172.20.0.1:49128 - "POST /node/69dcfa6c3c1e37dfe2f8cd32 HTTP/1.0" 202 Accepted 2026-04-15 14:15:21,708 - lava_callback - INFO - Starting async job submit for node 69dcfa6c3c1e37dfe2f8cd32 2026-04-15 14:15:21,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:15:21,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcfa6c3c1e37dfe2f8cd32 HTTP/1.1" 200 None 2026-04-15 14:15:21,734 - lava_callback - DEBUG - Processing node 69dcfa6c3c1e37dfe2f8cd32: baseline-arm64-clabbe 2026-04-15 14:15:21,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dcfa6c3c1e37dfe2f8cd32 2026-04-15 14:15:21,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:15:21,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dcfa6c3c1e37dfe2f8cd32 HTTP/1.1" 200 None 2026-04-15 14:15:21,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:15:21,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d9930d7e2a38af1be88a6f HTTP/1.1" 200 None 2026-04-15 14:15:21,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-15 14:15:21,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dcfa6c3c1e37dfe2f8cd32 HTTP/1.1" 200 None 2026-04-15 14:15:21,784 - lava_callback - ERROR - Error processing callback for node 69dcfa6c3c1e37dfe2f8cd32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40444 - "GET /node/699397c9cebe99dd8e074a26%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36578 - "GET /node/69c640c7b98d4d3c0206847a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]