INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54324 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:16:39,394 - lava_callback - INFO - Received callback for node 69fe19c5e4d4e78cd76b0dea 2026-05-09 08:16:39,401 - lava_callback - INFO - Starting async job submit for node 69fe19c5e4d4e78cd76b0dea INFO: 172.21.0.1:54344 - "POST /node/69fe19c5e4d4e78cd76b0dea HTTP/1.0" 202 Accepted 2026-05-09 08:16:39,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:16:39,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19c5e4d4e78cd76b0dea HTTP/1.1" 200 None 2026-05-09 08:16:39,444 - lava_callback - DEBUG - Processing node 69fe19c5e4d4e78cd76b0dea: baseline-arm64-broonie 2026-05-09 08:16:39,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:16:39,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:16:39,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19c5e4d4e78cd76b0dea/log.txt.gz 2026-05-09 08:16:39,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:16:40,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:16:40,099 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19c5e4d4e78cd76b0dea/lava-logs.yaml 2026-05-09 08:16:40,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:16:40,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:16:40,225 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe19c5e4d4e78cd76b0dea/lava_callback.json.gz 2026-05-09 08:16:40,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:16:40,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19c5e4d4e78cd76b0dea HTTP/1.1" 200 None 2026-05-09 08:16:40,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:16:40,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 08:16:40,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:16:40,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19c5e4d4e78cd76b0dea HTTP/1.1" 200 None 2026-05-09 08:16:40,412 - lava_callback - INFO - Completed processing callback for node 69fe19c5e4d4e78cd76b0dea INFO: 172.21.0.1:43902 - "GET /login HTTP/1.0" 404 Not Found INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59500 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:16:59,668 - lava_callback - INFO - Received callback for node 69fe5080e4d4e78cd76b24c1 INFO: 172.21.0.1:59506 - "POST /node/69fe5080e4d4e78cd76b24c1 HTTP/1.0" 202 Accepted 2026-05-09 08:16:59,674 - lava_callback - INFO - Starting async job submit for node 69fe5080e4d4e78cd76b24c1 2026-05-09 08:16:59,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:16:59,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5080e4d4e78cd76b24c1 HTTP/1.1" 200 None 2026-05-09 08:16:59,712 - lava_callback - DEBUG - Processing node 69fe5080e4d4e78cd76b24c1: baseline-arm64-broonie 2026-05-09 08:16:59,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:17:00,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:17:00,029 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe5080e4d4e78cd76b24c1/log.txt.gz 2026-05-09 08:17:00,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:17:00,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:17:00,321 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe5080e4d4e78cd76b24c1/lava-logs.yaml 2026-05-09 08:17:00,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:17:00,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:17:00,434 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe5080e4d4e78cd76b24c1/lava_callback.json.gz 2026-05-09 08:17:00,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:17:00,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe5080e4d4e78cd76b24c1 HTTP/1.1" 200 None 2026-05-09 08:17:00,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:17:00,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-09 08:17:00,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:17:00,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe5080e4d4e78cd76b24c1 HTTP/1.1" 200 None 2026-05-09 08:17:00,506 - lava_callback - INFO - Completed processing callback for node 69fe5080e4d4e78cd76b24c1 INFO: 172.21.0.1:47400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:17:10,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:17:10,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47414 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:19:19,874 - lava_callback - INFO - Received callback for node 69fe722ee4d4e78cd76b32b1 INFO: 172.21.0.1:40074 - "POST /node/69fe722ee4d4e78cd76b32b1 HTTP/1.0" 202 Accepted 2026-05-09 08:19:19,881 - lava_callback - INFO - Starting async job submit for node 69fe722ee4d4e78cd76b32b1 2026-05-09 08:19:19,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:19:19,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe722ee4d4e78cd76b32b1 HTTP/1.1" 200 None 2026-05-09 08:19:19,924 - lava_callback - DEBUG - Processing node 69fe722ee4d4e78cd76b32b1: baseline-arm64-broonie 2026-05-09 08:19:20,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:19:20,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:19:20,311 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe722ee4d4e78cd76b32b1/log.txt.gz 2026-05-09 08:19:20,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:19:20,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:19:20,764 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe722ee4d4e78cd76b32b1/lava-logs.yaml 2026-05-09 08:19:20,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:19:21,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:19:21,051 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe722ee4d4e78cd76b32b1/lava_callback.json.gz 2026-05-09 08:19:21,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:19:21,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe722ee4d4e78cd76b32b1 HTTP/1.1" 200 None 2026-05-09 08:19:21,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:19:21,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 08:19:21,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:19:21,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe722ee4d4e78cd76b32b1 HTTP/1.1" 200 None 2026-05-09 08:19:21,127 - lava_callback - INFO - Completed processing callback for node 69fe722ee4d4e78cd76b32b1 2026-05-09 08:19:21,489 - lava_callback - INFO - Received callback for node 69fe8483ef513bcf3f028702 INFO: 172.21.0.1:40086 - "POST /node/69fe8483ef513bcf3f028702 HTTP/1.0" 202 Accepted 2026-05-09 08:19:21,495 - lava_callback - INFO - Starting async job submit for node 69fe8483ef513bcf3f028702 2026-05-09 08:19:21,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:19:21,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe8483ef513bcf3f028702 HTTP/1.1" 200 None 2026-05-09 08:19:21,534 - lava_callback - DEBUG - Processing node 69fe8483ef513bcf3f028702: baseline-arm64-broonie 2026-05-09 08:19:21,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:19:21,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:19:21,824 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe8483ef513bcf3f028702/log.txt.gz 2026-05-09 08:19:21,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:19:22,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:19:22,114 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe8483ef513bcf3f028702/lava-logs.yaml 2026-05-09 08:19:22,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:19:22,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:19:22,217 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fe8483ef513bcf3f028702/lava_callback.json.gz 2026-05-09 08:19:22,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:19:22,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe8483ef513bcf3f028702 HTTP/1.1" 200 None 2026-05-09 08:19:22,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:19:22,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-09 08:19:22,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:19:22,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe8483ef513bcf3f028702 HTTP/1.1" 200 None 2026-05-09 08:19:22,314 - lava_callback - INFO - Completed processing callback for node 69fe8483ef513bcf3f028702 INFO: 172.21.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:19:40,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:19:40,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44068 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:21:39,590 - lava_callback - INFO - Received callback for node 69fea527ef513bcf3f02bec3 INFO: 172.21.0.1:44072 - "POST /node/69fea527ef513bcf3f02bec3 HTTP/1.0" 202 Accepted 2026-05-09 08:21:39,596 - lava_callback - INFO - Starting async job submit for node 69fea527ef513bcf3f02bec3 2026-05-09 08:21:39,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:21:39,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fea527ef513bcf3f02bec3 HTTP/1.1" 200 None 2026-05-09 08:21:39,632 - lava_callback - DEBUG - Processing node 69fea527ef513bcf3f02bec3: baseline-arm64-broonie 2026-05-09 08:21:39,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:21:40,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:21:40,159 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fea527ef513bcf3f02bec3/log.txt.gz 2026-05-09 08:21:40,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:21:40,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:21:40,602 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fea527ef513bcf3f02bec3/lava-logs.yaml 2026-05-09 08:21:40,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:21:40,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:21:40,726 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fea527ef513bcf3f02bec3/lava_callback.json.gz 2026-05-09 08:21:40,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:21:40,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fea527ef513bcf3f02bec3 HTTP/1.1" 200 None 2026-05-09 08:21:40,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:21:40,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-09 08:21:40,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:21:40,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fea527ef513bcf3f02bec3 HTTP/1.1" 200 None 2026-05-09 08:21:40,807 - lava_callback - INFO - Completed processing callback for node 69fea527ef513bcf3f02bec3 INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:21:59,818 - lava_callback - INFO - Received callback for node 69fec6b7ef513bcf3f02c6cc INFO: 172.21.0.1:33804 - "POST /node/69fec6b7ef513bcf3f02c6cc HTTP/1.0" 202 Accepted 2026-05-09 08:21:59,823 - lava_callback - INFO - Starting async job submit for node 69fec6b7ef513bcf3f02c6cc 2026-05-09 08:21:59,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:21:59,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fec6b7ef513bcf3f02c6cc HTTP/1.1" 200 None 2026-05-09 08:21:59,860 - lava_callback - DEBUG - Processing node 69fec6b7ef513bcf3f02c6cc: baseline-arm64-broonie 2026-05-09 08:22:00,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:22:00,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:22:00,148 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fec6b7ef513bcf3f02c6cc/log.txt.gz 2026-05-09 08:22:00,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:22:00,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:22:00,416 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fec6b7ef513bcf3f02c6cc/lava-logs.yaml 2026-05-09 08:22:00,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:22:00,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:22:00,523 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fec6b7ef513bcf3f02c6cc/lava_callback.json.gz 2026-05-09 08:22:00,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:22:00,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fec6b7ef513bcf3f02c6cc HTTP/1.1" 200 None 2026-05-09 08:22:00,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:22:00,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 08:22:00,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:22:00,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fec6b7ef513bcf3f02c6cc HTTP/1.1" 200 None 2026-05-09 08:22:00,594 - lava_callback - INFO - Completed processing callback for node 69fec6b7ef513bcf3f02c6cc INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:22:10,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:22:10,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:24:20,022 - lava_callback - INFO - Received callback for node 69fedef5ef513bcf3f02cceb INFO: 172.21.0.1:35468 - "POST /node/69fedef5ef513bcf3f02cceb HTTP/1.0" 202 Accepted 2026-05-09 08:24:20,029 - lava_callback - INFO - Starting async job submit for node 69fedef5ef513bcf3f02cceb 2026-05-09 08:24:20,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:24:20,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fedef5ef513bcf3f02cceb HTTP/1.1" 200 None 2026-05-09 08:24:20,081 - lava_callback - DEBUG - Processing node 69fedef5ef513bcf3f02cceb: baseline-arm64-broonie 2026-05-09 08:24:20,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:24:20,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:24:20,449 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fedef5ef513bcf3f02cceb/log.txt.gz 2026-05-09 08:24:20,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:24:20,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:24:20,803 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fedef5ef513bcf3f02cceb/lava-logs.yaml 2026-05-09 08:24:20,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:24:20,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:24:20,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fedef5ef513bcf3f02cceb/lava_callback.json.gz 2026-05-09 08:24:20,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:24:20,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fedef5ef513bcf3f02cceb HTTP/1.1" 200 None 2026-05-09 08:24:20,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:24:21,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-09 08:24:21,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:24:21,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fedef5ef513bcf3f02cceb HTTP/1.1" 200 None 2026-05-09 08:24:21,029 - lava_callback - INFO - Completed processing callback for node 69fedef5ef513bcf3f02cceb INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:24:40,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:24:40,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:35:20,832 - lava_callback - INFO - Received callback for node 69fef14f254d3291e98def86 INFO: 172.21.0.1:48096 - "POST /node/69fef14f254d3291e98def86 HTTP/1.0" 202 Accepted 2026-05-09 08:35:20,839 - lava_callback - INFO - Starting async job submit for node 69fef14f254d3291e98def86 2026-05-09 08:35:20,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:35:20,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef14f254d3291e98def86 HTTP/1.1" 200 None 2026-05-09 08:35:20,882 - lava_callback - DEBUG - Processing node 69fef14f254d3291e98def86: baseline-arm 2026-05-09 08:35:21,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:35:21,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:35:21,224 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fef14f254d3291e98def86/log.txt.gz 2026-05-09 08:35:21,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:35:21,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:35:21,482 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fef14f254d3291e98def86/lava-logs.yaml 2026-05-09 08:35:21,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:35:21,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:35:21,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fef14f254d3291e98def86/lava_callback.json.gz 2026-05-09 08:35:21,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:35:21,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef14f254d3291e98def86 HTTP/1.1" 200 None 2026-05-09 08:35:21,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:35:21,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feeddd254d3291e98de968 HTTP/1.1" 200 None 2026-05-09 08:35:21,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:35:21,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef14f254d3291e98def86 HTTP/1.1" 200 None 2026-05-09 08:35:21,716 - lava_callback - INFO - Completed processing callback for node 69fef14f254d3291e98def86 INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:35:30,795 - lava_callback - INFO - Received callback for node 69fef1ad254d3291e98def94 INFO: 172.21.0.1:52572 - "POST /node/69fef1ad254d3291e98def94 HTTP/1.0" 202 Accepted 2026-05-09 08:35:30,803 - lava_callback - INFO - Starting async job submit for node 69fef1ad254d3291e98def94 2026-05-09 08:35:30,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:35:30,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef1ad254d3291e98def94 HTTP/1.1" 200 None 2026-05-09 08:35:30,840 - lava_callback - DEBUG - Processing node 69fef1ad254d3291e98def94: baseline-x86 2026-05-09 08:35:31,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:35:31,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:35:31,132 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fef1ad254d3291e98def94/log.txt.gz 2026-05-09 08:35:31,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:35:31,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:35:31,421 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fef1ad254d3291e98def94/lava-logs.yaml 2026-05-09 08:35:31,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:35:31,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:35:31,580 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fef1ad254d3291e98def94/lava_callback.json.gz 2026-05-09 08:35:31,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:35:31,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef1ad254d3291e98def94 HTTP/1.1" 200 None 2026-05-09 08:35:31,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:35:31,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedfb254d3291e98de990 HTTP/1.1" 200 None 2026-05-09 08:35:31,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:35:31,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef1ad254d3291e98def94 HTTP/1.1" 200 None 2026-05-09 08:35:31,659 - lava_callback - INFO - Completed processing callback for node 69fef1ad254d3291e98def94 INFO: 172.21.0.1:52582 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:35:37,059 - lava_callback - INFO - Received callback for node 69fef1af254d3291e98def9d INFO: 172.21.0.1:52588 - "POST /node/69fef1af254d3291e98def9d HTTP/1.0" 202 Accepted 2026-05-09 08:35:37,065 - lava_callback - INFO - Starting async job submit for node 69fef1af254d3291e98def9d 2026-05-09 08:35:37,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:35:37,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef1af254d3291e98def9d HTTP/1.1" 200 None 2026-05-09 08:35:37,098 - lava_callback - DEBUG - Processing node 69fef1af254d3291e98def9d: baseline-x86 2026-05-09 08:35:37,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:35:37,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:35:37,423 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fef1af254d3291e98def9d/log.txt.gz 2026-05-09 08:35:37,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:35:37,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:35:37,707 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fef1af254d3291e98def9d/lava-logs.yaml 2026-05-09 08:35:37,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:35:37,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:35:37,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fef1af254d3291e98def9d/lava_callback.json.gz 2026-05-09 08:35:37,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:35:37,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef1af254d3291e98def9d HTTP/1.1" 200 None 2026-05-09 08:35:37,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:35:37,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedfb254d3291e98de990 HTTP/1.1" 200 None 2026-05-09 08:35:37,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:35:37,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef1af254d3291e98def9d HTTP/1.1" 200 None 2026-05-09 08:35:37,911 - lava_callback - INFO - Completed processing callback for node 69fef1af254d3291e98def9d 2026-05-09 08:35:40,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:35:40,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47692 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:36:21,310 - lava_callback - INFO - Received callback for node 69fef1ad254d3291e98def97 INFO: 172.21.0.1:44424 - "POST /node/69fef1ad254d3291e98def97 HTTP/1.0" 202 Accepted 2026-05-09 08:36:21,316 - lava_callback - INFO - Starting async job submit for node 69fef1ad254d3291e98def97 2026-05-09 08:36:21,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:36:21,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef1ad254d3291e98def97 HTTP/1.1" 200 None 2026-05-09 08:36:21,358 - lava_callback - DEBUG - Processing node 69fef1ad254d3291e98def97: baseline-x86 2026-05-09 08:36:21,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:36:21,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:36:21,736 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fef1ad254d3291e98def97/log.txt.gz 2026-05-09 08:36:21,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:36:22,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:36:22,093 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fef1ad254d3291e98def97/lava-logs.yaml 2026-05-09 08:36:22,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:36:22,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:36:22,228 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fef1ad254d3291e98def97/lava_callback.json.gz 2026-05-09 08:36:22,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:36:22,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef1ad254d3291e98def97 HTTP/1.1" 200 None 2026-05-09 08:36:22,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:36:22,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedfb254d3291e98de990 HTTP/1.1" 200 None 2026-05-09 08:36:22,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:36:22,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef1ad254d3291e98def97 HTTP/1.1" 200 None 2026-05-09 08:36:22,318 - lava_callback - INFO - Completed processing callback for node 69fef1ad254d3291e98def97 INFO: 172.21.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:36:40,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:36:40,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:38:13,313 - lava_callback - INFO - Received callback for node 69fc4f6f55ff273b190b9647 INFO: 172.21.0.1:34530 - "POST /node/69fc4f6f55ff273b190b9647 HTTP/1.0" 202 Accepted 2026-05-09 08:38:13,320 - lava_callback - INFO - Starting async job submit for node 69fc4f6f55ff273b190b9647 2026-05-09 08:38:13,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:13,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f6f55ff273b190b9647 HTTP/1.1" 200 None 2026-05-09 08:38:13,350 - lava_callback - DEBUG - Processing node 69fc4f6f55ff273b190b9647: baseline-arm-clabbe 2026-05-09 08:38:13,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4f6f55ff273b190b9647 2026-05-09 08:38:13,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:13,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f6f55ff273b190b9647 HTTP/1.1" 200 None 2026-05-09 08:38:13,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:13,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 08:38:13,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:13,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4f6f55ff273b190b9647 HTTP/1.1" 200 None 2026-05-09 08:38:13,418 - lava_callback - ERROR - Error processing callback for node 69fc4f6f55ff273b190b9647: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:38:38,267 - lava_callback - INFO - Received callback for node 69fef280254d3291e98df010 INFO: 172.21.0.1:49592 - "POST /node/69fef280254d3291e98df010 HTTP/1.0" 202 Accepted 2026-05-09 08:38:38,273 - lava_callback - INFO - Starting async job submit for node 69fef280254d3291e98df010 2026-05-09 08:38:38,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:38,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef280254d3291e98df010 HTTP/1.1" 200 None 2026-05-09 08:38:38,291 - lava_callback - DEBUG - Processing node 69fef280254d3291e98df010: baseline-arm 2026-05-09 08:38:38,296 - lava_callback - WARNING - Failed to upload log 2026-05-09 08:38:38,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:38:38,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:38:38,383 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fef280254d3291e98df010/lava-logs.yaml 2026-05-09 08:38:38,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:38:38,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:38:38,488 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fef280254d3291e98df010/lava_callback.json.gz 2026-05-09 08:38:38,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:38,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef280254d3291e98df010 HTTP/1.1" 200 None 2026-05-09 08:38:38,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:38,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:38:38,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:38,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef280254d3291e98df010 HTTP/1.1" 200 None 2026-05-09 08:38:38,571 - lava_callback - INFO - Completed processing callback for node 69fef280254d3291e98df010 2026-05-09 08:38:40,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:40,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40824 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:38:53,407 - lava_callback - INFO - Received callback for node 69fc4f9655ff273b190b966b INFO: 172.21.0.1:52474 - "POST /node/69fc4f9655ff273b190b966b HTTP/1.0" 202 Accepted 2026-05-09 08:38:53,416 - lava_callback - INFO - Starting async job submit for node 69fc4f9655ff273b190b966b 2026-05-09 08:38:53,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:53,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9655ff273b190b966b HTTP/1.1" 200 None 2026-05-09 08:38:53,435 - lava_callback - DEBUG - Processing node 69fc4f9655ff273b190b966b: baseline-arm-clabbe 2026-05-09 08:38:53,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4f9655ff273b190b966b 2026-05-09 08:38:53,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:53,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9655ff273b190b966b HTTP/1.1" 200 None 2026-05-09 08:38:53,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:53,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 08:38:53,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:53,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4f9655ff273b190b966b HTTP/1.1" 200 None 2026-05-09 08:38:53,494 - lava_callback - ERROR - Error processing callback for node 69fc4f9655ff273b190b966b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 08:38:55,329 - lava_callback - INFO - Received callback for node 69fef285254d3291e98df013 INFO: 172.21.0.1:52484 - "POST /node/69fef285254d3291e98df013 HTTP/1.0" 202 Accepted 2026-05-09 08:38:55,377 - lava_callback - INFO - Starting async job submit for node 69fef285254d3291e98df013 2026-05-09 08:38:55,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:55,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef285254d3291e98df013 HTTP/1.1" 200 None 2026-05-09 08:38:55,427 - lava_callback - DEBUG - Processing node 69fef285254d3291e98df013: baseline-arm 2026-05-09 08:38:55,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:38:55,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:38:55,743 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fef285254d3291e98df013/log.txt.gz 2026-05-09 08:38:55,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:38:55,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:38:55,971 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fef285254d3291e98df013/lava-logs.yaml 2026-05-09 08:38:55,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:38:56,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:38:56,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fef285254d3291e98df013/lava_callback.json.gz 2026-05-09 08:38:56,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:56,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef285254d3291e98df013 HTTP/1.1" 200 None 2026-05-09 08:38:56,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:56,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:38:56,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:38:56,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef285254d3291e98df013 HTTP/1.1" 200 None 2026-05-09 08:38:56,168 - lava_callback - INFO - Completed processing callback for node 69fef285254d3291e98df013 INFO: 172.21.0.1:52490 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:39:04,270 - lava_callback - INFO - Received callback for node 69fc4f9855ff273b190b9672 INFO: 172.21.0.1:55296 - "POST /node/69fc4f9855ff273b190b9672 HTTP/1.0" 202 Accepted 2026-05-09 08:39:04,279 - lava_callback - INFO - Starting async job submit for node 69fc4f9855ff273b190b9672 2026-05-09 08:39:04,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:04,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9855ff273b190b9672 HTTP/1.1" 200 None 2026-05-09 08:39:04,303 - lava_callback - DEBUG - Processing node 69fc4f9855ff273b190b9672: baseline-arm-baylibre 2026-05-09 08:39:04,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4f9855ff273b190b9672 2026-05-09 08:39:04,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:04,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9855ff273b190b9672 HTTP/1.1" 200 None 2026-05-09 08:39:04,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:04,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 08:39:04,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:04,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4f9855ff273b190b9672 HTTP/1.1" 200 None 2026-05-09 08:39:04,373 - lava_callback - ERROR - Error processing callback for node 69fc4f9855ff273b190b9672: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 08:39:04,978 - lava_callback - INFO - Received callback for node 69fc4f9955ff273b190b9675 INFO: 172.21.0.1:55300 - "POST /node/69fc4f9955ff273b190b9675 HTTP/1.0" 202 Accepted 2026-05-09 08:39:04,984 - lava_callback - INFO - Starting async job submit for node 69fc4f9955ff273b190b9675 2026-05-09 08:39:04,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:04,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9955ff273b190b9675 HTTP/1.1" 200 None 2026-05-09 08:39:04,998 - lava_callback - DEBUG - Processing node 69fc4f9955ff273b190b9675: baseline-arm-baylibre 2026-05-09 08:39:04,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4f9955ff273b190b9675 2026-05-09 08:39:04,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:05,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9955ff273b190b9675 HTTP/1.1" 200 None 2026-05-09 08:39:05,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:05,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 08:39:05,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:05,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4f9955ff273b190b9675 HTTP/1.1" 200 None 2026-05-09 08:39:05,049 - lava_callback - ERROR - Error processing callback for node 69fc4f9955ff273b190b9675: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 08:39:05,679 - lava_callback - INFO - Received callback for node 69fc4f9a55ff273b190b967a INFO: 172.21.0.1:55314 - "POST /node/69fc4f9a55ff273b190b967a HTTP/1.0" 202 Accepted 2026-05-09 08:39:05,684 - lava_callback - INFO - Starting async job submit for node 69fc4f9a55ff273b190b967a 2026-05-09 08:39:05,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:05,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9a55ff273b190b967a HTTP/1.1" 200 None 2026-05-09 08:39:05,705 - lava_callback - DEBUG - Processing node 69fc4f9a55ff273b190b967a: baseline-arm-baylibre 2026-05-09 08:39:05,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4f9a55ff273b190b967a 2026-05-09 08:39:05,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:05,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9a55ff273b190b967a HTTP/1.1" 200 None 2026-05-09 08:39:05,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:05,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 08:39:05,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:05,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4f9a55ff273b190b967a HTTP/1.1" 200 None 2026-05-09 08:39:05,756 - lava_callback - ERROR - Error processing callback for node 69fc4f9a55ff273b190b967a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:39:06,379 - lava_callback - INFO - Received callback for node 69fc4f9b55ff273b190b967d INFO: 172.21.0.1:55340 - "POST /node/69fc4f9b55ff273b190b967d HTTP/1.0" 202 Accepted 2026-05-09 08:39:06,385 - lava_callback - INFO - Starting async job submit for node 69fc4f9b55ff273b190b967d 2026-05-09 08:39:06,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:06,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9b55ff273b190b967d HTTP/1.1" 200 None 2026-05-09 08:39:06,404 - lava_callback - DEBUG - Processing node 69fc4f9b55ff273b190b967d: baseline-arm-baylibre 2026-05-09 08:39:06,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4f9b55ff273b190b967d 2026-05-09 08:39:06,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:06,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9b55ff273b190b967d HTTP/1.1" 200 None 2026-05-09 08:39:06,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:06,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 08:39:06,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:06,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4f9b55ff273b190b967d HTTP/1.1" 200 None 2026-05-09 08:39:06,457 - lava_callback - ERROR - Error processing callback for node 69fc4f9b55ff273b190b967d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55354 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:39:07,082 - lava_callback - INFO - Received callback for node 69fc4f9e55ff273b190b969c INFO: 172.21.0.1:55366 - "POST /node/69fc4f9e55ff273b190b969c HTTP/1.0" 202 Accepted 2026-05-09 08:39:07,092 - lava_callback - INFO - Starting async job submit for node 69fc4f9e55ff273b190b969c 2026-05-09 08:39:07,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:07,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9e55ff273b190b969c HTTP/1.1" 200 None 2026-05-09 08:39:07,127 - lava_callback - DEBUG - Processing node 69fc4f9e55ff273b190b969c: baseline-arm-baylibre 2026-05-09 08:39:07,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4f9e55ff273b190b969c 2026-05-09 08:39:07,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:07,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9e55ff273b190b969c HTTP/1.1" 200 None 2026-05-09 08:39:07,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:07,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 08:39:07,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:07,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4f9e55ff273b190b969c HTTP/1.1" 200 None 2026-05-09 08:39:07,182 - lava_callback - ERROR - Error processing callback for node 69fc4f9e55ff273b190b969c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 08:39:07,763 - lava_callback - INFO - Received callback for node 69fc4f9f55ff273b190b969f INFO: 172.21.0.1:55374 - "POST /node/69fc4f9f55ff273b190b969f HTTP/1.0" 202 Accepted 2026-05-09 08:39:07,769 - lava_callback - INFO - Starting async job submit for node 69fc4f9f55ff273b190b969f 2026-05-09 08:39:07,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:07,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9f55ff273b190b969f HTTP/1.1" 200 None 2026-05-09 08:39:07,788 - lava_callback - DEBUG - Processing node 69fc4f9f55ff273b190b969f: baseline-arm-baylibre 2026-05-09 08:39:07,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4f9f55ff273b190b969f 2026-05-09 08:39:07,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:07,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4f9f55ff273b190b969f HTTP/1.1" 200 None 2026-05-09 08:39:07,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:07,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 08:39:07,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:07,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4f9f55ff273b190b969f HTTP/1.1" 200 None 2026-05-09 08:39:07,835 - lava_callback - ERROR - Error processing callback for node 69fc4f9f55ff273b190b969f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 08:39:10,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:10,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-09 08:39:10,826 - lava_callback - INFO - Received callback for node 69fef287254d3291e98df01c INFO: 172.21.0.1:45474 - "POST /node/69fef287254d3291e98df01c HTTP/1.0" 202 Accepted 2026-05-09 08:39:10,873 - lava_callback - INFO - Starting async job submit for node 69fef287254d3291e98df01c 2026-05-09 08:39:10,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:10,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef287254d3291e98df01c HTTP/1.1" 200 None 2026-05-09 08:39:10,904 - lava_callback - DEBUG - Processing node 69fef287254d3291e98df01c: baseline-arm 2026-05-09 08:39:11,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:39:11,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:39:11,122 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fef287254d3291e98df01c/log.txt.gz 2026-05-09 08:39:11,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:39:11,367 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:39:11,369 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fef287254d3291e98df01c/lava-logs.yaml 2026-05-09 08:39:11,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:39:11,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:39:11,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fef287254d3291e98df01c/lava_callback.json.gz 2026-05-09 08:39:11,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:11,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef287254d3291e98df01c HTTP/1.1" 200 None 2026-05-09 08:39:11,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:11,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:39:11,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:11,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef287254d3291e98df01c HTTP/1.1" 200 None 2026-05-09 08:39:11,537 - lava_callback - INFO - Completed processing callback for node 69fef287254d3291e98df01c 2026-05-09 08:39:13,288 - lava_callback - INFO - Received callback for node 69fc4fa755ff273b190b96ba INFO: 172.21.0.1:45488 - "POST /node/69fc4fa755ff273b190b96ba HTTP/1.0" 202 Accepted 2026-05-09 08:39:13,294 - lava_callback - INFO - Starting async job submit for node 69fc4fa755ff273b190b96ba 2026-05-09 08:39:13,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:13,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4fa755ff273b190b96ba HTTP/1.1" 200 None 2026-05-09 08:39:13,316 - lava_callback - DEBUG - Processing node 69fc4fa755ff273b190b96ba: baseline-arm-clabbe 2026-05-09 08:39:13,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4fa755ff273b190b96ba 2026-05-09 08:39:13,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:13,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4fa755ff273b190b96ba HTTP/1.1" 200 None 2026-05-09 08:39:13,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:13,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 08:39:13,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:13,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4fa755ff273b190b96ba HTTP/1.1" 200 None 2026-05-09 08:39:13,381 - lava_callback - ERROR - Error processing callback for node 69fc4fa755ff273b190b96ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 08:39:13,968 - lava_callback - INFO - Received callback for node 69fc4fab55ff273b190b96c7 INFO: 172.21.0.1:45502 - "POST /node/69fc4fab55ff273b190b96c7 HTTP/1.0" 202 Accepted 2026-05-09 08:39:13,973 - lava_callback - INFO - Starting async job submit for node 69fc4fab55ff273b190b96c7 2026-05-09 08:39:13,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:13,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4fab55ff273b190b96c7 HTTP/1.1" 200 None 2026-05-09 08:39:13,988 - lava_callback - DEBUG - Processing node 69fc4fab55ff273b190b96c7: baseline-arm-clabbe 2026-05-09 08:39:13,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4fab55ff273b190b96c7 2026-05-09 08:39:13,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:14,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4fab55ff273b190b96c7 HTTP/1.1" 200 None 2026-05-09 08:39:14,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:14,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 08:39:14,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:14,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4fab55ff273b190b96c7 HTTP/1.1" 200 None 2026-05-09 08:39:14,041 - lava_callback - ERROR - Error processing callback for node 69fc4fab55ff273b190b96c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 08:39:14,625 - lava_callback - INFO - Received callback for node 69fc4fac55ff273b190b96ca INFO: 172.21.0.1:45518 - "POST /node/69fc4fac55ff273b190b96ca HTTP/1.0" 202 Accepted 2026-05-09 08:39:14,632 - lava_callback - INFO - Starting async job submit for node 69fc4fac55ff273b190b96ca 2026-05-09 08:39:14,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:14,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4fac55ff273b190b96ca HTTP/1.1" 200 None 2026-05-09 08:39:14,660 - lava_callback - DEBUG - Processing node 69fc4fac55ff273b190b96ca: baseline-arm-clabbe 2026-05-09 08:39:14,660 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4fac55ff273b190b96ca 2026-05-09 08:39:14,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:14,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4fac55ff273b190b96ca HTTP/1.1" 200 None 2026-05-09 08:39:14,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:14,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 08:39:14,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:14,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4fac55ff273b190b96ca HTTP/1.1" 200 None 2026-05-09 08:39:14,706 - lava_callback - ERROR - Error processing callback for node 69fc4fac55ff273b190b96ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45534 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-09 08:39:15,319 - lava_callback - INFO - Received callback for node 69fc4fac55ff273b190b96cd INFO: 172.21.0.1:45538 - "POST /node/69fc4fac55ff273b190b96cd HTTP/1.0" 202 Accepted 2026-05-09 08:39:15,324 - lava_callback - INFO - Starting async job submit for node 69fc4fac55ff273b190b96cd 2026-05-09 08:39:15,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:15,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4fac55ff273b190b96cd HTTP/1.1" 200 None 2026-05-09 08:39:15,347 - lava_callback - DEBUG - Processing node 69fc4fac55ff273b190b96cd: baseline-arm-clabbe 2026-05-09 08:39:15,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4fac55ff273b190b96cd 2026-05-09 08:39:15,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:15,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4fac55ff273b190b96cd HTTP/1.1" 200 None 2026-05-09 08:39:15,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:15,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 08:39:15,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:15,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4fac55ff273b190b96cd HTTP/1.1" 200 None 2026-05-09 08:39:15,402 - lava_callback - ERROR - Error processing callback for node 69fc4fac55ff273b190b96cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 08:39:16,085 - lava_callback - INFO - Received callback for node 69fc4fad55ff273b190b96d0 INFO: 172.21.0.1:45554 - "POST /node/69fc4fad55ff273b190b96d0 HTTP/1.0" 202 Accepted 2026-05-09 08:39:16,092 - lava_callback - INFO - Starting async job submit for node 69fc4fad55ff273b190b96d0 2026-05-09 08:39:16,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:16,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4fad55ff273b190b96d0 HTTP/1.1" 200 None 2026-05-09 08:39:16,107 - lava_callback - DEBUG - Processing node 69fc4fad55ff273b190b96d0: baseline-arm-clabbe 2026-05-09 08:39:16,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4fad55ff273b190b96d0 2026-05-09 08:39:16,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:16,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4fad55ff273b190b96d0 HTTP/1.1" 200 None 2026-05-09 08:39:16,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:16,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 08:39:16,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:16,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4fad55ff273b190b96d0 HTTP/1.1" 200 None 2026-05-09 08:39:16,159 - lava_callback - ERROR - Error processing callback for node 69fc4fad55ff273b190b96d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:39:16,759 - lava_callback - INFO - Received callback for node 69fc4faf55ff273b190b96d6 INFO: 172.21.0.1:45574 - "POST /node/69fc4faf55ff273b190b96d6 HTTP/1.0" 202 Accepted 2026-05-09 08:39:16,768 - lava_callback - INFO - Starting async job submit for node 69fc4faf55ff273b190b96d6 2026-05-09 08:39:16,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:16,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4faf55ff273b190b96d6 HTTP/1.1" 200 None 2026-05-09 08:39:16,792 - lava_callback - DEBUG - Processing node 69fc4faf55ff273b190b96d6: baseline-arm-clabbe 2026-05-09 08:39:16,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc4faf55ff273b190b96d6 2026-05-09 08:39:16,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:16,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4faf55ff273b190b96d6 HTTP/1.1" 200 None 2026-05-09 08:39:16,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:16,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 08:39:16,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:16,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc4faf55ff273b190b96d6 HTTP/1.1" 200 None 2026-05-09 08:39:16,863 - lava_callback - ERROR - Error processing callback for node 69fc4faf55ff273b190b96d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42856 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:39:40,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:40,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:39:54,063 - lava_callback - INFO - Received callback for node 69fef286254d3291e98df019 INFO: 172.21.0.1:58328 - "POST /node/69fef286254d3291e98df019 HTTP/1.0" 202 Accepted 2026-05-09 08:39:54,069 - lava_callback - INFO - Starting async job submit for node 69fef286254d3291e98df019 2026-05-09 08:39:54,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:54,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef286254d3291e98df019 HTTP/1.1" 200 None 2026-05-09 08:39:54,105 - lava_callback - DEBUG - Processing node 69fef286254d3291e98df019: baseline-arm 2026-05-09 08:39:54,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:39:54,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:39:54,476 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fef286254d3291e98df019/log.txt.gz 2026-05-09 08:39:54,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:39:54,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:39:54,817 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fef286254d3291e98df019/lava-logs.yaml 2026-05-09 08:39:54,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:39:54,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:39:54,946 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fef286254d3291e98df019/lava_callback.json.gz 2026-05-09 08:39:54,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:54,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef286254d3291e98df019 HTTP/1.1" 200 None 2026-05-09 08:39:54,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:55,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:39:55,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:39:55,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef286254d3291e98df019 HTTP/1.1" 200 None 2026-05-09 08:39:55,043 - lava_callback - INFO - Completed processing callback for node 69fef286254d3291e98df019 INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:40:01,948 - lava_callback - INFO - Received callback for node 69fef280254d3291e98df00c INFO: 172.21.0.1:37086 - "POST /node/69fef280254d3291e98df00c HTTP/1.0" 202 Accepted 2026-05-09 08:40:01,954 - lava_callback - INFO - Starting async job submit for node 69fef280254d3291e98df00c 2026-05-09 08:40:01,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:02,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef280254d3291e98df00c HTTP/1.1" 200 None 2026-05-09 08:40:02,009 - lava_callback - DEBUG - Processing node 69fef280254d3291e98df00c: baseline-arm 2026-05-09 08:40:02,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:02,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:02,347 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fef280254d3291e98df00c/log.txt.gz 2026-05-09 08:40:02,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:02,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:02,643 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fef280254d3291e98df00c/lava-logs.yaml 2026-05-09 08:40:02,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:02,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:02,793 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fef280254d3291e98df00c/lava_callback.json.gz 2026-05-09 08:40:02,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:02,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef280254d3291e98df00c HTTP/1.1" 200 None 2026-05-09 08:40:02,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:02,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:40:02,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:02,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef280254d3291e98df00c HTTP/1.1" 200 None 2026-05-09 08:40:02,881 - lava_callback - INFO - Completed processing callback for node 69fef280254d3291e98df00c INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37112 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:40:10,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:10,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:40:17,607 - lava_callback - INFO - Received callback for node 69fef2e5254d3291e98df148 INFO: 172.21.0.1:59054 - "POST /node/69fef2e5254d3291e98df148 HTTP/1.0" 202 Accepted 2026-05-09 08:40:17,612 - lava_callback - INFO - Starting async job submit for node 69fef2e5254d3291e98df148 2026-05-09 08:40:17,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:17,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2e5254d3291e98df148 HTTP/1.1" 200 None 2026-05-09 08:40:17,630 - lava_callback - DEBUG - Processing node 69fef2e5254d3291e98df148: baseline-arm 2026-05-09 08:40:17,635 - lava_callback - WARNING - Failed to upload log 2026-05-09 08:40:17,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:17,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:17,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fef2e5254d3291e98df148/lava-logs.yaml 2026-05-09 08:40:17,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:17,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:17,793 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fef2e5254d3291e98df148/lava_callback.json.gz 2026-05-09 08:40:17,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:17,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2e5254d3291e98df148 HTTP/1.1" 200 None 2026-05-09 08:40:17,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:17,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:40:17,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:17,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2e5254d3291e98df148 HTTP/1.1" 200 None 2026-05-09 08:40:17,845 - lava_callback - INFO - Completed processing callback for node 69fef2e5254d3291e98df148 2026-05-09 08:40:20,337 - lava_callback - INFO - Received callback for node 69fef2a4254d3291e98df0a8 INFO: 172.21.0.1:39102 - "POST /node/69fef2a4254d3291e98df0a8 HTTP/1.0" 202 Accepted 2026-05-09 08:40:20,385 - lava_callback - INFO - Starting async job submit for node 69fef2a4254d3291e98df0a8 2026-05-09 08:40:20,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:20,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2a4254d3291e98df0a8 HTTP/1.1" 200 None 2026-05-09 08:40:20,421 - lava_callback - DEBUG - Processing node 69fef2a4254d3291e98df0a8: baseline-arm-pengutronix 2026-05-09 08:40:20,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:20,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:20,641 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef2a4254d3291e98df0a8/log.txt.gz 2026-05-09 08:40:20,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:20,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:20,844 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef2a4254d3291e98df0a8/lava-logs.yaml 2026-05-09 08:40:20,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:20,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:20,942 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef2a4254d3291e98df0a8/lava_callback.json.gz 2026-05-09 08:40:20,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:20,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2a4254d3291e98df0a8 HTTP/1.1" 200 None 2026-05-09 08:40:20,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:20,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:40:20,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:21,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2a4254d3291e98df0a8 HTTP/1.1" 200 None 2026-05-09 08:40:21,022 - lava_callback - INFO - Completed processing callback for node 69fef2a4254d3291e98df0a8 2026-05-09 08:40:23,449 - lava_callback - INFO - Received callback for node 69fef291254d3291e98df033 INFO: 172.21.0.1:39104 - "POST /node/69fef291254d3291e98df033 HTTP/1.0" 202 Accepted 2026-05-09 08:40:23,456 - lava_callback - INFO - Starting async job submit for node 69fef291254d3291e98df033 2026-05-09 08:40:23,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:23,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef291254d3291e98df033 HTTP/1.1" 200 None 2026-05-09 08:40:23,511 - lava_callback - DEBUG - Processing node 69fef291254d3291e98df033: baseline-arm-broonie 2026-05-09 08:40:23,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:23,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:23,851 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fef291254d3291e98df033/log.txt.gz 2026-05-09 08:40:24,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:24,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:24,196 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fef291254d3291e98df033/lava-logs.yaml 2026-05-09 08:40:24,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:24,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:24,328 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fef291254d3291e98df033/lava_callback.json.gz 2026-05-09 08:40:24,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:24,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef291254d3291e98df033 HTTP/1.1" 200 None 2026-05-09 08:40:24,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:24,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:40:24,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:24,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef291254d3291e98df033 HTTP/1.1" 200 None 2026-05-09 08:40:24,431 - lava_callback - INFO - Completed processing callback for node 69fef291254d3291e98df033 2026-05-09 08:40:24,872 - lava_callback - INFO - Received callback for node 69fef295254d3291e98df042 INFO: 172.21.0.1:39116 - "POST /node/69fef295254d3291e98df042 HTTP/1.0" 202 Accepted 2026-05-09 08:40:24,878 - lava_callback - INFO - Starting async job submit for node 69fef295254d3291e98df042 2026-05-09 08:40:24,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:24,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef295254d3291e98df042 HTTP/1.1" 200 None 2026-05-09 08:40:24,916 - lava_callback - DEBUG - Processing node 69fef295254d3291e98df042: baseline-arm-clabbe 2026-05-09 08:40:25,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:25,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:25,218 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fef295254d3291e98df042/log.txt.gz 2026-05-09 08:40:25,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:25,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:25,476 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fef295254d3291e98df042/lava-logs.yaml 2026-05-09 08:40:25,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:25,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:25,581 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fef295254d3291e98df042/lava_callback.json.gz 2026-05-09 08:40:25,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:25,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef295254d3291e98df042 HTTP/1.1" 200 None 2026-05-09 08:40:25,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:25,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:40:25,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:25,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef295254d3291e98df042 HTTP/1.1" 200 None 2026-05-09 08:40:25,655 - lava_callback - INFO - Completed processing callback for node 69fef295254d3291e98df042 INFO: 172.21.0.1:39128 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:40:32,486 - lava_callback - INFO - Received callback for node 69fef2a0254d3291e98df09e INFO: 172.21.0.1:51064 - "POST /node/69fef2a0254d3291e98df09e HTTP/1.0" 202 Accepted 2026-05-09 08:40:32,491 - lava_callback - INFO - Starting async job submit for node 69fef2a0254d3291e98df09e 2026-05-09 08:40:32,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:32,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2a0254d3291e98df09e HTTP/1.1" 200 None 2026-05-09 08:40:32,528 - lava_callback - DEBUG - Processing node 69fef2a0254d3291e98df09e: baseline-arm-pengutronix 2026-05-09 08:40:32,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:32,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:32,745 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef2a0254d3291e98df09e/log.txt.gz 2026-05-09 08:40:32,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:33,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:33,008 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef2a0254d3291e98df09e/lava-logs.yaml 2026-05-09 08:40:33,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:33,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:33,129 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef2a0254d3291e98df09e/lava_callback.json.gz 2026-05-09 08:40:33,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:33,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2a0254d3291e98df09e HTTP/1.1" 200 None 2026-05-09 08:40:33,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:33,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:40:33,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:33,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2a0254d3291e98df09e HTTP/1.1" 200 None 2026-05-09 08:40:33,215 - lava_callback - INFO - Completed processing callback for node 69fef2a0254d3291e98df09e INFO: 172.21.0.1:51072 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:40:40,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:40,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-09 08:40:45,099 - lava_callback - INFO - Received callback for node 69fef29c254d3291e98df087 INFO: 172.21.0.1:51306 - "POST /node/69fef29c254d3291e98df087 HTTP/1.0" 202 Accepted 2026-05-09 08:40:45,106 - lava_callback - INFO - Starting async job submit for node 69fef29c254d3291e98df087 2026-05-09 08:40:45,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:45,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef29c254d3291e98df087 HTTP/1.1" 200 None 2026-05-09 08:40:45,150 - lava_callback - DEBUG - Processing node 69fef29c254d3291e98df087: baseline-arm-kontron 2026-05-09 08:40:45,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:45,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:45,504 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fef29c254d3291e98df087/log.txt.gz 2026-05-09 08:40:45,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:45,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:45,848 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fef29c254d3291e98df087/lava-logs.yaml 2026-05-09 08:40:45,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:45,990 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:45,992 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fef29c254d3291e98df087/lava_callback.json.gz 2026-05-09 08:40:46,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:46,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef29c254d3291e98df087 HTTP/1.1" 200 None 2026-05-09 08:40:46,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:46,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:40:46,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:46,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef29c254d3291e98df087 HTTP/1.1" 200 None 2026-05-09 08:40:46,086 - lava_callback - INFO - Completed processing callback for node 69fef29c254d3291e98df087 2026-05-09 08:40:46,450 - lava_callback - INFO - Received callback for node 69fef29e254d3291e98df08c INFO: 172.21.0.1:51322 - "POST /node/69fef29e254d3291e98df08c HTTP/1.0" 202 Accepted 2026-05-09 08:40:46,458 - lava_callback - INFO - Starting async job submit for node 69fef29e254d3291e98df08c 2026-05-09 08:40:46,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:46,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef29e254d3291e98df08c HTTP/1.1" 200 None 2026-05-09 08:40:46,506 - lava_callback - DEBUG - Processing node 69fef29e254d3291e98df08c: baseline-arm-kontron INFO: 172.21.0.1:51334 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:40:46,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:46,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:46,903 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fef29e254d3291e98df08c/log.txt.gz 2026-05-09 08:40:47,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:47,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:47,227 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fef29e254d3291e98df08c/lava-logs.yaml 2026-05-09 08:40:47,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:47,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:47,335 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fef29e254d3291e98df08c/lava_callback.json.gz 2026-05-09 08:40:47,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:47,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef29e254d3291e98df08c HTTP/1.1" 200 None 2026-05-09 08:40:47,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:47,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:40:47,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:47,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef29e254d3291e98df08c HTTP/1.1" 200 None 2026-05-09 08:40:47,421 - lava_callback - INFO - Completed processing callback for node 69fef29e254d3291e98df08c INFO: 172.21.0.1:37060 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:40:58,785 - lava_callback - INFO - Received callback for node 69fef2bb254d3291e98df0fd INFO: 172.21.0.1:37076 - "POST /node/69fef2bb254d3291e98df0fd HTTP/1.0" 202 Accepted 2026-05-09 08:40:58,798 - lava_callback - INFO - Starting async job submit for node 69fef2bb254d3291e98df0fd 2026-05-09 08:40:58,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:40:58,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2bb254d3291e98df0fd HTTP/1.1" 200 None 2026-05-09 08:40:58,861 - lava_callback - DEBUG - Processing node 69fef2bb254d3291e98df0fd: ltp-dio 2026-05-09 08:40:59,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:40:59,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:40:59,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69fef2bb254d3291e98df0fd/log.txt.gz 2026-05-09 08:41:00,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:41:00,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:41:00,285 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69fef2bb254d3291e98df0fd/lava-logs.yaml 2026-05-09 08:41:00,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:41:00,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:41:00,528 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69fef2bb254d3291e98df0fd/lava_callback.json.gz 2026-05-09 08:41:00,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:00,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2bb254d3291e98df0fd HTTP/1.1" 200 None 2026-05-09 08:41:00,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:00,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:41:00,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:00,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2bb254d3291e98df0fd HTTP/1.1" 200 None 2026-05-09 08:41:00,657 - lava_callback - INFO - Completed processing callback for node 69fef2bb254d3291e98df0fd INFO: 172.21.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35780 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:41:10,025 - lava_callback - INFO - Received callback for node 69fef2a2254d3291e98df0a2 INFO: 172.21.0.1:57010 - "POST /node/69fef2a2254d3291e98df0a2 HTTP/1.0" 202 Accepted 2026-05-09 08:41:10,037 - lava_callback - INFO - Starting async job submit for node 69fef2a2254d3291e98df0a2 2026-05-09 08:41:10,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:10,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2a2254d3291e98df0a2 HTTP/1.1" 200 None 2026-05-09 08:41:10,119 - lava_callback - DEBUG - Processing node 69fef2a2254d3291e98df0a2: baseline-arm-pengutronix 2026-05-09 08:41:10,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:41:10,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:41:10,580 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef2a2254d3291e98df0a2/log.txt.gz 2026-05-09 08:41:10,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:10,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:41:10,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-09 08:41:11,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:41:11,103 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef2a2254d3291e98df0a2/lava-logs.yaml 2026-05-09 08:41:11,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:41:11,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:41:11,237 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef2a2254d3291e98df0a2/lava_callback.json.gz 2026-05-09 08:41:11,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:11,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2a2254d3291e98df0a2 HTTP/1.1" 200 None 2026-05-09 08:41:11,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:11,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:41:11,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:11,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2a2254d3291e98df0a2 HTTP/1.1" 200 None 2026-05-09 08:41:11,404 - lava_callback - INFO - Completed processing callback for node 69fef2a2254d3291e98df0a2 INFO: 172.21.0.1:57012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:41:19,885 - lava_callback - INFO - Received callback for node 69fef296254d3291e98df046 INFO: 172.21.0.1:42834 - "POST /node/69fef296254d3291e98df046 HTTP/1.0" 202 Accepted 2026-05-09 08:41:19,903 - lava_callback - INFO - Starting async job submit for node 69fef296254d3291e98df046 2026-05-09 08:41:19,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:20,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef296254d3291e98df046 HTTP/1.1" 200 None 2026-05-09 08:41:20,009 - lava_callback - DEBUG - Processing node 69fef296254d3291e98df046: baseline-arm-clabbe 2026-05-09 08:41:20,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:41:20,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:41:20,448 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fef296254d3291e98df046/log.txt.gz 2026-05-09 08:41:20,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:41:20,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:41:20,848 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fef296254d3291e98df046/lava-logs.yaml 2026-05-09 08:41:20,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:41:20,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:41:20,975 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fef296254d3291e98df046/lava_callback.json.gz 2026-05-09 08:41:21,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:21,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef296254d3291e98df046 HTTP/1.1" 200 None 2026-05-09 08:41:21,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:21,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:41:21,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:21,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef296254d3291e98df046 HTTP/1.1" 200 None 2026-05-09 08:41:21,102 - lava_callback - INFO - Completed processing callback for node 69fef296254d3291e98df046 2026-05-09 08:41:23,472 - lava_callback - INFO - Received callback for node 69fef28e254d3291e98df02c INFO: 172.21.0.1:42836 - "POST /node/69fef28e254d3291e98df02c HTTP/1.0" 202 Accepted 2026-05-09 08:41:23,482 - lava_callback - INFO - Starting async job submit for node 69fef28e254d3291e98df02c 2026-05-09 08:41:23,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:23,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef28e254d3291e98df02c HTTP/1.1" 200 None 2026-05-09 08:41:23,542 - lava_callback - DEBUG - Processing node 69fef28e254d3291e98df02c: baseline-arm-broonie 2026-05-09 08:41:23,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:41:24,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:41:24,025 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fef28e254d3291e98df02c/log.txt.gz 2026-05-09 08:41:24,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:41:24,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:41:24,433 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fef28e254d3291e98df02c/lava-logs.yaml 2026-05-09 08:41:24,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:41:24,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:41:24,586 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fef28e254d3291e98df02c/lava_callback.json.gz 2026-05-09 08:41:24,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:24,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef28e254d3291e98df02c HTTP/1.1" 200 None 2026-05-09 08:41:24,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:24,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:41:24,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:24,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef28e254d3291e98df02c HTTP/1.1" 200 None 2026-05-09 08:41:24,682 - lava_callback - INFO - Completed processing callback for node 69fef28e254d3291e98df02c INFO: 172.21.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53654 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:41:40,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:41:40,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49388 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:42:04,917 - lava_callback - INFO - Received callback for node 69fef29a254d3291e98df055 INFO: 172.21.0.1:55580 - "POST /node/69fef29a254d3291e98df055 HTTP/1.0" 202 Accepted 2026-05-09 08:42:04,924 - lava_callback - INFO - Starting async job submit for node 69fef29a254d3291e98df055 2026-05-09 08:42:04,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:42:04,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef29a254d3291e98df055 HTTP/1.1" 200 None 2026-05-09 08:42:04,965 - lava_callback - DEBUG - Processing node 69fef29a254d3291e98df055: baseline-arm-clabbe 2026-05-09 08:42:05,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:42:05,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:42:05,332 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fef29a254d3291e98df055/log.txt.gz 2026-05-09 08:42:05,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:42:05,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:42:05,656 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fef29a254d3291e98df055/lava-logs.yaml 2026-05-09 08:42:05,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:42:05,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:42:05,756 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fef29a254d3291e98df055/lava_callback.json.gz 2026-05-09 08:42:05,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:42:05,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef29a254d3291e98df055 HTTP/1.1" 200 None 2026-05-09 08:42:05,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:42:05,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:42:05,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:42:05,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef29a254d3291e98df055 HTTP/1.1" 200 None 2026-05-09 08:42:05,826 - lava_callback - INFO - Completed processing callback for node 69fef29a254d3291e98df055 INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:42:10,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:42:10,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59408 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:43:20,601 - lava_callback - INFO - Received callback for node 69fef2b6254d3291e98df0d1 INFO: 172.21.0.1:53322 - "POST /node/69fef2b6254d3291e98df0d1 HTTP/1.0" 202 Accepted 2026-05-09 08:43:20,607 - lava_callback - INFO - Starting async job submit for node 69fef2b6254d3291e98df0d1 2026-05-09 08:43:20,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:43:20,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2b6254d3291e98df0d1 HTTP/1.1" 200 None 2026-05-09 08:43:20,647 - lava_callback - DEBUG - Processing node 69fef2b6254d3291e98df0d1: ltp-containers 2026-05-09 08:43:21,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:43:21,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:43:21,152 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69fef2b6254d3291e98df0d1/log.txt.gz 2026-05-09 08:43:21,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:43:21,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:43:21,546 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69fef2b6254d3291e98df0d1/lava-logs.yaml 2026-05-09 08:43:21,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:43:21,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:43:21,668 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69fef2b6254d3291e98df0d1/lava_callback.json.gz 2026-05-09 08:43:21,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:43:21,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2b6254d3291e98df0d1 HTTP/1.1" 200 None 2026-05-09 08:43:21,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:43:21,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:43:21,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:43:21,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2b6254d3291e98df0d1 HTTP/1.1" 200 None 2026-05-09 08:43:21,742 - lava_callback - INFO - Completed processing callback for node 69fef2b6254d3291e98df0d1 2026-05-09 08:43:23,607 - lava_callback - INFO - Received callback for node 69fef2b7254d3291e98df0d4 INFO: 172.21.0.1:53334 - "POST /node/69fef2b7254d3291e98df0d4 HTTP/1.0" 202 Accepted 2026-05-09 08:43:23,614 - lava_callback - INFO - Starting async job submit for node 69fef2b7254d3291e98df0d4 2026-05-09 08:43:23,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:43:23,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2b7254d3291e98df0d4 HTTP/1.1" 200 None 2026-05-09 08:43:23,654 - lava_callback - DEBUG - Processing node 69fef2b7254d3291e98df0d4: ltp-controllers 2026-05-09 08:43:24,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:43:24,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:43:24,595 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69fef2b7254d3291e98df0d4/log.txt.gz 2026-05-09 08:43:25,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:43:25,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:43:25,251 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69fef2b7254d3291e98df0d4/lava-logs.yaml 2026-05-09 08:43:25,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:43:25,304 - lava_callback - INFO - Received callback for node 69fef2b9254d3291e98df0d7 2026-05-09 08:43:25,319 - lava_callback - INFO - Starting async job submit for node 69fef2b9254d3291e98df0d7 INFO: 172.21.0.1:53338 - "POST /node/69fef2b9254d3291e98df0d7 HTTP/1.0" 202 Accepted 2026-05-09 08:43:25,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:43:25,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2b9254d3291e98df0d7 HTTP/1.1" 200 None 2026-05-09 08:43:25,408 - lava_callback - DEBUG - Processing node 69fef2b9254d3291e98df0d7: ltp-cve 2026-05-09 08:43:25,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:43:25,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69fef2b7254d3291e98df0d4/lava_callback.json.gz 2026-05-09 08:43:25,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:43:25,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2b7254d3291e98df0d4 HTTP/1.1" 200 None 2026-05-09 08:43:25,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:43:25,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:43:25,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:43:25,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2b7254d3291e98df0d4 HTTP/1.1" 200 None 2026-05-09 08:43:25,885 - lava_callback - INFO - Completed processing callback for node 69fef2b7254d3291e98df0d4 2026-05-09 08:43:26,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:43:26,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:43:26,442 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69fef2b9254d3291e98df0d7/log.txt.gz INFO: 172.21.0.1:53342 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:43:26,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:43:27,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:43:27,009 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69fef2b9254d3291e98df0d7/lava-logs.yaml 2026-05-09 08:43:27,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:43:27,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:43:27,177 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69fef2b9254d3291e98df0d7/lava_callback.json.gz 2026-05-09 08:43:27,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:43:27,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2b9254d3291e98df0d7 HTTP/1.1" 200 None 2026-05-09 08:43:27,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:43:27,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:43:27,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:43:27,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2b9254d3291e98df0d7 HTTP/1.1" 200 None 2026-05-09 08:43:27,327 - lava_callback - INFO - Completed processing callback for node 69fef2b9254d3291e98df0d7 INFO: 172.21.0.1:32952 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:43:40,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:43:40,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:44:04,042 - lava_callback - INFO - Received callback for node 69fef2c6254d3291e98df119 INFO: 172.21.0.1:51016 - "POST /node/69fef2c6254d3291e98df119 HTTP/1.0" 202 Accepted 2026-05-09 08:44:04,054 - lava_callback - INFO - Starting async job submit for node 69fef2c6254d3291e98df119 2026-05-09 08:44:04,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:44:04,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2c6254d3291e98df119 HTTP/1.1" 200 None 2026-05-09 08:44:04,100 - lava_callback - DEBUG - Processing node 69fef2c6254d3291e98df119: ltp-syscalls 2026-05-09 08:44:04,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:44:05,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:44:05,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fef2c6254d3291e98df119/log.txt.gz 2026-05-09 08:44:05,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:44:05,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:44:05,624 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fef2c6254d3291e98df119/lava-logs.yaml 2026-05-09 08:44:05,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:44:05,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:44:05,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fef2c6254d3291e98df119/lava_callback.json.gz 2026-05-09 08:44:05,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:44:05,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2c6254d3291e98df119 HTTP/1.1" 200 None 2026-05-09 08:44:05,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:44:05,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:44:05,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:44:05,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2c6254d3291e98df119 HTTP/1.1" 200 None 2026-05-09 08:44:05,825 - lava_callback - INFO - Completed processing callback for node 69fef2c6254d3291e98df119 INFO: 172.21.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51032 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:44:10,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:44:10,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-09 08:44:13,571 - lava_callback - INFO - Received callback for node 69fc50cf55ff273b190b9856 INFO: 172.21.0.1:55488 - "POST /node/69fc50cf55ff273b190b9856 HTTP/1.0" 202 Accepted 2026-05-09 08:44:13,578 - lava_callback - INFO - Starting async job submit for node 69fc50cf55ff273b190b9856 2026-05-09 08:44:13,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:44:13,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc50cf55ff273b190b9856 HTTP/1.1" 200 None 2026-05-09 08:44:13,593 - lava_callback - DEBUG - Processing node 69fc50cf55ff273b190b9856: baseline-arm-clabbe 2026-05-09 08:44:13,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc50cf55ff273b190b9856 2026-05-09 08:44:13,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:44:13,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc50cf55ff273b190b9856 HTTP/1.1" 200 None 2026-05-09 08:44:13,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:44:13,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 08:44:13,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:44:13,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc50cf55ff273b190b9856 HTTP/1.1" 200 None 2026-05-09 08:44:13,640 - lava_callback - ERROR - Error processing callback for node 69fc50cf55ff273b190b9856: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:46:03,851 - lava_callback - INFO - Received callback for node 69fef2b4254d3291e98df0cc INFO: 172.21.0.1:50036 - "POST /node/69fef2b4254d3291e98df0cc HTTP/1.0" 202 Accepted 2026-05-09 08:46:03,858 - lava_callback - INFO - Starting async job submit for node 69fef2b4254d3291e98df0cc 2026-05-09 08:46:03,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:03,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2b4254d3291e98df0cc HTTP/1.1" 200 None 2026-05-09 08:46:03,915 - lava_callback - DEBUG - Processing node 69fef2b4254d3291e98df0cc: ltp-cap_bounds 2026-05-09 08:46:04,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:46:04,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:46:04,376 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fef2b4254d3291e98df0cc/log.txt.gz 2026-05-09 08:46:04,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:46:04,703 - lava_callback - INFO - Received callback for node 69fc513c55ff273b190b988d INFO: 172.21.0.1:50048 - "POST /node/69fc513c55ff273b190b988d HTTP/1.0" 202 Accepted 2026-05-09 08:46:04,709 - lava_callback - INFO - Starting async job submit for node 69fc513c55ff273b190b988d 2026-05-09 08:46:04,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:04,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc513c55ff273b190b988d HTTP/1.1" 200 None 2026-05-09 08:46:04,724 - lava_callback - DEBUG - Processing node 69fc513c55ff273b190b988d: baseline-arm-baylibre 2026-05-09 08:46:04,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc513c55ff273b190b988d 2026-05-09 08:46:04,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:04,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc513c55ff273b190b988d HTTP/1.1" 200 None 2026-05-09 08:46:04,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:46:04,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:04,743 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fef2b4254d3291e98df0cc/lava-logs.yaml 2026-05-09 08:46:04,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:46:04,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 08:46:04,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:04,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc513c55ff273b190b988d HTTP/1.1" 200 None 2026-05-09 08:46:04,841 - lava_callback - ERROR - Error processing callback for node 69fc513c55ff273b190b988d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 08:46:04,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:46:04,893 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fef2b4254d3291e98df0cc/lava_callback.json.gz 2026-05-09 08:46:04,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:04,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2b4254d3291e98df0cc HTTP/1.1" 200 None 2026-05-09 08:46:04,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:04,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:46:04,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:04,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2b4254d3291e98df0cc HTTP/1.1" 200 None 2026-05-09 08:46:04,999 - lava_callback - INFO - Completed processing callback for node 69fef2b4254d3291e98df0cc 2026-05-09 08:46:05,525 - lava_callback - INFO - Received callback for node 69fef2bc254d3291e98df100 INFO: 172.21.0.1:50056 - "POST /node/69fef2bc254d3291e98df100 HTTP/1.0" 202 Accepted 2026-05-09 08:46:05,532 - lava_callback - INFO - Starting async job submit for node 69fef2bc254d3291e98df100 2026-05-09 08:46:05,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:05,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2bc254d3291e98df100 HTTP/1.1" 200 None 2026-05-09 08:46:05,581 - lava_callback - DEBUG - Processing node 69fef2bc254d3291e98df100: ltp-fs_bind 2026-05-09 08:46:05,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:46:06,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:46:06,063 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fef2bc254d3291e98df100/log.txt.gz 2026-05-09 08:46:06,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:46:06,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:46:06,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fef2bc254d3291e98df100/lava-logs.yaml 2026-05-09 08:46:06,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50076 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:46:06,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:46:06,632 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fef2bc254d3291e98df100/lava_callback.json.gz 2026-05-09 08:46:06,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:06,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2bc254d3291e98df100 HTTP/1.1" 200 None 2026-05-09 08:46:06,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:06,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:46:06,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:06,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2bc254d3291e98df100 HTTP/1.1" 200 None 2026-05-09 08:46:06,719 - lava_callback - INFO - Completed processing callback for node 69fef2bc254d3291e98df100 2026-05-09 08:46:10,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:10,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57976 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:46:44,605 - lava_callback - INFO - Received callback for node 69fc516255ff273b190b9899 INFO: 172.21.0.1:53866 - "POST /node/69fc516255ff273b190b9899 HTTP/1.0" 202 Accepted 2026-05-09 08:46:44,610 - lava_callback - INFO - Starting async job submit for node 69fc516255ff273b190b9899 2026-05-09 08:46:44,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:44,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc516255ff273b190b9899 HTTP/1.1" 200 None 2026-05-09 08:46:44,624 - lava_callback - DEBUG - Processing node 69fc516255ff273b190b9899: baseline-arm-baylibre 2026-05-09 08:46:44,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc516255ff273b190b9899 2026-05-09 08:46:44,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:44,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc516255ff273b190b9899 HTTP/1.1" 200 None 2026-05-09 08:46:44,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:44,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 08:46:44,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:46:44,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc516255ff273b190b9899 HTTP/1.1" 200 None 2026-05-09 08:46:44,668 - lava_callback - ERROR - Error processing callback for node 69fc516255ff273b190b9899: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:47:24,721 - lava_callback - INFO - Received callback for node 69fc518855ff273b190b98a6 INFO: 172.21.0.1:55832 - "POST /node/69fc518855ff273b190b98a6 HTTP/1.0" 202 Accepted 2026-05-09 08:47:24,730 - lava_callback - INFO - Starting async job submit for node 69fc518855ff273b190b98a6 2026-05-09 08:47:24,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:24,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc518855ff273b190b98a6 HTTP/1.1" 200 None 2026-05-09 08:47:24,752 - lava_callback - DEBUG - Processing node 69fc518855ff273b190b98a6: baseline-arm-baylibre 2026-05-09 08:47:24,753 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc518855ff273b190b98a6 2026-05-09 08:47:24,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:24,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc518855ff273b190b98a6 HTTP/1.1" 200 None 2026-05-09 08:47:24,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:24,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 08:47:24,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:24,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc518855ff273b190b98a6 HTTP/1.1" 200 None 2026-05-09 08:47:24,800 - lava_callback - ERROR - Error processing callback for node 69fc518855ff273b190b98a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:47:31,114 - lava_callback - INFO - Received callback for node 69fef496254d3291e98df2b3 INFO: 172.21.0.1:34442 - "POST /node/69fef496254d3291e98df2b3 HTTP/1.0" 202 Accepted 2026-05-09 08:47:31,120 - lava_callback - INFO - Starting async job submit for node 69fef496254d3291e98df2b3 2026-05-09 08:47:31,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:31,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef496254d3291e98df2b3 HTTP/1.1" 200 None 2026-05-09 08:47:31,137 - lava_callback - DEBUG - Processing node 69fef496254d3291e98df2b3: baseline-arm64 2026-05-09 08:47:31,142 - lava_callback - WARNING - Failed to upload log 2026-05-09 08:47:31,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:47:31,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:47:31,236 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef496254d3291e98df2b3/lava-logs.yaml 2026-05-09 08:47:31,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:47:31,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:47:31,314 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef496254d3291e98df2b3/lava_callback.json.gz 2026-05-09 08:47:31,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:31,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef496254d3291e98df2b3 HTTP/1.1" 200 None 2026-05-09 08:47:31,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:31,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:47:31,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:31,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef496254d3291e98df2b3 HTTP/1.1" 200 None 2026-05-09 08:47:31,402 - lava_callback - INFO - Completed processing callback for node 69fef496254d3291e98df2b3 INFO: 172.21.0.1:34446 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:47:40,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:40,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-09 08:47:43,851 - lava_callback - INFO - Received callback for node 69fef2bf254d3291e98df106 INFO: 172.21.0.1:47366 - "POST /node/69fef2bf254d3291e98df106 HTTP/1.0" 202 Accepted 2026-05-09 08:47:43,859 - lava_callback - INFO - Starting async job submit for node 69fef2bf254d3291e98df106 2026-05-09 08:47:43,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:43,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2bf254d3291e98df106 HTTP/1.1" 200 None 2026-05-09 08:47:43,909 - lava_callback - DEBUG - Processing node 69fef2bf254d3291e98df106: ltp-input 2026-05-09 08:47:44,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:47:44,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:47:44,441 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69fef2bf254d3291e98df106/log.txt.gz 2026-05-09 08:47:44,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:47:44,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:47:44,788 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69fef2bf254d3291e98df106/lava-logs.yaml 2026-05-09 08:47:44,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:47:44,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:47:44,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69fef2bf254d3291e98df106/lava_callback.json.gz 2026-05-09 08:47:44,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:44,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2bf254d3291e98df106 HTTP/1.1" 200 None 2026-05-09 08:47:44,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:44,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:47:44,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:45,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2bf254d3291e98df106 HTTP/1.1" 200 None 2026-05-09 08:47:45,029 - lava_callback - INFO - Completed processing callback for node 69fef2bf254d3291e98df106 2026-05-09 08:47:45,476 - lava_callback - INFO - Received callback for node 69fef2c1254d3291e98df109 INFO: 172.21.0.1:47374 - "POST /node/69fef2c1254d3291e98df109 HTTP/1.0" 202 Accepted 2026-05-09 08:47:45,483 - lava_callback - INFO - Starting async job submit for node 69fef2c1254d3291e98df109 2026-05-09 08:47:45,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:45,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2c1254d3291e98df109 HTTP/1.1" 200 None 2026-05-09 08:47:45,569 - lava_callback - DEBUG - Processing node 69fef2c1254d3291e98df109: ltp-ipc 2026-05-09 08:47:45,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:47:46,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:47:46,088 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69fef2c1254d3291e98df109/log.txt.gz 2026-05-09 08:47:46,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:47:46,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:47:46,568 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69fef2c1254d3291e98df109/lava-logs.yaml 2026-05-09 08:47:46,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:47:46,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:47:46,705 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69fef2c1254d3291e98df109/lava_callback.json.gz 2026-05-09 08:47:46,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:46,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2c1254d3291e98df109 HTTP/1.1" 200 None 2026-05-09 08:47:46,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:46,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:47:46,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:47:46,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2c1254d3291e98df109 HTTP/1.1" 200 None 2026-05-09 08:47:46,786 - lava_callback - INFO - Completed processing callback for node 69fef2c1254d3291e98df109 INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:48:02,412 - lava_callback - INFO - Received callback for node 69fef290254d3291e98df02f INFO: 172.21.0.1:41688 - "POST /node/69fef290254d3291e98df02f HTTP/1.0" 202 Accepted 2026-05-09 08:48:02,423 - lava_callback - INFO - Starting async job submit for node 69fef290254d3291e98df02f 2026-05-09 08:48:02,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:02,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef290254d3291e98df02f HTTP/1.1" 200 None 2026-05-09 08:48:02,478 - lava_callback - DEBUG - Processing node 69fef290254d3291e98df02f: baseline-arm-broonie 2026-05-09 08:48:02,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:02,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:02,792 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fef290254d3291e98df02f/log.txt.gz 2026-05-09 08:48:02,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:03,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:03,070 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fef290254d3291e98df02f/lava-logs.yaml 2026-05-09 08:48:03,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:03,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:03,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fef290254d3291e98df02f/lava_callback.json.gz 2026-05-09 08:48:03,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:03,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef290254d3291e98df02f HTTP/1.1" 200 None 2026-05-09 08:48:03,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:03,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:48:03,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:03,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef290254d3291e98df02f HTTP/1.1" 200 None 2026-05-09 08:48:03,330 - lava_callback - INFO - Completed processing callback for node 69fef290254d3291e98df02f 2026-05-09 08:48:04,654 - lava_callback - INFO - Received callback for node 69fc51af55ff273b190b98b2 INFO: 172.21.0.1:41692 - "POST /node/69fc51af55ff273b190b98b2 HTTP/1.0" 202 Accepted 2026-05-09 08:48:04,660 - lava_callback - INFO - Starting async job submit for node 69fc51af55ff273b190b98b2 2026-05-09 08:48:04,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:04,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc51af55ff273b190b98b2 HTTP/1.1" 200 None 2026-05-09 08:48:04,683 - lava_callback - DEBUG - Processing node 69fc51af55ff273b190b98b2: baseline-arm-baylibre 2026-05-09 08:48:04,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc51af55ff273b190b98b2 2026-05-09 08:48:04,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:04,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc51af55ff273b190b98b2 HTTP/1.1" 200 None 2026-05-09 08:48:04,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:04,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 08:48:04,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:04,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc51af55ff273b190b98b2 HTTP/1.1" 200 None 2026-05-09 08:48:04,733 - lava_callback - ERROR - Error processing callback for node 69fc51af55ff273b190b98b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:48:10,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:10,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-09 08:48:13,573 - lava_callback - INFO - Received callback for node 69fef49b254d3291e98df2d4 INFO: 172.21.0.1:42646 - "POST /node/69fef49b254d3291e98df2d4 HTTP/1.0" 202 Accepted 2026-05-09 08:48:13,581 - lava_callback - INFO - Starting async job submit for node 69fef49b254d3291e98df2d4 2026-05-09 08:48:13,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:13,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef49b254d3291e98df2d4 HTTP/1.1" 200 None 2026-05-09 08:48:13,638 - lava_callback - DEBUG - Processing node 69fef49b254d3291e98df2d4: baseline-arm64 2026-05-09 08:48:13,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:13,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:13,927 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49b254d3291e98df2d4/log.txt.gz 2026-05-09 08:48:14,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:14,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:14,209 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49b254d3291e98df2d4/lava-logs.yaml 2026-05-09 08:48:14,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:14,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:14,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49b254d3291e98df2d4/lava_callback.json.gz 2026-05-09 08:48:14,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:14,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef49b254d3291e98df2d4 HTTP/1.1" 200 None 2026-05-09 08:48:14,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:14,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:48:14,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:14,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef49b254d3291e98df2d4 HTTP/1.1" 200 None 2026-05-09 08:48:14,453 - lava_callback - INFO - Completed processing callback for node 69fef49b254d3291e98df2d4 INFO: 172.21.0.1:42658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:48:17,426 - lava_callback - INFO - Received callback for node 69fef49a254d3291e98df2c0 INFO: 172.21.0.1:42668 - "POST /node/69fef49a254d3291e98df2c0 HTTP/1.0" 202 Accepted 2026-05-09 08:48:17,433 - lava_callback - INFO - Starting async job submit for node 69fef49a254d3291e98df2c0 2026-05-09 08:48:17,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:17,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef49a254d3291e98df2c0 HTTP/1.1" 200 None 2026-05-09 08:48:17,477 - lava_callback - DEBUG - Processing node 69fef49a254d3291e98df2c0: baseline-arm64 2026-05-09 08:48:17,614 - lava_callback - WARNING - Failed to upload log 2026-05-09 08:48:17,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:17,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:17,934 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49a254d3291e98df2c0/lava-logs.yaml 2026-05-09 08:48:17,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:18,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:18,072 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49a254d3291e98df2c0/lava_callback.json.gz 2026-05-09 08:48:18,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:18,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef49a254d3291e98df2c0 HTTP/1.1" 200 None 2026-05-09 08:48:18,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:18,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:48:18,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:18,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef49a254d3291e98df2c0 HTTP/1.1" 200 None 2026-05-09 08:48:18,220 - lava_callback - INFO - Completed processing callback for node 69fef49a254d3291e98df2c0 2026-05-09 08:48:19,812 - lava_callback - INFO - Received callback for node 69fef4b0254d3291e98df313 INFO: 172.21.0.1:60524 - "POST /node/69fef4b0254d3291e98df313 HTTP/1.0" 202 Accepted 2026-05-09 08:48:19,818 - lava_callback - INFO - Starting async job submit for node 69fef4b0254d3291e98df313 2026-05-09 08:48:19,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:19,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4b0254d3291e98df313 HTTP/1.1" 200 None 2026-05-09 08:48:19,856 - lava_callback - DEBUG - Processing node 69fef4b0254d3291e98df313: baseline-nfs-arm64 2026-05-09 08:48:19,859 - lava_callback - WARNING - Failed to upload log 2026-05-09 08:48:19,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:19,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:19,982 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4b0254d3291e98df313/lava-logs.yaml 2026-05-09 08:48:19,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:20,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:20,084 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4b0254d3291e98df313/lava_callback.json.gz 2026-05-09 08:48:20,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:20,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4b0254d3291e98df313 HTTP/1.1" 200 None 2026-05-09 08:48:20,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:20,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:48:20,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:20,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4b0254d3291e98df313 HTTP/1.1" 200 None 2026-05-09 08:48:20,152 - lava_callback - INFO - Completed processing callback for node 69fef4b0254d3291e98df313 2026-05-09 08:48:22,789 - lava_callback - INFO - Received callback for node 69fef4a2254d3291e98df2e8 INFO: 172.21.0.1:60530 - "POST /node/69fef4a2254d3291e98df2e8 HTTP/1.0" 202 Accepted 2026-05-09 08:48:22,799 - lava_callback - INFO - Starting async job submit for node 69fef4a2254d3291e98df2e8 2026-05-09 08:48:22,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:22,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a2254d3291e98df2e8 HTTP/1.1" 200 None 2026-05-09 08:48:22,838 - lava_callback - DEBUG - Processing node 69fef4a2254d3291e98df2e8: baseline-arm64 2026-05-09 08:48:22,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:23,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:23,064 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a2254d3291e98df2e8/log.txt.gz 2026-05-09 08:48:23,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:23,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:23,305 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a2254d3291e98df2e8/lava-logs.yaml 2026-05-09 08:48:23,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:23,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:23,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a2254d3291e98df2e8/lava_callback.json.gz 2026-05-09 08:48:23,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:23,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a2254d3291e98df2e8 HTTP/1.1" 200 None 2026-05-09 08:48:23,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:23,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:48:23,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:23,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4a2254d3291e98df2e8 HTTP/1.1" 200 None 2026-05-09 08:48:23,473 - lava_callback - INFO - Completed processing callback for node 69fef4a2254d3291e98df2e8 2026-05-09 08:48:24,674 - lava_callback - INFO - Received callback for node 69fc51d655ff273b190b98c0 INFO: 172.21.0.1:60542 - "POST /node/69fc51d655ff273b190b98c0 HTTP/1.0" 202 Accepted 2026-05-09 08:48:24,679 - lava_callback - INFO - Starting async job submit for node 69fc51d655ff273b190b98c0 2026-05-09 08:48:24,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:24,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc51d655ff273b190b98c0 HTTP/1.1" 200 None 2026-05-09 08:48:24,695 - lava_callback - DEBUG - Processing node 69fc51d655ff273b190b98c0: baseline-arm-baylibre 2026-05-09 08:48:24,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc51d655ff273b190b98c0 2026-05-09 08:48:24,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:24,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc51d655ff273b190b98c0 HTTP/1.1" 200 None 2026-05-09 08:48:24,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:24,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 08:48:24,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:24,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc51d655ff273b190b98c0 HTTP/1.1" 200 None 2026-05-09 08:48:24,751 - lava_callback - ERROR - Error processing callback for node 69fc51d655ff273b190b98c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60544 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:48:33,064 - lava_callback - INFO - Received callback for node 69fef499254d3291e98df2bd INFO: 172.21.0.1:55752 - "POST /node/69fef499254d3291e98df2bd HTTP/1.0" 202 Accepted 2026-05-09 08:48:33,071 - lava_callback - INFO - Starting async job submit for node 69fef499254d3291e98df2bd 2026-05-09 08:48:33,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:33,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef499254d3291e98df2bd HTTP/1.1" 200 None 2026-05-09 08:48:33,106 - lava_callback - DEBUG - Processing node 69fef499254d3291e98df2bd: baseline-arm64 2026-05-09 08:48:33,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:33,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:33,418 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef499254d3291e98df2bd/log.txt.gz 2026-05-09 08:48:33,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:33,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:33,720 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef499254d3291e98df2bd/lava-logs.yaml 2026-05-09 08:48:33,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:33,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:33,825 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef499254d3291e98df2bd/lava_callback.json.gz 2026-05-09 08:48:33,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:33,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef499254d3291e98df2bd HTTP/1.1" 200 None 2026-05-09 08:48:33,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:33,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:48:33,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:33,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef499254d3291e98df2bd HTTP/1.1" 200 None 2026-05-09 08:48:33,905 - lava_callback - INFO - Completed processing callback for node 69fef499254d3291e98df2bd INFO: 172.21.0.1:55758 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:48:39,660 - lava_callback - INFO - Received callback for node 69fef498254d3291e98df2ba INFO: 172.21.0.1:55774 - "POST /node/69fef498254d3291e98df2ba HTTP/1.0" 202 Accepted 2026-05-09 08:48:39,666 - lava_callback - INFO - Starting async job submit for node 69fef498254d3291e98df2ba 2026-05-09 08:48:39,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:39,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef498254d3291e98df2ba HTTP/1.1" 200 None 2026-05-09 08:48:39,702 - lava_callback - DEBUG - Processing node 69fef498254d3291e98df2ba: baseline-arm64 2026-05-09 08:48:39,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:40,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:40,070 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef498254d3291e98df2ba/log.txt.gz 2026-05-09 08:48:40,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:40,317 - lava_callback - INFO - Received callback for node 69fef4a5254d3291e98df2f0 INFO: 172.21.0.1:53024 - "POST /node/69fef4a5254d3291e98df2f0 HTTP/1.0" 202 Accepted 2026-05-09 08:48:40,325 - lava_callback - INFO - Starting async job submit for node 69fef4a5254d3291e98df2f0 2026-05-09 08:48:40,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:40,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a5254d3291e98df2f0 HTTP/1.1" 200 None 2026-05-09 08:48:40,361 - lava_callback - DEBUG - Processing node 69fef4a5254d3291e98df2f0: baseline-arm64 2026-05-09 08:48:40,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:40,431 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef498254d3291e98df2ba/lava-logs.yaml 2026-05-09 08:48:40,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:40,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:40,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:40,693 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef498254d3291e98df2ba/lava_callback.json.gz 2026-05-09 08:48:40,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:40,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:40,720 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a5254d3291e98df2f0/log.txt.gz 2026-05-09 08:48:40,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef498254d3291e98df2ba HTTP/1.1" 200 None 2026-05-09 08:48:40,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:40,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:48:40,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:40,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:40,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:40,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef498254d3291e98df2ba HTTP/1.1" 200 None 2026-05-09 08:48:40,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-09 08:48:40,944 - lava_callback - INFO - Completed processing callback for node 69fef498254d3291e98df2ba 2026-05-09 08:48:41,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:41,107 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a5254d3291e98df2f0/lava-logs.yaml 2026-05-09 08:48:41,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:41,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:41,226 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a5254d3291e98df2f0/lava_callback.json.gz 2026-05-09 08:48:41,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:41,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a5254d3291e98df2f0 HTTP/1.1" 200 None 2026-05-09 08:48:41,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:41,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:48:41,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:41,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4a5254d3291e98df2f0 HTTP/1.1" 200 None 2026-05-09 08:48:41,314 - lava_callback - INFO - Completed processing callback for node 69fef4a5254d3291e98df2f0 2026-05-09 08:48:41,652 - lava_callback - INFO - Received callback for node 69fef49e254d3291e98df2dc INFO: 172.21.0.1:53038 - "POST /node/69fef49e254d3291e98df2dc HTTP/1.0" 202 Accepted 2026-05-09 08:48:41,660 - lava_callback - INFO - Starting async job submit for node 69fef49e254d3291e98df2dc 2026-05-09 08:48:41,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:41,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef49e254d3291e98df2dc HTTP/1.1" 200 None 2026-05-09 08:48:41,700 - lava_callback - DEBUG - Processing node 69fef49e254d3291e98df2dc: baseline-arm64 2026-05-09 08:48:41,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:42,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:42,030 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49e254d3291e98df2dc/log.txt.gz 2026-05-09 08:48:42,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:42,366 - lava_callback - INFO - Received callback for node 69fef49f254d3291e98df2df INFO: 172.21.0.1:53050 - "POST /node/69fef49f254d3291e98df2df HTTP/1.0" 202 Accepted 2026-05-09 08:48:42,373 - lava_callback - INFO - Starting async job submit for node 69fef49f254d3291e98df2df 2026-05-09 08:48:42,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:42,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:42,398 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49e254d3291e98df2dc/lava-logs.yaml 2026-05-09 08:48:42,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:42,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef49f254d3291e98df2df HTTP/1.1" 200 None 2026-05-09 08:48:42,412 - lava_callback - DEBUG - Processing node 69fef49f254d3291e98df2df: baseline-arm64 2026-05-09 08:48:42,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:42,590 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49e254d3291e98df2dc/lava_callback.json.gz 2026-05-09 08:48:42,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:42,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef49e254d3291e98df2dc HTTP/1.1" 200 None 2026-05-09 08:48:42,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:42,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:42,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:48:42,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:42,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef49e254d3291e98df2dc HTTP/1.1" 200 None 2026-05-09 08:48:42,822 - lava_callback - INFO - Completed processing callback for node 69fef49e254d3291e98df2dc 2026-05-09 08:48:42,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:42,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49f254d3291e98df2df/log.txt.gz 2026-05-09 08:48:43,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:43,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:43,273 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49f254d3291e98df2df/lava-logs.yaml 2026-05-09 08:48:43,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:43,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:43,407 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49f254d3291e98df2df/lava_callback.json.gz 2026-05-09 08:48:43,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:43,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef49f254d3291e98df2df HTTP/1.1" 200 None 2026-05-09 08:48:43,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:43,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:48:43,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:43,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef49f254d3291e98df2df HTTP/1.1" 200 None 2026-05-09 08:48:43,477 - lava_callback - INFO - Completed processing callback for node 69fef49f254d3291e98df2df INFO: 172.21.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33432 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:48:58,486 - lava_callback - INFO - Received callback for node 69fef4a7254d3291e98df2f7 INFO: 172.21.0.1:33440 - "POST /node/69fef4a7254d3291e98df2f7 HTTP/1.0" 202 Accepted 2026-05-09 08:48:58,492 - lava_callback - INFO - Starting async job submit for node 69fef4a7254d3291e98df2f7 2026-05-09 08:48:58,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:58,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a7254d3291e98df2f7 HTTP/1.1" 200 None 2026-05-09 08:48:58,526 - lava_callback - DEBUG - Processing node 69fef4a7254d3291e98df2f7: baseline-arm64 2026-05-09 08:48:58,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:59,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:59,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a7254d3291e98df2f7/log.txt.gz 2026-05-09 08:48:59,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:59,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:59,311 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a7254d3291e98df2f7/lava-logs.yaml 2026-05-09 08:48:59,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:48:59,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:48:59,413 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a7254d3291e98df2f7/lava_callback.json.gz 2026-05-09 08:48:59,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:59,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a7254d3291e98df2f7 HTTP/1.1" 200 None 2026-05-09 08:48:59,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:59,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:48:59,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:48:59,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4a7254d3291e98df2f7 HTTP/1.1" 200 None 2026-05-09 08:48:59,481 - lava_callback - INFO - Completed processing callback for node 69fef4a7254d3291e98df2f7 2026-05-09 08:49:03,230 - lava_callback - INFO - Received callback for node 69fef4a0254d3291e98df2e2 INFO: 172.21.0.1:45462 - "POST /node/69fef4a0254d3291e98df2e2 HTTP/1.0" 202 Accepted 2026-05-09 08:49:03,237 - lava_callback - INFO - Starting async job submit for node 69fef4a0254d3291e98df2e2 2026-05-09 08:49:03,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:03,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a0254d3291e98df2e2 HTTP/1.1" 200 None 2026-05-09 08:49:03,273 - lava_callback - DEBUG - Processing node 69fef4a0254d3291e98df2e2: baseline-arm64 2026-05-09 08:49:03,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:03,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:03,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a0254d3291e98df2e2/log.txt.gz 2026-05-09 08:49:03,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:04,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:04,007 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a0254d3291e98df2e2/lava-logs.yaml 2026-05-09 08:49:04,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:04,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:04,118 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a0254d3291e98df2e2/lava_callback.json.gz 2026-05-09 08:49:04,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:04,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a0254d3291e98df2e2 HTTP/1.1" 200 None 2026-05-09 08:49:04,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:04,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:04,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:04,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4a0254d3291e98df2e2 HTTP/1.1" 200 None 2026-05-09 08:49:04,256 - lava_callback - INFO - Completed processing callback for node 69fef4a0254d3291e98df2e2 2026-05-09 08:49:04,753 - lava_callback - INFO - Received callback for node 69fc51fb55ff273b190b98cc INFO: 172.21.0.1:45476 - "POST /node/69fc51fb55ff273b190b98cc HTTP/1.0" 202 Accepted 2026-05-09 08:49:04,758 - lava_callback - INFO - Starting async job submit for node 69fc51fb55ff273b190b98cc 2026-05-09 08:49:04,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:04,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc51fb55ff273b190b98cc HTTP/1.1" 200 None 2026-05-09 08:49:04,773 - lava_callback - DEBUG - Processing node 69fc51fb55ff273b190b98cc: baseline-arm-baylibre 2026-05-09 08:49:04,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc51fb55ff273b190b98cc 2026-05-09 08:49:04,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:04,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc51fb55ff273b190b98cc HTTP/1.1" 200 None 2026-05-09 08:49:04,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:04,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 08:49:04,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:04,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc51fb55ff273b190b98cc HTTP/1.1" 200 None 2026-05-09 08:49:04,829 - lava_callback - ERROR - Error processing callback for node 69fc51fb55ff273b190b98cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45496 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:49:10,430 - lava_callback - INFO - Received callback for node 69fef4a1254d3291e98df2e5 INFO: 172.21.0.1:40066 - "POST /node/69fef4a1254d3291e98df2e5 HTTP/1.0" 202 Accepted 2026-05-09 08:49:10,438 - lava_callback - INFO - Starting async job submit for node 69fef4a1254d3291e98df2e5 2026-05-09 08:49:10,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:10,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a1254d3291e98df2e5 HTTP/1.1" 200 None 2026-05-09 08:49:10,480 - lava_callback - DEBUG - Processing node 69fef4a1254d3291e98df2e5: baseline-arm64 2026-05-09 08:49:10,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:10,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:10,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-09 08:49:11,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:11,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a1254d3291e98df2e5/log.txt.gz 2026-05-09 08:49:11,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:11,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:11,524 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a1254d3291e98df2e5/lava-logs.yaml 2026-05-09 08:49:11,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:11,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:11,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a1254d3291e98df2e5/lava_callback.json.gz 2026-05-09 08:49:11,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:11,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a1254d3291e98df2e5 HTTP/1.1" 200 None 2026-05-09 08:49:11,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:11,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:11,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:11,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4a1254d3291e98df2e5 HTTP/1.1" 200 None 2026-05-09 08:49:11,850 - lava_callback - INFO - Completed processing callback for node 69fef4a1254d3291e98df2e5 2026-05-09 08:49:12,912 - lava_callback - INFO - Received callback for node 69fef4ae254d3291e98df30d INFO: 172.21.0.1:40070 - "POST /node/69fef4ae254d3291e98df30d HTTP/1.0" 202 Accepted 2026-05-09 08:49:12,922 - lava_callback - INFO - Starting async job submit for node 69fef4ae254d3291e98df30d 2026-05-09 08:49:12,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:12,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4ae254d3291e98df30d HTTP/1.1" 200 None 2026-05-09 08:49:12,991 - lava_callback - DEBUG - Processing node 69fef4ae254d3291e98df30d: baseline-nfs-arm64 2026-05-09 08:49:13,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:13,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:13,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4ae254d3291e98df30d/log.txt.gz 2026-05-09 08:49:13,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:14,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:14,124 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4ae254d3291e98df30d/lava-logs.yaml 2026-05-09 08:49:14,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:14,223 - lava_callback - INFO - Received callback for node 69fef4ab254d3291e98df306 INFO: 172.21.0.1:40078 - "POST /node/69fef4ab254d3291e98df306 HTTP/1.0" 202 Accepted 2026-05-09 08:49:14,234 - lava_callback - INFO - Starting async job submit for node 69fef4ab254d3291e98df306 2026-05-09 08:49:14,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:14,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4ab254d3291e98df306 HTTP/1.1" 200 None 2026-05-09 08:49:14,276 - lava_callback - DEBUG - Processing node 69fef4ab254d3291e98df306: baseline-nfs-arm64 2026-05-09 08:49:14,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:14,303 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4ae254d3291e98df30d/lava_callback.json.gz 2026-05-09 08:49:14,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:14,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4ae254d3291e98df30d HTTP/1.1" 200 None 2026-05-09 08:49:14,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:14,526 - lava_callback - INFO - Received callback for node 69fef4b2254d3291e98df321 2026-05-09 08:49:14,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:14,544 - lava_callback - INFO - Starting async job submit for node 69fef4b2254d3291e98df321 INFO: 172.21.0.1:40092 - "POST /node/69fef4b2254d3291e98df321 HTTP/1.0" 202 Accepted 2026-05-09 08:49:14,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:14,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:14,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4ae254d3291e98df30d HTTP/1.1" 200 None 2026-05-09 08:49:14,703 - lava_callback - INFO - Completed processing callback for node 69fef4ae254d3291e98df30d 2026-05-09 08:49:14,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4b2254d3291e98df321 HTTP/1.1" 200 None 2026-05-09 08:49:14,736 - lava_callback - DEBUG - Processing node 69fef4b2254d3291e98df321: baseline-nfs-arm64 2026-05-09 08:49:15,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:15,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.21.0.1:40096 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-09 08:49:15,194 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4ab254d3291e98df306/log.txt.gz 2026-05-09 08:49:15,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:15,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:15,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:15,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4b2254d3291e98df321/log.txt.gz 2026-05-09 08:49:15,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:15,825 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4ab254d3291e98df306/lava-logs.yaml 2026-05-09 08:49:15,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:15,910 - lava_callback - INFO - Received callback for node 69fef4b4254d3291e98df328 INFO: 172.21.0.1:40106 - "POST /node/69fef4b4254d3291e98df328 HTTP/1.0" 202 Accepted 2026-05-09 08:49:15,930 - lava_callback - INFO - Starting async job submit for node 69fef4b4254d3291e98df328 2026-05-09 08:49:16,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:16,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:16,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4b4254d3291e98df328 HTTP/1.1" 200 None 2026-05-09 08:49:16,044 - lava_callback - DEBUG - Processing node 69fef4b4254d3291e98df328: baseline-nfs-arm64 2026-05-09 08:49:16,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:16,167 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4ab254d3291e98df306/lava_callback.json.gz 2026-05-09 08:49:16,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:16,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:16,274 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4b2254d3291e98df321/lava-logs.yaml 2026-05-09 08:49:16,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:16,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4ab254d3291e98df306 HTTP/1.1" 200 None 2026-05-09 08:49:16,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:16,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:16,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:16,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.21.0.1:40120 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:49:16,574 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4b2254d3291e98df321/lava_callback.json.gz 2026-05-09 08:49:16,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4ab254d3291e98df306 HTTP/1.1" 200 None 2026-05-09 08:49:16,593 - lava_callback - INFO - Completed processing callback for node 69fef4ab254d3291e98df306 2026-05-09 08:49:16,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:16,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:16,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4b2254d3291e98df321 HTTP/1.1" 200 None 2026-05-09 08:49:16,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:16,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:16,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:16,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4b2254d3291e98df321 HTTP/1.1" 200 None 2026-05-09 08:49:16,806 - lava_callback - INFO - Completed processing callback for node 69fef4b2254d3291e98df321 2026-05-09 08:49:16,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:16,878 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4b4254d3291e98df328/log.txt.gz 2026-05-09 08:49:16,989 - lava_callback - INFO - Received callback for node 69fef4da254d3291e98df3e7 INFO: 172.21.0.1:40124 - "POST /node/69fef4da254d3291e98df3e7 HTTP/1.0" 202 Accepted 2026-05-09 08:49:17,012 - lava_callback - INFO - Starting async job submit for node 69fef4da254d3291e98df3e7 2026-05-09 08:49:17,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:17,156 - lava_callback - INFO - Received callback for node 69fef4d9254d3291e98df3e4 INFO: 172.21.0.1:40128 - "POST /node/69fef4d9254d3291e98df3e4 HTTP/1.0" 202 Accepted 2026-05-09 08:49:17,177 - lava_callback - INFO - Starting async job submit for node 69fef4d9254d3291e98df3e4 2026-05-09 08:49:17,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4da254d3291e98df3e7 HTTP/1.1" 200 None 2026-05-09 08:49:17,194 - lava_callback - DEBUG - Processing node 69fef4da254d3291e98df3e7: baseline-arm64-foundriesio 2026-05-09 08:49:17,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:17,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:17,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d9254d3291e98df3e4 HTTP/1.1" 200 None 2026-05-09 08:49:17,395 - lava_callback - DEBUG - Processing node 69fef4d9254d3291e98df3e4: baseline-arm64-foundriesio 2026-05-09 08:49:17,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:17,773 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4b4254d3291e98df328/lava-logs.yaml 2026-05-09 08:49:17,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:18,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:18,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:18,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:18,131 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fef4d9254d3291e98df3e4/log.txt.gz 2026-05-09 08:49:18,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:18,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:18,178 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4b4254d3291e98df328/lava_callback.json.gz 2026-05-09 08:49:18,250 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fef4da254d3291e98df3e7/log.txt.gz 2026-05-09 08:49:18,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:18,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4b4254d3291e98df328 HTTP/1.1" 200 None 2026-05-09 08:49:18,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:18,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:18,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:18,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:18,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4b4254d3291e98df328 HTTP/1.1" 200 None 2026-05-09 08:49:18,644 - lava_callback - INFO - Completed processing callback for node 69fef4b4254d3291e98df328 2026-05-09 08:49:18,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:18,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:18,697 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fef4d9254d3291e98df3e4/lava-logs.yaml 2026-05-09 08:49:18,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:18,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:18,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fef4d9254d3291e98df3e4/lava_callback.json.gz 2026-05-09 08:49:18,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:18,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:18,990 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fef4da254d3291e98df3e7/lava-logs.yaml 2026-05-09 08:49:18,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d9254d3291e98df3e4 HTTP/1.1" 200 None 2026-05-09 08:49:19,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:19,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:19,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:19,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:19,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4d9254d3291e98df3e4 HTTP/1.1" 200 None 2026-05-09 08:49:19,068 - lava_callback - INFO - Completed processing callback for node 69fef4d9254d3291e98df3e4 2026-05-09 08:49:19,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:19,166 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fef4da254d3291e98df3e7/lava_callback.json.gz 2026-05-09 08:49:19,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:19,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4da254d3291e98df3e7 HTTP/1.1" 200 None 2026-05-09 08:49:19,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:19,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:19,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:19,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4da254d3291e98df3e7 HTTP/1.1" 200 None 2026-05-09 08:49:19,316 - lava_callback - INFO - Completed processing callback for node 69fef4da254d3291e98df3e7 2026-05-09 08:49:20,657 - lava_callback - INFO - Received callback for node 69fef4bf254d3291e98df362 INFO: 172.21.0.1:51906 - "POST /node/69fef4bf254d3291e98df362 HTTP/1.0" 202 Accepted 2026-05-09 08:49:20,667 - lava_callback - INFO - Starting async job submit for node 69fef4bf254d3291e98df362 2026-05-09 08:49:20,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:20,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4bf254d3291e98df362 HTTP/1.1" 200 None 2026-05-09 08:49:20,724 - lava_callback - DEBUG - Processing node 69fef4bf254d3291e98df362: baseline-arm64-broonie 2026-05-09 08:49:20,856 - lava_callback - INFO - Received callback for node 69fef4af254d3291e98df310 INFO: 172.21.0.1:51910 - "POST /node/69fef4af254d3291e98df310 HTTP/1.0" 202 Accepted 2026-05-09 08:49:20,935 - lava_callback - INFO - Starting async job submit for node 69fef4af254d3291e98df310 2026-05-09 08:49:21,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:21,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4af254d3291e98df310 HTTP/1.1" 200 None 2026-05-09 08:49:21,115 - lava_callback - DEBUG - Processing node 69fef4af254d3291e98df310: baseline-nfs-arm64 2026-05-09 08:49:21,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:21,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:21,471 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4bf254d3291e98df362/log.txt.gz 2026-05-09 08:49:21,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:22,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:22,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:22,091 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4bf254d3291e98df362/lava-logs.yaml 2026-05-09 08:49:22,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:22,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:22,130 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4af254d3291e98df310/log.txt.gz 2026-05-09 08:49:22,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:22,247 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4bf254d3291e98df362/lava_callback.json.gz 2026-05-09 08:49:22,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:22,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4bf254d3291e98df362 HTTP/1.1" 200 None 2026-05-09 08:49:22,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:22,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:22,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:22,472 - lava_callback - INFO - Received callback for node 69fef497254d3291e98df2b6 INFO: 172.21.0.1:51914 - "POST /node/69fef497254d3291e98df2b6 HTTP/1.0" 202 Accepted 2026-05-09 08:49:22,511 - lava_callback - INFO - Starting async job submit for node 69fef497254d3291e98df2b6 2026-05-09 08:49:22,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4bf254d3291e98df362 HTTP/1.1" 200 None 2026-05-09 08:49:22,581 - lava_callback - INFO - Completed processing callback for node 69fef4bf254d3291e98df362 2026-05-09 08:49:22,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:22,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef497254d3291e98df2b6 HTTP/1.1" 200 None 2026-05-09 08:49:22,710 - lava_callback - DEBUG - Processing node 69fef497254d3291e98df2b6: baseline-arm64 2026-05-09 08:49:22,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:23,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:23,144 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4af254d3291e98df310/lava-logs.yaml 2026-05-09 08:49:23,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:23,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:23,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:23,251 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef497254d3291e98df2b6/log.txt.gz 2026-05-09 08:49:23,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:23,365 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4af254d3291e98df310/lava_callback.json.gz 2026-05-09 08:49:23,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:23,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:23,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4af254d3291e98df310 HTTP/1.1" 200 None 2026-05-09 08:49:23,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:23,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:23,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:23,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4af254d3291e98df310 HTTP/1.1" 200 None 2026-05-09 08:49:23,505 - lava_callback - INFO - Completed processing callback for node 69fef4af254d3291e98df310 2026-05-09 08:49:23,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:23,619 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef497254d3291e98df2b6/lava-logs.yaml 2026-05-09 08:49:23,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:23,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:23,791 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef497254d3291e98df2b6/lava_callback.json.gz 2026-05-09 08:49:23,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:23,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef497254d3291e98df2b6 HTTP/1.1" 200 None 2026-05-09 08:49:23,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:23,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:23,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:23,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef497254d3291e98df2b6 HTTP/1.1" 200 None 2026-05-09 08:49:23,883 - lava_callback - INFO - Completed processing callback for node 69fef497254d3291e98df2b6 2026-05-09 08:49:24,728 - lava_callback - INFO - Received callback for node 69fef4d5254d3291e98df3ad INFO: 172.21.0.1:51926 - "POST /node/69fef4d5254d3291e98df3ad HTTP/1.0" 202 Accepted 2026-05-09 08:49:24,735 - lava_callback - INFO - Starting async job submit for node 69fef4d5254d3291e98df3ad 2026-05-09 08:49:24,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:24,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d5254d3291e98df3ad HTTP/1.1" 200 None 2026-05-09 08:49:24,778 - lava_callback - DEBUG - Processing node 69fef4d5254d3291e98df3ad: baseline-arm64-pengutronix 2026-05-09 08:49:24,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:25,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:25,043 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fef4d5254d3291e98df3ad/log.txt.gz 2026-05-09 08:49:25,158 - lava_callback - INFO - Received callback for node 69fef4a9254d3291e98df300 INFO: 172.21.0.1:51938 - "POST /node/69fef4a9254d3291e98df300 HTTP/1.0" 202 Accepted 2026-05-09 08:49:25,184 - lava_callback - INFO - Starting async job submit for node 69fef4a9254d3291e98df300 2026-05-09 08:49:25,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:25,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:25,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a9254d3291e98df300 HTTP/1.1" 200 None 2026-05-09 08:49:25,261 - lava_callback - DEBUG - Processing node 69fef4a9254d3291e98df300: baseline-nfs-arm64 2026-05-09 08:49:25,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:25,477 - lava_callback - INFO - Received callback for node 69fef4d3254d3291e98df3a8 2026-05-09 08:49:25,488 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fef4d5254d3291e98df3ad/lava-logs.yaml INFO: 172.21.0.1:51944 - "POST /node/69fef4d3254d3291e98df3a8 HTTP/1.0" 202 Accepted 2026-05-09 08:49:25,530 - lava_callback - INFO - Starting async job submit for node 69fef4d3254d3291e98df3a8 2026-05-09 08:49:25,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:25,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:25,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d3254d3291e98df3a8 HTTP/1.1" 200 None 2026-05-09 08:49:25,779 - lava_callback - DEBUG - Processing node 69fef4d3254d3291e98df3a8: baseline-arm64-kontron 2026-05-09 08:49:25,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:25,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:25,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fef4d5254d3291e98df3ad/lava_callback.json.gz 2026-05-09 08:49:25,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:25,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d5254d3291e98df3ad HTTP/1.1" 200 None 2026-05-09 08:49:25,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:26,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:26,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:26,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:26,061 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4a9254d3291e98df300/log.txt.gz 2026-05-09 08:49:26,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4d5254d3291e98df3ad HTTP/1.1" 200 None 2026-05-09 08:49:26,305 - lava_callback - INFO - Completed processing callback for node 69fef4d5254d3291e98df3ad 2026-05-09 08:49:26,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51956 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:49:26,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:26,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:26,553 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fef4d3254d3291e98df3a8/log.txt.gz 2026-05-09 08:49:26,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:26,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:26,762 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4a9254d3291e98df300/lava-logs.yaml 2026-05-09 08:49:26,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:26,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:26,887 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4a9254d3291e98df300/lava_callback.json.gz 2026-05-09 08:49:26,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:26,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a9254d3291e98df300 HTTP/1.1" 200 None 2026-05-09 08:49:26,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:26,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:26,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:27,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:27,012 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fef4d3254d3291e98df3a8/lava-logs.yaml 2026-05-09 08:49:27,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:27,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4a9254d3291e98df300 HTTP/1.1" 200 None 2026-05-09 08:49:27,035 - lava_callback - INFO - Completed processing callback for node 69fef4a9254d3291e98df300 2026-05-09 08:49:27,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:27,211 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fef4d3254d3291e98df3a8/lava_callback.json.gz 2026-05-09 08:49:27,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:27,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d3254d3291e98df3a8 HTTP/1.1" 200 None 2026-05-09 08:49:27,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:27,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:27,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:27,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4d3254d3291e98df3a8 HTTP/1.1" 200 None 2026-05-09 08:49:27,304 - lava_callback - INFO - Completed processing callback for node 69fef4d3254d3291e98df3a8 INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:49:40,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:40,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-09 08:49:42,632 - lava_callback - INFO - Received callback for node 69fef4c6254d3291e98df377 INFO: 172.21.0.1:46558 - "POST /node/69fef4c6254d3291e98df377 HTTP/1.0" 202 Accepted 2026-05-09 08:49:42,641 - lava_callback - INFO - Starting async job submit for node 69fef4c6254d3291e98df377 2026-05-09 08:49:42,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:42,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c6254d3291e98df377 HTTP/1.1" 200 None 2026-05-09 08:49:42,690 - lava_callback - DEBUG - Processing node 69fef4c6254d3291e98df377: baseline-arm64-broonie 2026-05-09 08:49:42,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:43,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:43,101 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c6254d3291e98df377/log.txt.gz 2026-05-09 08:49:43,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:43,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:43,442 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c6254d3291e98df377/lava-logs.yaml 2026-05-09 08:49:43,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:43,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:43,580 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c6254d3291e98df377/lava_callback.json.gz 2026-05-09 08:49:43,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:43,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c6254d3291e98df377 HTTP/1.1" 200 None 2026-05-09 08:49:43,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:43,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:43,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:43,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4c6254d3291e98df377 HTTP/1.1" 200 None 2026-05-09 08:49:43,691 - lava_callback - INFO - Completed processing callback for node 69fef4c6254d3291e98df377 INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:49:46,715 - lava_callback - INFO - Received callback for node 69fef4d7254d3291e98df3d8 INFO: 172.21.0.1:46572 - "POST /node/69fef4d7254d3291e98df3d8 HTTP/1.0" 202 Accepted 2026-05-09 08:49:46,722 - lava_callback - INFO - Starting async job submit for node 69fef4d7254d3291e98df3d8 2026-05-09 08:49:46,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:46,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d7254d3291e98df3d8 HTTP/1.1" 200 None 2026-05-09 08:49:46,767 - lava_callback - DEBUG - Processing node 69fef4d7254d3291e98df3d8: baseline-arm64-pengutronix 2026-05-09 08:49:46,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:47,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:47,091 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fef4d7254d3291e98df3d8/log.txt.gz 2026-05-09 08:49:47,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:47,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:47,390 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fef4d7254d3291e98df3d8/lava-logs.yaml 2026-05-09 08:49:47,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:49:47,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:49:47,496 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fef4d7254d3291e98df3d8/lava_callback.json.gz 2026-05-09 08:49:47,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:47,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d7254d3291e98df3d8 HTTP/1.1" 200 None 2026-05-09 08:49:47,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:47,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:49:47,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:47,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4d7254d3291e98df3d8 HTTP/1.1" 200 None 2026-05-09 08:49:47,580 - lava_callback - INFO - Completed processing callback for node 69fef4d7254d3291e98df3d8 2026-05-09 08:49:53,792 - lava_callback - INFO - Received callback for node 69fc522355ff273b190b98dd INFO: 172.21.0.1:32786 - "POST /node/69fc522355ff273b190b98dd HTTP/1.0" 202 Accepted 2026-05-09 08:49:53,799 - lava_callback - INFO - Starting async job submit for node 69fc522355ff273b190b98dd 2026-05-09 08:49:53,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:53,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc522355ff273b190b98dd HTTP/1.1" 200 None 2026-05-09 08:49:53,822 - lava_callback - DEBUG - Processing node 69fc522355ff273b190b98dd: baseline-arm-clabbe 2026-05-09 08:49:53,822 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc522355ff273b190b98dd 2026-05-09 08:49:53,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:53,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc522355ff273b190b98dd HTTP/1.1" 200 None 2026-05-09 08:49:53,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:53,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 08:49:53,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:49:53,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc522355ff273b190b98dd HTTP/1.1" 200 None 2026-05-09 08:49:53,893 - lava_callback - ERROR - Error processing callback for node 69fc522355ff273b190b98dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32788 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:50:03,767 - lava_callback - INFO - Received callback for node 69fef4c2254d3291e98df368 INFO: 172.21.0.1:47422 - "POST /node/69fef4c2254d3291e98df368 HTTP/1.0" 202 Accepted 2026-05-09 08:50:03,778 - lava_callback - INFO - Starting async job submit for node 69fef4c2254d3291e98df368 2026-05-09 08:50:03,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:03,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c2254d3291e98df368 HTTP/1.1" 200 None 2026-05-09 08:50:03,837 - lava_callback - DEBUG - Processing node 69fef4c2254d3291e98df368: baseline-arm64-broonie 2026-05-09 08:50:04,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:04,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:04,270 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c2254d3291e98df368/log.txt.gz 2026-05-09 08:50:04,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:04,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:04,779 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c2254d3291e98df368/lava-logs.yaml 2026-05-09 08:50:04,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:04,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:04,908 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c2254d3291e98df368/lava_callback.json.gz 2026-05-09 08:50:04,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:04,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c2254d3291e98df368 HTTP/1.1" 200 None 2026-05-09 08:50:04,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:04,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:50:04,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:05,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4c2254d3291e98df368 HTTP/1.1" 200 None 2026-05-09 08:50:05,023 - lava_callback - INFO - Completed processing callback for node 69fef4c2254d3291e98df368 2026-05-09 08:50:05,266 - lava_callback - INFO - Received callback for node 69fef4c9254d3291e98df37d INFO: 172.21.0.1:47424 - "POST /node/69fef4c9254d3291e98df37d HTTP/1.0" 202 Accepted 2026-05-09 08:50:05,275 - lava_callback - INFO - Starting async job submit for node 69fef4c9254d3291e98df37d 2026-05-09 08:50:05,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:05,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c9254d3291e98df37d HTTP/1.1" 200 None 2026-05-09 08:50:05,386 - lava_callback - DEBUG - Processing node 69fef4c9254d3291e98df37d: baseline-arm64-broonie 2026-05-09 08:50:05,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:05,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:05,877 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c9254d3291e98df37d/log.txt.gz INFO: 172.21.0.1:47434 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:50:06,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:06,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:06,230 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c9254d3291e98df37d/lava-logs.yaml 2026-05-09 08:50:06,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:06,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:06,383 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c9254d3291e98df37d/lava_callback.json.gz 2026-05-09 08:50:06,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:06,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c9254d3291e98df37d HTTP/1.1" 200 None 2026-05-09 08:50:06,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:06,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:50:06,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:06,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4c9254d3291e98df37d HTTP/1.1" 200 None 2026-05-09 08:50:06,478 - lava_callback - INFO - Completed processing callback for node 69fef4c9254d3291e98df37d INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:50:10,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:11,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:36920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:50:23,775 - lava_callback - INFO - Received callback for node 69fef4c3254d3291e98df36f INFO: 172.21.0.1:32810 - "POST /node/69fef4c3254d3291e98df36f HTTP/1.0" 202 Accepted 2026-05-09 08:50:23,784 - lava_callback - INFO - Starting async job submit for node 69fef4c3254d3291e98df36f 2026-05-09 08:50:23,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:23,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c3254d3291e98df36f HTTP/1.1" 200 None 2026-05-09 08:50:23,824 - lava_callback - DEBUG - Processing node 69fef4c3254d3291e98df36f: baseline-arm64-broonie 2026-05-09 08:50:24,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:24,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:24,319 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c3254d3291e98df36f/log.txt.gz 2026-05-09 08:50:24,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:24,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:24,591 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c3254d3291e98df36f/lava-logs.yaml 2026-05-09 08:50:24,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:24,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:24,690 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c3254d3291e98df36f/lava_callback.json.gz 2026-05-09 08:50:24,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:24,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c3254d3291e98df36f HTTP/1.1" 200 None 2026-05-09 08:50:24,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:24,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:50:24,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:24,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4c3254d3291e98df36f HTTP/1.1" 200 None 2026-05-09 08:50:24,761 - lava_callback - INFO - Completed processing callback for node 69fef4c3254d3291e98df36f 2026-05-09 08:50:25,227 - lava_callback - INFO - Received callback for node 69fef4c8254d3291e98df37a INFO: 172.21.0.1:32822 - "POST /node/69fef4c8254d3291e98df37a HTTP/1.0" 202 Accepted 2026-05-09 08:50:25,233 - lava_callback - INFO - Starting async job submit for node 69fef4c8254d3291e98df37a 2026-05-09 08:50:25,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:25,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c8254d3291e98df37a HTTP/1.1" 200 None 2026-05-09 08:50:25,271 - lava_callback - DEBUG - Processing node 69fef4c8254d3291e98df37a: baseline-arm64-broonie 2026-05-09 08:50:25,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:25,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:25,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c8254d3291e98df37a/log.txt.gz 2026-05-09 08:50:25,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:25,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:25,920 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c8254d3291e98df37a/lava-logs.yaml 2026-05-09 08:50:25,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:26,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:26,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c8254d3291e98df37a/lava_callback.json.gz 2026-05-09 08:50:26,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:26,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c8254d3291e98df37a HTTP/1.1" 200 None 2026-05-09 08:50:26,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:26,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:50:26,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:26,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4c8254d3291e98df37a HTTP/1.1" 200 None 2026-05-09 08:50:26,102 - lava_callback - INFO - Completed processing callback for node 69fef4c8254d3291e98df37a INFO: 172.21.0.1:32834 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:50:28,456 - lava_callback - INFO - Received callback for node 69fef4d0254d3291e98df39c INFO: 172.21.0.1:32836 - "POST /node/69fef4d0254d3291e98df39c HTTP/1.0" 202 Accepted 2026-05-09 08:50:28,462 - lava_callback - INFO - Starting async job submit for node 69fef4d0254d3291e98df39c 2026-05-09 08:50:28,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:28,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d0254d3291e98df39c HTTP/1.1" 200 None 2026-05-09 08:50:28,498 - lava_callback - DEBUG - Processing node 69fef4d0254d3291e98df39c: baseline-arm64-clabbe 2026-05-09 08:50:28,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:28,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:28,795 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fef4d0254d3291e98df39c/log.txt.gz 2026-05-09 08:50:28,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:29,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:29,072 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fef4d0254d3291e98df39c/lava-logs.yaml 2026-05-09 08:50:29,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:29,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:29,172 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fef4d0254d3291e98df39c/lava_callback.json.gz 2026-05-09 08:50:29,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:29,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d0254d3291e98df39c HTTP/1.1" 200 None 2026-05-09 08:50:29,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:29,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:50:29,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:29,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4d0254d3291e98df39c HTTP/1.1" 200 None 2026-05-09 08:50:29,250 - lava_callback - INFO - Completed processing callback for node 69fef4d0254d3291e98df39c 2026-05-09 08:50:33,808 - lava_callback - INFO - Received callback for node 69fc524b55ff273b190b9903 INFO: 172.21.0.1:42148 - "POST /node/69fc524b55ff273b190b9903 HTTP/1.0" 202 Accepted 2026-05-09 08:50:33,814 - lava_callback - INFO - Starting async job submit for node 69fc524b55ff273b190b9903 2026-05-09 08:50:33,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:33,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc524b55ff273b190b9903 HTTP/1.1" 200 None 2026-05-09 08:50:33,828 - lava_callback - DEBUG - Processing node 69fc524b55ff273b190b9903: baseline-arm-clabbe 2026-05-09 08:50:33,829 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc524b55ff273b190b9903 2026-05-09 08:50:33,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:33,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc524b55ff273b190b9903 HTTP/1.1" 200 None 2026-05-09 08:50:33,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:33,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 08:50:33,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:33,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc524b55ff273b190b9903 HTTP/1.1" 200 None 2026-05-09 08:50:33,883 - lava_callback - ERROR - Error processing callback for node 69fc524b55ff273b190b9903: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 08:50:35,502 - lava_callback - INFO - Received callback for node 69fef4d8254d3291e98df3df INFO: 172.21.0.1:42164 - "POST /node/69fef4d8254d3291e98df3df HTTP/1.0" 202 Accepted 2026-05-09 08:50:35,549 - lava_callback - INFO - Starting async job submit for node 69fef4d8254d3291e98df3df 2026-05-09 08:50:35,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:35,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d8254d3291e98df3df HTTP/1.1" 200 None 2026-05-09 08:50:35,584 - lava_callback - DEBUG - Processing node 69fef4d8254d3291e98df3df: baseline-arm64-pengutronix 2026-05-09 08:50:35,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:35,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:35,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fef4d8254d3291e98df3df/log.txt.gz 2026-05-09 08:50:35,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:35,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:35,952 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fef4d8254d3291e98df3df/lava-logs.yaml 2026-05-09 08:50:35,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:36,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:36,041 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fef4d8254d3291e98df3df/lava_callback.json.gz 2026-05-09 08:50:36,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:36,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4d8254d3291e98df3df HTTP/1.1" 200 None 2026-05-09 08:50:36,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:36,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:50:36,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:36,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4d8254d3291e98df3df HTTP/1.1" 200 None 2026-05-09 08:50:36,118 - lava_callback - INFO - Completed processing callback for node 69fef4d8254d3291e98df3df INFO: 172.21.0.1:42176 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:50:40,797 - lava_callback - INFO - Received callback for node 69fef2be254d3291e98df103 INFO: 172.21.0.1:50544 - "POST /node/69fef2be254d3291e98df103 HTTP/1.0" 202 Accepted 2026-05-09 08:50:40,803 - lava_callback - INFO - Starting async job submit for node 69fef2be254d3291e98df103 2026-05-09 08:50:40,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:40,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2be254d3291e98df103 HTTP/1.1" 200 None 2026-05-09 08:50:40,853 - lava_callback - DEBUG - Processing node 69fef2be254d3291e98df103: ltp-fsx 2026-05-09 08:50:41,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:41,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-09 08:50:41,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:41,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:41,408 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69fef2be254d3291e98df103/log.txt.gz 2026-05-09 08:50:41,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:41,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:41,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69fef2be254d3291e98df103/lava-logs.yaml 2026-05-09 08:50:41,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:41,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:41,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69fef2be254d3291e98df103/lava_callback.json.gz 2026-05-09 08:50:41,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:41,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2be254d3291e98df103 HTTP/1.1" 200 None 2026-05-09 08:50:41,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:41,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:50:41,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:42,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2be254d3291e98df103 HTTP/1.1" 200 None 2026-05-09 08:50:42,005 - lava_callback - INFO - Completed processing callback for node 69fef2be254d3291e98df103 2026-05-09 08:50:42,357 - lava_callback - INFO - Received callback for node 69fef4c0254d3291e98df365 INFO: 172.21.0.1:50558 - "POST /node/69fef4c0254d3291e98df365 HTTP/1.0" 202 Accepted 2026-05-09 08:50:42,363 - lava_callback - INFO - Starting async job submit for node 69fef4c0254d3291e98df365 2026-05-09 08:50:42,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:42,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c0254d3291e98df365 HTTP/1.1" 200 None 2026-05-09 08:50:42,401 - lava_callback - DEBUG - Processing node 69fef4c0254d3291e98df365: baseline-arm64-broonie 2026-05-09 08:50:42,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:42,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:42,726 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c0254d3291e98df365/log.txt.gz 2026-05-09 08:50:42,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:43,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:43,002 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c0254d3291e98df365/lava-logs.yaml 2026-05-09 08:50:43,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:43,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:43,114 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c0254d3291e98df365/lava_callback.json.gz 2026-05-09 08:50:43,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:43,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c0254d3291e98df365 HTTP/1.1" 200 None 2026-05-09 08:50:43,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:43,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:50:43,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:43,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4c0254d3291e98df365 HTTP/1.1" 200 None 2026-05-09 08:50:43,298 - lava_callback - INFO - Completed processing callback for node 69fef4c0254d3291e98df365 2026-05-09 08:50:43,941 - lava_callback - INFO - Received callback for node 69fef2c2254d3291e98df10c INFO: 172.21.0.1:50564 - "POST /node/69fef2c2254d3291e98df10c HTTP/1.0" 202 Accepted 2026-05-09 08:50:43,947 - lava_callback - INFO - Starting async job submit for node 69fef2c2254d3291e98df10c 2026-05-09 08:50:43,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:43,974 - lava_callback - INFO - Received callback for node 69fef4cb254d3291e98df389 INFO: 172.21.0.1:50570 - "POST /node/69fef4cb254d3291e98df389 HTTP/1.0" 202 Accepted 2026-05-09 08:50:43,981 - lava_callback - INFO - Starting async job submit for node 69fef4cb254d3291e98df389 2026-05-09 08:50:44,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:44,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2c2254d3291e98df10c HTTP/1.1" 200 None 2026-05-09 08:50:44,026 - lava_callback - DEBUG - Processing node 69fef2c2254d3291e98df10c: ltp-pty 2026-05-09 08:50:44,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4cb254d3291e98df389 HTTP/1.1" 200 None 2026-05-09 08:50:44,089 - lava_callback - DEBUG - Processing node 69fef4cb254d3291e98df389: baseline-arm64-broonie 2026-05-09 08:50:44,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:44,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:44,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:44,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:44,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69fef2c2254d3291e98df10c/log.txt.gz 2026-05-09 08:50:44,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4cb254d3291e98df389/log.txt.gz 2026-05-09 08:50:45,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:45,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:45,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:45,343 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4cb254d3291e98df389/lava-logs.yaml 2026-05-09 08:50:45,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:45,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:45,358 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69fef2c2254d3291e98df10c/lava-logs.yaml 2026-05-09 08:50:45,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:45,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:45,454 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4cb254d3291e98df389/lava_callback.json.gz 2026-05-09 08:50:45,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:45,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:45,490 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69fef2c2254d3291e98df10c/lava_callback.json.gz 2026-05-09 08:50:45,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:45,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4cb254d3291e98df389 HTTP/1.1" 200 None 2026-05-09 08:50:45,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2c2254d3291e98df10c HTTP/1.1" 200 None 2026-05-09 08:50:45,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:45,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:45,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:50:45,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:50:45,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:45,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:45,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4cb254d3291e98df389 HTTP/1.1" 200 None 2026-05-09 08:50:45,584 - lava_callback - INFO - Completed processing callback for node 69fef4cb254d3291e98df389 2026-05-09 08:50:45,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2c2254d3291e98df10c HTTP/1.1" 200 None 2026-05-09 08:50:45,594 - lava_callback - INFO - Completed processing callback for node 69fef2c2254d3291e98df10c INFO: 172.21.0.1:50580 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:50:54,777 - lava_callback - INFO - Received callback for node 69fef1ae254d3291e98def9a INFO: 172.21.0.1:58552 - "POST /node/69fef1ae254d3291e98def9a HTTP/1.0" 202 Accepted 2026-05-09 08:50:54,784 - lava_callback - INFO - Starting async job submit for node 69fef1ae254d3291e98def9a 2026-05-09 08:50:54,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:54,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef1ae254d3291e98def9a HTTP/1.1" 200 None 2026-05-09 08:50:54,842 - lava_callback - DEBUG - Processing node 69fef1ae254d3291e98def9a: baseline-x86 2026-05-09 08:50:55,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:55,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:55,779 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fef1ae254d3291e98def9a/log.txt.gz 2026-05-09 08:50:56,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:56,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:56,339 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fef1ae254d3291e98def9a/lava-logs.yaml 2026-05-09 08:50:56,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:50:56,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:50:56,481 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fef1ae254d3291e98def9a/lava_callback.json.gz INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK DEBUG: Setup failed for 69fef1ae254d3291e98def9a. Transitting job node result: incomplete -> fail 2026-05-09 08:50:56,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:56,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef1ae254d3291e98def9a HTTP/1.1" 200 None 2026-05-09 08:50:56,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:56,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedfb254d3291e98de990 HTTP/1.1" 200 None 2026-05-09 08:50:56,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:50:56,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef1ae254d3291e98def9a HTTP/1.1" 200 None 2026-05-09 08:50:56,728 - lava_callback - INFO - Completed processing callback for node 69fef1ae254d3291e98def9a INFO: 172.21.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:51:11,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:51:11,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-09 08:51:13,861 - lava_callback - INFO - Received callback for node 69fc527255ff273b190b9918 INFO: 172.21.0.1:49548 - "POST /node/69fc527255ff273b190b9918 HTTP/1.0" 202 Accepted 2026-05-09 08:51:13,866 - lava_callback - INFO - Starting async job submit for node 69fc527255ff273b190b9918 2026-05-09 08:51:13,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:51:13,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc527255ff273b190b9918 HTTP/1.1" 200 None 2026-05-09 08:51:13,890 - lava_callback - DEBUG - Processing node 69fc527255ff273b190b9918: baseline-arm-clabbe 2026-05-09 08:51:13,890 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc527255ff273b190b9918 2026-05-09 08:51:13,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:51:13,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc527255ff273b190b9918 HTTP/1.1" 200 None 2026-05-09 08:51:13,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:51:13,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 08:51:13,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:51:13,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc527255ff273b190b9918 HTTP/1.1" 200 None 2026-05-09 08:51:13,935 - lava_callback - ERROR - Error processing callback for node 69fc527255ff273b190b9918: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51230 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:51:53,910 - lava_callback - INFO - Received callback for node 69fc529855ff273b190b9924 INFO: 172.21.0.1:34024 - "POST /node/69fc529855ff273b190b9924 HTTP/1.0" 202 Accepted 2026-05-09 08:51:53,918 - lava_callback - INFO - Starting async job submit for node 69fc529855ff273b190b9924 2026-05-09 08:51:53,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:51:53,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc529855ff273b190b9924 HTTP/1.1" 200 None 2026-05-09 08:51:53,942 - lava_callback - DEBUG - Processing node 69fc529855ff273b190b9924: baseline-arm-clabbe 2026-05-09 08:51:53,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc529855ff273b190b9924 2026-05-09 08:51:53,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:51:53,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc529855ff273b190b9924 HTTP/1.1" 200 None 2026-05-09 08:51:53,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:51:53,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 08:51:53,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:51:53,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc529855ff273b190b9924 HTTP/1.1" 200 None 2026-05-09 08:51:53,994 - lava_callback - ERROR - Error processing callback for node 69fc529855ff273b190b9924: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34038 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:52:00,704 - lava_callback - INFO - Received callback for node 69fef4c5254d3291e98df374 INFO: 172.21.0.1:40290 - "POST /node/69fef4c5254d3291e98df374 HTTP/1.0" 202 Accepted 2026-05-09 08:52:00,710 - lava_callback - INFO - Starting async job submit for node 69fef4c5254d3291e98df374 2026-05-09 08:52:00,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:00,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c5254d3291e98df374 HTTP/1.1" 200 None 2026-05-09 08:52:00,747 - lava_callback - DEBUG - Processing node 69fef4c5254d3291e98df374: baseline-arm64-broonie 2026-05-09 08:52:01,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:52:01,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:52:01,285 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c5254d3291e98df374/log.txt.gz 2026-05-09 08:52:01,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:52:01,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:52:01,649 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c5254d3291e98df374/lava-logs.yaml 2026-05-09 08:52:01,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:52:01,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:52:01,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fef4c5254d3291e98df374/lava_callback.json.gz 2026-05-09 08:52:01,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:01,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4c5254d3291e98df374 HTTP/1.1" 200 None 2026-05-09 08:52:01,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:01,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:52:01,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:01,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4c5254d3291e98df374 HTTP/1.1" 200 None 2026-05-09 08:52:01,847 - lava_callback - INFO - Completed processing callback for node 69fef4c5254d3291e98df374 2026-05-09 08:52:03,976 - lava_callback - INFO - Received callback for node 69fef2c5254d3291e98df114 INFO: 172.21.0.1:40306 - "POST /node/69fef2c5254d3291e98df114 HTTP/1.0" 202 Accepted 2026-05-09 08:52:03,982 - lava_callback - INFO - Starting async job submit for node 69fef2c5254d3291e98df114 2026-05-09 08:52:04,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:04,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2c5254d3291e98df114 HTTP/1.1" 200 None 2026-05-09 08:52:04,020 - lava_callback - DEBUG - Processing node 69fef2c5254d3291e98df114: ltp-smoke 2026-05-09 08:52:04,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:52:04,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:52:04,566 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fef2c5254d3291e98df114/log.txt.gz 2026-05-09 08:52:04,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:52:04,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:52:04,966 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fef2c5254d3291e98df114/lava-logs.yaml 2026-05-09 08:52:04,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:52:05,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:52:05,089 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fef2c5254d3291e98df114/lava_callback.json.gz 2026-05-09 08:52:05,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:05,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2c5254d3291e98df114 HTTP/1.1" 200 None 2026-05-09 08:52:05,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:05,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:52:05,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:05,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2c5254d3291e98df114 HTTP/1.1" 200 None 2026-05-09 08:52:05,164 - lava_callback - INFO - Completed processing callback for node 69fef2c5254d3291e98df114 2026-05-09 08:52:05,617 - lava_callback - INFO - Received callback for node 69fef2c8254d3291e98df11c INFO: 172.21.0.1:40314 - "POST /node/69fef2c8254d3291e98df11c HTTP/1.0" 202 Accepted 2026-05-09 08:52:05,623 - lava_callback - INFO - Starting async job submit for node 69fef2c8254d3291e98df11c 2026-05-09 08:52:05,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:05,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2c8254d3291e98df11c HTTP/1.1" 200 None 2026-05-09 08:52:05,662 - lava_callback - DEBUG - Processing node 69fef2c8254d3291e98df11c: ltp-syscalls-ipc 2026-05-09 08:52:06,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40322 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:52:06,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:52:06,181 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fef2c8254d3291e98df11c/log.txt.gz 2026-05-09 08:52:06,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:52:06,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:52:06,566 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fef2c8254d3291e98df11c/lava-logs.yaml 2026-05-09 08:52:06,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:52:06,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:52:06,708 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fef2c8254d3291e98df11c/lava_callback.json.gz 2026-05-09 08:52:06,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:06,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2c8254d3291e98df11c HTTP/1.1" 200 None 2026-05-09 08:52:06,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:06,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:52:06,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:06,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2c8254d3291e98df11c HTTP/1.1" 200 None 2026-05-09 08:52:06,787 - lava_callback - INFO - Completed processing callback for node 69fef2c8254d3291e98df11c 2026-05-09 08:52:11,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:11,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37752 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:52:33,907 - lava_callback - INFO - Received callback for node 69fc52bf55ff273b190b9930 INFO: 172.21.0.1:49456 - "POST /node/69fc52bf55ff273b190b9930 HTTP/1.0" 202 Accepted 2026-05-09 08:52:33,912 - lava_callback - INFO - Starting async job submit for node 69fc52bf55ff273b190b9930 2026-05-09 08:52:33,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:33,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc52bf55ff273b190b9930 HTTP/1.1" 200 None 2026-05-09 08:52:33,928 - lava_callback - DEBUG - Processing node 69fc52bf55ff273b190b9930: baseline-arm-clabbe 2026-05-09 08:52:33,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc52bf55ff273b190b9930 2026-05-09 08:52:33,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:33,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc52bf55ff273b190b9930 HTTP/1.1" 200 None 2026-05-09 08:52:33,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:33,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 08:52:33,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:33,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc52bf55ff273b190b9930 HTTP/1.1" 200 None 2026-05-09 08:52:33,981 - lava_callback - ERROR - Error processing callback for node 69fc52bf55ff273b190b9930: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55006 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:52:48,342 - lava_callback - INFO - Received callback for node 69fef5d4254d3291e98df558 INFO: 172.21.0.1:55020 - "POST /node/69fef5d4254d3291e98df558 HTTP/1.0" 202 Accepted 2026-05-09 08:52:48,348 - lava_callback - INFO - Starting async job submit for node 69fef5d4254d3291e98df558 2026-05-09 08:52:48,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:48,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef5d4254d3291e98df558 HTTP/1.1" 200 None 2026-05-09 08:52:48,374 - lava_callback - DEBUG - Processing node 69fef5d4254d3291e98df558: baseline-arm 2026-05-09 08:52:48,379 - lava_callback - WARNING - Failed to upload log 2026-05-09 08:52:48,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:52:48,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:52:48,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fef5d4254d3291e98df558/lava-logs.yaml 2026-05-09 08:52:48,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:52:48,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:52:48,902 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fef5d4254d3291e98df558/lava_callback.json.gz 2026-05-09 08:52:48,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:48,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef5d4254d3291e98df558 HTTP/1.1" 200 None 2026-05-09 08:52:48,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:48,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:52:48,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:52:48,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef5d4254d3291e98df558 HTTP/1.1" 200 None 2026-05-09 08:52:48,982 - lava_callback - INFO - Completed processing callback for node 69fef5d4254d3291e98df558 INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:53:00,915 - lava_callback - INFO - Received callback for node 69fef150254d3291e98def89 INFO: 172.21.0.1:58756 - "POST /node/69fef150254d3291e98def89 HTTP/1.0" 202 Accepted 2026-05-09 08:53:00,922 - lava_callback - INFO - Starting async job submit for node 69fef150254d3291e98def89 2026-05-09 08:53:00,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:53:00,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef150254d3291e98def89 HTTP/1.1" 200 None 2026-05-09 08:53:00,993 - lava_callback - DEBUG - Processing node 69fef150254d3291e98def89: ltp-smoke 2026-05-09 08:53:01,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:53:01,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:53:01,701 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fef150254d3291e98def89/log.txt.gz 2026-05-09 08:53:01,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:53:02,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:53:02,164 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fef150254d3291e98def89/lava-logs.yaml 2026-05-09 08:53:02,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:53:02,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:53:02,285 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fef150254d3291e98def89/lava_callback.json.gz 2026-05-09 08:53:02,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:53:02,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef150254d3291e98def89 HTTP/1.1" 200 None 2026-05-09 08:53:02,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:53:02,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feeddd254d3291e98de968 HTTP/1.1" 200 None 2026-05-09 08:53:02,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:53:02,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef150254d3291e98def89 HTTP/1.1" 200 None 2026-05-09 08:53:02,573 - lava_callback - INFO - Completed processing callback for node 69fef150254d3291e98def89 INFO: 172.21.0.1:58764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:53:11,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:53:11,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-09 08:53:13,887 - lava_callback - INFO - Received callback for node 69fc52e655ff273b190b9940 INFO: 172.21.0.1:33026 - "POST /node/69fc52e655ff273b190b9940 HTTP/1.0" 202 Accepted 2026-05-09 08:53:13,896 - lava_callback - INFO - Starting async job submit for node 69fc52e655ff273b190b9940 2026-05-09 08:53:13,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:53:13,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc52e655ff273b190b9940 HTTP/1.1" 200 None 2026-05-09 08:53:13,911 - lava_callback - DEBUG - Processing node 69fc52e655ff273b190b9940: baseline-arm-clabbe 2026-05-09 08:53:13,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc52e655ff273b190b9940 2026-05-09 08:53:13,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:53:13,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc52e655ff273b190b9940 HTTP/1.1" 200 None 2026-05-09 08:53:13,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:53:13,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 08:53:13,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:53:13,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc52e655ff273b190b9940 HTTP/1.1" 200 None 2026-05-09 08:53:13,967 - lava_callback - ERROR - Error processing callback for node 69fc52e655ff273b190b9940: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:54:14,003 - lava_callback - INFO - Received callback for node 69fc533155ff273b190b995b INFO: 172.21.0.1:57144 - "POST /node/69fc533155ff273b190b995b HTTP/1.0" 202 Accepted 2026-05-09 08:54:14,011 - lava_callback - INFO - Starting async job submit for node 69fc533155ff273b190b995b 2026-05-09 08:54:14,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:54:14,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc533155ff273b190b995b HTTP/1.1" 200 None 2026-05-09 08:54:14,028 - lava_callback - DEBUG - Processing node 69fc533155ff273b190b995b: baseline-arm-clabbe 2026-05-09 08:54:14,028 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc533155ff273b190b995b 2026-05-09 08:54:14,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:54:14,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc533155ff273b190b995b HTTP/1.1" 200 None 2026-05-09 08:54:14,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:54:14,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 08:54:14,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:54:14,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc533155ff273b190b995b HTTP/1.1" 200 None 2026-05-09 08:54:14,093 - lava_callback - ERROR - Error processing callback for node 69fc533155ff273b190b995b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59160 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:54:44,773 - lava_callback - INFO - Received callback for node 69fef2ca254d3291e98df11f INFO: 172.21.0.1:45134 - "POST /node/69fef2ca254d3291e98df11f HTTP/1.0" 202 Accepted 2026-05-09 08:54:44,780 - lava_callback - INFO - Starting async job submit for node 69fef2ca254d3291e98df11f 2026-05-09 08:54:44,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:54:44,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2ca254d3291e98df11f HTTP/1.1" 200 None 2026-05-09 08:54:44,877 - lava_callback - DEBUG - Processing node 69fef2ca254d3291e98df11f: ltp-timers 2026-05-09 08:54:45,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:54:45,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:54:45,538 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69fef2ca254d3291e98df11f/log.txt.gz 2026-05-09 08:54:45,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:54:46,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:54:46,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69fef2ca254d3291e98df11f/lava-logs.yaml 2026-05-09 08:54:46,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:54:46,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:54:46,385 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69fef2ca254d3291e98df11f/lava_callback.json.gz 2026-05-09 08:54:46,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:54:46,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2ca254d3291e98df11f HTTP/1.1" 200 None 2026-05-09 08:54:46,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:54:46,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:54:46,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:54:46,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2ca254d3291e98df11f HTTP/1.1" 200 None 2026-05-09 08:54:46,505 - lava_callback - INFO - Completed processing callback for node 69fef2ca254d3291e98df11f INFO: 172.21.0.1:45142 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:54:53,981 - lava_callback - INFO - Received callback for node 69fc535855ff273b190b9976 INFO: 172.21.0.1:38798 - "POST /node/69fc535855ff273b190b9976 HTTP/1.0" 202 Accepted 2026-05-09 08:54:53,987 - lava_callback - INFO - Starting async job submit for node 69fc535855ff273b190b9976 2026-05-09 08:54:53,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:54:54,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc535855ff273b190b9976 HTTP/1.1" 200 None 2026-05-09 08:54:54,002 - lava_callback - DEBUG - Processing node 69fc535855ff273b190b9976: baseline-arm-clabbe 2026-05-09 08:54:54,002 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc535855ff273b190b9976 2026-05-09 08:54:54,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:54:54,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc535855ff273b190b9976 HTTP/1.1" 200 None 2026-05-09 08:54:54,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:54:54,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 08:54:54,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:54:54,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc535855ff273b190b9976 HTTP/1.1" 200 None 2026-05-09 08:54:54,051 - lava_callback - ERROR - Error processing callback for node 69fc535855ff273b190b9976: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38804 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:54:59,791 - lava_callback - INFO - Received callback for node 69fef4a8254d3291e98df2fd INFO: 172.21.0.1:50748 - "POST /node/69fef4a8254d3291e98df2fd HTTP/1.0" 202 Accepted 2026-05-09 08:54:59,798 - lava_callback - INFO - Starting async job submit for node 69fef4a8254d3291e98df2fd 2026-05-09 08:54:59,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:54:59,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a8254d3291e98df2fd HTTP/1.1" 200 None 2026-05-09 08:54:59,847 - lava_callback - DEBUG - Processing node 69fef4a8254d3291e98df2fd: baseline-arm64 2026-05-09 08:55:00,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:55:00,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:55:00,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a8254d3291e98df2fd/log.txt.gz 2026-05-09 08:55:00,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:55:00,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:55:00,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a8254d3291e98df2fd/lava-logs.yaml 2026-05-09 08:55:00,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:55:00,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:55:00,798 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a8254d3291e98df2fd/lava_callback.json.gz DEBUG: Setup failed for 69fef4a8254d3291e98df2fd. Transitting job node result: incomplete -> fail 2026-05-09 08:55:00,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:55:00,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a8254d3291e98df2fd HTTP/1.1" 200 None 2026-05-09 08:55:00,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:55:00,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 08:55:00,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:55:00,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4a8254d3291e98df2fd HTTP/1.1" 200 None 2026-05-09 08:55:00,994 - lava_callback - INFO - Completed processing callback for node 69fef4a8254d3291e98df2fd 2026-05-09 08:55:05,881 - lava_callback - INFO - Received callback for node 69fef62a254d3291e98df583 INFO: 172.21.0.1:50764 - "POST /node/69fef62a254d3291e98df583 HTTP/1.0" 202 Accepted 2026-05-09 08:55:05,886 - lava_callback - INFO - Starting async job submit for node 69fef62a254d3291e98df583 2026-05-09 08:55:05,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:55:05,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef62a254d3291e98df583 HTTP/1.1" 200 None 2026-05-09 08:55:05,920 - lava_callback - DEBUG - Processing node 69fef62a254d3291e98df583: baseline-arm-pengutronix 2026-05-09 08:55:06,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50780 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:55:06,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:55:06,169 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef62a254d3291e98df583/log.txt.gz 2026-05-09 08:55:06,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:55:06,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:55:06,390 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef62a254d3291e98df583/lava-logs.yaml 2026-05-09 08:55:06,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:55:06,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:55:06,504 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef62a254d3291e98df583/lava_callback.json.gz INFO: 172.21.0.1:50792 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:55:06,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:55:06,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef62a254d3291e98df583 HTTP/1.1" 200 None 2026-05-09 08:55:06,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:55:06,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:55:06,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:55:06,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef62a254d3291e98df583 HTTP/1.1" 200 None 2026-05-09 08:55:06,583 - lava_callback - INFO - Completed processing callback for node 69fef62a254d3291e98df583 2026-05-09 08:55:11,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:55:11,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59706 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:55:24,115 - lava_callback - INFO - Received callback for node 69fef2cb254d3291e98df122 INFO: 172.21.0.1:40850 - "POST /node/69fef2cb254d3291e98df122 HTTP/1.0" 202 Accepted 2026-05-09 08:55:24,121 - lava_callback - INFO - Starting async job submit for node 69fef2cb254d3291e98df122 2026-05-09 08:55:24,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:55:24,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2cb254d3291e98df122 HTTP/1.1" 200 None 2026-05-09 08:55:24,188 - lava_callback - DEBUG - Processing node 69fef2cb254d3291e98df122: ltp-watchqueue 2026-05-09 08:55:24,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:55:24,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:55:24,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fef2cb254d3291e98df122/log.txt.gz 2026-05-09 08:55:24,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:55:24,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:55:24,997 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fef2cb254d3291e98df122/lava-logs.yaml 2026-05-09 08:55:25,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:55:25,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:55:25,122 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fef2cb254d3291e98df122/lava_callback.json.gz 2026-05-09 08:55:25,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:55:25,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2cb254d3291e98df122 HTTP/1.1" 200 None 2026-05-09 08:55:25,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:55:25,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:55:25,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:55:25,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2cb254d3291e98df122 HTTP/1.1" 200 None 2026-05-09 08:55:25,201 - lava_callback - INFO - Completed processing callback for node 69fef2cb254d3291e98df122 INFO: 172.21.0.1:40862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35226 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:55:41,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:55:41,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:56:29,833 - lava_callback - INFO - Received callback for node 69fef285254d3291e98df016 INFO: 172.21.0.1:40938 - "POST /node/69fef285254d3291e98df016 HTTP/1.0" 202 Accepted 2026-05-09 08:56:29,840 - lava_callback - INFO - Starting async job submit for node 69fef285254d3291e98df016 2026-05-09 08:56:29,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:56:29,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef285254d3291e98df016 HTTP/1.1" 200 None 2026-05-09 08:56:29,907 - lava_callback - DEBUG - Processing node 69fef285254d3291e98df016: baseline-arm 2026-05-09 08:56:30,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:56:30,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:56:30,791 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fef285254d3291e98df016/log.txt.gz 2026-05-09 08:56:31,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:56:31,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:56:31,356 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fef285254d3291e98df016/lava-logs.yaml 2026-05-09 08:56:31,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:56:31,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:56:31,690 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fef285254d3291e98df016/lava_callback.json.gz DEBUG: Setup failed for 69fef285254d3291e98df016. Transitting job node result: incomplete -> fail 2026-05-09 08:56:31,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:56:31,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef285254d3291e98df016 HTTP/1.1" 200 None 2026-05-09 08:56:31,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:56:31,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:56:31,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:56:31,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef285254d3291e98df016 HTTP/1.1" 200 None 2026-05-09 08:56:31,964 - lava_callback - INFO - Completed processing callback for node 69fef285254d3291e98df016 INFO: 172.21.0.1:40952 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:56:41,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:56:41,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36432 - "GET / HTTP/1.0" 200 OK 2026-05-09 08:58:37,682 - lava_callback - INFO - Received callback for node 69fef2a3254d3291e98df0a5 INFO: 172.21.0.1:36434 - "POST /node/69fef2a3254d3291e98df0a5 HTTP/1.0" 202 Accepted 2026-05-09 08:58:37,731 - lava_callback - INFO - Starting async job submit for node 69fef2a3254d3291e98df0a5 2026-05-09 08:58:37,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:58:37,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2a3254d3291e98df0a5 HTTP/1.1" 200 None 2026-05-09 08:58:37,776 - lava_callback - DEBUG - Processing node 69fef2a3254d3291e98df0a5: baseline-arm-pengutronix 2026-05-09 08:58:37,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:58:38,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:58:38,026 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef2a3254d3291e98df0a5/log.txt.gz 2026-05-09 08:58:38,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:58:38,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:58:38,457 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef2a3254d3291e98df0a5/lava-logs.yaml 2026-05-09 08:58:38,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 08:58:38,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 08:58:38,564 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fef2a3254d3291e98df0a5/lava_callback.json.gz DEBUG: Setup failed for 69fef2a3254d3291e98df0a5. Transitting job node result: incomplete -> fail 2026-05-09 08:58:38,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:58:38,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2a3254d3291e98df0a5 HTTP/1.1" 200 None 2026-05-09 08:58:38,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:58:38,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 08:58:38,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:58:38,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2a3254d3291e98df0a5 HTTP/1.1" 200 None 2026-05-09 08:58:38,789 - lava_callback - INFO - Completed processing callback for node 69fef2a3254d3291e98df0a5 2026-05-09 08:58:41,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 08:58:41,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46044 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:00:05,509 - lava_callback - INFO - Received callback for node 69fc548155ff273b190b9a14 INFO: 172.21.0.1:47890 - "POST /node/69fc548155ff273b190b9a14 HTTP/1.0" 202 Accepted 2026-05-09 09:00:05,514 - lava_callback - INFO - Starting async job submit for node 69fc548155ff273b190b9a14 2026-05-09 09:00:05,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:05,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc548155ff273b190b9a14 HTTP/1.1" 200 None 2026-05-09 09:00:05,532 - lava_callback - DEBUG - Processing node 69fc548155ff273b190b9a14: baseline-arm64-baylibre 2026-05-09 09:00:05,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc548155ff273b190b9a14 2026-05-09 09:00:05,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:05,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc548155ff273b190b9a14 HTTP/1.1" 200 None 2026-05-09 09:00:05,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:05,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 09:00:05,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:05,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc548155ff273b190b9a14 HTTP/1.1" 200 None 2026-05-09 09:00:05,578 - lava_callback - ERROR - Error processing callback for node 69fc548155ff273b190b9a14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:00:10,776 - lava_callback - INFO - Received callback for node 69fef790254d3291e98df61b INFO: 172.21.0.1:52506 - "POST /node/69fef790254d3291e98df61b HTTP/1.0" 202 Accepted 2026-05-09 09:00:10,782 - lava_callback - INFO - Starting async job submit for node 69fef790254d3291e98df61b 2026-05-09 09:00:10,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:10,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef790254d3291e98df61b HTTP/1.1" 200 None 2026-05-09 09:00:10,800 - lava_callback - DEBUG - Processing node 69fef790254d3291e98df61b: baseline-arm64 2026-05-09 09:00:10,805 - lava_callback - WARNING - Failed to upload log 2026-05-09 09:00:10,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:00:10,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:00:10,891 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef790254d3291e98df61b/lava-logs.yaml 2026-05-09 09:00:10,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:00:10,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:00:10,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef790254d3291e98df61b/lava_callback.json.gz 2026-05-09 09:00:10,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:10,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef790254d3291e98df61b HTTP/1.1" 200 None 2026-05-09 09:00:10,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:11,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:00:11,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:11,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef790254d3291e98df61b HTTP/1.1" 200 None 2026-05-09 09:00:11,042 - lava_callback - INFO - Completed processing callback for node 69fef790254d3291e98df61b 2026-05-09 09:00:11,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:11,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58370 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:00:29,117 - lava_callback - INFO - Received callback for node 69fef796254d3291e98df620 INFO: 172.21.0.1:58384 - "POST /node/69fef796254d3291e98df620 HTTP/1.0" 202 Accepted 2026-05-09 09:00:29,125 - lava_callback - INFO - Starting async job submit for node 69fef796254d3291e98df620 2026-05-09 09:00:29,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:29,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef796254d3291e98df620 HTTP/1.1" 200 None 2026-05-09 09:00:29,157 - lava_callback - DEBUG - Processing node 69fef796254d3291e98df620: baseline-arm64 2026-05-09 09:00:29,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:00:29,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:00:29,412 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef796254d3291e98df620/log.txt.gz 2026-05-09 09:00:29,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:00:29,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:00:29,638 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef796254d3291e98df620/lava-logs.yaml 2026-05-09 09:00:29,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:00:29,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:00:29,752 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef796254d3291e98df620/lava_callback.json.gz 2026-05-09 09:00:29,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:29,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef796254d3291e98df620 HTTP/1.1" 200 None 2026-05-09 09:00:29,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:29,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:00:29,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:29,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef796254d3291e98df620 HTTP/1.1" 200 None 2026-05-09 09:00:29,836 - lava_callback - INFO - Completed processing callback for node 69fef796254d3291e98df620 INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:00:41,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:00:41,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:01:34,388 - lava_callback - INFO - Received callback for node 69fc54d855ff273b190b9a5c INFO: 172.21.0.1:55214 - "POST /node/69fc54d855ff273b190b9a5c HTTP/1.0" 202 Accepted 2026-05-09 09:01:34,395 - lava_callback - INFO - Starting async job submit for node 69fc54d855ff273b190b9a5c 2026-05-09 09:01:34,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:01:34,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc54d855ff273b190b9a5c HTTP/1.1" 200 None 2026-05-09 09:01:34,411 - lava_callback - DEBUG - Processing node 69fc54d855ff273b190b9a5c: baseline-arm64-clabbe 2026-05-09 09:01:34,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc54d855ff273b190b9a5c 2026-05-09 09:01:34,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:01:34,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc54d855ff273b190b9a5c HTTP/1.1" 200 None 2026-05-09 09:01:34,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:01:34,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 09:01:34,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:01:34,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc54d855ff273b190b9a5c HTTP/1.1" 200 None 2026-05-09 09:01:34,459 - lava_callback - ERROR - Error processing callback for node 69fc54d855ff273b190b9a5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35278 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:02:54,379 - lava_callback - INFO - Received callback for node 69fc552855ff273b190b9aa2 INFO: 172.21.0.1:53946 - "POST /node/69fc552855ff273b190b9aa2 HTTP/1.0" 202 Accepted 2026-05-09 09:02:54,384 - lava_callback - INFO - Starting async job submit for node 69fc552855ff273b190b9aa2 2026-05-09 09:02:54,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:02:54,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc552855ff273b190b9aa2 HTTP/1.1" 200 None 2026-05-09 09:02:54,403 - lava_callback - DEBUG - Processing node 69fc552855ff273b190b9aa2: baseline-arm64-clabbe 2026-05-09 09:02:54,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc552855ff273b190b9aa2 2026-05-09 09:02:54,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:02:54,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc552855ff273b190b9aa2 HTTP/1.1" 200 None 2026-05-09 09:02:54,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:02:54,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 09:02:54,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:02:54,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc552855ff273b190b9aa2 HTTP/1.1" 200 None 2026-05-09 09:02:54,450 - lava_callback - ERROR - Error processing callback for node 69fc552855ff273b190b9aa2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46486 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:04:14,478 - lava_callback - INFO - Received callback for node 69fc557955ff273b190b9ac9 INFO: 172.21.0.1:34268 - "POST /node/69fc557955ff273b190b9ac9 HTTP/1.0" 202 Accepted 2026-05-09 09:04:14,485 - lava_callback - INFO - Starting async job submit for node 69fc557955ff273b190b9ac9 2026-05-09 09:04:14,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:04:14,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc557955ff273b190b9ac9 HTTP/1.1" 200 None 2026-05-09 09:04:14,499 - lava_callback - DEBUG - Processing node 69fc557955ff273b190b9ac9: baseline-arm64-clabbe 2026-05-09 09:04:14,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc557955ff273b190b9ac9 2026-05-09 09:04:14,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:04:14,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc557955ff273b190b9ac9 HTTP/1.1" 200 None 2026-05-09 09:04:14,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:04:14,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 09:04:14,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:04:14,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc557955ff273b190b9ac9 HTTP/1.1" 200 None 2026-05-09 09:04:14,552 - lava_callback - ERROR - Error processing callback for node 69fc557955ff273b190b9ac9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:04:56,347 - lava_callback - INFO - Received callback for node 69fe199ce4d4e78cd76b0d4a INFO: 172.21.0.1:42512 - "POST /node/69fe199ce4d4e78cd76b0d4a HTTP/1.0" 202 Accepted 2026-05-09 09:04:56,353 - lava_callback - INFO - Starting async job submit for node 69fe199ce4d4e78cd76b0d4a 2026-05-09 09:04:56,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:04:56,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe199ce4d4e78cd76b0d4a HTTP/1.1" 200 None 2026-05-09 09:04:56,414 - lava_callback - DEBUG - Processing node 69fe199ce4d4e78cd76b0d4a: baseline-arm64 INFO: 172.21.0.1:42528 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:04:56,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:04:56,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:04:56,962 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe199ce4d4e78cd76b0d4a/log.txt.gz 2026-05-09 09:04:57,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:04:57,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:04:57,355 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe199ce4d4e78cd76b0d4a/lava-logs.yaml 2026-05-09 09:04:57,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:04:57,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:04:57,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe199ce4d4e78cd76b0d4a/lava_callback.json.gz 2026-05-09 09:04:57,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:04:57,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe199ce4d4e78cd76b0d4a HTTP/1.1" 200 None 2026-05-09 09:04:57,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:04:57,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 09:04:57,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:04:57,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe199ce4d4e78cd76b0d4a HTTP/1.1" 200 None 2026-05-09 09:04:57,631 - lava_callback - INFO - Completed processing callback for node 69fe199ce4d4e78cd76b0d4a INFO: 172.21.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54166 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:05:11,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:05:11,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:05:34,410 - lava_callback - INFO - Received callback for node 69fc55ca55ff273b190b9aef INFO: 172.21.0.1:49350 - "POST /node/69fc55ca55ff273b190b9aef HTTP/1.0" 202 Accepted 2026-05-09 09:05:34,416 - lava_callback - INFO - Starting async job submit for node 69fc55ca55ff273b190b9aef 2026-05-09 09:05:34,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:05:34,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc55ca55ff273b190b9aef HTTP/1.1" 200 None 2026-05-09 09:05:34,431 - lava_callback - DEBUG - Processing node 69fc55ca55ff273b190b9aef: baseline-arm64-clabbe 2026-05-09 09:05:34,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc55ca55ff273b190b9aef 2026-05-09 09:05:34,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:05:34,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc55ca55ff273b190b9aef HTTP/1.1" 200 None 2026-05-09 09:05:34,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:05:34,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 09:05:34,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:05:34,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc55ca55ff273b190b9aef HTTP/1.1" 200 None 2026-05-09 09:05:34,478 - lava_callback - ERROR - Error processing callback for node 69fc55ca55ff273b190b9aef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:06:04,289 - lava_callback - INFO - Received callback for node 69fef4a4254d3291e98df2ed INFO: 172.21.0.1:43196 - "POST /node/69fef4a4254d3291e98df2ed HTTP/1.0" 202 Accepted 2026-05-09 09:06:04,295 - lava_callback - INFO - Starting async job submit for node 69fef4a4254d3291e98df2ed 2026-05-09 09:06:04,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:06:04,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a4254d3291e98df2ed HTTP/1.1" 200 None 2026-05-09 09:06:04,351 - lava_callback - DEBUG - Processing node 69fef4a4254d3291e98df2ed: baseline-arm64 2026-05-09 09:06:04,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:06:04,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:06:04,834 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a4254d3291e98df2ed/log.txt.gz 2026-05-09 09:06:04,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:06:05,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:06:05,118 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a4254d3291e98df2ed/lava-logs.yaml 2026-05-09 09:06:05,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:06:05,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:06:05,255 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef4a4254d3291e98df2ed/lava_callback.json.gz 2026-05-09 09:06:05,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:06:05,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4a4254d3291e98df2ed HTTP/1.1" 200 None 2026-05-09 09:06:05,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:06:05,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:06:05,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:06:05,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4a4254d3291e98df2ed HTTP/1.1" 200 None 2026-05-09 09:06:05,343 - lava_callback - INFO - Completed processing callback for node 69fef4a4254d3291e98df2ed INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:06:11,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:06:11,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:07:14,575 - lava_callback - INFO - Received callback for node 69fc563d55ff273b190b9b21 INFO: 172.21.0.1:58630 - "POST /node/69fc563d55ff273b190b9b21 HTTP/1.0" 202 Accepted 2026-05-09 09:07:14,581 - lava_callback - INFO - Starting async job submit for node 69fc563d55ff273b190b9b21 2026-05-09 09:07:14,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:14,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc563d55ff273b190b9b21 HTTP/1.1" 200 None 2026-05-09 09:07:14,605 - lava_callback - DEBUG - Processing node 69fc563d55ff273b190b9b21: baseline-arm64-clabbe 2026-05-09 09:07:14,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc563d55ff273b190b9b21 2026-05-09 09:07:14,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:14,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc563d55ff273b190b9b21 HTTP/1.1" 200 None 2026-05-09 09:07:14,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:14,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 09:07:14,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:14,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc563d55ff273b190b9b21 HTTP/1.1" 200 None 2026-05-09 09:07:14,651 - lava_callback - ERROR - Error processing callback for node 69fc563d55ff273b190b9b21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:07:23,970 - lava_callback - INFO - Received callback for node 69fef4b1254d3291e98df31a INFO: 172.21.0.1:49036 - "POST /node/69fef4b1254d3291e98df31a HTTP/1.0" 202 Accepted 2026-05-09 09:07:23,976 - lava_callback - INFO - Starting async job submit for node 69fef4b1254d3291e98df31a 2026-05-09 09:07:24,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:24,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4b1254d3291e98df31a HTTP/1.1" 200 None 2026-05-09 09:07:24,015 - lava_callback - DEBUG - Processing node 69fef4b1254d3291e98df31a: baseline-nfs-arm64 2026-05-09 09:07:24,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:07:24,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:07:24,576 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4b1254d3291e98df31a/log.txt.gz 2026-05-09 09:07:24,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:07:25,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:07:25,106 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4b1254d3291e98df31a/lava-logs.yaml 2026-05-09 09:07:25,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:07:25,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:07:25,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4b1254d3291e98df31a/lava_callback.json.gz 2026-05-09 09:07:25,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:25,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4b1254d3291e98df31a HTTP/1.1" 200 None 2026-05-09 09:07:25,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:25,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:07:25,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:25,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4b1254d3291e98df31a HTTP/1.1" 200 None 2026-05-09 09:07:25,332 - lava_callback - INFO - Completed processing callback for node 69fef4b1254d3291e98df31a INFO: 172.21.0.1:49042 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:07:30,203 - lava_callback - INFO - Received callback for node 69fef8f4254d3291e98df700 INFO: 172.21.0.1:54550 - "POST /node/69fef8f4254d3291e98df700 HTTP/1.0" 202 Accepted 2026-05-09 09:07:30,210 - lava_callback - INFO - Starting async job submit for node 69fef8f4254d3291e98df700 2026-05-09 09:07:30,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:30,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef8f4254d3291e98df700 HTTP/1.1" 200 None 2026-05-09 09:07:30,258 - lava_callback - DEBUG - Processing node 69fef8f4254d3291e98df700: baseline-arm64 2026-05-09 09:07:30,475 - lava_callback - WARNING - Failed to upload log 2026-05-09 09:07:30,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:07:30,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:07:30,751 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef8f4254d3291e98df700/lava-logs.yaml 2026-05-09 09:07:30,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:07:30,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:07:30,857 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef8f4254d3291e98df700/lava_callback.json.gz 2026-05-09 09:07:30,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:30,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef8f4254d3291e98df700 HTTP/1.1" 200 None 2026-05-09 09:07:30,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:30,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:07:30,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:30,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef8f4254d3291e98df700 HTTP/1.1" 200 None 2026-05-09 09:07:31,013 - lava_callback - INFO - Completed processing callback for node 69fef8f4254d3291e98df700 INFO: 172.21.0.1:54562 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:07:41,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:41,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60190 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:07:51,806 - lava_callback - INFO - Received callback for node 69fef4ad254d3291e98df30a INFO: 172.21.0.1:36458 - "POST /node/69fef4ad254d3291e98df30a HTTP/1.0" 202 Accepted 2026-05-09 09:07:51,815 - lava_callback - INFO - Starting async job submit for node 69fef4ad254d3291e98df30a 2026-05-09 09:07:51,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:51,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4ad254d3291e98df30a HTTP/1.1" 200 None 2026-05-09 09:07:51,893 - lava_callback - DEBUG - Processing node 69fef4ad254d3291e98df30a: baseline-nfs-arm64 2026-05-09 09:07:52,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:07:52,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:07:52,991 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4ad254d3291e98df30a/log.txt.gz 2026-05-09 09:07:53,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:07:53,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:07:53,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4ad254d3291e98df30a/lava-logs.yaml 2026-05-09 09:07:53,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:07:53,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:07:53,873 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4ad254d3291e98df30a/lava_callback.json.gz DEBUG: Setup failed for 69fef4ad254d3291e98df30a. Transitting job node result: incomplete -> fail 2026-05-09 09:07:53,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:53,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4ad254d3291e98df30a HTTP/1.1" 200 None 2026-05-09 09:07:53,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:54,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:07:54,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:07:54,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4ad254d3291e98df30a HTTP/1.1" 200 None 2026-05-09 09:07:54,118 - lava_callback - INFO - Completed processing callback for node 69fef4ad254d3291e98df30a INFO: 172.21.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36456 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:08:10,971 - lava_callback - INFO - Received callback for node 69fef942254d3291e98df72d INFO: 172.21.0.1:45500 - "POST /node/69fef942254d3291e98df72d HTTP/1.0" 202 Accepted 2026-05-09 09:08:10,978 - lava_callback - INFO - Starting async job submit for node 69fef942254d3291e98df72d 2026-05-09 09:08:11,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:11,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef942254d3291e98df72d HTTP/1.1" 200 None 2026-05-09 09:08:11,035 - lava_callback - DEBUG - Processing node 69fef942254d3291e98df72d: baseline-arm64 2026-05-09 09:08:11,167 - lava_callback - WARNING - Failed to upload log 2026-05-09 09:08:11,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:08:11,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:08:11,354 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef942254d3291e98df72d/lava-logs.yaml 2026-05-09 09:08:11,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:08:11,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:11,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-09 09:08:11,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:08:11,435 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef942254d3291e98df72d/lava_callback.json.gz 2026-05-09 09:08:11,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:11,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef942254d3291e98df72d HTTP/1.1" 200 None 2026-05-09 09:08:11,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:11,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:08:11,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:11,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef942254d3291e98df72d HTTP/1.1" 200 None 2026-05-09 09:08:11,581 - lava_callback - INFO - Completed processing callback for node 69fef942254d3291e98df72d INFO: 172.21.0.1:45508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45516 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:08:24,285 - lava_callback - INFO - Received callback for node 69fef2c4254d3291e98df10f INFO: 172.21.0.1:33820 - "POST /node/69fef2c4254d3291e98df10f HTTP/1.0" 202 Accepted 2026-05-09 09:08:24,335 - lava_callback - INFO - Starting async job submit for node 69fef2c4254d3291e98df10f 2026-05-09 09:08:24,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:24,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2c4254d3291e98df10f HTTP/1.1" 200 None 2026-05-09 09:08:24,391 - lava_callback - DEBUG - Processing node 69fef2c4254d3291e98df10f: ltp-sched 2026-05-09 09:08:24,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:08:24,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:08:24,576 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69fef2c4254d3291e98df10f/log.txt.gz 2026-05-09 09:08:24,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:08:24,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:08:24,740 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69fef2c4254d3291e98df10f/lava-logs.yaml 2026-05-09 09:08:24,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:08:24,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:08:24,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69fef2c4254d3291e98df10f/lava_callback.json.gz 2026-05-09 09:08:24,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:24,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef2c4254d3291e98df10f HTTP/1.1" 200 None 2026-05-09 09:08:24,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:24,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 09:08:24,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:24,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef2c4254d3291e98df10f HTTP/1.1" 200 None 2026-05-09 09:08:24,961 - lava_callback - INFO - Completed processing callback for node 69fef2c4254d3291e98df10f INFO: 172.21.0.1:33826 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:08:34,623 - lava_callback - INFO - Received callback for node 69fc568c55ff273b190b9b56 INFO: 172.21.0.1:36532 - "POST /node/69fc568c55ff273b190b9b56 HTTP/1.0" 202 Accepted 2026-05-09 09:08:34,629 - lava_callback - INFO - Starting async job submit for node 69fc568c55ff273b190b9b56 2026-05-09 09:08:34,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:34,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc568c55ff273b190b9b56 HTTP/1.1" 200 None 2026-05-09 09:08:34,649 - lava_callback - DEBUG - Processing node 69fc568c55ff273b190b9b56: baseline-arm64-clabbe 2026-05-09 09:08:34,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc568c55ff273b190b9b56 2026-05-09 09:08:34,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:34,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc568c55ff273b190b9b56 HTTP/1.1" 200 None 2026-05-09 09:08:34,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:34,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 09:08:34,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:34,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc568c55ff273b190b9b56 HTTP/1.1" 200 None 2026-05-09 09:08:34,744 - lava_callback - ERROR - Error processing callback for node 69fc568c55ff273b190b9b56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36544 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:08:41,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:08:41,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:09:00,551 - lava_callback - INFO - Received callback for node 69fef998254d3291e98df76f INFO: 172.21.0.1:54218 - "POST /node/69fef998254d3291e98df76f HTTP/1.0" 202 Accepted 2026-05-09 09:09:00,557 - lava_callback - INFO - Starting async job submit for node 69fef998254d3291e98df76f 2026-05-09 09:09:00,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:09:00,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef998254d3291e98df76f HTTP/1.1" 200 None 2026-05-09 09:09:00,572 - lava_callback - DEBUG - Processing node 69fef998254d3291e98df76f: baseline-nfs-arm64 2026-05-09 09:09:00,574 - lava_callback - WARNING - Failed to upload log 2026-05-09 09:09:00,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:09:00,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:09:00,679 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef998254d3291e98df76f/lava-logs.yaml 2026-05-09 09:09:00,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:09:00,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:09:00,784 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef998254d3291e98df76f/lava_callback.json.gz 2026-05-09 09:09:00,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:09:00,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef998254d3291e98df76f HTTP/1.1" 200 None 2026-05-09 09:09:00,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:09:00,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:09:00,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:09:00,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef998254d3291e98df76f HTTP/1.1" 200 None 2026-05-09 09:09:00,836 - lava_callback - INFO - Completed processing callback for node 69fef998254d3291e98df76f INFO: 172.21.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54236 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:09:11,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:09:11,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:11:51,175 - lava_callback - INFO - Received callback for node 69fefa04254d3291e98df7b4 INFO: 172.21.0.1:56490 - "POST /node/69fefa04254d3291e98df7b4 HTTP/1.0" 202 Accepted 2026-05-09 09:11:51,181 - lava_callback - INFO - Starting async job submit for node 69fefa04254d3291e98df7b4 2026-05-09 09:11:51,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:11:51,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefa04254d3291e98df7b4 HTTP/1.1" 200 None 2026-05-09 09:11:51,224 - lava_callback - DEBUG - Processing node 69fefa04254d3291e98df7b4: baseline-arm64 2026-05-09 09:11:51,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:11:51,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:11:51,637 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefa04254d3291e98df7b4/log.txt.gz 2026-05-09 09:11:51,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:11:51,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:11:51,989 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefa04254d3291e98df7b4/lava-logs.yaml 2026-05-09 09:11:51,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:11:52,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:11:52,098 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefa04254d3291e98df7b4/lava_callback.json.gz 2026-05-09 09:11:52,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:11:52,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefa04254d3291e98df7b4 HTTP/1.1" 200 None 2026-05-09 09:11:52,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:11:52,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:11:52,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:11:52,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefa04254d3291e98df7b4 HTTP/1.1" 200 None 2026-05-09 09:11:52,260 - lava_callback - INFO - Completed processing callback for node 69fefa04254d3291e98df7b4 INFO: 172.21.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:12:11,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:12:11,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59180 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:15:06,210 - lava_callback - INFO - Received callback for node 69fc581355ff273b190b9bd1 INFO: 172.21.0.1:34926 - "POST /node/69fc581355ff273b190b9bd1 HTTP/1.0" 202 Accepted 2026-05-09 09:15:06,215 - lava_callback - INFO - Starting async job submit for node 69fc581355ff273b190b9bd1 2026-05-09 09:15:06,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:15:06,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc581355ff273b190b9bd1 HTTP/1.1" 200 None 2026-05-09 09:15:06,230 - lava_callback - DEBUG - Processing node 69fc581355ff273b190b9bd1: baseline-arm-baylibre 2026-05-09 09:15:06,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc581355ff273b190b9bd1 2026-05-09 09:15:06,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:15:06,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc581355ff273b190b9bd1 HTTP/1.1" 200 None 2026-05-09 09:15:06,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:15:06,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-09 09:15:06,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:15:06,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc581355ff273b190b9bd1 HTTP/1.1" 200 None 2026-05-09 09:15:06,277 - lava_callback - ERROR - Error processing callback for node 69fc581355ff273b190b9bd1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:16:26,272 - lava_callback - INFO - Received callback for node 69fc585f55ff273b190b9beb INFO: 172.21.0.1:36690 - "POST /node/69fc585f55ff273b190b9beb HTTP/1.0" 202 Accepted 2026-05-09 09:16:26,278 - lava_callback - INFO - Starting async job submit for node 69fc585f55ff273b190b9beb 2026-05-09 09:16:26,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:16:26,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc585f55ff273b190b9beb HTTP/1.1" 200 None 2026-05-09 09:16:26,293 - lava_callback - DEBUG - Processing node 69fc585f55ff273b190b9beb: baseline-arm-baylibre 2026-05-09 09:16:26,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc585f55ff273b190b9beb 2026-05-09 09:16:26,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:16:26,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc585f55ff273b190b9beb HTTP/1.1" 200 None 2026-05-09 09:16:26,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:16:26,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-09 09:16:26,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:16:26,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc585f55ff273b190b9beb HTTP/1.1" 200 None 2026-05-09 09:16:26,343 - lava_callback - ERROR - Error processing callback for node 69fc585f55ff273b190b9beb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40470 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:17:03,771 - lava_callback - INFO - Received callback for node 69fefb41254d3291e98df846 INFO: 172.21.0.1:60626 - "POST /node/69fefb41254d3291e98df846 HTTP/1.0" 202 Accepted 2026-05-09 09:17:03,777 - lava_callback - INFO - Starting async job submit for node 69fefb41254d3291e98df846 2026-05-09 09:17:03,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:17:03,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefb41254d3291e98df846 HTTP/1.1" 200 None 2026-05-09 09:17:03,809 - lava_callback - DEBUG - Processing node 69fefb41254d3291e98df846: baseline-x86 2026-05-09 09:17:04,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:17:04,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:17:04,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fefb41254d3291e98df846/log.txt.gz 2026-05-09 09:17:04,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:17:04,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:17:04,507 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fefb41254d3291e98df846/lava-logs.yaml 2026-05-09 09:17:04,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:17:04,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:17:04,648 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fefb41254d3291e98df846/lava_callback.json.gz 2026-05-09 09:17:04,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:17:04,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefb41254d3291e98df846 HTTP/1.1" 200 None 2026-05-09 09:17:04,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:17:04,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedfb254d3291e98de990 HTTP/1.1" 200 None 2026-05-09 09:17:04,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:17:04,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefb41254d3291e98df846 HTTP/1.1" 200 None 2026-05-09 09:17:04,717 - lava_callback - INFO - Completed processing callback for node 69fefb41254d3291e98df846 2026-05-09 09:17:06,244 - lava_callback - INFO - Received callback for node 69fc588555ff273b190b9bfa INFO: 172.21.0.1:60642 - "POST /node/69fc588555ff273b190b9bfa HTTP/1.0" 202 Accepted 2026-05-09 09:17:06,250 - lava_callback - INFO - Starting async job submit for node 69fc588555ff273b190b9bfa 2026-05-09 09:17:06,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:17:06,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc588555ff273b190b9bfa HTTP/1.1" 200 None 2026-05-09 09:17:06,265 - lava_callback - DEBUG - Processing node 69fc588555ff273b190b9bfa: baseline-arm-baylibre 2026-05-09 09:17:06,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc588555ff273b190b9bfa 2026-05-09 09:17:06,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:17:06,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc588555ff273b190b9bfa HTTP/1.1" 200 None 2026-05-09 09:17:06,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:17:06,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-09 09:17:06,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:17:06,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc588555ff273b190b9bfa HTTP/1.1" 200 None 2026-05-09 09:17:06,312 - lava_callback - ERROR - Error processing callback for node 69fc588555ff273b190b9bfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:17:11,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:17:11,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:17:46,333 - lava_callback - INFO - Received callback for node 69fc58ac55ff273b190b9c08 INFO: 172.21.0.1:59966 - "POST /node/69fc58ac55ff273b190b9c08 HTTP/1.0" 202 Accepted 2026-05-09 09:17:46,338 - lava_callback - INFO - Starting async job submit for node 69fc58ac55ff273b190b9c08 2026-05-09 09:17:46,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:17:46,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc58ac55ff273b190b9c08 HTTP/1.1" 200 None 2026-05-09 09:17:46,353 - lava_callback - DEBUG - Processing node 69fc58ac55ff273b190b9c08: baseline-arm-baylibre 2026-05-09 09:17:46,353 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc58ac55ff273b190b9c08 2026-05-09 09:17:46,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:17:46,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc58ac55ff273b190b9c08 HTTP/1.1" 200 None 2026-05-09 09:17:46,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:17:46,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-09 09:17:46,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:17:46,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc58ac55ff273b190b9c08 HTTP/1.1" 200 None 2026-05-09 09:17:46,398 - lava_callback - ERROR - Error processing callback for node 69fc58ac55ff273b190b9c08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:18:26,309 - lava_callback - INFO - Received callback for node 69fc58d255ff273b190b9c14 INFO: 172.21.0.1:57492 - "POST /node/69fc58d255ff273b190b9c14 HTTP/1.0" 202 Accepted 2026-05-09 09:18:26,314 - lava_callback - INFO - Starting async job submit for node 69fc58d255ff273b190b9c14 2026-05-09 09:18:26,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:18:26,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc58d255ff273b190b9c14 HTTP/1.1" 200 None 2026-05-09 09:18:26,330 - lava_callback - DEBUG - Processing node 69fc58d255ff273b190b9c14: baseline-arm-baylibre 2026-05-09 09:18:26,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc58d255ff273b190b9c14 2026-05-09 09:18:26,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:18:26,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc58d255ff273b190b9c14 HTTP/1.1" 200 None 2026-05-09 09:18:26,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:18:26,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-09 09:18:26,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:18:26,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc58d255ff273b190b9c14 HTTP/1.1" 200 None 2026-05-09 09:18:26,380 - lava_callback - ERROR - Error processing callback for node 69fc58d255ff273b190b9c14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57508 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:18:28,889 - lava_callback - INFO - Received callback for node 69fefbd7254d3291e98df89a INFO: 172.21.0.1:57524 - "POST /node/69fefbd7254d3291e98df89a HTTP/1.0" 202 Accepted 2026-05-09 09:18:28,894 - lava_callback - INFO - Starting async job submit for node 69fefbd7254d3291e98df89a 2026-05-09 09:18:28,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:18:28,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefbd7254d3291e98df89a HTTP/1.1" 200 None 2026-05-09 09:18:28,911 - lava_callback - DEBUG - Processing node 69fefbd7254d3291e98df89a: baseline-arm 2026-05-09 09:18:28,916 - lava_callback - WARNING - Failed to upload log 2026-05-09 09:18:28,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:18:29,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:18:29,040 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fefbd7254d3291e98df89a/lava-logs.yaml 2026-05-09 09:18:29,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:18:29,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:18:29,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fefbd7254d3291e98df89a/lava_callback.json.gz 2026-05-09 09:18:29,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:18:29,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefbd7254d3291e98df89a HTTP/1.1" 200 None 2026-05-09 09:18:29,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:18:29,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 09:18:29,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:18:29,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefbd7254d3291e98df89a HTTP/1.1" 200 None 2026-05-09 09:18:29,212 - lava_callback - INFO - Completed processing callback for node 69fefbd7254d3291e98df89a INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:18:41,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:18:41,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:19:06,415 - lava_callback - INFO - Received callback for node 69fc58f855ff273b190b9c1e INFO: 172.21.0.1:55658 - "POST /node/69fc58f855ff273b190b9c1e HTTP/1.0" 202 Accepted 2026-05-09 09:19:06,420 - lava_callback - INFO - Starting async job submit for node 69fc58f855ff273b190b9c1e 2026-05-09 09:19:06,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:19:06,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc58f855ff273b190b9c1e HTTP/1.1" 200 None 2026-05-09 09:19:06,447 - lava_callback - DEBUG - Processing node 69fc58f855ff273b190b9c1e: baseline-arm-baylibre 2026-05-09 09:19:06,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc58f855ff273b190b9c1e 2026-05-09 09:19:06,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:19:06,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc58f855ff273b190b9c1e HTTP/1.1" 200 None 2026-05-09 09:19:06,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:19:06,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-09 09:19:06,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:55666 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:19:06,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc58f855ff273b190b9c1e HTTP/1.1" 200 None 2026-05-09 09:19:06,497 - lava_callback - ERROR - Error processing callback for node 69fc58f855ff273b190b9c1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47764 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:19:34,951 - lava_callback - INFO - Received callback for node 69fc591f55ff273b190b9c2e INFO: 172.21.0.1:51818 - "POST /node/69fc591f55ff273b190b9c2e HTTP/1.0" 202 Accepted 2026-05-09 09:19:34,957 - lava_callback - INFO - Starting async job submit for node 69fc591f55ff273b190b9c2e 2026-05-09 09:19:34,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:19:34,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc591f55ff273b190b9c2e HTTP/1.1" 200 None 2026-05-09 09:19:34,972 - lava_callback - DEBUG - Processing node 69fc591f55ff273b190b9c2e: baseline-arm-clabbe 2026-05-09 09:19:34,972 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc591f55ff273b190b9c2e 2026-05-09 09:19:34,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:19:34,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc591f55ff273b190b9c2e HTTP/1.1" 200 None 2026-05-09 09:19:34,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:19:34,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-09 09:19:35,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:19:35,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc591f55ff273b190b9c2e HTTP/1.1" 200 None 2026-05-09 09:19:35,020 - lava_callback - ERROR - Error processing callback for node 69fc591f55ff273b190b9c2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:20:14,978 - lava_callback - INFO - Received callback for node 69fc594655ff273b190b9c37 INFO: 172.21.0.1:48262 - "POST /node/69fc594655ff273b190b9c37 HTTP/1.0" 202 Accepted 2026-05-09 09:20:14,983 - lava_callback - INFO - Starting async job submit for node 69fc594655ff273b190b9c37 2026-05-09 09:20:14,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:20:14,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc594655ff273b190b9c37 HTTP/1.1" 200 None 2026-05-09 09:20:14,998 - lava_callback - DEBUG - Processing node 69fc594655ff273b190b9c37: baseline-arm-clabbe 2026-05-09 09:20:14,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc594655ff273b190b9c37 2026-05-09 09:20:14,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:20:15,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc594655ff273b190b9c37 HTTP/1.1" 200 None 2026-05-09 09:20:15,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:20:15,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-09 09:20:15,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:20:15,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc594655ff273b190b9c37 HTTP/1.1" 200 None 2026-05-09 09:20:15,054 - lava_callback - ERROR - Error processing callback for node 69fc594655ff273b190b9c37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:20:55,108 - lava_callback - INFO - Received callback for node 69fc597055ff273b190b9c44 INFO: 172.21.0.1:45764 - "POST /node/69fc597055ff273b190b9c44 HTTP/1.0" 202 Accepted 2026-05-09 09:20:55,114 - lava_callback - INFO - Starting async job submit for node 69fc597055ff273b190b9c44 2026-05-09 09:20:55,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:20:55,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc597055ff273b190b9c44 HTTP/1.1" 200 None 2026-05-09 09:20:55,153 - lava_callback - DEBUG - Processing node 69fc597055ff273b190b9c44: baseline-arm-clabbe 2026-05-09 09:20:55,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc597055ff273b190b9c44 2026-05-09 09:20:55,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:20:55,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc597055ff273b190b9c44 HTTP/1.1" 200 None 2026-05-09 09:20:55,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:20:55,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-09 09:20:55,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:20:55,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc597055ff273b190b9c44 HTTP/1.1" 200 None 2026-05-09 09:20:55,207 - lava_callback - ERROR - Error processing callback for node 69fc597055ff273b190b9c44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-09 09:24:15,237 - lava_callback - INFO - Received callback for node 69fc5a3155ff273b190b9ca3 INFO: 172.21.0.1:49470 - "POST /node/69fc5a3155ff273b190b9ca3 HTTP/1.0" 202 Accepted 2026-05-09 09:24:15,242 - lava_callback - INFO - Starting async job submit for node 69fc5a3155ff273b190b9ca3 2026-05-09 09:24:15,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:24:15,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5a3155ff273b190b9ca3 HTTP/1.1" 200 None 2026-05-09 09:24:15,258 - lava_callback - DEBUG - Processing node 69fc5a3155ff273b190b9ca3: baseline-arm-clabbe 2026-05-09 09:24:15,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5a3155ff273b190b9ca3 2026-05-09 09:24:15,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:24:15,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5a3155ff273b190b9ca3 HTTP/1.1" 200 None 2026-05-09 09:24:15,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:24:15,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-09 09:24:15,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:24:15,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5a3155ff273b190b9ca3 HTTP/1.1" 200 None 2026-05-09 09:24:15,306 - lava_callback - ERROR - Error processing callback for node 69fc5a3155ff273b190b9ca3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42404 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:25:50,890 - lava_callback - INFO - Received callback for node 69fe19abe4d4e78cd76b0d91 INFO: 172.21.0.1:33220 - "POST /node/69fe19abe4d4e78cd76b0d91 HTTP/1.0" 202 Accepted 2026-05-09 09:25:50,901 - lava_callback - INFO - Starting async job submit for node 69fe19abe4d4e78cd76b0d91 2026-05-09 09:25:50,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:25:50,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19abe4d4e78cd76b0d91 HTTP/1.1" 200 None 2026-05-09 09:25:50,945 - lava_callback - DEBUG - Processing node 69fe19abe4d4e78cd76b0d91: baseline-nfs-arm64 2026-05-09 09:25:53,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:25:53,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:25:53,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19abe4d4e78cd76b0d91/log.txt.gz 2026-05-09 09:25:54,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:25:54,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:25:54,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19abe4d4e78cd76b0d91/lava-logs.yaml 2026-05-09 09:25:54,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:25:55,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:25:55,006 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe19abe4d4e78cd76b0d91/lava_callback.json.gz DEBUG: Setup failed for 69fe19abe4d4e78cd76b0d91. Transitting job node result: incomplete -> fail 2026-05-09 09:25:55,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:25:55,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe19abe4d4e78cd76b0d91 HTTP/1.1" 200 None 2026-05-09 09:25:55,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:25:55,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 09:25:55,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:25:55,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe19abe4d4e78cd76b0d91 HTTP/1.1" 200 None 2026-05-09 09:25:55,193 - lava_callback - INFO - Completed processing callback for node 69fe19abe4d4e78cd76b0d91 INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:26:11,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:26:11,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47284 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:26:25,088 - lava_callback - INFO - Received callback for node 69fefa75254d3291e98df7f5 INFO: 172.21.0.1:51724 - "POST /node/69fefa75254d3291e98df7f5 HTTP/1.0" 202 Accepted 2026-05-09 09:26:25,096 - lava_callback - INFO - Starting async job submit for node 69fefa75254d3291e98df7f5 2026-05-09 09:26:25,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:26:25,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefa75254d3291e98df7f5 HTTP/1.1" 200 None 2026-05-09 09:26:25,151 - lava_callback - DEBUG - Processing node 69fefa75254d3291e98df7f5: baseline-arm64 2026-05-09 09:26:26,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:26:26,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:26:26,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefa75254d3291e98df7f5/log.txt.gz INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:26:26,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:26:27,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:26:27,113 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefa75254d3291e98df7f5/lava-logs.yaml 2026-05-09 09:26:27,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:26:27,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:26:27,266 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefa75254d3291e98df7f5/lava_callback.json.gz 2026-05-09 09:26:27,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:26:27,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefa75254d3291e98df7f5 HTTP/1.1" 200 None 2026-05-09 09:26:27,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:26:27,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:26:27,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:26:27,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefa75254d3291e98df7f5 HTTP/1.1" 200 None 2026-05-09 09:26:27,371 - lava_callback - INFO - Completed processing callback for node 69fefa75254d3291e98df7f5 INFO: 172.21.0.1:59518 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:26:41,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:26:41,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57490 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:27:22,049 - lava_callback - INFO - Received callback for node 69fefdd9254d3291e98df978 INFO: 172.21.0.1:59728 - "POST /node/69fefdd9254d3291e98df978 HTTP/1.0" 202 Accepted 2026-05-09 09:27:22,055 - lava_callback - INFO - Starting async job submit for node 69fefdd9254d3291e98df978 2026-05-09 09:27:22,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:27:22,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefdd9254d3291e98df978 HTTP/1.1" 200 None 2026-05-09 09:27:22,087 - lava_callback - DEBUG - Processing node 69fefdd9254d3291e98df978: baseline-arm64 2026-05-09 09:27:22,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:27:22,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:27:22,358 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefdd9254d3291e98df978/log.txt.gz 2026-05-09 09:27:22,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:27:22,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:27:22,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefdd9254d3291e98df978/lava-logs.yaml 2026-05-09 09:27:22,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:27:22,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:27:22,733 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefdd9254d3291e98df978/lava_callback.json.gz 2026-05-09 09:27:22,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:27:22,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefdd9254d3291e98df978 HTTP/1.1" 200 None 2026-05-09 09:27:22,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:27:22,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:27:22,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:27:22,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefdd9254d3291e98df978 HTTP/1.1" 200 None 2026-05-09 09:27:22,815 - lava_callback - INFO - Completed processing callback for node 69fefdd9254d3291e98df978 INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:27:35,370 - lava_callback - INFO - Received callback for node 69fc5af455ff273b190b9d00 INFO: 172.21.0.1:40196 - "POST /node/69fc5af455ff273b190b9d00 HTTP/1.0" 202 Accepted 2026-05-09 09:27:35,376 - lava_callback - INFO - Starting async job submit for node 69fc5af455ff273b190b9d00 2026-05-09 09:27:35,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:27:35,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5af455ff273b190b9d00 HTTP/1.1" 200 None 2026-05-09 09:27:35,413 - lava_callback - DEBUG - Processing node 69fc5af455ff273b190b9d00: baseline-arm-clabbe 2026-05-09 09:27:35,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5af455ff273b190b9d00 2026-05-09 09:27:35,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:27:35,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5af455ff273b190b9d00 HTTP/1.1" 200 None 2026-05-09 09:27:35,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:27:35,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-09 09:27:35,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:27:35,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5af455ff273b190b9d00 HTTP/1.1" 200 None 2026-05-09 09:27:35,508 - lava_callback - ERROR - Error processing callback for node 69fc5af455ff273b190b9d00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40208 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:27:41,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:27:41,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-09 09:27:42,492 - lava_callback - INFO - Received callback for node 69fefddd254d3291e98df97b INFO: 172.21.0.1:46214 - "POST /node/69fefddd254d3291e98df97b HTTP/1.0" 202 Accepted 2026-05-09 09:27:42,498 - lava_callback - INFO - Starting async job submit for node 69fefddd254d3291e98df97b 2026-05-09 09:27:42,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:27:42,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefddd254d3291e98df97b HTTP/1.1" 200 None 2026-05-09 09:27:42,529 - lava_callback - DEBUG - Processing node 69fefddd254d3291e98df97b: baseline-arm64 2026-05-09 09:27:42,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:27:42,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:27:42,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefddd254d3291e98df97b/log.txt.gz 2026-05-09 09:27:42,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:27:43,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:27:43,042 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefddd254d3291e98df97b/lava-logs.yaml 2026-05-09 09:27:43,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:27:43,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:27:43,180 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefddd254d3291e98df97b/lava_callback.json.gz 2026-05-09 09:27:43,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:27:43,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefddd254d3291e98df97b HTTP/1.1" 200 None 2026-05-09 09:27:43,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:27:43,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:27:43,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:27:43,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefddd254d3291e98df97b HTTP/1.1" 200 None 2026-05-09 09:27:43,248 - lava_callback - INFO - Completed processing callback for node 69fefddd254d3291e98df97b INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45372 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:28:11,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:28:11,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:29:28,171 - lava_callback - INFO - Received callback for node 69fefcb9254d3291e98df8ed INFO: 172.21.0.1:52500 - "POST /node/69fefcb9254d3291e98df8ed HTTP/1.0" 202 Accepted 2026-05-09 09:29:28,178 - lava_callback - INFO - Starting async job submit for node 69fefcb9254d3291e98df8ed 2026-05-09 09:29:28,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:29:28,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefcb9254d3291e98df8ed HTTP/1.1" 200 None 2026-05-09 09:29:28,227 - lava_callback - DEBUG - Processing node 69fefcb9254d3291e98df8ed: baseline-arm64 2026-05-09 09:29:28,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:29:28,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:29:28,754 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefcb9254d3291e98df8ed/log.txt.gz 2026-05-09 09:29:28,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:29:29,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:29:29,130 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefcb9254d3291e98df8ed/lava-logs.yaml 2026-05-09 09:29:29,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:29:29,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:29:29,281 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefcb9254d3291e98df8ed/lava_callback.json.gz DEBUG: Setup failed for 69fefcb9254d3291e98df8ed. Transitting job node result: incomplete -> fail 2026-05-09 09:29:29,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:29:29,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefcb9254d3291e98df8ed HTTP/1.1" 200 None 2026-05-09 09:29:29,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:29:29,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:29:29,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:29:29,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefcb9254d3291e98df8ed HTTP/1.1" 200 None 2026-05-09 09:29:29,511 - lava_callback - INFO - Completed processing callback for node 69fefcb9254d3291e98df8ed INFO: 172.21.0.1:33842 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:29:41,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:29:41,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35052 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:31:47,138 - lava_callback - INFO - Received callback for node 69fc5bfd55ff273b190b9d77 INFO: 172.21.0.1:35066 - "POST /node/69fc5bfd55ff273b190b9d77 HTTP/1.0" 202 Accepted 2026-05-09 09:31:47,143 - lava_callback - INFO - Starting async job submit for node 69fc5bfd55ff273b190b9d77 2026-05-09 09:31:47,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:31:47,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5bfd55ff273b190b9d77 HTTP/1.1" 200 None 2026-05-09 09:31:47,158 - lava_callback - DEBUG - Processing node 69fc5bfd55ff273b190b9d77: baseline-arm64-baylibre 2026-05-09 09:31:47,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5bfd55ff273b190b9d77 2026-05-09 09:31:47,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:31:47,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5bfd55ff273b190b9d77 HTTP/1.1" 200 None 2026-05-09 09:31:47,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:31:47,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 09:31:47,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:31:47,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5bfd55ff273b190b9d77 HTTP/1.1" 200 None 2026-05-09 09:31:47,204 - lava_callback - ERROR - Error processing callback for node 69fc5bfd55ff273b190b9d77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60284 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:33:07,157 - lava_callback - INFO - Received callback for node 69fc5c4f55ff273b190b9da6 INFO: 172.21.0.1:60298 - "POST /node/69fc5c4f55ff273b190b9da6 HTTP/1.0" 202 Accepted 2026-05-09 09:33:07,162 - lava_callback - INFO - Starting async job submit for node 69fc5c4f55ff273b190b9da6 2026-05-09 09:33:07,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:33:07,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5c4f55ff273b190b9da6 HTTP/1.1" 200 None 2026-05-09 09:33:07,178 - lava_callback - DEBUG - Processing node 69fc5c4f55ff273b190b9da6: baseline-arm64-baylibre 2026-05-09 09:33:07,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5c4f55ff273b190b9da6 2026-05-09 09:33:07,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:33:07,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5c4f55ff273b190b9da6 HTTP/1.1" 200 None 2026-05-09 09:33:07,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:33:07,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 09:33:07,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:33:07,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5c4f55ff273b190b9da6 HTTP/1.1" 200 None 2026-05-09 09:33:07,226 - lava_callback - ERROR - Error processing callback for node 69fc5c4f55ff273b190b9da6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:34:27,170 - lava_callback - INFO - Received callback for node 69fc5ca055ff273b190b9dc3 INFO: 172.21.0.1:51788 - "POST /node/69fc5ca055ff273b190b9dc3 HTTP/1.0" 202 Accepted 2026-05-09 09:34:27,175 - lava_callback - INFO - Starting async job submit for node 69fc5ca055ff273b190b9dc3 2026-05-09 09:34:27,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:34:27,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5ca055ff273b190b9dc3 HTTP/1.1" 200 None 2026-05-09 09:34:27,191 - lava_callback - DEBUG - Processing node 69fc5ca055ff273b190b9dc3: baseline-arm64-baylibre 2026-05-09 09:34:27,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5ca055ff273b190b9dc3 2026-05-09 09:34:27,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:34:27,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5ca055ff273b190b9dc3 HTTP/1.1" 200 None 2026-05-09 09:34:27,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:34:27,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 09:34:27,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:34:27,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5ca055ff273b190b9dc3 HTTP/1.1" 200 None 2026-05-09 09:34:27,236 - lava_callback - ERROR - Error processing callback for node 69fc5ca055ff273b190b9dc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:35:47,310 - lava_callback - INFO - Received callback for node 69fc5cee55ff273b190b9de4 INFO: 172.21.0.1:54852 - "POST /node/69fc5cee55ff273b190b9de4 HTTP/1.0" 202 Accepted 2026-05-09 09:35:47,316 - lava_callback - INFO - Starting async job submit for node 69fc5cee55ff273b190b9de4 2026-05-09 09:35:47,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:35:47,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5cee55ff273b190b9de4 HTTP/1.1" 200 None 2026-05-09 09:35:47,330 - lava_callback - DEBUG - Processing node 69fc5cee55ff273b190b9de4: baseline-arm64-baylibre 2026-05-09 09:35:47,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5cee55ff273b190b9de4 2026-05-09 09:35:47,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:35:47,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5cee55ff273b190b9de4 HTTP/1.1" 200 None 2026-05-09 09:35:47,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:35:47,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 09:35:47,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:35:47,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5cee55ff273b190b9de4 HTTP/1.1" 200 None 2026-05-09 09:35:47,375 - lava_callback - ERROR - Error processing callback for node 69fc5cee55ff273b190b9de4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:36:42,950 - lava_callback - INFO - Received callback for node 69fefbfb254d3291e98df8a8 INFO: 172.21.0.1:57970 - "POST /node/69fefbfb254d3291e98df8a8 HTTP/1.0" 202 Accepted 2026-05-09 09:36:42,956 - lava_callback - INFO - Starting async job submit for node 69fefbfb254d3291e98df8a8 2026-05-09 09:36:43,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:36:43,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefbfb254d3291e98df8a8 HTTP/1.1" 200 None 2026-05-09 09:36:43,029 - lava_callback - DEBUG - Processing node 69fefbfb254d3291e98df8a8: ltp-smoke 2026-05-09 09:36:43,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:36:43,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:36:43,606 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fefbfb254d3291e98df8a8/log.txt.gz 2026-05-09 09:36:43,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:36:44,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:36:44,029 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fefbfb254d3291e98df8a8/lava-logs.yaml 2026-05-09 09:36:44,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:36:44,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:36:44,152 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fefbfb254d3291e98df8a8/lava_callback.json.gz 2026-05-09 09:36:44,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:36:44,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefbfb254d3291e98df8a8 HTTP/1.1" 200 None 2026-05-09 09:36:44,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:36:44,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feeddd254d3291e98de968 HTTP/1.1" 200 None 2026-05-09 09:36:44,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:36:44,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefbfb254d3291e98df8a8 HTTP/1.1" 200 None 2026-05-09 09:36:44,428 - lava_callback - INFO - Completed processing callback for node 69fefbfb254d3291e98df8a8 INFO: 172.21.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46388 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:37:11,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:37:11,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38306 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-09 09:37:15,739 - lava_callback - INFO - Received callback for node 69fc5d4355ff273b190b9e07 INFO: 172.21.0.1:38308 - "POST /node/69fc5d4355ff273b190b9e07 HTTP/1.0" 202 Accepted 2026-05-09 09:37:15,745 - lava_callback - INFO - Starting async job submit for node 69fc5d4355ff273b190b9e07 2026-05-09 09:37:15,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:37:15,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5d4355ff273b190b9e07 HTTP/1.1" 200 None 2026-05-09 09:37:15,761 - lava_callback - DEBUG - Processing node 69fc5d4355ff273b190b9e07: baseline-arm64-clabbe 2026-05-09 09:37:15,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5d4355ff273b190b9e07 2026-05-09 09:37:15,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:37:15,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5d4355ff273b190b9e07 HTTP/1.1" 200 None 2026-05-09 09:37:15,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:37:15,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 09:37:15,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:37:15,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5d4355ff273b190b9e07 HTTP/1.1" 200 None 2026-05-09 09:37:15,811 - lava_callback - ERROR - Error processing callback for node 69fc5d4355ff273b190b9e07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:38:35,815 - lava_callback - INFO - Received callback for node 69fc5d9255ff273b190b9e32 INFO: 172.21.0.1:41746 - "POST /node/69fc5d9255ff273b190b9e32 HTTP/1.0" 202 Accepted 2026-05-09 09:38:35,820 - lava_callback - INFO - Starting async job submit for node 69fc5d9255ff273b190b9e32 2026-05-09 09:38:35,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:38:35,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5d9255ff273b190b9e32 HTTP/1.1" 200 None 2026-05-09 09:38:35,837 - lava_callback - DEBUG - Processing node 69fc5d9255ff273b190b9e32: baseline-arm64-clabbe 2026-05-09 09:38:35,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5d9255ff273b190b9e32 2026-05-09 09:38:35,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:38:35,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5d9255ff273b190b9e32 HTTP/1.1" 200 None 2026-05-09 09:38:35,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:38:35,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 09:38:35,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:38:35,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5d9255ff273b190b9e32 HTTP/1.1" 200 None 2026-05-09 09:38:35,883 - lava_callback - ERROR - Error processing callback for node 69fc5d9255ff273b190b9e32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39876 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:39:55,954 - lava_callback - INFO - Received callback for node 69fc5de155ff273b190b9e49 INFO: 172.21.0.1:36288 - "POST /node/69fc5de155ff273b190b9e49 HTTP/1.0" 202 Accepted 2026-05-09 09:39:55,960 - lava_callback - INFO - Starting async job submit for node 69fc5de155ff273b190b9e49 2026-05-09 09:39:55,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:39:55,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5de155ff273b190b9e49 HTTP/1.1" 200 None 2026-05-09 09:39:55,974 - lava_callback - DEBUG - Processing node 69fc5de155ff273b190b9e49: baseline-arm64-clabbe 2026-05-09 09:39:55,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5de155ff273b190b9e49 2026-05-09 09:39:55,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:39:55,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5de155ff273b190b9e49 HTTP/1.1" 200 None 2026-05-09 09:39:55,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:39:56,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 09:39:56,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:39:56,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5de155ff273b190b9e49 HTTP/1.1" 200 None 2026-05-09 09:39:56,026 - lava_callback - ERROR - Error processing callback for node 69fc5de155ff273b190b9e49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50666 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:40:22,934 - lava_callback - INFO - Received callback for node 69ff00d4254d3291e98dfb58 INFO: 172.21.0.1:52710 - "POST /node/69ff00d4254d3291e98dfb58 HTTP/1.0" 202 Accepted 2026-05-09 09:40:22,941 - lava_callback - INFO - Starting async job submit for node 69ff00d4254d3291e98dfb58 2026-05-09 09:40:22,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:40:22,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff00d4254d3291e98dfb58 HTTP/1.1" 200 None 2026-05-09 09:40:22,985 - lava_callback - DEBUG - Processing node 69ff00d4254d3291e98dfb58: baseline-arm64 2026-05-09 09:40:23,117 - lava_callback - WARNING - Failed to upload log 2026-05-09 09:40:23,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:40:23,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:40:23,342 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff00d4254d3291e98dfb58/lava-logs.yaml 2026-05-09 09:40:23,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:40:23,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:40:23,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff00d4254d3291e98dfb58/lava_callback.json.gz 2026-05-09 09:40:23,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:40:23,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff00d4254d3291e98dfb58 HTTP/1.1" 200 None 2026-05-09 09:40:23,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:40:23,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:40:23,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:40:23,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff00d4254d3291e98dfb58 HTTP/1.1" 200 None 2026-05-09 09:40:23,600 - lava_callback - INFO - Completed processing callback for node 69ff00d4254d3291e98dfb58 INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:40:41,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:40:41,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53262 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-09 09:41:15,913 - lava_callback - INFO - Received callback for node 69fc5e2f55ff273b190b9e6d INFO: 172.21.0.1:53264 - "POST /node/69fc5e2f55ff273b190b9e6d HTTP/1.0" 202 Accepted 2026-05-09 09:41:15,918 - lava_callback - INFO - Starting async job submit for node 69fc5e2f55ff273b190b9e6d 2026-05-09 09:41:15,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:41:15,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5e2f55ff273b190b9e6d HTTP/1.1" 200 None 2026-05-09 09:41:15,933 - lava_callback - DEBUG - Processing node 69fc5e2f55ff273b190b9e6d: baseline-arm64-clabbe 2026-05-09 09:41:15,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5e2f55ff273b190b9e6d 2026-05-09 09:41:15,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:41:15,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5e2f55ff273b190b9e6d HTTP/1.1" 200 None 2026-05-09 09:41:15,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:41:15,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 09:41:15,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:41:15,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5e2f55ff273b190b9e6d HTTP/1.1" 200 None 2026-05-09 09:41:15,978 - lava_callback - ERROR - Error processing callback for node 69fc5e2f55ff273b190b9e6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 09:41:15,987 - lava_callback - INFO - Received callback for node 69fefd21254d3291e98df921 INFO: 172.21.0.1:53270 - "POST /node/69fefd21254d3291e98df921 HTTP/1.0" 202 Accepted 2026-05-09 09:41:16,018 - lava_callback - INFO - Starting async job submit for node 69fefd21254d3291e98df921 2026-05-09 09:41:16,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:41:16,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefd21254d3291e98df921 HTTP/1.1" 200 None 2026-05-09 09:41:16,143 - lava_callback - DEBUG - Processing node 69fefd21254d3291e98df921: baseline-arm INFO: 172.21.0.1:53272 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:41:16,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:41:16,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:41:16,816 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fefd21254d3291e98df921/log.txt.gz 2026-05-09 09:41:17,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:41:17,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:41:17,333 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fefd21254d3291e98df921/lava-logs.yaml 2026-05-09 09:41:17,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:41:17,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:41:17,456 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fefd21254d3291e98df921/lava_callback.json.gz DEBUG: Setup failed for 69fefd21254d3291e98df921. Transitting job node result: incomplete -> fail 2026-05-09 09:41:17,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:41:17,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefd21254d3291e98df921 HTTP/1.1" 200 None 2026-05-09 09:41:17,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:41:17,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 09:41:17,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:41:17,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefd21254d3291e98df921 HTTP/1.1" 200 None 2026-05-09 09:41:17,731 - lava_callback - INFO - Completed processing callback for node 69fefd21254d3291e98df921 INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45270 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:41:41,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:41:41,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51202 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:42:36,004 - lava_callback - INFO - Received callback for node 69fc5e7f55ff273b190b9e9f INFO: 172.21.0.1:57686 - "POST /node/69fc5e7f55ff273b190b9e9f HTTP/1.0" 202 Accepted 2026-05-09 09:42:36,009 - lava_callback - INFO - Starting async job submit for node 69fc5e7f55ff273b190b9e9f 2026-05-09 09:42:36,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:42:36,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5e7f55ff273b190b9e9f HTTP/1.1" 200 None 2026-05-09 09:42:36,039 - lava_callback - DEBUG - Processing node 69fc5e7f55ff273b190b9e9f: baseline-arm64-clabbe 2026-05-09 09:42:36,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5e7f55ff273b190b9e9f 2026-05-09 09:42:36,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:42:36,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5e7f55ff273b190b9e9f HTTP/1.1" 200 None 2026-05-09 09:42:36,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:42:36,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 09:42:36,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:42:36,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5e7f55ff273b190b9e9f HTTP/1.1" 200 None 2026-05-09 09:42:36,087 - lava_callback - ERROR - Error processing callback for node 69fc5e7f55ff273b190b9e9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42638 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:42:52,104 - lava_callback - INFO - Received callback for node 69ff016b254d3291e98dfbb8 INFO: 172.21.0.1:42218 - "POST /node/69ff016b254d3291e98dfbb8 HTTP/1.0" 202 Accepted 2026-05-09 09:42:52,111 - lava_callback - INFO - Starting async job submit for node 69ff016b254d3291e98dfbb8 2026-05-09 09:42:52,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:42:52,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff016b254d3291e98dfbb8 HTTP/1.1" 200 None 2026-05-09 09:42:52,158 - lava_callback - DEBUG - Processing node 69ff016b254d3291e98dfbb8: baseline-arm64 2026-05-09 09:42:52,304 - lava_callback - WARNING - Failed to upload log 2026-05-09 09:42:52,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:42:52,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:42:52,682 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff016b254d3291e98dfbb8/lava-logs.yaml 2026-05-09 09:42:52,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:42:52,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:42:52,774 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff016b254d3291e98dfbb8/lava_callback.json.gz 2026-05-09 09:42:52,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:42:52,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff016b254d3291e98dfbb8 HTTP/1.1" 200 None 2026-05-09 09:42:52,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:42:52,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:42:52,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:42:52,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff016b254d3291e98dfbb8 HTTP/1.1" 200 None 2026-05-09 09:42:52,911 - lava_callback - INFO - Completed processing callback for node 69ff016b254d3291e98dfbb8 INFO: 172.21.0.1:42226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:43:07,662 - lava_callback - INFO - Received callback for node 69fc5e9d55ff273b190b9f0c INFO: 172.21.0.1:42670 - "POST /node/69fc5e9d55ff273b190b9f0c HTTP/1.0" 202 Accepted 2026-05-09 09:43:07,667 - lava_callback - INFO - Starting async job submit for node 69fc5e9d55ff273b190b9f0c 2026-05-09 09:43:07,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:07,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5e9d55ff273b190b9f0c HTTP/1.1" 200 None 2026-05-09 09:43:07,684 - lava_callback - DEBUG - Processing node 69fc5e9d55ff273b190b9f0c: baseline-arm64-baylibre 2026-05-09 09:43:07,684 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5e9d55ff273b190b9f0c 2026-05-09 09:43:07,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:07,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5e9d55ff273b190b9f0c HTTP/1.1" 200 None 2026-05-09 09:43:07,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:07,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 09:43:07,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:07,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5e9d55ff273b190b9f0c HTTP/1.1" 200 None 2026-05-09 09:43:07,734 - lava_callback - ERROR - Error processing callback for node 69fc5e9d55ff273b190b9f0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 09:43:08,304 - lava_callback - INFO - Received callback for node 69fc5e9e55ff273b190b9f0f INFO: 172.21.0.1:42676 - "POST /node/69fc5e9e55ff273b190b9f0f HTTP/1.0" 202 Accepted 2026-05-09 09:43:08,309 - lava_callback - INFO - Starting async job submit for node 69fc5e9e55ff273b190b9f0f 2026-05-09 09:43:08,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:08,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5e9e55ff273b190b9f0f HTTP/1.1" 200 None 2026-05-09 09:43:08,327 - lava_callback - DEBUG - Processing node 69fc5e9e55ff273b190b9f0f: baseline-arm64-baylibre 2026-05-09 09:43:08,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5e9e55ff273b190b9f0f 2026-05-09 09:43:08,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:08,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5e9e55ff273b190b9f0f HTTP/1.1" 200 None 2026-05-09 09:43:08,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:08,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 09:43:08,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:08,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5e9e55ff273b190b9f0f HTTP/1.1" 200 None 2026-05-09 09:43:08,383 - lava_callback - ERROR - Error processing callback for node 69fc5e9e55ff273b190b9f0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 09:43:09,009 - lava_callback - INFO - Received callback for node 69fc5ea155ff273b190b9f41 INFO: 172.21.0.1:42682 - "POST /node/69fc5ea155ff273b190b9f41 HTTP/1.0" 202 Accepted 2026-05-09 09:43:09,015 - lava_callback - INFO - Starting async job submit for node 69fc5ea155ff273b190b9f41 2026-05-09 09:43:09,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:09,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5ea155ff273b190b9f41 HTTP/1.1" 200 None 2026-05-09 09:43:09,029 - lava_callback - DEBUG - Processing node 69fc5ea155ff273b190b9f41: baseline-arm64-baylibre 2026-05-09 09:43:09,030 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5ea155ff273b190b9f41 2026-05-09 09:43:09,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:09,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5ea155ff273b190b9f41 HTTP/1.1" 200 None 2026-05-09 09:43:09,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:09,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 09:43:09,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:09,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5ea155ff273b190b9f41 HTTP/1.1" 200 None 2026-05-09 09:43:09,077 - lava_callback - ERROR - Error processing callback for node 69fc5ea155ff273b190b9f41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 09:43:09,652 - lava_callback - INFO - Received callback for node 69fc5ea355ff273b190b9f44 INFO: 172.21.0.1:42690 - "POST /node/69fc5ea355ff273b190b9f44 HTTP/1.0" 202 Accepted 2026-05-09 09:43:09,658 - lava_callback - INFO - Starting async job submit for node 69fc5ea355ff273b190b9f44 2026-05-09 09:43:09,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:09,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5ea355ff273b190b9f44 HTTP/1.1" 200 None 2026-05-09 09:43:09,673 - lava_callback - DEBUG - Processing node 69fc5ea355ff273b190b9f44: baseline-arm64-baylibre 2026-05-09 09:43:09,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5ea355ff273b190b9f44 2026-05-09 09:43:09,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:09,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5ea355ff273b190b9f44 HTTP/1.1" 200 None 2026-05-09 09:43:09,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:09,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 09:43:09,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:09,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5ea355ff273b190b9f44 HTTP/1.1" 200 None 2026-05-09 09:43:09,719 - lava_callback - ERROR - Error processing callback for node 69fc5ea355ff273b190b9f44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 09:43:11,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:11,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43472 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:43:36,013 - lava_callback - INFO - Received callback for node 69fc5eb255ff273b190b9f64 INFO: 172.21.0.1:37644 - "POST /node/69fc5eb255ff273b190b9f64 HTTP/1.0" 202 Accepted 2026-05-09 09:43:36,018 - lava_callback - INFO - Starting async job submit for node 69fc5eb255ff273b190b9f64 2026-05-09 09:43:36,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:36,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5eb255ff273b190b9f64 HTTP/1.1" 200 None 2026-05-09 09:43:36,034 - lava_callback - DEBUG - Processing node 69fc5eb255ff273b190b9f64: baseline-arm64-clabbe 2026-05-09 09:43:36,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5eb255ff273b190b9f64 2026-05-09 09:43:36,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:36,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5eb255ff273b190b9f64 HTTP/1.1" 200 None 2026-05-09 09:43:36,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:36,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 09:43:36,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:36,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5eb255ff273b190b9f64 HTTP/1.1" 200 None 2026-05-09 09:43:36,080 - lava_callback - ERROR - Error processing callback for node 69fc5eb255ff273b190b9f64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:43:36,682 - lava_callback - INFO - Received callback for node 69fc5eb455ff273b190b9f68 INFO: 172.21.0.1:37666 - "POST /node/69fc5eb455ff273b190b9f68 HTTP/1.0" 202 Accepted 2026-05-09 09:43:36,688 - lava_callback - INFO - Starting async job submit for node 69fc5eb455ff273b190b9f68 2026-05-09 09:43:36,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:36,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5eb455ff273b190b9f68 HTTP/1.1" 200 None 2026-05-09 09:43:36,702 - lava_callback - DEBUG - Processing node 69fc5eb455ff273b190b9f68: baseline-arm64-clabbe 2026-05-09 09:43:36,702 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5eb455ff273b190b9f68 2026-05-09 09:43:36,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:36,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5eb455ff273b190b9f68 HTTP/1.1" 200 None 2026-05-09 09:43:36,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:36,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 09:43:36,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:36,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5eb455ff273b190b9f68 HTTP/1.1" 200 None 2026-05-09 09:43:36,759 - lava_callback - ERROR - Error processing callback for node 69fc5eb455ff273b190b9f68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 09:43:37,320 - lava_callback - INFO - Received callback for node 69fc5eb555ff273b190b9f6f INFO: 172.21.0.1:37682 - "POST /node/69fc5eb555ff273b190b9f6f HTTP/1.0" 202 Accepted 2026-05-09 09:43:37,326 - lava_callback - INFO - Starting async job submit for node 69fc5eb555ff273b190b9f6f 2026-05-09 09:43:37,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:37,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5eb555ff273b190b9f6f HTTP/1.1" 200 None 2026-05-09 09:43:37,341 - lava_callback - DEBUG - Processing node 69fc5eb555ff273b190b9f6f: baseline-arm64-clabbe 2026-05-09 09:43:37,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5eb555ff273b190b9f6f 2026-05-09 09:43:37,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:37,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5eb555ff273b190b9f6f HTTP/1.1" 200 None 2026-05-09 09:43:37,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:37,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 09:43:37,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:37,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5eb555ff273b190b9f6f HTTP/1.1" 200 None 2026-05-09 09:43:37,387 - lava_callback - ERROR - Error processing callback for node 69fc5eb555ff273b190b9f6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 09:43:37,967 - lava_callback - INFO - Received callback for node 69fc5eb555ff273b190b9f76 INFO: 172.21.0.1:37688 - "POST /node/69fc5eb555ff273b190b9f76 HTTP/1.0" 202 Accepted 2026-05-09 09:43:37,973 - lava_callback - INFO - Starting async job submit for node 69fc5eb555ff273b190b9f76 2026-05-09 09:43:37,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:37,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5eb555ff273b190b9f76 HTTP/1.1" 200 None 2026-05-09 09:43:37,989 - lava_callback - DEBUG - Processing node 69fc5eb555ff273b190b9f76: baseline-arm64-clabbe 2026-05-09 09:43:37,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5eb555ff273b190b9f76 2026-05-09 09:43:37,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:38,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5eb555ff273b190b9f76 HTTP/1.1" 200 None 2026-05-09 09:43:38,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:38,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 09:43:38,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:38,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5eb555ff273b190b9f76 HTTP/1.1" 200 None 2026-05-09 09:43:38,044 - lava_callback - ERROR - Error processing callback for node 69fc5eb555ff273b190b9f76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 09:43:38,633 - lava_callback - INFO - Received callback for node 69fc5eb855ff273b190b9f7f INFO: 172.21.0.1:37700 - "POST /node/69fc5eb855ff273b190b9f7f HTTP/1.0" 202 Accepted 2026-05-09 09:43:38,639 - lava_callback - INFO - Starting async job submit for node 69fc5eb855ff273b190b9f7f 2026-05-09 09:43:38,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:38,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5eb855ff273b190b9f7f HTTP/1.1" 200 None 2026-05-09 09:43:38,654 - lava_callback - DEBUG - Processing node 69fc5eb855ff273b190b9f7f: baseline-arm64-clabbe 2026-05-09 09:43:38,654 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5eb855ff273b190b9f7f 2026-05-09 09:43:38,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:38,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5eb855ff273b190b9f7f HTTP/1.1" 200 None 2026-05-09 09:43:38,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:38,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 09:43:38,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:38,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5eb855ff273b190b9f7f HTTP/1.1" 200 None 2026-05-09 09:43:38,707 - lava_callback - ERROR - Error processing callback for node 69fc5eb855ff273b190b9f7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 09:43:39,314 - lava_callback - INFO - Received callback for node 69fc5eb755ff273b190b9f7c INFO: 172.21.0.1:37710 - "POST /node/69fc5eb755ff273b190b9f7c HTTP/1.0" 202 Accepted 2026-05-09 09:43:39,319 - lava_callback - INFO - Starting async job submit for node 69fc5eb755ff273b190b9f7c 2026-05-09 09:43:39,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:39,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5eb755ff273b190b9f7c HTTP/1.1" 200 None 2026-05-09 09:43:39,339 - lava_callback - DEBUG - Processing node 69fc5eb755ff273b190b9f7c: baseline-arm64-clabbe 2026-05-09 09:43:39,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5eb755ff273b190b9f7c 2026-05-09 09:43:39,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:39,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5eb755ff273b190b9f7c HTTP/1.1" 200 None 2026-05-09 09:43:39,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:39,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 09:43:39,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:39,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5eb755ff273b190b9f7c HTTP/1.1" 200 None 2026-05-09 09:43:39,383 - lava_callback - ERROR - Error processing callback for node 69fc5eb755ff273b190b9f7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:43:55,950 - lava_callback - INFO - Received callback for node 69fc5ece55ff273b190b9fc5 INFO: 172.21.0.1:59134 - "POST /node/69fc5ece55ff273b190b9fc5 HTTP/1.0" 202 Accepted 2026-05-09 09:43:55,956 - lava_callback - INFO - Starting async job submit for node 69fc5ece55ff273b190b9fc5 2026-05-09 09:43:55,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:55,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5ece55ff273b190b9fc5 HTTP/1.1" 200 None 2026-05-09 09:43:55,970 - lava_callback - DEBUG - Processing node 69fc5ece55ff273b190b9fc5: baseline-arm64-clabbe 2026-05-09 09:43:55,970 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc5ece55ff273b190b9fc5 2026-05-09 09:43:55,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:55,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc5ece55ff273b190b9fc5 HTTP/1.1" 200 None 2026-05-09 09:43:55,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:56,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 09:43:56,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:43:56,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc5ece55ff273b190b9fc5 HTTP/1.1" 200 None 2026-05-09 09:43:56,062 - lava_callback - ERROR - Error processing callback for node 69fc5ece55ff273b190b9fc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:44:30,674 - lava_callback - INFO - Received callback for node 69fefd75254d3291e98df93b INFO: 172.21.0.1:51126 - "POST /node/69fefd75254d3291e98df93b HTTP/1.0" 202 Accepted 2026-05-09 09:44:30,721 - lava_callback - INFO - Starting async job submit for node 69fefd75254d3291e98df93b 2026-05-09 09:44:30,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:44:30,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefd75254d3291e98df93b HTTP/1.1" 200 None 2026-05-09 09:44:30,762 - lava_callback - DEBUG - Processing node 69fefd75254d3291e98df93b: baseline-arm-pengutronix 2026-05-09 09:44:30,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:44:30,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:44:30,975 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fefd75254d3291e98df93b/log.txt.gz 2026-05-09 09:44:31,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:44:31,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:44:31,172 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fefd75254d3291e98df93b/lava-logs.yaml 2026-05-09 09:44:31,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:44:31,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:44:31,281 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fefd75254d3291e98df93b/lava_callback.json.gz DEBUG: Setup failed for 69fefd75254d3291e98df93b. Transitting job node result: incomplete -> fail 2026-05-09 09:44:31,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:44:31,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefd75254d3291e98df93b HTTP/1.1" 200 None 2026-05-09 09:44:31,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:44:31,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 09:44:31,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:44:31,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefd75254d3291e98df93b HTTP/1.1" 200 None 2026-05-09 09:44:31,436 - lava_callback - INFO - Completed processing callback for node 69fefd75254d3291e98df93b INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:44:41,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:44:41,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41452 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:45:34,801 - lava_callback - INFO - Received callback for node 69ff0231254d3291e98dfc31 INFO: 172.21.0.1:45030 - "POST /node/69ff0231254d3291e98dfc31 HTTP/1.0" 202 Accepted 2026-05-09 09:45:34,806 - lava_callback - INFO - Starting async job submit for node 69ff0231254d3291e98dfc31 2026-05-09 09:45:34,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:45:34,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0231254d3291e98dfc31 HTTP/1.1" 200 None 2026-05-09 09:45:34,827 - lava_callback - DEBUG - Processing node 69ff0231254d3291e98dfc31: baseline-nfs-arm64 2026-05-09 09:45:34,828 - lava_callback - WARNING - Failed to upload log 2026-05-09 09:45:34,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:45:35,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:45:35,090 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff0231254d3291e98dfc31/lava-logs.yaml 2026-05-09 09:45:35,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:45:35,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:45:35,351 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff0231254d3291e98dfc31/lava_callback.json.gz 2026-05-09 09:45:35,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:45:35,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0231254d3291e98dfc31 HTTP/1.1" 200 None 2026-05-09 09:45:35,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:45:35,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:45:35,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:45:35,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0231254d3291e98dfc31 HTTP/1.1" 200 None 2026-05-09 09:45:35,415 - lava_callback - INFO - Completed processing callback for node 69ff0231254d3291e98dfc31 INFO: 172.21.0.1:45038 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:45:41,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:45:41,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40928 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:48:26,120 - lava_callback - INFO - Received callback for node 69ff01d7254d3291e98dfbff INFO: 172.21.0.1:41558 - "POST /node/69ff01d7254d3291e98dfbff HTTP/1.0" 202 Accepted 2026-05-09 09:48:26,126 - lava_callback - INFO - Starting async job submit for node 69ff01d7254d3291e98dfbff 2026-05-09 09:48:26,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:48:26,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff01d7254d3291e98dfbff HTTP/1.1" 200 None 2026-05-09 09:48:26,164 - lava_callback - DEBUG - Processing node 69ff01d7254d3291e98dfbff: ltp-sched 2026-05-09 09:48:26,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:41568 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:48:26,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:48:26,647 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69ff01d7254d3291e98dfbff/log.txt.gz 2026-05-09 09:48:26,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:48:27,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:48:27,031 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69ff01d7254d3291e98dfbff/lava-logs.yaml 2026-05-09 09:48:27,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:48:27,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:48:27,155 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69ff01d7254d3291e98dfbff/lava_callback.json.gz 2026-05-09 09:48:27,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:48:27,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff01d7254d3291e98dfbff HTTP/1.1" 200 None 2026-05-09 09:48:27,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:48:27,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 09:48:27,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:48:27,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff01d7254d3291e98dfbff HTTP/1.1" 200 None 2026-05-09 09:48:27,243 - lava_callback - INFO - Completed processing callback for node 69ff01d7254d3291e98dfbff INFO: 172.21.0.1:53920 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:48:41,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:48:41,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:50:40,067 - lava_callback - INFO - Received callback for node 69ff0312254d3291e98dfcb1 INFO: 172.21.0.1:57422 - "POST /node/69ff0312254d3291e98dfcb1 HTTP/1.0" 202 Accepted 2026-05-09 09:50:40,073 - lava_callback - INFO - Starting async job submit for node 69ff0312254d3291e98dfcb1 2026-05-09 09:50:40,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:50:40,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0312254d3291e98dfcb1 HTTP/1.1" 200 None 2026-05-09 09:50:40,115 - lava_callback - DEBUG - Processing node 69ff0312254d3291e98dfcb1: baseline-arm64 2026-05-09 09:50:40,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:50:40,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:50:40,541 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff0312254d3291e98dfcb1/log.txt.gz 2026-05-09 09:50:40,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:50:40,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:50:40,905 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff0312254d3291e98dfcb1/lava-logs.yaml 2026-05-09 09:50:40,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:50:41,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:50:41,033 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff0312254d3291e98dfcb1/lava_callback.json.gz 2026-05-09 09:50:41,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:50:41,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0312254d3291e98dfcb1 HTTP/1.1" 200 None 2026-05-09 09:50:41,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:50:41,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 09:50:41,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:50:41,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0312254d3291e98dfcb1 HTTP/1.1" 200 None 2026-05-09 09:50:41,182 - lava_callback - INFO - Completed processing callback for node 69ff0312254d3291e98dfcb1 2026-05-09 09:50:41,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:50:41,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36318 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:52:08,337 - lava_callback - INFO - Received callback for node 69fc60bd55ff273b190ba19d INFO: 172.21.0.1:36330 - "POST /node/69fc60bd55ff273b190ba19d HTTP/1.0" 202 Accepted 2026-05-09 09:52:08,343 - lava_callback - INFO - Starting async job submit for node 69fc60bd55ff273b190ba19d 2026-05-09 09:52:08,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:52:08,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc60bd55ff273b190ba19d HTTP/1.1" 200 None 2026-05-09 09:52:08,359 - lava_callback - DEBUG - Processing node 69fc60bd55ff273b190ba19d: baseline-arm64-baylibre 2026-05-09 09:52:08,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc60bd55ff273b190ba19d 2026-05-09 09:52:08,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:52:08,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc60bd55ff273b190ba19d HTTP/1.1" 200 None 2026-05-09 09:52:08,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:52:08,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-09 09:52:08,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:52:08,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc60bd55ff273b190ba19d HTTP/1.1" 200 None 2026-05-09 09:52:08,416 - lava_callback - ERROR - Error processing callback for node 69fc60bd55ff273b190ba19d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:53:36,415 - lava_callback - INFO - Received callback for node 69fc610f55ff273b190ba1c4 INFO: 172.21.0.1:32926 - "POST /node/69fc610f55ff273b190ba1c4 HTTP/1.0" 202 Accepted 2026-05-09 09:53:36,421 - lava_callback - INFO - Starting async job submit for node 69fc610f55ff273b190ba1c4 2026-05-09 09:53:36,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:53:36,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc610f55ff273b190ba1c4 HTTP/1.1" 200 None 2026-05-09 09:53:36,443 - lava_callback - DEBUG - Processing node 69fc610f55ff273b190ba1c4: baseline-arm64-clabbe 2026-05-09 09:53:36,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc610f55ff273b190ba1c4 2026-05-09 09:53:36,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:53:36,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc610f55ff273b190ba1c4 HTTP/1.1" 200 None 2026-05-09 09:53:36,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:53:36,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-09 09:53:36,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:53:36,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc610f55ff273b190ba1c4 HTTP/1.1" 200 None 2026-05-09 09:53:36,492 - lava_callback - ERROR - Error processing callback for node 69fc610f55ff273b190ba1c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:54:19,044 - lava_callback - INFO - Received callback for node 69fe6f4be4d4e78cd76b30d2 INFO: 172.21.0.1:53850 - "POST /node/69fe6f4be4d4e78cd76b30d2 HTTP/1.0" 202 Accepted 2026-05-09 09:54:19,050 - lava_callback - INFO - Starting async job submit for node 69fe6f4be4d4e78cd76b30d2 2026-05-09 09:54:19,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:54:19,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6f4be4d4e78cd76b30d2 HTTP/1.1" 200 None 2026-05-09 09:54:19,082 - lava_callback - DEBUG - Processing node 69fe6f4be4d4e78cd76b30d2: baseline-arm64 2026-05-09 09:54:19,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:54:19,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:54:19,505 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe6f4be4d4e78cd76b30d2/log.txt.gz 2026-05-09 09:54:19,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:54:19,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:54:19,829 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe6f4be4d4e78cd76b30d2/lava-logs.yaml 2026-05-09 09:54:19,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 09:54:19,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 09:54:19,946 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe6f4be4d4e78cd76b30d2/lava_callback.json.gz 2026-05-09 09:54:19,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:54:20,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6f4be4d4e78cd76b30d2 HTTP/1.1" 200 None 2026-05-09 09:54:20,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:54:20,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 09:54:20,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:54:20,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe6f4be4d4e78cd76b30d2 HTTP/1.1" 200 None 2026-05-09 09:54:20,115 - lava_callback - INFO - Completed processing callback for node 69fe6f4be4d4e78cd76b30d2 INFO: 172.21.0.1:52614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:54:41,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:54:41,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:54:56,437 - lava_callback - INFO - Received callback for node 69fc615c55ff273b190ba1ee INFO: 172.21.0.1:49534 - "POST /node/69fc615c55ff273b190ba1ee HTTP/1.0" 202 Accepted 2026-05-09 09:54:56,442 - lava_callback - INFO - Starting async job submit for node 69fc615c55ff273b190ba1ee 2026-05-09 09:54:56,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:54:56,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc615c55ff273b190ba1ee HTTP/1.1" 200 None 2026-05-09 09:54:56,459 - lava_callback - DEBUG - Processing node 69fc615c55ff273b190ba1ee: baseline-arm64-clabbe 2026-05-09 09:54:56,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc615c55ff273b190ba1ee 2026-05-09 09:54:56,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:54:56,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc615c55ff273b190ba1ee HTTP/1.1" 200 None 2026-05-09 09:54:56,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:54:56,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-09 09:54:56,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:54:56,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc615c55ff273b190ba1ee HTTP/1.1" 200 None 2026-05-09 09:54:56,518 - lava_callback - ERROR - Error processing callback for node 69fc615c55ff273b190ba1ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:56:16,509 - lava_callback - INFO - Received callback for node 69fc61aa55ff273b190ba20e INFO: 172.21.0.1:44382 - "POST /node/69fc61aa55ff273b190ba20e HTTP/1.0" 202 Accepted 2026-05-09 09:56:16,515 - lava_callback - INFO - Starting async job submit for node 69fc61aa55ff273b190ba20e 2026-05-09 09:56:16,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:56:16,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc61aa55ff273b190ba20e HTTP/1.1" 200 None 2026-05-09 09:56:16,531 - lava_callback - DEBUG - Processing node 69fc61aa55ff273b190ba20e: baseline-arm64-clabbe 2026-05-09 09:56:16,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc61aa55ff273b190ba20e 2026-05-09 09:56:16,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:56:16,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc61aa55ff273b190ba20e HTTP/1.1" 200 None 2026-05-09 09:56:16,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:56:16,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-09 09:56:16,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:56:16,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc61aa55ff273b190ba20e HTTP/1.1" 200 None 2026-05-09 09:56:16,602 - lava_callback - ERROR - Error processing callback for node 69fc61aa55ff273b190ba20e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:57:36,575 - lava_callback - INFO - Received callback for node 69fc61fd55ff273b190ba238 INFO: 172.21.0.1:59554 - "POST /node/69fc61fd55ff273b190ba238 HTTP/1.0" 202 Accepted 2026-05-09 09:57:36,580 - lava_callback - INFO - Starting async job submit for node 69fc61fd55ff273b190ba238 2026-05-09 09:57:36,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:57:36,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc61fd55ff273b190ba238 HTTP/1.1" 200 None 2026-05-09 09:57:36,599 - lava_callback - DEBUG - Processing node 69fc61fd55ff273b190ba238: baseline-arm64-clabbe 2026-05-09 09:57:36,599 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc61fd55ff273b190ba238 2026-05-09 09:57:36,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:57:36,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc61fd55ff273b190ba238 HTTP/1.1" 200 None 2026-05-09 09:57:36,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:57:36,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-09 09:57:36,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:57:36,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc61fd55ff273b190ba238 HTTP/1.1" 200 None 2026-05-09 09:57:36,643 - lava_callback - ERROR - Error processing callback for node 69fc61fd55ff273b190ba238: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48692 - "GET / HTTP/1.0" 200 OK 2026-05-09 09:59:16,628 - lava_callback - INFO - Received callback for node 69fc626155ff273b190ba263 INFO: 172.21.0.1:48694 - "POST /node/69fc626155ff273b190ba263 HTTP/1.0" 202 Accepted 2026-05-09 09:59:16,634 - lava_callback - INFO - Starting async job submit for node 69fc626155ff273b190ba263 2026-05-09 09:59:16,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:59:16,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc626155ff273b190ba263 HTTP/1.1" 200 None 2026-05-09 09:59:16,655 - lava_callback - DEBUG - Processing node 69fc626155ff273b190ba263: baseline-arm64-clabbe 2026-05-09 09:59:16,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc626155ff273b190ba263 2026-05-09 09:59:16,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:59:16,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc626155ff273b190ba263 HTTP/1.1" 200 None 2026-05-09 09:59:16,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:59:16,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-09 09:59:16,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 09:59:16,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc626155ff273b190ba263 HTTP/1.1" 200 None 2026-05-09 09:59:16,702 - lava_callback - ERROR - Error processing callback for node 69fc626155ff273b190ba263: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:00:16,865 - lava_callback - INFO - Received callback for node 69fc62ae55ff273b190ba27b INFO: 172.21.0.1:51262 - "POST /node/69fc62ae55ff273b190ba27b HTTP/1.0" 202 Accepted 2026-05-09 10:00:16,871 - lava_callback - INFO - Starting async job submit for node 69fc62ae55ff273b190ba27b 2026-05-09 10:00:16,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:00:16,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc62ae55ff273b190ba27b HTTP/1.1" 200 None 2026-05-09 10:00:16,886 - lava_callback - DEBUG - Processing node 69fc62ae55ff273b190ba27b: baseline-arm64-clabbe 2026-05-09 10:00:16,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc62ae55ff273b190ba27b 2026-05-09 10:00:16,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:00:16,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc62ae55ff273b190ba27b HTTP/1.1" 200 None 2026-05-09 10:00:16,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:00:16,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-09 10:00:16,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:00:16,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc62ae55ff273b190ba27b HTTP/1.1" 200 None 2026-05-09 10:00:16,932 - lava_callback - ERROR - Error processing callback for node 69fc62ae55ff273b190ba27b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:00:49,981 - lava_callback - INFO - Received callback for node 69ff0125254d3291e98dfb82 INFO: 172.21.0.1:50084 - "POST /node/69ff0125254d3291e98dfb82 HTTP/1.0" 202 Accepted 2026-05-09 10:00:49,988 - lava_callback - INFO - Starting async job submit for node 69ff0125254d3291e98dfb82 2026-05-09 10:00:50,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:00:50,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0125254d3291e98dfb82 HTTP/1.1" 200 None 2026-05-09 10:00:50,048 - lava_callback - DEBUG - Processing node 69ff0125254d3291e98dfb82: baseline-nfs-arm64 2026-05-09 10:00:51,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:00:51,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:00:51,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff0125254d3291e98dfb82/log.txt.gz 2026-05-09 10:00:51,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:00:52,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:00:52,217 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff0125254d3291e98dfb82/lava-logs.yaml 2026-05-09 10:00:52,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:00:52,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:00:52,422 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff0125254d3291e98dfb82/lava_callback.json.gz DEBUG: Setup failed for 69ff0125254d3291e98dfb82. Transitting job node result: incomplete -> fail 2026-05-09 10:00:52,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:00:52,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0125254d3291e98dfb82 HTTP/1.1" 200 None 2026-05-09 10:00:52,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:00:52,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 10:00:52,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:00:52,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0125254d3291e98dfb82 HTTP/1.1" 200 None 2026-05-09 10:00:52,653 - lava_callback - INFO - Completed processing callback for node 69ff0125254d3291e98dfb82 INFO: 172.21.0.1:50086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46172 - "GET /node/680f7036085db4d80d1e1faa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:01:11,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:01:11,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:12:09,356 - lava_callback - INFO - Received callback for node 69fc656a55ff273b190ba3a6 INFO: 172.21.0.1:54660 - "POST /node/69fc656a55ff273b190ba3a6 HTTP/1.0" 202 Accepted 2026-05-09 10:12:09,362 - lava_callback - INFO - Starting async job submit for node 69fc656a55ff273b190ba3a6 2026-05-09 10:12:09,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:12:09,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc656a55ff273b190ba3a6 HTTP/1.1" 200 None 2026-05-09 10:12:09,377 - lava_callback - DEBUG - Processing node 69fc656a55ff273b190ba3a6: baseline-arm64-baylibre 2026-05-09 10:12:09,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc656a55ff273b190ba3a6 2026-05-09 10:12:09,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:12:09,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc656a55ff273b190ba3a6 HTTP/1.1" 200 None 2026-05-09 10:12:09,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:12:09,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-09 10:12:09,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:12:09,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc656a55ff273b190ba3a6 HTTP/1.1" 200 None 2026-05-09 10:12:09,452 - lava_callback - ERROR - Error processing callback for node 69fc656a55ff273b190ba3a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:14:43,848 - lava_callback - INFO - Received callback for node 69ff07cf254d3291e98dff47 INFO: 172.21.0.1:50238 - "POST /node/69ff07cf254d3291e98dff47 HTTP/1.0" 202 Accepted 2026-05-09 10:14:43,855 - lava_callback - INFO - Starting async job submit for node 69ff07cf254d3291e98dff47 2026-05-09 10:14:43,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:14:43,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff07cf254d3291e98dff47 HTTP/1.1" 200 None 2026-05-09 10:14:43,904 - lava_callback - DEBUG - Processing node 69ff07cf254d3291e98dff47: baseline-arm64 2026-05-09 10:14:44,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:14:44,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:14:44,379 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff07cf254d3291e98dff47/log.txt.gz 2026-05-09 10:14:44,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:14:44,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:14:44,900 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff07cf254d3291e98dff47/lava-logs.yaml 2026-05-09 10:14:44,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:14:45,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:14:45,044 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff07cf254d3291e98dff47/lava_callback.json.gz DEBUG: Setup failed for 69ff07cf254d3291e98dff47. Transitting job node result: incomplete -> fail 2026-05-09 10:14:45,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:14:45,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff07cf254d3291e98dff47 HTTP/1.1" 200 None 2026-05-09 10:14:45,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:14:45,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 10:14:45,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:14:45,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff07cf254d3291e98dff47 HTTP/1.1" 200 None 2026-05-09 10:14:45,223 - lava_callback - INFO - Completed processing callback for node 69ff07cf254d3291e98dff47 INFO: 172.21.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:15:09,380 - lava_callback - INFO - Received callback for node 69fc662155ff273b190ba3f1 INFO: 172.21.0.1:40188 - "POST /node/69fc662155ff273b190ba3f1 HTTP/1.0" 202 Accepted 2026-05-09 10:15:09,386 - lava_callback - INFO - Starting async job submit for node 69fc662155ff273b190ba3f1 2026-05-09 10:15:09,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:15:09,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc662155ff273b190ba3f1 HTTP/1.1" 200 None 2026-05-09 10:15:09,402 - lava_callback - DEBUG - Processing node 69fc662155ff273b190ba3f1: baseline-arm64-baylibre 2026-05-09 10:15:09,402 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc662155ff273b190ba3f1 2026-05-09 10:15:09,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:15:09,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc662155ff273b190ba3f1 HTTP/1.1" 200 None 2026-05-09 10:15:09,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:15:09,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-09 10:15:09,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:15:09,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc662155ff273b190ba3f1 HTTP/1.1" 200 None 2026-05-09 10:15:09,452 - lava_callback - ERROR - Error processing callback for node 69fc662155ff273b190ba3f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-09 10:15:11,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:15:11,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-09 10:15:11,900 - lava_callback - INFO - Received callback for node 69fe6f9fe4d4e78cd76b3109 INFO: 172.21.0.1:37304 - "POST /node/69fe6f9fe4d4e78cd76b3109 HTTP/1.0" 202 Accepted 2026-05-09 10:15:11,911 - lava_callback - INFO - Starting async job submit for node 69fe6f9fe4d4e78cd76b3109 2026-05-09 10:15:11,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:15:11,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6f9fe4d4e78cd76b3109 HTTP/1.1" 200 None 2026-05-09 10:15:11,953 - lava_callback - DEBUG - Processing node 69fe6f9fe4d4e78cd76b3109: baseline-nfs-arm64 2026-05-09 10:15:14,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:15:14,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:15:14,299 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe6f9fe4d4e78cd76b3109/log.txt.gz INFO: 172.21.0.1:37318 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-09 10:15:15,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:15:15,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:15:15,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe6f9fe4d4e78cd76b3109/lava-logs.yaml 2026-05-09 10:15:15,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:15:16,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:15:16,120 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe6f9fe4d4e78cd76b3109/lava_callback.json.gz DEBUG: Setup failed for 69fe6f9fe4d4e78cd76b3109. Transitting job node result: incomplete -> fail 2026-05-09 10:15:16,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:15:16,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe6f9fe4d4e78cd76b3109 HTTP/1.1" 200 None 2026-05-09 10:15:16,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:15:16,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 10:15:16,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:15:16,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe6f9fe4d4e78cd76b3109 HTTP/1.1" 200 None 2026-05-09 10:15:16,295 - lava_callback - INFO - Completed processing callback for node 69fe6f9fe4d4e78cd76b3109 INFO: 172.21.0.1:37320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41998 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:15:41,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:15:41,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42098 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:17:49,571 - lava_callback - INFO - Received callback for node 69fc66b955ff273b190ba42f INFO: 172.21.0.1:42110 - "POST /node/69fc66b955ff273b190ba42f HTTP/1.0" 202 Accepted 2026-05-09 10:17:49,576 - lava_callback - INFO - Starting async job submit for node 69fc66b955ff273b190ba42f 2026-05-09 10:17:49,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:17:49,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc66b955ff273b190ba42f HTTP/1.1" 200 None 2026-05-09 10:17:49,598 - lava_callback - DEBUG - Processing node 69fc66b955ff273b190ba42f: baseline-arm64-baylibre 2026-05-09 10:17:49,599 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc66b955ff273b190ba42f 2026-05-09 10:17:49,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:17:49,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc66b955ff273b190ba42f HTTP/1.1" 200 None 2026-05-09 10:17:49,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:17:49,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-09 10:17:49,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:17:49,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc66b955ff273b190ba42f HTTP/1.1" 200 None 2026-05-09 10:17:49,644 - lava_callback - ERROR - Error processing callback for node 69fc66b955ff273b190ba42f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:20:10,032 - lava_callback - INFO - Received callback for node 69fc675055ff273b190ba471 INFO: 172.21.0.1:51936 - "POST /node/69fc675055ff273b190ba471 HTTP/1.0" 202 Accepted 2026-05-09 10:20:10,038 - lava_callback - INFO - Starting async job submit for node 69fc675055ff273b190ba471 2026-05-09 10:20:10,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:20:10,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc675055ff273b190ba471 HTTP/1.1" 200 None 2026-05-09 10:20:10,053 - lava_callback - DEBUG - Processing node 69fc675055ff273b190ba471: baseline-arm64-baylibre 2026-05-09 10:20:10,054 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc675055ff273b190ba471 2026-05-09 10:20:10,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:20:10,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc675055ff273b190ba471 HTTP/1.1" 200 None 2026-05-09 10:20:10,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:20:10,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-09 10:20:10,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:20:10,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc675055ff273b190ba471 HTTP/1.1" 200 None 2026-05-09 10:20:10,118 - lava_callback - ERROR - Error processing callback for node 69fc675055ff273b190ba471: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:21:29,892 - lava_callback - INFO - Received callback for node 69fc67a255ff273b190ba498 INFO: 172.21.0.1:53362 - "POST /node/69fc67a255ff273b190ba498 HTTP/1.0" 202 Accepted 2026-05-09 10:21:29,897 - lava_callback - INFO - Starting async job submit for node 69fc67a255ff273b190ba498 2026-05-09 10:21:29,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:21:29,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc67a255ff273b190ba498 HTTP/1.1" 200 None 2026-05-09 10:21:29,912 - lava_callback - DEBUG - Processing node 69fc67a255ff273b190ba498: baseline-arm64-baylibre 2026-05-09 10:21:29,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc67a255ff273b190ba498 2026-05-09 10:21:29,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:21:29,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc67a255ff273b190ba498 HTTP/1.1" 200 None 2026-05-09 10:21:29,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:21:29,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-09 10:21:29,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:21:29,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc67a255ff273b190ba498 HTTP/1.1" 200 None 2026-05-09 10:21:29,966 - lava_callback - ERROR - Error processing callback for node 69fc67a255ff273b190ba498: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:22:49,870 - lava_callback - INFO - Received callback for node 69fc67ed55ff273b190ba4c3 INFO: 172.21.0.1:35662 - "POST /node/69fc67ed55ff273b190ba4c3 HTTP/1.0" 202 Accepted 2026-05-09 10:22:49,876 - lava_callback - INFO - Starting async job submit for node 69fc67ed55ff273b190ba4c3 2026-05-09 10:22:49,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:22:49,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc67ed55ff273b190ba4c3 HTTP/1.1" 200 None 2026-05-09 10:22:49,890 - lava_callback - DEBUG - Processing node 69fc67ed55ff273b190ba4c3: baseline-arm64-baylibre 2026-05-09 10:22:49,891 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc67ed55ff273b190ba4c3 2026-05-09 10:22:49,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:22:49,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc67ed55ff273b190ba4c3 HTTP/1.1" 200 None 2026-05-09 10:22:49,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:22:49,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-09 10:22:49,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:22:49,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc67ed55ff273b190ba4c3 HTTP/1.1" 200 None 2026-05-09 10:22:49,955 - lava_callback - ERROR - Error processing callback for node 69fc67ed55ff273b190ba4c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43594 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:24:37,748 - lava_callback - INFO - Received callback for node 69fc686155ff273b190ba4f8 INFO: 172.21.0.1:43596 - "POST /node/69fc686155ff273b190ba4f8 HTTP/1.0" 202 Accepted 2026-05-09 10:24:37,754 - lava_callback - INFO - Starting async job submit for node 69fc686155ff273b190ba4f8 2026-05-09 10:24:37,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:24:37,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc686155ff273b190ba4f8 HTTP/1.1" 200 None 2026-05-09 10:24:37,775 - lava_callback - DEBUG - Processing node 69fc686155ff273b190ba4f8: baseline-arm64-clabbe 2026-05-09 10:24:37,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc686155ff273b190ba4f8 2026-05-09 10:24:37,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:24:37,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc686155ff273b190ba4f8 HTTP/1.1" 200 None 2026-05-09 10:24:37,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:24:37,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-09 10:24:37,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:24:37,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc686155ff273b190ba4f8 HTTP/1.1" 200 None 2026-05-09 10:24:37,819 - lava_callback - ERROR - Error processing callback for node 69fc686155ff273b190ba4f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48964 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:29:57,924 - lava_callback - INFO - Received callback for node 69fc699255ff273b190ba584 INFO: 172.21.0.1:48978 - "POST /node/69fc699255ff273b190ba584 HTTP/1.0" 202 Accepted 2026-05-09 10:29:57,929 - lava_callback - INFO - Starting async job submit for node 69fc699255ff273b190ba584 2026-05-09 10:29:57,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:29:57,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc699255ff273b190ba584 HTTP/1.1" 200 None 2026-05-09 10:29:57,948 - lava_callback - DEBUG - Processing node 69fc699255ff273b190ba584: baseline-arm64-clabbe 2026-05-09 10:29:57,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc699255ff273b190ba584 2026-05-09 10:29:57,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:29:57,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc699255ff273b190ba584 HTTP/1.1" 200 None 2026-05-09 10:29:57,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:29:57,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-09 10:29:57,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:29:58,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc699255ff273b190ba584 HTTP/1.1" 200 None 2026-05-09 10:29:58,006 - lava_callback - ERROR - Error processing callback for node 69fc699255ff273b190ba584: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50048 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:31:42,842 - lava_callback - INFO - Received callback for node 69fe845eef513bcf3f02866e INFO: 172.21.0.1:39500 - "POST /node/69fe845eef513bcf3f02866e HTTP/1.0" 202 Accepted 2026-05-09 10:31:42,848 - lava_callback - INFO - Starting async job submit for node 69fe845eef513bcf3f02866e 2026-05-09 10:31:42,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:31:42,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe845eef513bcf3f02866e HTTP/1.1" 200 None 2026-05-09 10:31:42,880 - lava_callback - DEBUG - Processing node 69fe845eef513bcf3f02866e: baseline-arm64 2026-05-09 10:31:43,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:31:43,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:31:43,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe845eef513bcf3f02866e/log.txt.gz 2026-05-09 10:31:43,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:31:43,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:31:43,899 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe845eef513bcf3f02866e/lava-logs.yaml 2026-05-09 10:31:43,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:31:44,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:31:44,024 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fe845eef513bcf3f02866e/lava_callback.json.gz 2026-05-09 10:31:44,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:31:44,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe845eef513bcf3f02866e HTTP/1.1" 200 None 2026-05-09 10:31:44,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:31:44,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-09 10:31:44,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:31:44,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe845eef513bcf3f02866e HTTP/1.1" 200 None 2026-05-09 10:31:44,171 - lava_callback - INFO - Completed processing callback for node 69fe845eef513bcf3f02866e INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:31:48,110 - lava_callback - INFO - Received callback for node 69ff0cd7254d3291e98e01e3 INFO: 172.21.0.1:39520 - "POST /node/69ff0cd7254d3291e98e01e3 HTTP/1.0" 202 Accepted 2026-05-09 10:31:48,117 - lava_callback - INFO - Starting async job submit for node 69ff0cd7254d3291e98e01e3 2026-05-09 10:31:48,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:31:48,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0cd7254d3291e98e01e3 HTTP/1.1" 200 None 2026-05-09 10:31:48,162 - lava_callback - DEBUG - Processing node 69ff0cd7254d3291e98e01e3: baseline-arm64 2026-05-09 10:31:48,360 - lava_callback - WARNING - Failed to upload log 2026-05-09 10:31:48,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:31:48,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:31:48,625 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff0cd7254d3291e98e01e3/lava-logs.yaml 2026-05-09 10:31:48,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:31:48,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:31:48,725 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff0cd7254d3291e98e01e3/lava_callback.json.gz 2026-05-09 10:31:48,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:31:48,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0cd7254d3291e98e01e3 HTTP/1.1" 200 None 2026-05-09 10:31:48,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:31:48,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 10:31:48,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:31:48,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0cd7254d3291e98e01e3 HTTP/1.1" 200 None 2026-05-09 10:31:48,870 - lava_callback - INFO - Completed processing callback for node 69ff0cd7254d3291e98e01e3 INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:32:11,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:32:11,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:33:38,004 - lava_callback - INFO - Received callback for node 69fc6a7155ff273b190ba5ef INFO: 172.21.0.1:57120 - "POST /node/69fc6a7155ff273b190ba5ef HTTP/1.0" 202 Accepted 2026-05-09 10:33:38,009 - lava_callback - INFO - Starting async job submit for node 69fc6a7155ff273b190ba5ef 2026-05-09 10:33:38,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:33:38,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc6a7155ff273b190ba5ef HTTP/1.1" 200 None 2026-05-09 10:33:38,047 - lava_callback - DEBUG - Processing node 69fc6a7155ff273b190ba5ef: baseline-arm64-clabbe 2026-05-09 10:33:38,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc6a7155ff273b190ba5ef 2026-05-09 10:33:38,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:33:38,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc6a7155ff273b190ba5ef HTTP/1.1" 200 None 2026-05-09 10:33:38,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:33:38,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-09 10:33:38,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:33:38,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc6a7155ff273b190ba5ef HTTP/1.1" 200 None 2026-05-09 10:33:38,100 - lava_callback - ERROR - Error processing callback for node 69fc6a7155ff273b190ba5ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:35:58,112 - lava_callback - INFO - Received callback for node 69fc6b0355ff273b190ba640 INFO: 172.21.0.1:52742 - "POST /node/69fc6b0355ff273b190ba640 HTTP/1.0" 202 Accepted 2026-05-09 10:35:58,117 - lava_callback - INFO - Starting async job submit for node 69fc6b0355ff273b190ba640 2026-05-09 10:35:58,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:35:58,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc6b0355ff273b190ba640 HTTP/1.1" 200 None 2026-05-09 10:35:58,132 - lava_callback - DEBUG - Processing node 69fc6b0355ff273b190ba640: baseline-arm64-clabbe 2026-05-09 10:35:58,133 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc6b0355ff273b190ba640 2026-05-09 10:35:58,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:35:58,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc6b0355ff273b190ba640 HTTP/1.1" 200 None 2026-05-09 10:35:58,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:35:58,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-09 10:35:58,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:35:58,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc6b0355ff273b190ba640 HTTP/1.1" 200 None 2026-05-09 10:35:58,181 - lava_callback - ERROR - Error processing callback for node 69fc6b0355ff273b190ba640: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:36:08,435 - lava_callback - INFO - Received callback for node 69fe846def513bcf3f028692 INFO: 172.21.0.1:36266 - "POST /node/69fe846def513bcf3f028692 HTTP/1.0" 202 Accepted 2026-05-09 10:36:08,441 - lava_callback - INFO - Starting async job submit for node 69fe846def513bcf3f028692 2026-05-09 10:36:08,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:36:08,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe846def513bcf3f028692 HTTP/1.1" 200 None 2026-05-09 10:36:08,474 - lava_callback - DEBUG - Processing node 69fe846def513bcf3f028692: baseline-nfs-arm64 2026-05-09 10:36:08,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:36:09,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:36:09,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe846def513bcf3f028692/log.txt.gz 2026-05-09 10:36:09,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:36:09,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:36:09,422 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe846def513bcf3f028692/lava-logs.yaml 2026-05-09 10:36:09,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:36:09,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:36:09,591 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fe846def513bcf3f028692/lava_callback.json.gz 2026-05-09 10:36:09,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:36:09,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe846def513bcf3f028692 HTTP/1.1" 200 None 2026-05-09 10:36:09,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:36:09,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-09 10:36:09,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:36:09,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fe846def513bcf3f028692 HTTP/1.1" 200 None 2026-05-09 10:36:09,659 - lava_callback - INFO - Completed processing callback for node 69fe846def513bcf3f028692 2026-05-09 10:36:11,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:36:11,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:37:34,183 - lava_callback - INFO - Received callback for node 69ff0e35254d3291e98e0291 INFO: 172.21.0.1:42356 - "POST /node/69ff0e35254d3291e98e0291 HTTP/1.0" 202 Accepted 2026-05-09 10:37:34,189 - lava_callback - INFO - Starting async job submit for node 69ff0e35254d3291e98e0291 2026-05-09 10:37:34,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:37:34,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0e35254d3291e98e0291 HTTP/1.1" 200 None 2026-05-09 10:37:34,234 - lava_callback - DEBUG - Processing node 69ff0e35254d3291e98e0291: baseline-arm64 2026-05-09 10:37:34,369 - lava_callback - WARNING - Failed to upload log 2026-05-09 10:37:34,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:37:34,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:37:34,770 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff0e35254d3291e98e0291/lava-logs.yaml 2026-05-09 10:37:34,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:37:35,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:37:35,041 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff0e35254d3291e98e0291/lava_callback.json.gz 2026-05-09 10:37:35,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:37:35,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0e35254d3291e98e0291 HTTP/1.1" 200 None 2026-05-09 10:37:35,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:37:35,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 10:37:35,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:37:35,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0e35254d3291e98e0291 HTTP/1.1" 200 None 2026-05-09 10:37:35,199 - lava_callback - INFO - Completed processing callback for node 69ff0e35254d3291e98e0291 INFO: 172.21.0.1:42364 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:37:41,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:37:41,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:39:38,231 - lava_callback - INFO - Received callback for node 69fc6be155ff273b190ba6c5 INFO: 172.21.0.1:49828 - "POST /node/69fc6be155ff273b190ba6c5 HTTP/1.0" 202 Accepted 2026-05-09 10:39:38,237 - lava_callback - INFO - Starting async job submit for node 69fc6be155ff273b190ba6c5 2026-05-09 10:39:38,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:39:38,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc6be155ff273b190ba6c5 HTTP/1.1" 200 None 2026-05-09 10:39:38,251 - lava_callback - DEBUG - Processing node 69fc6be155ff273b190ba6c5: baseline-arm64-clabbe 2026-05-09 10:39:38,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc6be155ff273b190ba6c5 2026-05-09 10:39:38,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:39:38,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc6be155ff273b190ba6c5 HTTP/1.1" 200 None 2026-05-09 10:39:38,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:39:38,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-09 10:39:38,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:39:38,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc6be155ff273b190ba6c5 HTTP/1.1" 200 None 2026-05-09 10:39:38,304 - lava_callback - ERROR - Error processing callback for node 69fc6be155ff273b190ba6c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54484 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:40:22,294 - lava_callback - INFO - Received callback for node 69fec3d6ef513bcf3f02c582 INFO: 172.21.0.1:57436 - "POST /node/69fec3d6ef513bcf3f02c582 HTTP/1.0" 202 Accepted 2026-05-09 10:40:22,300 - lava_callback - INFO - Starting async job submit for node 69fec3d6ef513bcf3f02c582 2026-05-09 10:40:22,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:40:22,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fec3d6ef513bcf3f02c582 HTTP/1.1" 200 None 2026-05-09 10:40:22,331 - lava_callback - DEBUG - Processing node 69fec3d6ef513bcf3f02c582: baseline-arm64 2026-05-09 10:40:22,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:40:22,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:40:22,910 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fec3d6ef513bcf3f02c582/log.txt.gz 2026-05-09 10:40:23,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:40:23,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:40:23,305 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fec3d6ef513bcf3f02c582/lava-logs.yaml 2026-05-09 10:40:23,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:40:23,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:40:23,424 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fec3d6ef513bcf3f02c582/lava_callback.json.gz 2026-05-09 10:40:23,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:40:23,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fec3d6ef513bcf3f02c582 HTTP/1.1" 200 None 2026-05-09 10:40:23,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:40:23,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 10:40:23,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:40:23,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fec3d6ef513bcf3f02c582 HTTP/1.1" 200 None 2026-05-09 10:40:23,594 - lava_callback - INFO - Completed processing callback for node 69fec3d6ef513bcf3f02c582 INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:40:41,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:40:41,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58382 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:40:58,386 - lava_callback - INFO - Received callback for node 69fc6c2d55ff273b190ba6e1 INFO: 172.21.0.1:58388 - "POST /node/69fc6c2d55ff273b190ba6e1 HTTP/1.0" 202 Accepted 2026-05-09 10:40:58,392 - lava_callback - INFO - Starting async job submit for node 69fc6c2d55ff273b190ba6e1 2026-05-09 10:40:58,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:40:58,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc6c2d55ff273b190ba6e1 HTTP/1.1" 200 None 2026-05-09 10:40:58,407 - lava_callback - DEBUG - Processing node 69fc6c2d55ff273b190ba6e1: baseline-arm64-clabbe 2026-05-09 10:40:58,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc6c2d55ff273b190ba6e1 2026-05-09 10:40:58,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:40:58,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc6c2d55ff273b190ba6e1 HTTP/1.1" 200 None 2026-05-09 10:40:58,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:40:58,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-09 10:40:58,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:40:58,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc6c2d55ff273b190ba6e1 HTTP/1.1" 200 None 2026-05-09 10:40:58,457 - lava_callback - ERROR - Error processing callback for node 69fc6c2d55ff273b190ba6e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:42:05,365 - lava_callback - INFO - Received callback for node 69ff0b51254d3291e98e0129 INFO: 172.21.0.1:33168 - "POST /node/69ff0b51254d3291e98e0129 HTTP/1.0" 202 Accepted 2026-05-09 10:42:05,372 - lava_callback - INFO - Starting async job submit for node 69ff0b51254d3291e98e0129 2026-05-09 10:42:05,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:42:05,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0b51254d3291e98e0129 HTTP/1.1" 200 None 2026-05-09 10:42:05,460 - lava_callback - DEBUG - Processing node 69ff0b51254d3291e98e0129: ltp-smoke 2026-05-09 10:42:05,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:42:06,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:42:06,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ff0b51254d3291e98e0129/log.txt.gz INFO: 172.21.0.1:33170 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:42:06,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:42:06,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:42:06,694 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ff0b51254d3291e98e0129/lava-logs.yaml 2026-05-09 10:42:06,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:42:06,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:42:06,835 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ff0b51254d3291e98e0129/lava_callback.json.gz 2026-05-09 10:42:06,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:42:06,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0b51254d3291e98e0129 HTTP/1.1" 200 None 2026-05-09 10:42:06,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:42:06,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feeddd254d3291e98de968 HTTP/1.1" 200 None 2026-05-09 10:42:06,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:42:07,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0b51254d3291e98e0129 HTTP/1.1" 200 None 2026-05-09 10:42:07,169 - lava_callback - INFO - Completed processing callback for node 69ff0b51254d3291e98e0129 INFO: 172.21.0.1:33184 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:42:11,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:42:11,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-09 10:51:15,752 - lava_callback - INFO - Received callback for node 69ff0dc2254d3291e98e025a INFO: 172.21.0.1:57478 - "POST /node/69ff0dc2254d3291e98e025a HTTP/1.0" 202 Accepted 2026-05-09 10:51:15,759 - lava_callback - INFO - Starting async job submit for node 69ff0dc2254d3291e98e025a 2026-05-09 10:51:15,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:51:15,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0dc2254d3291e98e025a HTTP/1.1" 200 None 2026-05-09 10:51:15,852 - lava_callback - DEBUG - Processing node 69ff0dc2254d3291e98e025a: baseline-arm 2026-05-09 10:51:16,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:57492 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:51:16,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:51:16,606 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ff0dc2254d3291e98e025a/log.txt.gz 2026-05-09 10:51:16,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:51:17,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:51:17,228 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ff0dc2254d3291e98e025a/lava-logs.yaml 2026-05-09 10:51:17,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:51:17,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:51:17,420 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ff0dc2254d3291e98e025a/lava_callback.json.gz DEBUG: Setup failed for 69ff0dc2254d3291e98e025a. Transitting job node result: incomplete -> fail 2026-05-09 10:51:17,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:51:17,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0dc2254d3291e98e025a HTTP/1.1" 200 None 2026-05-09 10:51:17,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:51:17,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 10:51:17,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:51:17,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0dc2254d3291e98e025a HTTP/1.1" 200 None 2026-05-09 10:51:17,733 - lava_callback - INFO - Completed processing callback for node 69ff0dc2254d3291e98e025a INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:51:41,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:51:41,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41272 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:54:17,864 - lava_callback - INFO - Received callback for node 69ff124e254d3291e98e04e3 INFO: 172.21.0.1:41284 - "POST /node/69ff124e254d3291e98e04e3 HTTP/1.0" 202 Accepted 2026-05-09 10:54:17,870 - lava_callback - INFO - Starting async job submit for node 69ff124e254d3291e98e04e3 2026-05-09 10:54:17,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:54:17,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff124e254d3291e98e04e3 HTTP/1.1" 200 None 2026-05-09 10:54:17,889 - lava_callback - DEBUG - Processing node 69ff124e254d3291e98e04e3: baseline-nfs-arm64 2026-05-09 10:54:17,890 - lava_callback - WARNING - Failed to upload log 2026-05-09 10:54:17,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:54:17,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:54:17,977 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff124e254d3291e98e04e3/lava-logs.yaml 2026-05-09 10:54:17,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:54:18,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:54:18,068 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff124e254d3291e98e04e3/lava_callback.json.gz 2026-05-09 10:54:18,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:54:18,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff124e254d3291e98e04e3 HTTP/1.1" 200 None 2026-05-09 10:54:18,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:54:18,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 10:54:18,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:54:18,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff124e254d3291e98e04e3 HTTP/1.1" 200 None 2026-05-09 10:54:18,124 - lava_callback - INFO - Completed processing callback for node 69ff124e254d3291e98e04e3 INFO: 172.21.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:54:41,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:54:41,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42834 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:56:20,876 - lava_callback - INFO - Received callback for node 69ff1293254d3291e98e0505 INFO: 172.21.0.1:38024 - "POST /node/69ff1293254d3291e98e0505 HTTP/1.0" 202 Accepted 2026-05-09 10:56:20,882 - lava_callback - INFO - Starting async job submit for node 69ff1293254d3291e98e0505 2026-05-09 10:56:20,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:56:20,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1293254d3291e98e0505 HTTP/1.1" 200 None 2026-05-09 10:56:20,926 - lava_callback - DEBUG - Processing node 69ff1293254d3291e98e0505: baseline-arm64 2026-05-09 10:56:21,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:56:21,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:56:21,398 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1293254d3291e98e0505/log.txt.gz 2026-05-09 10:56:21,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:56:21,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:56:21,794 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1293254d3291e98e0505/lava-logs.yaml 2026-05-09 10:56:21,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 10:56:21,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 10:56:21,902 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1293254d3291e98e0505/lava_callback.json.gz 2026-05-09 10:56:21,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:56:21,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1293254d3291e98e0505 HTTP/1.1" 200 None 2026-05-09 10:56:21,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:56:21,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 10:56:21,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:56:21,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1293254d3291e98e0505 HTTP/1.1" 200 None 2026-05-09 10:56:21,978 - lava_callback - INFO - Completed processing callback for node 69ff1293254d3291e98e0505 INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51146 - "GET / HTTP/1.0" 200 OK 2026-05-09 10:56:41,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 10:56:42,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:01:17,437 - lava_callback - INFO - Received callback for node 69fec42cef513bcf3f02c5b1 INFO: 172.21.0.1:49330 - "POST /node/69fec42cef513bcf3f02c5b1 HTTP/1.0" 202 Accepted 2026-05-09 11:01:17,447 - lava_callback - INFO - Starting async job submit for node 69fec42cef513bcf3f02c5b1 2026-05-09 11:01:17,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:01:17,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fec42cef513bcf3f02c5b1 HTTP/1.1" 200 None 2026-05-09 11:01:17,490 - lava_callback - DEBUG - Processing node 69fec42cef513bcf3f02c5b1: baseline-nfs-arm64 2026-05-09 11:01:19,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:01:19,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:01:19,968 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fec42cef513bcf3f02c5b1/log.txt.gz 2026-05-09 11:01:21,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:01:21,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:01:21,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fec42cef513bcf3f02c5b1/lava-logs.yaml 2026-05-09 11:01:21,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:01:21,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:01:21,730 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fec42cef513bcf3f02c5b1/lava_callback.json.gz DEBUG: Setup failed for 69fec42cef513bcf3f02c5b1. Transitting job node result: incomplete -> fail 2026-05-09 11:01:21,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:01:21,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fec42cef513bcf3f02c5b1 HTTP/1.1" 200 None 2026-05-09 11:01:21,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:01:21,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 11:01:21,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:01:21,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fec42cef513bcf3f02c5b1 HTTP/1.1" 200 None 2026-05-09 11:01:21,902 - lava_callback - INFO - Completed processing callback for node 69fec42cef513bcf3f02c5b1 INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34226 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:01:42,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:01:42,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:09:40,655 - lava_callback - INFO - Received callback for node 69fedc48ef513bcf3f02cb9a INFO: 172.21.0.1:41746 - "POST /node/69fedc48ef513bcf3f02cb9a HTTP/1.0" 202 Accepted 2026-05-09 11:09:40,661 - lava_callback - INFO - Starting async job submit for node 69fedc48ef513bcf3f02cb9a 2026-05-09 11:09:40,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:09:40,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fedc48ef513bcf3f02cb9a HTTP/1.1" 200 None 2026-05-09 11:09:40,693 - lava_callback - DEBUG - Processing node 69fedc48ef513bcf3f02cb9a: baseline-arm64 2026-05-09 11:09:41,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:09:41,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:09:41,167 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fedc48ef513bcf3f02cb9a/log.txt.gz 2026-05-09 11:09:41,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:09:41,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:09:41,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fedc48ef513bcf3f02cb9a/lava-logs.yaml 2026-05-09 11:09:41,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:09:41,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:09:41,816 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fedc48ef513bcf3f02cb9a/lava_callback.json.gz 2026-05-09 11:09:41,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:09:41,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fedc48ef513bcf3f02cb9a HTTP/1.1" 200 None 2026-05-09 11:09:41,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:09:41,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-09 11:09:41,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:09:41,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fedc48ef513bcf3f02cb9a HTTP/1.1" 200 None 2026-05-09 11:09:41,949 - lava_callback - INFO - Completed processing callback for node 69fedc48ef513bcf3f02cb9a 2026-05-09 11:09:42,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:09:42,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:12:53,648 - lava_callback - INFO - Received callback for node 69ff122d254d3291e98e04da INFO: 172.21.0.1:48790 - "POST /node/69ff122d254d3291e98e04da HTTP/1.0" 202 Accepted 2026-05-09 11:12:53,697 - lava_callback - INFO - Starting async job submit for node 69ff122d254d3291e98e04da 2026-05-09 11:12:53,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:12:53,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff122d254d3291e98e04da HTTP/1.1" 200 None 2026-05-09 11:12:53,735 - lava_callback - DEBUG - Processing node 69ff122d254d3291e98e04da: baseline-arm-pengutronix 2026-05-09 11:12:53,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:12:53,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:12:53,957 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ff122d254d3291e98e04da/log.txt.gz 2026-05-09 11:12:54,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:12:54,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:12:54,300 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ff122d254d3291e98e04da/lava-logs.yaml 2026-05-09 11:12:54,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:12:54,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:12:54,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ff122d254d3291e98e04da/lava_callback.json.gz DEBUG: Setup failed for 69ff122d254d3291e98e04da. Transitting job node result: incomplete -> fail 2026-05-09 11:12:54,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:12:54,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff122d254d3291e98e04da HTTP/1.1" 200 None 2026-05-09 11:12:54,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:12:54,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 11:12:54,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:12:54,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff122d254d3291e98e04da HTTP/1.1" 200 None 2026-05-09 11:12:54,546 - lava_callback - INFO - Completed processing callback for node 69ff122d254d3291e98e04da INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:13:12,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:13:12,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:14:10,621 - lava_callback - INFO - Received callback for node 69fedc9cef513bcf3f02cbc4 INFO: 172.21.0.1:38736 - "POST /node/69fedc9cef513bcf3f02cbc4 HTTP/1.0" 202 Accepted 2026-05-09 11:14:10,628 - lava_callback - INFO - Starting async job submit for node 69fedc9cef513bcf3f02cbc4 2026-05-09 11:14:10,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:14:10,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fedc9cef513bcf3f02cbc4 HTTP/1.1" 200 None 2026-05-09 11:14:10,660 - lava_callback - DEBUG - Processing node 69fedc9cef513bcf3f02cbc4: baseline-nfs-arm64 2026-05-09 11:14:11,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:14:11,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:14:11,176 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fedc9cef513bcf3f02cbc4/log.txt.gz 2026-05-09 11:14:11,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:14:11,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:14:11,625 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fedc9cef513bcf3f02cbc4/lava-logs.yaml 2026-05-09 11:14:11,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:14:11,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:14:11,773 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fedc9cef513bcf3f02cbc4/lava_callback.json.gz 2026-05-09 11:14:11,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:14:11,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fedc9cef513bcf3f02cbc4 HTTP/1.1" 200 None 2026-05-09 11:14:11,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:14:11,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-09 11:14:11,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:14:11,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fedc9cef513bcf3f02cbc4 HTTP/1.1" 200 None 2026-05-09 11:14:11,847 - lava_callback - INFO - Completed processing callback for node 69fedc9cef513bcf3f02cbc4 2026-05-09 11:14:12,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:14:12,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50522 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:15:20,497 - lava_callback - INFO - Received callback for node 69ff1590254d3291e98e06ad INFO: 172.21.0.1:48034 - "POST /node/69ff1590254d3291e98e06ad HTTP/1.0" 202 Accepted 2026-05-09 11:15:20,504 - lava_callback - INFO - Starting async job submit for node 69ff1590254d3291e98e06ad 2026-05-09 11:15:20,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:15:20,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1590254d3291e98e06ad HTTP/1.1" 200 None 2026-05-09 11:15:20,554 - lava_callback - DEBUG - Processing node 69ff1590254d3291e98e06ad: baseline-arm64 2026-05-09 11:15:20,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:15:21,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:15:21,020 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1590254d3291e98e06ad/log.txt.gz 2026-05-09 11:15:21,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:15:21,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:15:21,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1590254d3291e98e06ad/lava-logs.yaml 2026-05-09 11:15:21,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:15:21,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:15:21,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1590254d3291e98e06ad/lava_callback.json.gz DEBUG: Setup failed for 69ff1590254d3291e98e06ad. Transitting job node result: incomplete -> fail 2026-05-09 11:15:21,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:15:21,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1590254d3291e98e06ad HTTP/1.1" 200 None 2026-05-09 11:15:21,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:15:21,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 11:15:21,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:15:21,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1590254d3291e98e06ad HTTP/1.1" 200 None 2026-05-09 11:15:21,777 - lava_callback - INFO - Completed processing callback for node 69ff1590254d3291e98e06ad INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34964 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:15:42,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:15:42,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:15:52,682 - lava_callback - INFO - Received callback for node 69fc745b55ff273b190ba91b INFO: 172.21.0.1:37866 - "POST /node/69fc745b55ff273b190ba91b HTTP/1.0" 202 Accepted 2026-05-09 11:15:52,687 - lava_callback - INFO - Starting async job submit for node 69fc745b55ff273b190ba91b 2026-05-09 11:15:52,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:15:52,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc745b55ff273b190ba91b HTTP/1.1" 200 None 2026-05-09 11:15:52,703 - lava_callback - DEBUG - Processing node 69fc745b55ff273b190ba91b: baseline-arm-baylibre 2026-05-09 11:15:52,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc745b55ff273b190ba91b 2026-05-09 11:15:52,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:15:52,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc745b55ff273b190ba91b HTTP/1.1" 200 None 2026-05-09 11:15:52,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:15:52,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-09 11:15:52,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:15:52,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc745b55ff273b190ba91b HTTP/1.1" 200 None 2026-05-09 11:15:52,767 - lava_callback - ERROR - Error processing callback for node 69fc745b55ff273b190ba91b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:16:32,689 - lava_callback - INFO - Received callback for node 69fc748355ff273b190ba927 INFO: 172.21.0.1:58984 - "POST /node/69fc748355ff273b190ba927 HTTP/1.0" 202 Accepted 2026-05-09 11:16:32,694 - lava_callback - INFO - Starting async job submit for node 69fc748355ff273b190ba927 2026-05-09 11:16:32,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:16:32,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc748355ff273b190ba927 HTTP/1.1" 200 None 2026-05-09 11:16:32,709 - lava_callback - DEBUG - Processing node 69fc748355ff273b190ba927: baseline-arm-baylibre 2026-05-09 11:16:32,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc748355ff273b190ba927 2026-05-09 11:16:32,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:16:32,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc748355ff273b190ba927 HTTP/1.1" 200 None 2026-05-09 11:16:32,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:16:32,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-09 11:16:32,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:16:32,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc748355ff273b190ba927 HTTP/1.1" 200 None 2026-05-09 11:16:32,756 - lava_callback - ERROR - Error processing callback for node 69fc748355ff273b190ba927: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:17:12,724 - lava_callback - INFO - Received callback for node 69fc74ac55ff273b190ba935 INFO: 172.21.0.1:50686 - "POST /node/69fc74ac55ff273b190ba935 HTTP/1.0" 202 Accepted 2026-05-09 11:17:12,730 - lava_callback - INFO - Starting async job submit for node 69fc74ac55ff273b190ba935 2026-05-09 11:17:12,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:17:12,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc74ac55ff273b190ba935 HTTP/1.1" 200 None 2026-05-09 11:17:12,745 - lava_callback - DEBUG - Processing node 69fc74ac55ff273b190ba935: baseline-arm-baylibre 2026-05-09 11:17:12,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc74ac55ff273b190ba935 2026-05-09 11:17:12,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:17:12,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc74ac55ff273b190ba935 HTTP/1.1" 200 None 2026-05-09 11:17:12,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:17:12,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-09 11:17:12,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:17:12,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc74ac55ff273b190ba935 HTTP/1.1" 200 None 2026-05-09 11:17:12,798 - lava_callback - ERROR - Error processing callback for node 69fc74ac55ff273b190ba935: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46290 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:17:52,789 - lava_callback - INFO - Received callback for node 69fc74d155ff273b190ba941 INFO: 172.21.0.1:47826 - "POST /node/69fc74d155ff273b190ba941 HTTP/1.0" 202 Accepted 2026-05-09 11:17:52,794 - lava_callback - INFO - Starting async job submit for node 69fc74d155ff273b190ba941 2026-05-09 11:17:52,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:17:52,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc74d155ff273b190ba941 HTTP/1.1" 200 None 2026-05-09 11:17:52,822 - lava_callback - DEBUG - Processing node 69fc74d155ff273b190ba941: baseline-arm-baylibre 2026-05-09 11:17:52,822 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc74d155ff273b190ba941 2026-05-09 11:17:52,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:17:52,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc74d155ff273b190ba941 HTTP/1.1" 200 None 2026-05-09 11:17:52,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:17:52,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-09 11:17:52,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:17:52,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc74d155ff273b190ba941 HTTP/1.1" 200 None 2026-05-09 11:17:52,876 - lava_callback - ERROR - Error processing callback for node 69fc74d155ff273b190ba941: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:18:17,523 - lava_callback - INFO - Received callback for node 69fef49c254d3291e98df2d9 INFO: 172.21.0.1:40180 - "POST /node/69fef49c254d3291e98df2d9 HTTP/1.0" 202 Accepted 2026-05-09 11:18:17,528 - lava_callback - INFO - Starting async job submit for node 69fef49c254d3291e98df2d9 2026-05-09 11:18:17,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:18:17,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef49c254d3291e98df2d9 HTTP/1.1" 200 None 2026-05-09 11:18:17,559 - lava_callback - DEBUG - Processing node 69fef49c254d3291e98df2d9: baseline-arm64 2026-05-09 11:18:17,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:18:18,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:18:18,024 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49c254d3291e98df2d9/log.txt.gz 2026-05-09 11:18:18,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:18:18,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:18:18,410 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49c254d3291e98df2d9/lava-logs.yaml 2026-05-09 11:18:18,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:18:18,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:18:18,723 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fef49c254d3291e98df2d9/lava_callback.json.gz 2026-05-09 11:18:18,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:18:18,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef49c254d3291e98df2d9 HTTP/1.1" 200 None 2026-05-09 11:18:18,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:18:18,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 11:18:18,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:18:18,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef49c254d3291e98df2d9 HTTP/1.1" 200 None 2026-05-09 11:18:18,799 - lava_callback - INFO - Completed processing callback for node 69fef49c254d3291e98df2d9 INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:18:32,887 - lava_callback - INFO - Received callback for node 69fc74f655ff273b190ba94e INFO: 172.21.0.1:48582 - "POST /node/69fc74f655ff273b190ba94e HTTP/1.0" 202 Accepted 2026-05-09 11:18:32,892 - lava_callback - INFO - Starting async job submit for node 69fc74f655ff273b190ba94e 2026-05-09 11:18:32,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:18:32,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc74f655ff273b190ba94e HTTP/1.1" 200 None 2026-05-09 11:18:32,907 - lava_callback - DEBUG - Processing node 69fc74f655ff273b190ba94e: baseline-arm-baylibre 2026-05-09 11:18:32,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc74f655ff273b190ba94e 2026-05-09 11:18:32,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:18:32,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc74f655ff273b190ba94e HTTP/1.1" 200 None 2026-05-09 11:18:32,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:18:32,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-09 11:18:32,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:18:32,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc74f655ff273b190ba94e HTTP/1.1" 200 None 2026-05-09 11:18:32,967 - lava_callback - ERROR - Error processing callback for node 69fc74f655ff273b190ba94e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48584 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:18:42,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:18:42,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:18:52,805 - lava_callback - INFO - Received callback for node 69fc751a55ff273b190ba95a INFO: 172.21.0.1:39742 - "POST /node/69fc751a55ff273b190ba95a HTTP/1.0" 202 Accepted 2026-05-09 11:18:52,811 - lava_callback - INFO - Starting async job submit for node 69fc751a55ff273b190ba95a 2026-05-09 11:18:52,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:18:52,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc751a55ff273b190ba95a HTTP/1.1" 200 None 2026-05-09 11:18:52,826 - lava_callback - DEBUG - Processing node 69fc751a55ff273b190ba95a: baseline-arm-baylibre 2026-05-09 11:18:52,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc751a55ff273b190ba95a 2026-05-09 11:18:52,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:18:52,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc751a55ff273b190ba95a HTTP/1.1" 200 None 2026-05-09 11:18:52,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:18:52,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-09 11:18:52,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:18:52,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc751a55ff273b190ba95a HTTP/1.1" 200 None 2026-05-09 11:18:52,886 - lava_callback - ERROR - Error processing callback for node 69fc751a55ff273b190ba95a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41504 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:19:39,820 - lava_callback - INFO - Received callback for node 69fc754455ff273b190ba968 INFO: 172.21.0.1:45712 - "POST /node/69fc754455ff273b190ba968 HTTP/1.0" 202 Accepted 2026-05-09 11:19:39,825 - lava_callback - INFO - Starting async job submit for node 69fc754455ff273b190ba968 2026-05-09 11:19:39,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:19:39,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc754455ff273b190ba968 HTTP/1.1" 200 None 2026-05-09 11:19:39,841 - lava_callback - DEBUG - Processing node 69fc754455ff273b190ba968: baseline-arm-clabbe 2026-05-09 11:19:39,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc754455ff273b190ba968 2026-05-09 11:19:39,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:19:39,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc754455ff273b190ba968 HTTP/1.1" 200 None 2026-05-09 11:19:39,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:19:39,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-09 11:19:39,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:19:39,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc754455ff273b190ba968 HTTP/1.1" 200 None 2026-05-09 11:19:39,891 - lava_callback - ERROR - Error processing callback for node 69fc754455ff273b190ba968: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48346 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:20:19,778 - lava_callback - INFO - Received callback for node 69fc756e55ff273b190ba974 INFO: 172.21.0.1:47314 - "POST /node/69fc756e55ff273b190ba974 HTTP/1.0" 202 Accepted 2026-05-09 11:20:19,783 - lava_callback - INFO - Starting async job submit for node 69fc756e55ff273b190ba974 2026-05-09 11:20:19,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:20:19,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc756e55ff273b190ba974 HTTP/1.1" 200 None 2026-05-09 11:20:19,810 - lava_callback - DEBUG - Processing node 69fc756e55ff273b190ba974: baseline-arm-clabbe 2026-05-09 11:20:19,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc756e55ff273b190ba974 2026-05-09 11:20:19,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:20:19,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc756e55ff273b190ba974 HTTP/1.1" 200 None 2026-05-09 11:20:19,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:20:19,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-09 11:20:19,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:20:19,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc756e55ff273b190ba974 HTTP/1.1" 200 None 2026-05-09 11:20:19,859 - lava_callback - ERROR - Error processing callback for node 69fc756e55ff273b190ba974: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:20:59,789 - lava_callback - INFO - Received callback for node 69fc759755ff273b190ba982 INFO: 172.21.0.1:54400 - "POST /node/69fc759755ff273b190ba982 HTTP/1.0" 202 Accepted 2026-05-09 11:20:59,795 - lava_callback - INFO - Starting async job submit for node 69fc759755ff273b190ba982 2026-05-09 11:20:59,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:20:59,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc759755ff273b190ba982 HTTP/1.1" 200 None 2026-05-09 11:20:59,811 - lava_callback - DEBUG - Processing node 69fc759755ff273b190ba982: baseline-arm-clabbe 2026-05-09 11:20:59,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc759755ff273b190ba982 2026-05-09 11:20:59,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:20:59,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc759755ff273b190ba982 HTTP/1.1" 200 None 2026-05-09 11:20:59,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:20:59,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-09 11:20:59,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:20:59,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc759755ff273b190ba982 HTTP/1.1" 200 None 2026-05-09 11:20:59,857 - lava_callback - ERROR - Error processing callback for node 69fc759755ff273b190ba982: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45456 - "GET /node/67f39137e734ae3a1c04c47f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:21:59,841 - lava_callback - INFO - Received callback for node 69fc75c155ff273b190ba98f INFO: 172.21.0.1:56616 - "POST /node/69fc75c155ff273b190ba98f HTTP/1.0" 202 Accepted 2026-05-09 11:21:59,846 - lava_callback - INFO - Starting async job submit for node 69fc75c155ff273b190ba98f 2026-05-09 11:21:59,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:21:59,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc75c155ff273b190ba98f HTTP/1.1" 200 None 2026-05-09 11:21:59,863 - lava_callback - DEBUG - Processing node 69fc75c155ff273b190ba98f: baseline-arm-clabbe 2026-05-09 11:21:59,863 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc75c155ff273b190ba98f 2026-05-09 11:21:59,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:21:59,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc75c155ff273b190ba98f HTTP/1.1" 200 None 2026-05-09 11:21:59,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:21:59,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-09 11:21:59,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:21:59,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc75c155ff273b190ba98f HTTP/1.1" 200 None 2026-05-09 11:21:59,910 - lava_callback - ERROR - Error processing callback for node 69fc75c155ff273b190ba98f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41262 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:22:39,846 - lava_callback - INFO - Received callback for node 69fc75e955ff273b190ba99c INFO: 172.21.0.1:56238 - "POST /node/69fc75e955ff273b190ba99c HTTP/1.0" 202 Accepted 2026-05-09 11:22:39,851 - lava_callback - INFO - Starting async job submit for node 69fc75e955ff273b190ba99c 2026-05-09 11:22:39,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:22:39,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc75e955ff273b190ba99c HTTP/1.1" 200 None 2026-05-09 11:22:39,886 - lava_callback - DEBUG - Processing node 69fc75e955ff273b190ba99c: baseline-arm-clabbe 2026-05-09 11:22:39,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc75e955ff273b190ba99c 2026-05-09 11:22:39,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:22:39,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc75e955ff273b190ba99c HTTP/1.1" 200 None 2026-05-09 11:22:39,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:22:39,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-09 11:22:39,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:22:39,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc75e955ff273b190ba99c HTTP/1.1" 200 None 2026-05-09 11:22:39,965 - lava_callback - ERROR - Error processing callback for node 69fc75e955ff273b190ba99c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56252 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:22:52,454 - lava_callback - INFO - Received callback for node 69fef4aa254d3291e98df303 INFO: 172.21.0.1:50920 - "POST /node/69fef4aa254d3291e98df303 HTTP/1.0" 202 Accepted 2026-05-09 11:22:52,461 - lava_callback - INFO - Starting async job submit for node 69fef4aa254d3291e98df303 2026-05-09 11:22:52,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:22:52,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4aa254d3291e98df303 HTTP/1.1" 200 None 2026-05-09 11:22:52,494 - lava_callback - DEBUG - Processing node 69fef4aa254d3291e98df303: baseline-nfs-arm64 2026-05-09 11:22:52,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:22:53,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:22:53,025 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4aa254d3291e98df303/log.txt.gz 2026-05-09 11:22:53,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:22:53,433 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:22:53,435 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4aa254d3291e98df303/lava-logs.yaml 2026-05-09 11:22:53,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:22:53,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:22:53,612 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fef4aa254d3291e98df303/lava_callback.json.gz 2026-05-09 11:22:53,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:22:53,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fef4aa254d3291e98df303 HTTP/1.1" 200 None 2026-05-09 11:22:53,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:22:53,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 11:22:53,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:22:53,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fef4aa254d3291e98df303 HTTP/1.1" 200 None 2026-05-09 11:22:53,705 - lava_callback - INFO - Completed processing callback for node 69fef4aa254d3291e98df303 INFO: 172.21.0.1:50924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38866 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:23:12,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:23:12,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:26:34,382 - lava_callback - INFO - Received callback for node 69ff1546254d3291e98e067f INFO: 172.21.0.1:51436 - "POST /node/69ff1546254d3291e98e067f HTTP/1.0" 202 Accepted 2026-05-09 11:26:34,390 - lava_callback - INFO - Starting async job submit for node 69ff1546254d3291e98e067f 2026-05-09 11:26:34,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:26:34,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1546254d3291e98e067f HTTP/1.1" 200 None 2026-05-09 11:26:34,448 - lava_callback - DEBUG - Processing node 69ff1546254d3291e98e067f: baseline-nfs-arm64 2026-05-09 11:26:35,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:26:35,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:26:35,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff1546254d3291e98e067f/log.txt.gz 2026-05-09 11:26:36,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:26:36,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:26:36,481 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff1546254d3291e98e067f/lava-logs.yaml 2026-05-09 11:26:36,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:26:36,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:26:36,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff1546254d3291e98e067f/lava_callback.json.gz DEBUG: Setup failed for 69ff1546254d3291e98e067f. Transitting job node result: incomplete -> fail 2026-05-09 11:26:36,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:26:36,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1546254d3291e98e067f HTTP/1.1" 200 None 2026-05-09 11:26:36,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:26:36,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 11:26:36,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:26:36,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1546254d3291e98e067f HTTP/1.1" 200 None 2026-05-09 11:26:36,870 - lava_callback - INFO - Completed processing callback for node 69ff1546254d3291e98e067f 2026-05-09 11:26:42,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:26:42,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:27:01,378 - lava_callback - INFO - Received callback for node 69fefff2254d3291e98dfacc INFO: 172.21.0.1:47380 - "POST /node/69fefff2254d3291e98dfacc HTTP/1.0" 202 Accepted 2026-05-09 11:27:01,384 - lava_callback - INFO - Starting async job submit for node 69fefff2254d3291e98dfacc 2026-05-09 11:27:01,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:27:01,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefff2254d3291e98dfacc HTTP/1.1" 200 None 2026-05-09 11:27:01,416 - lava_callback - DEBUG - Processing node 69fefff2254d3291e98dfacc: baseline-arm64 2026-05-09 11:27:01,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:27:01,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:27:01,938 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefff2254d3291e98dfacc/log.txt.gz 2026-05-09 11:27:02,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:27:02,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:27:02,278 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefff2254d3291e98dfacc/lava-logs.yaml 2026-05-09 11:27:02,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:27:02,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:27:02,383 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fefff2254d3291e98dfacc/lava_callback.json.gz 2026-05-09 11:27:02,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:27:02,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fefff2254d3291e98dfacc HTTP/1.1" 200 None 2026-05-09 11:27:02,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:27:02,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 11:27:02,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:27:02,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fefff2254d3291e98dfacc HTTP/1.1" 200 None 2026-05-09 11:27:02,499 - lava_callback - INFO - Completed processing callback for node 69fefff2254d3291e98dfacc INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:27:12,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:27:12,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55746 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:28:53,580 - lava_callback - INFO - Received callback for node 69fc776155ff273b190ba9b1 INFO: 172.21.0.1:51304 - "POST /node/69fc776155ff273b190ba9b1 HTTP/1.0" 202 Accepted 2026-05-09 11:28:53,585 - lava_callback - INFO - Starting async job submit for node 69fc776155ff273b190ba9b1 2026-05-09 11:28:53,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:28:53,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc776155ff273b190ba9b1 HTTP/1.1" 200 None 2026-05-09 11:28:53,601 - lava_callback - DEBUG - Processing node 69fc776155ff273b190ba9b1: baseline-arm64-baylibre 2026-05-09 11:28:53,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc776155ff273b190ba9b1 2026-05-09 11:28:53,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:28:53,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc776155ff273b190ba9b1 HTTP/1.1" 200 None 2026-05-09 11:28:53,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:28:53,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-09 11:28:53,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:28:53,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc776155ff273b190ba9b1 HTTP/1.1" 200 None 2026-05-09 11:28:53,654 - lava_callback - ERROR - Error processing callback for node 69fc776155ff273b190ba9b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:30:20,200 - lava_callback - INFO - Received callback for node 69fc77be55ff273b190ba9db INFO: 172.21.0.1:50320 - "POST /node/69fc77be55ff273b190ba9db HTTP/1.0" 202 Accepted 2026-05-09 11:30:20,205 - lava_callback - INFO - Starting async job submit for node 69fc77be55ff273b190ba9db 2026-05-09 11:30:20,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:30:20,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc77be55ff273b190ba9db HTTP/1.1" 200 None 2026-05-09 11:30:20,220 - lava_callback - DEBUG - Processing node 69fc77be55ff273b190ba9db: baseline-arm64-clabbe 2026-05-09 11:30:20,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc77be55ff273b190ba9db 2026-05-09 11:30:20,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:30:20,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc77be55ff273b190ba9db HTTP/1.1" 200 None 2026-05-09 11:30:20,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:30:20,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-09 11:30:20,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:30:20,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc77be55ff273b190ba9db HTTP/1.1" 200 None 2026-05-09 11:30:20,278 - lava_callback - ERROR - Error processing callback for node 69fc77be55ff273b190ba9db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:31:40,255 - lava_callback - INFO - Received callback for node 69fc780f55ff273b190ba9fc INFO: 172.21.0.1:57620 - "POST /node/69fc780f55ff273b190ba9fc HTTP/1.0" 202 Accepted 2026-05-09 11:31:40,260 - lava_callback - INFO - Starting async job submit for node 69fc780f55ff273b190ba9fc 2026-05-09 11:31:40,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:31:40,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc780f55ff273b190ba9fc HTTP/1.1" 200 None 2026-05-09 11:31:40,275 - lava_callback - DEBUG - Processing node 69fc780f55ff273b190ba9fc: baseline-arm64-clabbe 2026-05-09 11:31:40,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc780f55ff273b190ba9fc 2026-05-09 11:31:40,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:31:40,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc780f55ff273b190ba9fc HTTP/1.1" 200 None 2026-05-09 11:31:40,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:31:40,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-09 11:31:40,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:31:40,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc780f55ff273b190ba9fc HTTP/1.1" 200 None 2026-05-09 11:31:40,332 - lava_callback - ERROR - Error processing callback for node 69fc780f55ff273b190ba9fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:33:00,288 - lava_callback - INFO - Received callback for node 69fc785e55ff273b190baa25 INFO: 172.21.0.1:43012 - "POST /node/69fc785e55ff273b190baa25 HTTP/1.0" 202 Accepted 2026-05-09 11:33:00,294 - lava_callback - INFO - Starting async job submit for node 69fc785e55ff273b190baa25 2026-05-09 11:33:00,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:33:00,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc785e55ff273b190baa25 HTTP/1.1" 200 None 2026-05-09 11:33:00,317 - lava_callback - DEBUG - Processing node 69fc785e55ff273b190baa25: baseline-arm64-clabbe 2026-05-09 11:33:00,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc785e55ff273b190baa25 2026-05-09 11:33:00,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:33:00,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc785e55ff273b190baa25 HTTP/1.1" 200 None 2026-05-09 11:33:00,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:33:00,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-09 11:33:00,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:33:00,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc785e55ff273b190baa25 HTTP/1.1" 200 None 2026-05-09 11:33:00,364 - lava_callback - ERROR - Error processing callback for node 69fc785e55ff273b190baa25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:34:20,358 - lava_callback - INFO - Received callback for node 69fc78ae55ff273b190baa53 INFO: 172.21.0.1:40088 - "POST /node/69fc78ae55ff273b190baa53 HTTP/1.0" 202 Accepted 2026-05-09 11:34:20,364 - lava_callback - INFO - Starting async job submit for node 69fc78ae55ff273b190baa53 2026-05-09 11:34:20,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:34:20,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc78ae55ff273b190baa53 HTTP/1.1" 200 None 2026-05-09 11:34:20,378 - lava_callback - DEBUG - Processing node 69fc78ae55ff273b190baa53: baseline-arm64-clabbe 2026-05-09 11:34:20,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc78ae55ff273b190baa53 2026-05-09 11:34:20,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:34:20,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc78ae55ff273b190baa53 HTTP/1.1" 200 None 2026-05-09 11:34:20,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:34:20,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-09 11:34:20,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:34:20,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc78ae55ff273b190baa53 HTTP/1.1" 200 None 2026-05-09 11:34:20,453 - lava_callback - ERROR - Error processing callback for node 69fc78ae55ff273b190baa53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52596 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:35:07,582 - lava_callback - INFO - Received callback for node 69ff17bf254d3291e98e07b8 INFO: 172.21.0.1:52612 - "POST /node/69ff17bf254d3291e98e07b8 HTTP/1.0" 202 Accepted 2026-05-09 11:35:07,589 - lava_callback - INFO - Starting async job submit for node 69ff17bf254d3291e98e07b8 2026-05-09 11:35:07,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:35:07,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff17bf254d3291e98e07b8 HTTP/1.1" 200 None 2026-05-09 11:35:07,668 - lava_callback - DEBUG - Processing node 69ff17bf254d3291e98e07b8: ltp-smoke 2026-05-09 11:35:08,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:35:08,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:35:08,303 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ff17bf254d3291e98e07b8/log.txt.gz 2026-05-09 11:35:08,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:35:08,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:35:08,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ff17bf254d3291e98e07b8/lava-logs.yaml 2026-05-09 11:35:08,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:35:08,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:35:08,932 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ff17bf254d3291e98e07b8/lava_callback.json.gz 2026-05-09 11:35:09,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:35:09,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff17bf254d3291e98e07b8 HTTP/1.1" 200 None 2026-05-09 11:35:09,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:35:09,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feeddd254d3291e98de968 HTTP/1.1" 200 None 2026-05-09 11:35:09,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:35:09,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff17bf254d3291e98e07b8 HTTP/1.1" 200 None 2026-05-09 11:35:09,214 - lava_callback - INFO - Completed processing callback for node 69ff17bf254d3291e98e07b8 2026-05-09 11:35:12,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:35:12,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36664 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:37:00,416 - lava_callback - INFO - Received callback for node 69fc794f55ff273b190baa77 INFO: 172.21.0.1:33690 - "POST /node/69fc794f55ff273b190baa77 HTTP/1.0" 202 Accepted 2026-05-09 11:37:00,421 - lava_callback - INFO - Starting async job submit for node 69fc794f55ff273b190baa77 2026-05-09 11:37:00,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:37:00,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc794f55ff273b190baa77 HTTP/1.1" 200 None 2026-05-09 11:37:00,437 - lava_callback - DEBUG - Processing node 69fc794f55ff273b190baa77: baseline-arm64-clabbe 2026-05-09 11:37:00,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc794f55ff273b190baa77 2026-05-09 11:37:00,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:37:00,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc794f55ff273b190baa77 HTTP/1.1" 200 None 2026-05-09 11:37:00,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:37:00,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-09 11:37:00,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:37:00,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc794f55ff273b190baa77 HTTP/1.1" 200 None 2026-05-09 11:37:00,495 - lava_callback - ERROR - Error processing callback for node 69fc794f55ff273b190baa77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:39:40,562 - lava_callback - INFO - Received callback for node 69fc79ef55ff273b190baa9f INFO: 172.21.0.1:52484 - "POST /node/69fc79ef55ff273b190baa9f HTTP/1.0" 202 Accepted 2026-05-09 11:39:40,568 - lava_callback - INFO - Starting async job submit for node 69fc79ef55ff273b190baa9f 2026-05-09 11:39:40,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:39:40,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc79ef55ff273b190baa9f HTTP/1.1" 200 None 2026-05-09 11:39:40,583 - lava_callback - DEBUG - Processing node 69fc79ef55ff273b190baa9f: baseline-arm64-clabbe 2026-05-09 11:39:40,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc79ef55ff273b190baa9f 2026-05-09 11:39:40,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:39:40,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc79ef55ff273b190baa9f HTTP/1.1" 200 None 2026-05-09 11:39:40,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:39:40,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-09 11:39:40,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:39:40,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc79ef55ff273b190baa9f HTTP/1.1" 200 None 2026-05-09 11:39:40,630 - lava_callback - ERROR - Error processing callback for node 69fc79ef55ff273b190baa9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33278 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:41:37,282 - lava_callback - INFO - Received callback for node 69ff1992254d3291e98e0848 INFO: 172.21.0.1:33294 - "POST /node/69ff1992254d3291e98e0848 HTTP/1.0" 202 Accepted 2026-05-09 11:41:37,289 - lava_callback - INFO - Starting async job submit for node 69ff1992254d3291e98e0848 2026-05-09 11:41:37,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:41:37,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1992254d3291e98e0848 HTTP/1.1" 200 None 2026-05-09 11:41:37,385 - lava_callback - DEBUG - Processing node 69ff1992254d3291e98e0848: baseline-arm 2026-05-09 11:41:37,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:41:38,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:41:38,097 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ff1992254d3291e98e0848/log.txt.gz 2026-05-09 11:41:38,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:41:38,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:41:38,647 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ff1992254d3291e98e0848/lava-logs.yaml 2026-05-09 11:41:38,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:41:38,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:41:38,798 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ff1992254d3291e98e0848/lava_callback.json.gz DEBUG: Setup failed for 69ff1992254d3291e98e0848. Transitting job node result: incomplete -> fail 2026-05-09 11:41:38,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:41:38,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1992254d3291e98e0848 HTTP/1.1" 200 None 2026-05-09 11:41:38,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:41:38,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 11:41:38,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:41:38,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1992254d3291e98e0848 HTTP/1.1" 200 None 2026-05-09 11:41:39,091 - lava_callback - INFO - Completed processing callback for node 69ff1992254d3291e98e0848 2026-05-09 11:41:42,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:41:42,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47340 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:47:54,254 - lava_callback - INFO - Received callback for node 69ff1a59254d3291e98e08bc INFO: 172.21.0.1:49950 - "POST /node/69ff1a59254d3291e98e08bc HTTP/1.0" 202 Accepted 2026-05-09 11:47:54,301 - lava_callback - INFO - Starting async job submit for node 69ff1a59254d3291e98e08bc 2026-05-09 11:47:54,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:47:54,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1a59254d3291e98e08bc HTTP/1.1" 200 None 2026-05-09 11:47:54,340 - lava_callback - DEBUG - Processing node 69ff1a59254d3291e98e08bc: baseline-arm-pengutronix 2026-05-09 11:47:54,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:47:54,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:47:54,591 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ff1a59254d3291e98e08bc/log.txt.gz 2026-05-09 11:47:54,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:47:54,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:47:54,950 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ff1a59254d3291e98e08bc/lava-logs.yaml 2026-05-09 11:47:54,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:47:55,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:47:55,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ff1a59254d3291e98e08bc/lava_callback.json.gz DEBUG: Setup failed for 69ff1a59254d3291e98e08bc. Transitting job node result: incomplete -> fail 2026-05-09 11:47:55,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:47:55,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1a59254d3291e98e08bc HTTP/1.1" 200 None 2026-05-09 11:47:55,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:47:55,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feedd7254d3291e98de962 HTTP/1.1" 200 None 2026-05-09 11:47:55,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:47:55,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1a59254d3291e98e08bc HTTP/1.1" 200 None 2026-05-09 11:47:55,221 - lava_callback - INFO - Completed processing callback for node 69ff1a59254d3291e98e08bc 2026-05-09 11:47:56,346 - lava_callback - INFO - Received callback for node 69ff0650254d3291e98dfe82 INFO: 172.21.0.1:49958 - "POST /node/69ff0650254d3291e98dfe82 HTTP/1.0" 202 Accepted 2026-05-09 11:47:56,356 - lava_callback - INFO - Starting async job submit for node 69ff0650254d3291e98dfe82 2026-05-09 11:47:56,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:47:56,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0650254d3291e98dfe82 HTTP/1.1" 200 None 2026-05-09 11:47:56,400 - lava_callback - DEBUG - Processing node 69ff0650254d3291e98dfe82: baseline-nfs-arm64 INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:47:58,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:47:58,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:47:58,669 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff0650254d3291e98dfe82/log.txt.gz 2026-05-09 11:47:59,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:48:00,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:48:00,085 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff0650254d3291e98dfe82/lava-logs.yaml 2026-05-09 11:48:00,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:48:00,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:48:00,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff0650254d3291e98dfe82/lava_callback.json.gz DEBUG: Setup failed for 69ff0650254d3291e98dfe82. Transitting job node result: incomplete -> fail 2026-05-09 11:48:00,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:48:00,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff0650254d3291e98dfe82 HTTP/1.1" 200 None 2026-05-09 11:48:00,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:48:00,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 11:48:00,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:48:00,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff0650254d3291e98dfe82 HTTP/1.1" 200 None 2026-05-09 11:48:00,475 - lava_callback - INFO - Completed processing callback for node 69ff0650254d3291e98dfe82 INFO: 172.21.0.1:59670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:48:12,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:48:12,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET /node/680526948f95d85157cc7d33%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55930 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:56:22,943 - lava_callback - INFO - Received callback for node 69ff1378254d3291e98e0589 INFO: 172.21.0.1:55590 - "POST /node/69ff1378254d3291e98e0589 HTTP/1.0" 202 Accepted 2026-05-09 11:56:22,948 - lava_callback - INFO - Starting async job submit for node 69ff1378254d3291e98e0589 2026-05-09 11:56:22,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:56:22,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1378254d3291e98e0589 HTTP/1.1" 200 None 2026-05-09 11:56:22,981 - lava_callback - DEBUG - Processing node 69ff1378254d3291e98e0589: baseline-arm64 2026-05-09 11:56:23,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:56:23,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:56:23,607 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1378254d3291e98e0589/log.txt.gz 2026-05-09 11:56:23,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:56:23,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:56:23,953 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1378254d3291e98e0589/lava-logs.yaml 2026-05-09 11:56:23,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:56:24,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:56:24,044 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1378254d3291e98e0589/lava_callback.json.gz 2026-05-09 11:56:24,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:56:24,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1378254d3291e98e0589 HTTP/1.1" 200 None 2026-05-09 11:56:24,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:56:24,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 11:56:24,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:56:24,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1378254d3291e98e0589 HTTP/1.1" 200 None 2026-05-09 11:56:24,193 - lava_callback - INFO - Completed processing callback for node 69ff1378254d3291e98e0589 INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:56:42,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:56:42,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:57:54,372 - lava_callback - INFO - Received callback for node 69ff1c9d254d3291e98e09ec INFO: 172.21.0.1:50352 - "POST /node/69ff1c9d254d3291e98e09ec HTTP/1.0" 202 Accepted 2026-05-09 11:57:54,380 - lava_callback - INFO - Starting async job submit for node 69ff1c9d254d3291e98e09ec 2026-05-09 11:57:54,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:57:54,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1c9d254d3291e98e09ec HTTP/1.1" 200 None 2026-05-09 11:57:54,438 - lava_callback - DEBUG - Processing node 69ff1c9d254d3291e98e09ec: baseline-nfs-arm64 2026-05-09 11:57:55,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:57:55,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:57:55,547 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff1c9d254d3291e98e09ec/log.txt.gz 2026-05-09 11:57:56,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:57:56,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:57:56,285 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff1c9d254d3291e98e09ec/lava-logs.yaml 2026-05-09 11:57:56,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 11:57:56,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 11:57:56,431 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff1c9d254d3291e98e09ec/lava_callback.json.gz DEBUG: Setup failed for 69ff1c9d254d3291e98e09ec. Transitting job node result: incomplete -> fail INFO: 172.21.0.1:50360 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:57:56,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:57:56,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1c9d254d3291e98e09ec HTTP/1.1" 200 None 2026-05-09 11:57:56,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:57:56,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69feede5254d3291e98de971 HTTP/1.1" 200 None 2026-05-09 11:57:56,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:57:56,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1c9d254d3291e98e09ec HTTP/1.1" 200 None 2026-05-09 11:57:56,653 - lava_callback - INFO - Completed processing callback for node 69ff1c9d254d3291e98e09ec INFO: 172.21.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET / HTTP/1.0" 200 OK 2026-05-09 11:58:12,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 11:58:12,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET /node/6826fd8f823a00d2823e17c2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54352 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-09 12:17:16,460 - lava_callback - INFO - Received callback for node 69ff15e2254d3291e98e06cc INFO: 172.21.0.1:54356 - "POST /node/69ff15e2254d3291e98e06cc HTTP/1.0" 202 Accepted 2026-05-09 12:17:16,470 - lava_callback - INFO - Starting async job submit for node 69ff15e2254d3291e98e06cc 2026-05-09 12:17:16,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54384 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:17:16,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff15e2254d3291e98e06cc HTTP/1.1" 200 None 2026-05-09 12:17:16,528 - lava_callback - DEBUG - Processing node 69ff15e2254d3291e98e06cc: baseline-nfs-arm64 2026-05-09 12:17:18,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 12:17:18,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 12:17:18,858 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff15e2254d3291e98e06cc/log.txt.gz 2026-05-09 12:17:20,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 12:17:20,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 12:17:20,454 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff15e2254d3291e98e06cc/lava-logs.yaml 2026-05-09 12:17:20,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 12:17:20,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 12:17:20,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff15e2254d3291e98e06cc/lava_callback.json.gz DEBUG: Setup failed for 69ff15e2254d3291e98e06cc. Transitting job node result: incomplete -> fail 2026-05-09 12:17:20,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:17:20,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff15e2254d3291e98e06cc HTTP/1.1" 200 None 2026-05-09 12:17:20,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:17:20,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 12:17:20,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:17:20,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff15e2254d3291e98e06cc HTTP/1.1" 200 None 2026-05-09 12:17:20,899 - lava_callback - INFO - Completed processing callback for node 69ff15e2254d3291e98e06cc INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39814 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:39818 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:51336 - "GET /config.json HTTP/1.0" 404 Not Found 2026-05-09 12:17:42,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:17:42,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:34:05,058 - lava_callback - INFO - Received callback for node 69ff162a254d3291e98e06ff INFO: 172.21.0.1:57068 - "POST /node/69ff162a254d3291e98e06ff HTTP/1.0" 202 Accepted 2026-05-09 12:34:05,064 - lava_callback - INFO - Starting async job submit for node 69ff162a254d3291e98e06ff 2026-05-09 12:34:05,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:34:05,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff162a254d3291e98e06ff HTTP/1.1" 200 None 2026-05-09 12:34:05,096 - lava_callback - DEBUG - Processing node 69ff162a254d3291e98e06ff: baseline-arm64 2026-05-09 12:34:05,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 12:34:05,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 12:34:05,698 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff162a254d3291e98e06ff/log.txt.gz 2026-05-09 12:34:05,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 12:34:06,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 12:34:06,052 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff162a254d3291e98e06ff/lava-logs.yaml 2026-05-09 12:34:06,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 12:34:06,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 12:34:06,167 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff162a254d3291e98e06ff/lava_callback.json.gz 2026-05-09 12:34:06,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:34:06,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff162a254d3291e98e06ff HTTP/1.1" 200 None 2026-05-09 12:34:06,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:34:06,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-09 12:34:06,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:34:06,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff162a254d3291e98e06ff HTTP/1.1" 200 None 2026-05-09 12:34:06,301 - lava_callback - INFO - Completed processing callback for node 69ff162a254d3291e98e06ff INFO: 172.21.0.1:57072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57074 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:34:12,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:34:12,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46858 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:38:04,094 - lava_callback - INFO - Received callback for node 69ff1708254d3291e98e0760 INFO: 172.21.0.1:48530 - "POST /node/69ff1708254d3291e98e0760 HTTP/1.0" 202 Accepted 2026-05-09 12:38:04,100 - lava_callback - INFO - Starting async job submit for node 69ff1708254d3291e98e0760 2026-05-09 12:38:04,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:38:04,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1708254d3291e98e0760 HTTP/1.1" 200 None 2026-05-09 12:38:04,132 - lava_callback - DEBUG - Processing node 69ff1708254d3291e98e0760: baseline-arm64 2026-05-09 12:38:04,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 12:38:04,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 12:38:04,559 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1708254d3291e98e0760/log.txt.gz 2026-05-09 12:38:04,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 12:38:04,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 12:38:04,916 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1708254d3291e98e0760/lava-logs.yaml 2026-05-09 12:38:04,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 12:38:05,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 12:38:05,032 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1708254d3291e98e0760/lava_callback.json.gz 2026-05-09 12:38:05,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:38:05,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1708254d3291e98e0760 HTTP/1.1" 200 None 2026-05-09 12:38:05,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:38:05,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 12:38:05,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:38:05,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1708254d3291e98e0760 HTTP/1.1" 200 None 2026-05-09 12:38:05,177 - lava_callback - INFO - Completed processing callback for node 69ff1708254d3291e98e0760 INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48552 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:38:12,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:38:12,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34146 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:42:37,516 - lava_callback - INFO - Received callback for node 69fc88a855ff273b190bab65 INFO: 172.21.0.1:34156 - "POST /node/69fc88a855ff273b190bab65 HTTP/1.0" 202 Accepted 2026-05-09 12:42:37,522 - lava_callback - INFO - Starting async job submit for node 69fc88a855ff273b190bab65 2026-05-09 12:42:37,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:42:37,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc88a855ff273b190bab65 HTTP/1.1" 200 None 2026-05-09 12:42:37,537 - lava_callback - DEBUG - Processing node 69fc88a855ff273b190bab65: baseline-arm-baylibre 2026-05-09 12:42:37,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc88a855ff273b190bab65 2026-05-09 12:42:37,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:42:37,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc88a855ff273b190bab65 HTTP/1.1" 200 None 2026-05-09 12:42:37,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:42:37,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-09 12:42:37,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:42:37,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc88a855ff273b190bab65 HTTP/1.1" 200 None 2026-05-09 12:42:37,591 - lava_callback - ERROR - Error processing callback for node 69fc88a855ff273b190bab65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60562 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:42:57,471 - lava_callback - INFO - Received callback for node 69fc88cc55ff273b190bab72 INFO: 172.21.0.1:60566 - "POST /node/69fc88cc55ff273b190bab72 HTTP/1.0" 202 Accepted 2026-05-09 12:42:57,476 - lava_callback - INFO - Starting async job submit for node 69fc88cc55ff273b190bab72 2026-05-09 12:42:57,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:42:57,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc88cc55ff273b190bab72 HTTP/1.1" 200 None 2026-05-09 12:42:57,491 - lava_callback - DEBUG - Processing node 69fc88cc55ff273b190bab72: baseline-arm-baylibre 2026-05-09 12:42:57,491 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc88cc55ff273b190bab72 2026-05-09 12:42:57,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:42:57,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc88cc55ff273b190bab72 HTTP/1.1" 200 None 2026-05-09 12:42:57,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:42:57,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-09 12:42:57,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:42:57,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc88cc55ff273b190bab72 HTTP/1.1" 200 None 2026-05-09 12:42:57,543 - lava_callback - ERROR - Error processing callback for node 69fc88cc55ff273b190bab72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37888 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:43:57,549 - lava_callback - INFO - Received callback for node 69fc88fe55ff273b190bab7e INFO: 172.21.0.1:37900 - "POST /node/69fc88fe55ff273b190bab7e HTTP/1.0" 202 Accepted 2026-05-09 12:43:57,555 - lava_callback - INFO - Starting async job submit for node 69fc88fe55ff273b190bab7e 2026-05-09 12:43:57,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:43:57,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc88fe55ff273b190bab7e HTTP/1.1" 200 None 2026-05-09 12:43:57,571 - lava_callback - DEBUG - Processing node 69fc88fe55ff273b190bab7e: baseline-arm-baylibre 2026-05-09 12:43:57,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc88fe55ff273b190bab7e 2026-05-09 12:43:57,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:43:57,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc88fe55ff273b190bab7e HTTP/1.1" 200 None 2026-05-09 12:43:57,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:43:57,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-09 12:43:57,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:43:57,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc88fe55ff273b190bab7e HTTP/1.1" 200 None 2026-05-09 12:43:57,621 - lava_callback - ERROR - Error processing callback for node 69fc88fe55ff273b190bab7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:44:57,592 - lava_callback - INFO - Received callback for node 69fc893b55ff273b190bab8d INFO: 172.21.0.1:51286 - "POST /node/69fc893b55ff273b190bab8d HTTP/1.0" 202 Accepted 2026-05-09 12:44:57,598 - lava_callback - INFO - Starting async job submit for node 69fc893b55ff273b190bab8d 2026-05-09 12:44:57,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:44:57,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc893b55ff273b190bab8d HTTP/1.1" 200 None 2026-05-09 12:44:57,619 - lava_callback - DEBUG - Processing node 69fc893b55ff273b190bab8d: baseline-arm-baylibre 2026-05-09 12:44:57,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc893b55ff273b190bab8d 2026-05-09 12:44:57,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:44:57,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc893b55ff273b190bab8d HTTP/1.1" 200 None 2026-05-09 12:44:57,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:44:57,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-09 12:44:57,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:44:57,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc893b55ff273b190bab8d HTTP/1.1" 200 None 2026-05-09 12:44:57,673 - lava_callback - ERROR - Error processing callback for node 69fc893b55ff273b190bab8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35872 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:45:37,606 - lava_callback - INFO - Received callback for node 69fc896055ff273b190bab99 INFO: 172.21.0.1:35874 - "POST /node/69fc896055ff273b190bab99 HTTP/1.0" 202 Accepted 2026-05-09 12:45:37,612 - lava_callback - INFO - Starting async job submit for node 69fc896055ff273b190bab99 2026-05-09 12:45:37,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:45:37,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc896055ff273b190bab99 HTTP/1.1" 200 None 2026-05-09 12:45:37,628 - lava_callback - DEBUG - Processing node 69fc896055ff273b190bab99: baseline-arm-baylibre 2026-05-09 12:45:37,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc896055ff273b190bab99 2026-05-09 12:45:37,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:45:37,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc896055ff273b190bab99 HTTP/1.1" 200 None 2026-05-09 12:45:37,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:45:37,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-09 12:45:37,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:45:37,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc896055ff273b190bab99 HTTP/1.1" 200 None 2026-05-09 12:45:37,682 - lava_callback - ERROR - Error processing callback for node 69fc896055ff273b190bab99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42264 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:46:17,585 - lava_callback - INFO - Received callback for node 69fc898555ff273b190baba6 INFO: 172.21.0.1:42272 - "POST /node/69fc898555ff273b190baba6 HTTP/1.0" 202 Accepted 2026-05-09 12:46:17,590 - lava_callback - INFO - Starting async job submit for node 69fc898555ff273b190baba6 2026-05-09 12:46:17,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:46:17,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc898555ff273b190baba6 HTTP/1.1" 200 None 2026-05-09 12:46:17,606 - lava_callback - DEBUG - Processing node 69fc898555ff273b190baba6: baseline-arm-baylibre 2026-05-09 12:46:17,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc898555ff273b190baba6 2026-05-09 12:46:17,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:46:17,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc898555ff273b190baba6 HTTP/1.1" 200 None 2026-05-09 12:46:17,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:46:17,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-09 12:46:17,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:46:17,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc898555ff273b190baba6 HTTP/1.1" 200 None 2026-05-09 12:46:17,652 - lava_callback - ERROR - Error processing callback for node 69fc898555ff273b190baba6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:48:03,450 - lava_callback - INFO - Received callback for node 69fc89fd55ff273b190babcd INFO: 172.21.0.1:48350 - "POST /node/69fc89fd55ff273b190babcd HTTP/1.0" 202 Accepted 2026-05-09 12:48:03,456 - lava_callback - INFO - Starting async job submit for node 69fc89fd55ff273b190babcd 2026-05-09 12:48:03,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:48:03,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc89fd55ff273b190babcd HTTP/1.1" 200 None 2026-05-09 12:48:03,471 - lava_callback - DEBUG - Processing node 69fc89fd55ff273b190babcd: baseline-arm-clabbe 2026-05-09 12:48:03,471 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc89fd55ff273b190babcd 2026-05-09 12:48:03,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:48:03,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc89fd55ff273b190babcd HTTP/1.1" 200 None 2026-05-09 12:48:03,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:48:03,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-09 12:48:03,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:48:03,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc89fd55ff273b190babcd HTTP/1.1" 200 None 2026-05-09 12:48:03,519 - lava_callback - ERROR - Error processing callback for node 69fc89fd55ff273b190babcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:48:43,396 - lava_callback - INFO - Received callback for node 69fc8a2355ff273b190babdb INFO: 172.21.0.1:47602 - "POST /node/69fc8a2355ff273b190babdb HTTP/1.0" 202 Accepted 2026-05-09 12:48:43,401 - lava_callback - INFO - Starting async job submit for node 69fc8a2355ff273b190babdb 2026-05-09 12:48:43,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:48:43,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8a2355ff273b190babdb HTTP/1.1" 200 None 2026-05-09 12:48:43,417 - lava_callback - DEBUG - Processing node 69fc8a2355ff273b190babdb: baseline-arm-clabbe 2026-05-09 12:48:43,417 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8a2355ff273b190babdb 2026-05-09 12:48:43,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:48:43,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8a2355ff273b190babdb HTTP/1.1" 200 None 2026-05-09 12:48:43,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:48:43,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:48:43,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:48:43,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8a2355ff273b190babdb HTTP/1.1" 200 None 2026-05-09 12:48:43,472 - lava_callback - ERROR - Error processing callback for node 69fc8a2355ff273b190babdb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33014 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:49:23,547 - lava_callback - INFO - Received callback for node 69fc8a4855ff273b190babeb INFO: 172.21.0.1:40580 - "POST /node/69fc8a4855ff273b190babeb HTTP/1.0" 202 Accepted 2026-05-09 12:49:23,552 - lava_callback - INFO - Starting async job submit for node 69fc8a4855ff273b190babeb 2026-05-09 12:49:23,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:49:23,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8a4855ff273b190babeb HTTP/1.1" 200 None 2026-05-09 12:49:23,567 - lava_callback - DEBUG - Processing node 69fc8a4855ff273b190babeb: baseline-arm-clabbe 2026-05-09 12:49:23,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8a4855ff273b190babeb 2026-05-09 12:49:23,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:49:23,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8a4855ff273b190babeb HTTP/1.1" 200 None 2026-05-09 12:49:23,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:49:23,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-09 12:49:23,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:49:23,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8a4855ff273b190babeb HTTP/1.1" 200 None 2026-05-09 12:49:23,623 - lava_callback - ERROR - Error processing callback for node 69fc8a4855ff273b190babeb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53492 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:50:03,846 - lava_callback - INFO - Received callback for node 69fc8a6d55ff273b190babf8 INFO: 172.21.0.1:58792 - "POST /node/69fc8a6d55ff273b190babf8 HTTP/1.0" 202 Accepted 2026-05-09 12:50:03,851 - lava_callback - INFO - Starting async job submit for node 69fc8a6d55ff273b190babf8 2026-05-09 12:50:03,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:50:03,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8a6d55ff273b190babf8 HTTP/1.1" 200 None 2026-05-09 12:50:03,869 - lava_callback - DEBUG - Processing node 69fc8a6d55ff273b190babf8: baseline-arm-clabbe 2026-05-09 12:50:03,869 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8a6d55ff273b190babf8 2026-05-09 12:50:03,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:50:03,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8a6d55ff273b190babf8 HTTP/1.1" 200 None 2026-05-09 12:50:03,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:50:03,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-09 12:50:03,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:50:03,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8a6d55ff273b190babf8 HTTP/1.1" 200 None 2026-05-09 12:50:03,914 - lava_callback - ERROR - Error processing callback for node 69fc8a6d55ff273b190babf8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54676 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:50:43,548 - lava_callback - INFO - Received callback for node 69fc8a9355ff273b190bac05 INFO: 172.21.0.1:39900 - "POST /node/69fc8a9355ff273b190bac05 HTTP/1.0" 202 Accepted 2026-05-09 12:50:43,553 - lava_callback - INFO - Starting async job submit for node 69fc8a9355ff273b190bac05 2026-05-09 12:50:43,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:50:43,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8a9355ff273b190bac05 HTTP/1.1" 200 None 2026-05-09 12:50:43,569 - lava_callback - DEBUG - Processing node 69fc8a9355ff273b190bac05: baseline-arm-clabbe 2026-05-09 12:50:43,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8a9355ff273b190bac05 2026-05-09 12:50:43,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:50:43,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8a9355ff273b190bac05 HTTP/1.1" 200 None 2026-05-09 12:50:43,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:50:43,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:50:43,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:50:43,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8a9355ff273b190bac05 HTTP/1.1" 200 None 2026-05-09 12:50:43,615 - lava_callback - ERROR - Error processing callback for node 69fc8a9355ff273b190bac05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39828 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:51:23,579 - lava_callback - INFO - Received callback for node 69fc8ab855ff273b190bac19 INFO: 172.21.0.1:44858 - "POST /node/69fc8ab855ff273b190bac19 HTTP/1.0" 202 Accepted 2026-05-09 12:51:23,585 - lava_callback - INFO - Starting async job submit for node 69fc8ab855ff273b190bac19 2026-05-09 12:51:23,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:51:23,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8ab855ff273b190bac19 HTTP/1.1" 200 None 2026-05-09 12:51:23,599 - lava_callback - DEBUG - Processing node 69fc8ab855ff273b190bac19: baseline-arm-clabbe 2026-05-09 12:51:23,599 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8ab855ff273b190bac19 2026-05-09 12:51:23,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:51:23,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8ab855ff273b190bac19 HTTP/1.1" 200 None 2026-05-09 12:51:23,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:51:23,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-09 12:51:23,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:51:23,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8ab855ff273b190bac19 HTTP/1.1" 200 None 2026-05-09 12:51:23,642 - lava_callback - ERROR - Error processing callback for node 69fc8ab855ff273b190bac19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:51:43,598 - lava_callback - INFO - Received callback for node 69fc8add55ff273b190bac27 INFO: 172.21.0.1:37786 - "POST /node/69fc8add55ff273b190bac27 HTTP/1.0" 202 Accepted 2026-05-09 12:51:43,603 - lava_callback - INFO - Starting async job submit for node 69fc8add55ff273b190bac27 2026-05-09 12:51:43,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:51:43,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8add55ff273b190bac27 HTTP/1.1" 200 None 2026-05-09 12:51:43,623 - lava_callback - DEBUG - Processing node 69fc8add55ff273b190bac27: baseline-arm-clabbe 2026-05-09 12:51:43,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8add55ff273b190bac27 2026-05-09 12:51:43,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:51:43,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8add55ff273b190bac27 HTTP/1.1" 200 None 2026-05-09 12:51:43,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:51:43,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:51:43,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:51:43,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8add55ff273b190bac27 HTTP/1.1" 200 None 2026-05-09 12:51:43,668 - lava_callback - ERROR - Error processing callback for node 69fc8add55ff273b190bac27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:52:23,552 - lava_callback - INFO - Received callback for node 69fc8b0255ff273b190bac34 INFO: 172.21.0.1:60334 - "POST /node/69fc8b0255ff273b190bac34 HTTP/1.0" 202 Accepted 2026-05-09 12:52:23,557 - lava_callback - INFO - Starting async job submit for node 69fc8b0255ff273b190bac34 2026-05-09 12:52:23,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:52:23,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8b0255ff273b190bac34 HTTP/1.1" 200 None 2026-05-09 12:52:23,573 - lava_callback - DEBUG - Processing node 69fc8b0255ff273b190bac34: baseline-arm-clabbe 2026-05-09 12:52:23,573 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8b0255ff273b190bac34 2026-05-09 12:52:23,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:52:23,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8b0255ff273b190bac34 HTTP/1.1" 200 None 2026-05-09 12:52:23,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:52:23,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-09 12:52:23,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:52:23,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8b0255ff273b190bac34 HTTP/1.1" 200 None 2026-05-09 12:52:23,622 - lava_callback - ERROR - Error processing callback for node 69fc8b0255ff273b190bac34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39474 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:53:03,629 - lava_callback - INFO - Received callback for node 69fc8b2755ff273b190bac43 INFO: 172.21.0.1:59584 - "POST /node/69fc8b2755ff273b190bac43 HTTP/1.0" 202 Accepted 2026-05-09 12:53:03,634 - lava_callback - INFO - Starting async job submit for node 69fc8b2755ff273b190bac43 2026-05-09 12:53:03,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:53:03,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8b2755ff273b190bac43 HTTP/1.1" 200 None 2026-05-09 12:53:03,657 - lava_callback - DEBUG - Processing node 69fc8b2755ff273b190bac43: baseline-arm-clabbe 2026-05-09 12:53:03,657 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8b2755ff273b190bac43 2026-05-09 12:53:03,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:53:03,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8b2755ff273b190bac43 HTTP/1.1" 200 None 2026-05-09 12:53:03,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:53:03,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbd9ff474a995a188409fb HTTP/1.1" 200 None 2026-05-09 12:53:03,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:53:03,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8b2755ff273b190bac43 HTTP/1.1" 200 None 2026-05-09 12:53:03,704 - lava_callback - ERROR - Error processing callback for node 69fc8b2755ff273b190bac43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37268 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:53:43,600 - lava_callback - INFO - Received callback for node 69fc8b4b55ff273b190bac50 INFO: 172.21.0.1:59618 - "POST /node/69fc8b4b55ff273b190bac50 HTTP/1.0" 202 Accepted 2026-05-09 12:53:43,606 - lava_callback - INFO - Starting async job submit for node 69fc8b4b55ff273b190bac50 2026-05-09 12:53:43,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:53:43,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8b4b55ff273b190bac50 HTTP/1.1" 200 None 2026-05-09 12:53:43,621 - lava_callback - DEBUG - Processing node 69fc8b4b55ff273b190bac50: baseline-arm-clabbe 2026-05-09 12:53:43,621 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8b4b55ff273b190bac50 2026-05-09 12:53:43,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:53:43,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8b4b55ff273b190bac50 HTTP/1.1" 200 None 2026-05-09 12:53:43,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:53:43,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:53:43,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:53:43,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8b4b55ff273b190bac50 HTTP/1.1" 200 None 2026-05-09 12:53:43,668 - lava_callback - ERROR - Error processing callback for node 69fc8b4b55ff273b190bac50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44932 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:54:23,679 - lava_callback - INFO - Received callback for node 69fc8b7055ff273b190bac5f INFO: 172.21.0.1:49092 - "POST /node/69fc8b7055ff273b190bac5f HTTP/1.0" 202 Accepted 2026-05-09 12:54:23,684 - lava_callback - INFO - Starting async job submit for node 69fc8b7055ff273b190bac5f 2026-05-09 12:54:23,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:54:23,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8b7055ff273b190bac5f HTTP/1.1" 200 None 2026-05-09 12:54:23,699 - lava_callback - DEBUG - Processing node 69fc8b7055ff273b190bac5f: baseline-arm-clabbe 2026-05-09 12:54:23,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8b7055ff273b190bac5f 2026-05-09 12:54:23,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:54:23,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8b7055ff273b190bac5f HTTP/1.1" 200 None 2026-05-09 12:54:23,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:54:23,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:54:23,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:54:23,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8b7055ff273b190bac5f HTTP/1.1" 200 None 2026-05-09 12:54:23,744 - lava_callback - ERROR - Error processing callback for node 69fc8b7055ff273b190bac5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:54:58,614 - lava_callback - INFO - Received callback for node 69fc8b9055ff273b190bac6b INFO: 172.21.0.1:41770 - "POST /node/69fc8b9055ff273b190bac6b HTTP/1.0" 202 Accepted 2026-05-09 12:54:58,619 - lava_callback - INFO - Starting async job submit for node 69fc8b9055ff273b190bac6b 2026-05-09 12:54:58,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:54:58,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8b9055ff273b190bac6b HTTP/1.1" 200 None 2026-05-09 12:54:58,644 - lava_callback - DEBUG - Processing node 69fc8b9055ff273b190bac6b: baseline-arm-baylibre 2026-05-09 12:54:58,644 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8b9055ff273b190bac6b 2026-05-09 12:54:58,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:54:58,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8b9055ff273b190bac6b HTTP/1.1" 200 None 2026-05-09 12:54:58,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:54:58,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:54:58,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:54:58,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8b9055ff273b190bac6b HTTP/1.1" 200 None 2026-05-09 12:54:58,690 - lava_callback - ERROR - Error processing callback for node 69fc8b9055ff273b190bac6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55090 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:55:38,109 - lava_callback - INFO - Received callback for node 69fc8bb955ff273b190bac76 INFO: 172.21.0.1:55094 - "POST /node/69fc8bb955ff273b190bac76 HTTP/1.0" 202 Accepted 2026-05-09 12:55:38,114 - lava_callback - INFO - Starting async job submit for node 69fc8bb955ff273b190bac76 2026-05-09 12:55:38,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:55:38,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8bb955ff273b190bac76 HTTP/1.1" 200 None 2026-05-09 12:55:38,130 - lava_callback - DEBUG - Processing node 69fc8bb955ff273b190bac76: baseline-arm-baylibre 2026-05-09 12:55:38,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8bb955ff273b190bac76 2026-05-09 12:55:38,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:55:38,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8bb955ff273b190bac76 HTTP/1.1" 200 None 2026-05-09 12:55:38,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:55:38,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:55:38,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:55:38,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8bb955ff273b190bac76 HTTP/1.1" 200 None 2026-05-09 12:55:38,218 - lava_callback - ERROR - Error processing callback for node 69fc8bb955ff273b190bac76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:56:18,199 - lava_callback - INFO - Received callback for node 69fc8bdd55ff273b190bac86 INFO: 172.21.0.1:53830 - "POST /node/69fc8bdd55ff273b190bac86 HTTP/1.0" 202 Accepted 2026-05-09 12:56:18,204 - lava_callback - INFO - Starting async job submit for node 69fc8bdd55ff273b190bac86 2026-05-09 12:56:18,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:56:18,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8bdd55ff273b190bac86 HTTP/1.1" 200 None 2026-05-09 12:56:18,219 - lava_callback - DEBUG - Processing node 69fc8bdd55ff273b190bac86: baseline-arm-baylibre 2026-05-09 12:56:18,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8bdd55ff273b190bac86 2026-05-09 12:56:18,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:56:18,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8bdd55ff273b190bac86 HTTP/1.1" 200 None 2026-05-09 12:56:18,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:56:18,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:56:18,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:56:18,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8bdd55ff273b190bac86 HTTP/1.1" 200 None 2026-05-09 12:56:18,269 - lava_callback - ERROR - Error processing callback for node 69fc8bdd55ff273b190bac86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:56:43,706 - lava_callback - INFO - Received callback for node 69fc8c0555ff273b190bac93 INFO: 172.21.0.1:44780 - "POST /node/69fc8c0555ff273b190bac93 HTTP/1.0" 202 Accepted 2026-05-09 12:56:43,711 - lava_callback - INFO - Starting async job submit for node 69fc8c0555ff273b190bac93 2026-05-09 12:56:43,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:56:43,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8c0555ff273b190bac93 HTTP/1.1" 200 None 2026-05-09 12:56:43,726 - lava_callback - DEBUG - Processing node 69fc8c0555ff273b190bac93: baseline-arm-clabbe 2026-05-09 12:56:43,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8c0555ff273b190bac93 2026-05-09 12:56:43,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:56:43,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8c0555ff273b190bac93 HTTP/1.1" 200 None 2026-05-09 12:56:43,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:56:43,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:56:43,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:56:43,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8c0555ff273b190bac93 HTTP/1.1" 200 None 2026-05-09 12:56:43,779 - lava_callback - ERROR - Error processing callback for node 69fc8c0555ff273b190bac93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43860 - "GET /node/682695f75e519999a66d1c2c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43872 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:57:18,219 - lava_callback - INFO - Received callback for node 69fc8c2555ff273b190baca3 INFO: 172.21.0.1:43882 - "POST /node/69fc8c2555ff273b190baca3 HTTP/1.0" 202 Accepted 2026-05-09 12:57:18,225 - lava_callback - INFO - Starting async job submit for node 69fc8c2555ff273b190baca3 2026-05-09 12:57:18,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:57:18,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8c2555ff273b190baca3 HTTP/1.1" 200 None 2026-05-09 12:57:18,241 - lava_callback - DEBUG - Processing node 69fc8c2555ff273b190baca3: baseline-arm-baylibre 2026-05-09 12:57:18,241 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8c2555ff273b190baca3 2026-05-09 12:57:18,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:57:18,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8c2555ff273b190baca3 HTTP/1.1" 200 None 2026-05-09 12:57:18,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:57:18,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:57:18,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:57:18,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8c2555ff273b190baca3 HTTP/1.1" 200 None 2026-05-09 12:57:18,286 - lava_callback - ERROR - Error processing callback for node 69fc8c2555ff273b190baca3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:57:58,277 - lava_callback - INFO - Received callback for node 69fc8c4c55ff273b190bacb4 INFO: 172.21.0.1:54320 - "POST /node/69fc8c4c55ff273b190bacb4 HTTP/1.0" 202 Accepted 2026-05-09 12:57:58,283 - lava_callback - INFO - Starting async job submit for node 69fc8c4c55ff273b190bacb4 2026-05-09 12:57:58,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:57:58,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8c4c55ff273b190bacb4 HTTP/1.1" 200 None 2026-05-09 12:57:58,305 - lava_callback - DEBUG - Processing node 69fc8c4c55ff273b190bacb4: baseline-arm-baylibre 2026-05-09 12:57:58,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8c4c55ff273b190bacb4 2026-05-09 12:57:58,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:57:58,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8c4c55ff273b190bacb4 HTTP/1.1" 200 None 2026-05-09 12:57:58,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:57:58,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:57:58,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:57:58,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8c4c55ff273b190bacb4 HTTP/1.1" 200 None 2026-05-09 12:57:58,349 - lava_callback - ERROR - Error processing callback for node 69fc8c4c55ff273b190bacb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37610 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:58:43,834 - lava_callback - INFO - Received callback for node 69fc8c7255ff273b190bacc4 INFO: 172.21.0.1:38920 - "POST /node/69fc8c7255ff273b190bacc4 HTTP/1.0" 202 Accepted 2026-05-09 12:58:43,839 - lava_callback - INFO - Starting async job submit for node 69fc8c7255ff273b190bacc4 2026-05-09 12:58:43,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:58:43,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8c7255ff273b190bacc4 HTTP/1.1" 200 None 2026-05-09 12:58:43,854 - lava_callback - DEBUG - Processing node 69fc8c7255ff273b190bacc4: baseline-arm-clabbe 2026-05-09 12:58:43,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8c7255ff273b190bacc4 2026-05-09 12:58:43,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:58:43,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8c7255ff273b190bacc4 HTTP/1.1" 200 None 2026-05-09 12:58:43,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:58:43,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:58:43,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:58:43,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8c7255ff273b190bacc4 HTTP/1.1" 200 None 2026-05-09 12:58:43,913 - lava_callback - ERROR - Error processing callback for node 69fc8c7255ff273b190bacc4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:58:58,315 - lava_callback - INFO - Received callback for node 69ff19be254d3291e98e085b INFO: 172.21.0.1:52588 - "POST /node/69ff19be254d3291e98e085b HTTP/1.0" 202 Accepted 2026-05-09 12:58:58,324 - lava_callback - INFO - Starting async job submit for node 69ff19be254d3291e98e085b 2026-05-09 12:58:58,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:58:58,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff19be254d3291e98e085b HTTP/1.1" 200 None 2026-05-09 12:58:58,368 - lava_callback - DEBUG - Processing node 69ff19be254d3291e98e085b: baseline-nfs-arm64 2026-05-09 12:59:00,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 12:59:00,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 12:59:00,780 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff19be254d3291e98e085b/log.txt.gz 2026-05-09 12:59:01,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 12:59:02,190 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 12:59:02,194 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff19be254d3291e98e085b/lava-logs.yaml 2026-05-09 12:59:02,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 12:59:02,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 12:59:02,392 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ff19be254d3291e98e085b/lava_callback.json.gz DEBUG: Setup failed for 69ff19be254d3291e98e085b. Transitting job node result: incomplete -> fail 2026-05-09 12:59:02,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:59:02,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff19be254d3291e98e085b HTTP/1.1" 200 None 2026-05-09 12:59:02,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:59:02,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 12:59:02,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:59:02,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff19be254d3291e98e085b HTTP/1.1" 200 None 2026-05-09 12:59:02,590 - lava_callback - INFO - Completed processing callback for node 69ff19be254d3291e98e085b INFO: 172.21.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34972 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:59:12,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:59:12,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50060 - "GET /node/6809fd8abfd39100d82c2883%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-09 12:59:23,864 - lava_callback - INFO - Received callback for node 69fc8c9855ff273b190bacd9 INFO: 172.21.0.1:50070 - "POST /node/69fc8c9855ff273b190bacd9 HTTP/1.0" 202 Accepted 2026-05-09 12:59:23,869 - lava_callback - INFO - Starting async job submit for node 69fc8c9855ff273b190bacd9 2026-05-09 12:59:23,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:59:23,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8c9855ff273b190bacd9 HTTP/1.1" 200 None 2026-05-09 12:59:23,884 - lava_callback - DEBUG - Processing node 69fc8c9855ff273b190bacd9: baseline-arm-clabbe 2026-05-09 12:59:23,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8c9855ff273b190bacd9 2026-05-09 12:59:23,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:59:23,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8c9855ff273b190bacd9 HTTP/1.1" 200 None 2026-05-09 12:59:23,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:59:23,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:59:23,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:59:23,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8c9855ff273b190bacd9 HTTP/1.1" 200 None 2026-05-09 12:59:23,931 - lava_callback - ERROR - Error processing callback for node 69fc8c9855ff273b190bacd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK 2026-05-09 12:59:43,900 - lava_callback - INFO - Received callback for node 69fc8cbc55ff273b190bace8 INFO: 172.21.0.1:58068 - "POST /node/69fc8cbc55ff273b190bace8 HTTP/1.0" 202 Accepted 2026-05-09 12:59:43,905 - lava_callback - INFO - Starting async job submit for node 69fc8cbc55ff273b190bace8 2026-05-09 12:59:43,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:59:43,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8cbc55ff273b190bace8 HTTP/1.1" 200 None 2026-05-09 12:59:43,930 - lava_callback - DEBUG - Processing node 69fc8cbc55ff273b190bace8: baseline-arm-clabbe 2026-05-09 12:59:43,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8cbc55ff273b190bace8 2026-05-09 12:59:43,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:59:43,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8cbc55ff273b190bace8 HTTP/1.1" 200 None 2026-05-09 12:59:43,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:59:43,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 12:59:43,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 12:59:44,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8cbc55ff273b190bace8 HTTP/1.1" 200 None 2026-05-09 12:59:44,017 - lava_callback - ERROR - Error processing callback for node 69fc8cbc55ff273b190bace8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:00:23,933 - lava_callback - INFO - Received callback for node 69fc8ce255ff273b190bacfa INFO: 172.21.0.1:46662 - "POST /node/69fc8ce255ff273b190bacfa HTTP/1.0" 202 Accepted 2026-05-09 13:00:23,939 - lava_callback - INFO - Starting async job submit for node 69fc8ce255ff273b190bacfa 2026-05-09 13:00:23,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:00:23,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8ce255ff273b190bacfa HTTP/1.1" 200 None 2026-05-09 13:00:23,954 - lava_callback - DEBUG - Processing node 69fc8ce255ff273b190bacfa: baseline-arm-clabbe 2026-05-09 13:00:23,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8ce255ff273b190bacfa 2026-05-09 13:00:23,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:00:23,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8ce255ff273b190bacfa HTTP/1.1" 200 None 2026-05-09 13:00:23,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:00:23,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 13:00:23,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:00:23,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8ce255ff273b190bacfa HTTP/1.1" 200 None 2026-05-09 13:00:24,000 - lava_callback - ERROR - Error processing callback for node 69fc8ce255ff273b190bacfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33106 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:01:03,984 - lava_callback - INFO - Received callback for node 69fc8d0755ff273b190bad0b INFO: 172.21.0.1:57992 - "POST /node/69fc8d0755ff273b190bad0b HTTP/1.0" 202 Accepted 2026-05-09 13:01:03,990 - lava_callback - INFO - Starting async job submit for node 69fc8d0755ff273b190bad0b 2026-05-09 13:01:03,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:01:04,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8d0755ff273b190bad0b HTTP/1.1" 200 None 2026-05-09 13:01:04,008 - lava_callback - DEBUG - Processing node 69fc8d0755ff273b190bad0b: baseline-arm-clabbe 2026-05-09 13:01:04,008 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8d0755ff273b190bad0b 2026-05-09 13:01:04,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:01:04,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8d0755ff273b190bad0b HTTP/1.1" 200 None 2026-05-09 13:01:04,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:01:04,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 13:01:04,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:01:04,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8d0755ff273b190bad0b HTTP/1.1" 200 None 2026-05-09 13:01:04,064 - lava_callback - ERROR - Error processing callback for node 69fc8d0755ff273b190bad0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59972 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:01:44,053 - lava_callback - INFO - Received callback for node 69fc8d2d55ff273b190bad1f INFO: 172.21.0.1:51664 - "POST /node/69fc8d2d55ff273b190bad1f HTTP/1.0" 202 Accepted 2026-05-09 13:01:44,059 - lava_callback - INFO - Starting async job submit for node 69fc8d2d55ff273b190bad1f 2026-05-09 13:01:44,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:01:44,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8d2d55ff273b190bad1f HTTP/1.1" 200 None 2026-05-09 13:01:44,097 - lava_callback - DEBUG - Processing node 69fc8d2d55ff273b190bad1f: baseline-arm-clabbe 2026-05-09 13:01:44,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8d2d55ff273b190bad1f 2026-05-09 13:01:44,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:01:44,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8d2d55ff273b190bad1f HTTP/1.1" 200 None 2026-05-09 13:01:44,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:01:44,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 13:01:44,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:01:44,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8d2d55ff273b190bad1f HTTP/1.1" 200 None 2026-05-09 13:01:44,149 - lava_callback - ERROR - Error processing callback for node 69fc8d2d55ff273b190bad1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:02:24,019 - lava_callback - INFO - Received callback for node 69fc8d5255ff273b190bad2e INFO: 172.21.0.1:47516 - "POST /node/69fc8d5255ff273b190bad2e HTTP/1.0" 202 Accepted 2026-05-09 13:02:24,024 - lava_callback - INFO - Starting async job submit for node 69fc8d5255ff273b190bad2e 2026-05-09 13:02:24,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:02:24,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8d5255ff273b190bad2e HTTP/1.1" 200 None 2026-05-09 13:02:24,042 - lava_callback - DEBUG - Processing node 69fc8d5255ff273b190bad2e: baseline-arm-clabbe 2026-05-09 13:02:24,043 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8d5255ff273b190bad2e 2026-05-09 13:02:24,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:02:24,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8d5255ff273b190bad2e HTTP/1.1" 200 None 2026-05-09 13:02:24,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:02:24,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 13:02:24,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:02:24,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8d5255ff273b190bad2e HTTP/1.1" 200 None 2026-05-09 13:02:24,092 - lava_callback - ERROR - Error processing callback for node 69fc8d5255ff273b190bad2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:03:04,017 - lava_callback - INFO - Received callback for node 69fc8d7755ff273b190bad3f INFO: 172.21.0.1:50014 - "POST /node/69fc8d7755ff273b190bad3f HTTP/1.0" 202 Accepted 2026-05-09 13:03:04,022 - lava_callback - INFO - Starting async job submit for node 69fc8d7755ff273b190bad3f 2026-05-09 13:03:04,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:03:04,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8d7755ff273b190bad3f HTTP/1.1" 200 None 2026-05-09 13:03:04,037 - lava_callback - DEBUG - Processing node 69fc8d7755ff273b190bad3f: baseline-arm-clabbe 2026-05-09 13:03:04,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8d7755ff273b190bad3f 2026-05-09 13:03:04,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:03:04,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8d7755ff273b190bad3f HTTP/1.1" 200 None 2026-05-09 13:03:04,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:03:04,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 13:03:04,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:03:04,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8d7755ff273b190bad3f HTTP/1.1" 200 None 2026-05-09 13:03:04,101 - lava_callback - ERROR - Error processing callback for node 69fc8d7755ff273b190bad3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:03:44,048 - lava_callback - INFO - Received callback for node 69fc8d9c55ff273b190bad4f INFO: 172.21.0.1:43308 - "POST /node/69fc8d9c55ff273b190bad4f HTTP/1.0" 202 Accepted 2026-05-09 13:03:44,053 - lava_callback - INFO - Starting async job submit for node 69fc8d9c55ff273b190bad4f 2026-05-09 13:03:44,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:03:44,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8d9c55ff273b190bad4f HTTP/1.1" 200 None 2026-05-09 13:03:44,068 - lava_callback - DEBUG - Processing node 69fc8d9c55ff273b190bad4f: baseline-arm-clabbe 2026-05-09 13:03:44,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8d9c55ff273b190bad4f 2026-05-09 13:03:44,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:03:44,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8d9c55ff273b190bad4f HTTP/1.1" 200 None 2026-05-09 13:03:44,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:03:44,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 13:03:44,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:03:44,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8d9c55ff273b190bad4f HTTP/1.1" 200 None 2026-05-09 13:03:44,115 - lava_callback - ERROR - Error processing callback for node 69fc8d9c55ff273b190bad4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:04:24,076 - lava_callback - INFO - Received callback for node 69fc8dc255ff273b190bad6b INFO: 172.21.0.1:34440 - "POST /node/69fc8dc255ff273b190bad6b HTTP/1.0" 202 Accepted 2026-05-09 13:04:24,081 - lava_callback - INFO - Starting async job submit for node 69fc8dc255ff273b190bad6b 2026-05-09 13:04:24,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:04:24,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8dc255ff273b190bad6b HTTP/1.1" 200 None 2026-05-09 13:04:24,096 - lava_callback - DEBUG - Processing node 69fc8dc255ff273b190bad6b: baseline-arm-clabbe 2026-05-09 13:04:24,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8dc255ff273b190bad6b 2026-05-09 13:04:24,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:04:24,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8dc255ff273b190bad6b HTTP/1.1" 200 None 2026-05-09 13:04:24,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:04:24,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 13:04:24,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:04:24,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8dc255ff273b190bad6b HTTP/1.1" 200 None 2026-05-09 13:04:24,147 - lava_callback - ERROR - Error processing callback for node 69fc8dc255ff273b190bad6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34682 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:04:44,117 - lava_callback - INFO - Received callback for node 69fc8de755ff273b190bad73 INFO: 172.21.0.1:39294 - "POST /node/69fc8de755ff273b190bad73 HTTP/1.0" 202 Accepted 2026-05-09 13:04:44,122 - lava_callback - INFO - Starting async job submit for node 69fc8de755ff273b190bad73 2026-05-09 13:04:44,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:04:44,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8de755ff273b190bad73 HTTP/1.1" 200 None 2026-05-09 13:04:44,138 - lava_callback - DEBUG - Processing node 69fc8de755ff273b190bad73: baseline-arm-clabbe 2026-05-09 13:04:44,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8de755ff273b190bad73 2026-05-09 13:04:44,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:04:44,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8de755ff273b190bad73 HTTP/1.1" 200 None 2026-05-09 13:04:44,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:04:44,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 13:04:44,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:04:44,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8de755ff273b190bad73 HTTP/1.1" 200 None 2026-05-09 13:04:44,211 - lava_callback - ERROR - Error processing callback for node 69fc8de755ff273b190bad73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50174 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:05:18,859 - lava_callback - INFO - Received callback for node 69fc8e0a55ff273b190bad83 INFO: 172.21.0.1:50188 - "POST /node/69fc8e0a55ff273b190bad83 HTTP/1.0" 202 Accepted 2026-05-09 13:05:18,865 - lava_callback - INFO - Starting async job submit for node 69fc8e0a55ff273b190bad83 2026-05-09 13:05:18,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:05:18,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8e0a55ff273b190bad83 HTTP/1.1" 200 None 2026-05-09 13:05:18,880 - lava_callback - DEBUG - Processing node 69fc8e0a55ff273b190bad83: baseline-arm-baylibre 2026-05-09 13:05:18,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8e0a55ff273b190bad83 2026-05-09 13:05:18,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:05:18,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8e0a55ff273b190bad83 HTTP/1.1" 200 None 2026-05-09 13:05:18,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:05:18,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 13:05:18,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:05:18,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8e0a55ff273b190bad83 HTTP/1.1" 200 None 2026-05-09 13:05:18,925 - lava_callback - ERROR - Error processing callback for node 69fc8e0a55ff273b190bad83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:06:04,132 - lava_callback - INFO - Received callback for node 69fc8e2f55ff273b190bad94 INFO: 172.21.0.1:55730 - "POST /node/69fc8e2f55ff273b190bad94 HTTP/1.0" 202 Accepted 2026-05-09 13:06:04,138 - lava_callback - INFO - Starting async job submit for node 69fc8e2f55ff273b190bad94 2026-05-09 13:06:04,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:06:04,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8e2f55ff273b190bad94 HTTP/1.1" 200 None 2026-05-09 13:06:04,160 - lava_callback - DEBUG - Processing node 69fc8e2f55ff273b190bad94: baseline-arm-clabbe 2026-05-09 13:06:04,160 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc8e2f55ff273b190bad94 2026-05-09 13:06:04,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:06:04,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc8e2f55ff273b190bad94 HTTP/1.1" 200 None 2026-05-09 13:06:04,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:06:04,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93702d09fe59064f02ceb HTTP/1.1" 200 None 2026-05-09 13:06:04,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:06:04,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc8e2f55ff273b190bad94 HTTP/1.1" 200 None 2026-05-09 13:06:04,210 - lava_callback - ERROR - Error processing callback for node 69fc8e2f55ff273b190bad94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:07:25,559 - lava_callback - INFO - Received callback for node 69ff1a04254d3291e98e088d INFO: 172.21.0.1:46964 - "POST /node/69ff1a04254d3291e98e088d HTTP/1.0" 202 Accepted 2026-05-09 13:07:25,564 - lava_callback - INFO - Starting async job submit for node 69ff1a04254d3291e98e088d 2026-05-09 13:07:25,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:07:25,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1a04254d3291e98e088d HTTP/1.1" 200 None 2026-05-09 13:07:25,597 - lava_callback - DEBUG - Processing node 69ff1a04254d3291e98e088d: baseline-arm64 2026-05-09 13:07:25,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:07:26,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:07:26,083 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1a04254d3291e98e088d/log.txt.gz 2026-05-09 13:07:26,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:07:26,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:07:26,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1a04254d3291e98e088d/lava-logs.yaml 2026-05-09 13:07:26,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:07:26,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:07:26,633 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1a04254d3291e98e088d/lava_callback.json.gz 2026-05-09 13:07:26,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:07:26,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1a04254d3291e98e088d HTTP/1.1" 200 None 2026-05-09 13:07:26,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:07:26,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-09 13:07:26,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:07:26,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1a04254d3291e98e088d HTTP/1.1" 200 None 2026-05-09 13:07:26,776 - lava_callback - INFO - Completed processing callback for node 69ff1a04254d3291e98e088d INFO: 172.21.0.1:53762 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:07:42,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:07:42,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:11:25,025 - lava_callback - INFO - Received callback for node 69ff1ce6254d3291e98e0a12 INFO: 172.21.0.1:53908 - "POST /node/69ff1ce6254d3291e98e0a12 HTTP/1.0" 202 Accepted 2026-05-09 13:11:25,031 - lava_callback - INFO - Starting async job submit for node 69ff1ce6254d3291e98e0a12 2026-05-09 13:11:25,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:11:25,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1ce6254d3291e98e0a12 HTTP/1.1" 200 None 2026-05-09 13:11:25,066 - lava_callback - DEBUG - Processing node 69ff1ce6254d3291e98e0a12: baseline-arm64 2026-05-09 13:11:25,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:11:25,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:11:25,509 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1ce6254d3291e98e0a12/log.txt.gz 2026-05-09 13:11:25,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:11:25,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:11:25,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1ce6254d3291e98e0a12/lava-logs.yaml 2026-05-09 13:11:25,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:11:26,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:11:26,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff1ce6254d3291e98e0a12/lava_callback.json.gz 2026-05-09 13:11:26,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:11:26,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff1ce6254d3291e98e0a12 HTTP/1.1" 200 None 2026-05-09 13:11:26,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:11:26,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 13:11:26,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:11:26,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff1ce6254d3291e98e0a12 HTTP/1.1" 200 None 2026-05-09 13:11:26,157 - lava_callback - INFO - Completed processing callback for node 69ff1ce6254d3291e98e0a12 INFO: 172.21.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:11:42,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:11:42,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET /node/6818d56b62a0f414c6209383%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56578 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:15:26,174 - lava_callback - INFO - Received callback for node 69ff20ea254d3291e98e0c01 INFO: 172.21.0.1:42366 - "POST /node/69ff20ea254d3291e98e0c01 HTTP/1.0" 202 Accepted 2026-05-09 13:15:26,180 - lava_callback - INFO - Starting async job submit for node 69ff20ea254d3291e98e0c01 2026-05-09 13:15:26,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:15:26,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff20ea254d3291e98e0c01 HTTP/1.1" 200 None 2026-05-09 13:15:26,215 - lava_callback - DEBUG - Processing node 69ff20ea254d3291e98e0c01: baseline-arm64 INFO: 172.21.0.1:42376 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:15:26,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:15:26,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:15:26,655 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff20ea254d3291e98e0c01/log.txt.gz 2026-05-09 13:15:26,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:15:27,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:15:27,025 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff20ea254d3291e98e0c01/lava-logs.yaml 2026-05-09 13:15:27,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:15:27,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:15:27,308 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff20ea254d3291e98e0c01/lava_callback.json.gz 2026-05-09 13:15:27,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:15:27,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff20ea254d3291e98e0c01 HTTP/1.1" 200 None 2026-05-09 13:15:27,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:15:27,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 13:15:27,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:15:27,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff20ea254d3291e98e0c01 HTTP/1.1" 200 None 2026-05-09 13:15:27,459 - lava_callback - INFO - Completed processing callback for node 69ff20ea254d3291e98e0c01 INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:15:42,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:15:42,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49476 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:19:26,187 - lava_callback - INFO - Received callback for node 69ff29c1254d3291e98e0c6c INFO: 172.21.0.1:35348 - "POST /node/69ff29c1254d3291e98e0c6c HTTP/1.0" 202 Accepted 2026-05-09 13:19:26,193 - lava_callback - INFO - Starting async job submit for node 69ff29c1254d3291e98e0c6c 2026-05-09 13:19:26,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:19:26,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff29c1254d3291e98e0c6c HTTP/1.1" 200 None 2026-05-09 13:19:26,230 - lava_callback - DEBUG - Processing node 69ff29c1254d3291e98e0c6c: baseline-arm64 INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:19:26,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:19:26,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:19:26,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff29c1254d3291e98e0c6c/log.txt.gz 2026-05-09 13:19:26,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:19:27,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:19:27,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff29c1254d3291e98e0c6c/lava-logs.yaml 2026-05-09 13:19:27,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:19:27,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:19:27,209 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff29c1254d3291e98e0c6c/lava_callback.json.gz 2026-05-09 13:19:27,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:19:27,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff29c1254d3291e98e0c6c HTTP/1.1" 200 None 2026-05-09 13:19:27,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:19:27,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-09 13:19:27,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:19:27,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff29c1254d3291e98e0c6c HTTP/1.1" 200 None 2026-05-09 13:19:27,335 - lava_callback - INFO - Completed processing callback for node 69ff29c1254d3291e98e0c6c INFO: 172.21.0.1:53572 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:19:42,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:19:42,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:23:25,284 - lava_callback - INFO - Received callback for node 69ff326e254d3291e98e103f INFO: 172.21.0.1:33840 - "POST /node/69ff326e254d3291e98e103f HTTP/1.0" 202 Accepted 2026-05-09 13:23:25,291 - lava_callback - INFO - Starting async job submit for node 69ff326e254d3291e98e103f 2026-05-09 13:23:25,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:23:25,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff326e254d3291e98e103f HTTP/1.1" 200 None 2026-05-09 13:23:25,323 - lava_callback - DEBUG - Processing node 69ff326e254d3291e98e103f: baseline-arm64 2026-05-09 13:23:25,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:23:25,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:23:25,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff326e254d3291e98e103f/log.txt.gz 2026-05-09 13:23:25,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:23:26,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:23:26,125 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff326e254d3291e98e103f/lava-logs.yaml 2026-05-09 13:23:26,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:23:26,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:23:26,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff326e254d3291e98e103f/lava_callback.json.gz 2026-05-09 13:23:26,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:23:26,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff326e254d3291e98e103f HTTP/1.1" 200 None 2026-05-09 13:23:26,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:23:26,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-09 13:23:26,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:23:26,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff326e254d3291e98e103f HTTP/1.1" 200 None 2026-05-09 13:23:26,361 - lava_callback - INFO - Completed processing callback for node 69ff326e254d3291e98e103f INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57580 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:23:42,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:23:42,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55004 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:24:59,731 - lava_callback - INFO - Received callback for node 69fc92a855ff273b190bae61 INFO: 172.21.0.1:60630 - "POST /node/69fc92a855ff273b190bae61 HTTP/1.0" 202 Accepted 2026-05-09 13:24:59,736 - lava_callback - INFO - Starting async job submit for node 69fc92a855ff273b190bae61 2026-05-09 13:24:59,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:24:59,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc92a855ff273b190bae61 HTTP/1.1" 200 None 2026-05-09 13:24:59,752 - lava_callback - DEBUG - Processing node 69fc92a855ff273b190bae61: baseline-arm64-baylibre 2026-05-09 13:24:59,752 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc92a855ff273b190bae61 2026-05-09 13:24:59,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:24:59,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc92a855ff273b190bae61 HTTP/1.1" 200 None 2026-05-09 13:24:59,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:24:59,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-09 13:24:59,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:24:59,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc92a855ff273b190bae61 HTTP/1.1" 200 None 2026-05-09 13:24:59,802 - lava_callback - ERROR - Error processing callback for node 69fc92a855ff273b190bae61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42466 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:26:40,273 - lava_callback - INFO - Received callback for node 69fc92fc55ff273b190bae81 INFO: 172.21.0.1:48642 - "POST /node/69fc92fc55ff273b190bae81 HTTP/1.0" 202 Accepted 2026-05-09 13:26:40,282 - lava_callback - INFO - Starting async job submit for node 69fc92fc55ff273b190bae81 2026-05-09 13:26:40,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:26:40,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc92fc55ff273b190bae81 HTTP/1.1" 200 None 2026-05-09 13:26:40,304 - lava_callback - DEBUG - Processing node 69fc92fc55ff273b190bae81: baseline-arm64-baylibre 2026-05-09 13:26:40,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc92fc55ff273b190bae81 2026-05-09 13:26:40,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:26:40,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc92fc55ff273b190bae81 HTTP/1.1" 200 None 2026-05-09 13:26:40,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:26:40,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 13:26:40,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:26:40,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc92fc55ff273b190bae81 HTTP/1.1" 200 None 2026-05-09 13:26:40,350 - lava_callback - ERROR - Error processing callback for node 69fc92fc55ff273b190bae81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37224 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:27:25,815 - lava_callback - INFO - Received callback for node 69ff339d254d3291e98e10ed INFO: 172.21.0.1:41226 - "POST /node/69ff339d254d3291e98e10ed HTTP/1.0" 202 Accepted 2026-05-09 13:27:25,825 - lava_callback - INFO - Starting async job submit for node 69ff339d254d3291e98e10ed 2026-05-09 13:27:25,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:27:25,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff339d254d3291e98e10ed HTTP/1.1" 200 None 2026-05-09 13:27:25,856 - lava_callback - DEBUG - Processing node 69ff339d254d3291e98e10ed: baseline-arm64 2026-05-09 13:27:26,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:27:26,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:27:26,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff339d254d3291e98e10ed/log.txt.gz 2026-05-09 13:27:26,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:41234 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:27:26,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:27:26,648 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff339d254d3291e98e10ed/lava-logs.yaml 2026-05-09 13:27:26,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:27:26,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:27:26,755 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff339d254d3291e98e10ed/lava_callback.json.gz 2026-05-09 13:27:26,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:27:26,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff339d254d3291e98e10ed HTTP/1.1" 200 None 2026-05-09 13:27:26,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:27:26,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe0d38e4d4e78cd76adcd5 HTTP/1.1" 200 None 2026-05-09 13:27:26,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:27:26,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff339d254d3291e98e10ed HTTP/1.1" 200 None 2026-05-09 13:27:26,889 - lava_callback - INFO - Completed processing callback for node 69ff339d254d3291e98e10ed INFO: 172.21.0.1:60268 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:27:42,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:27:42,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:28:05,078 - lava_callback - INFO - Received callback for node 69fc935755ff273b190baea5 INFO: 172.21.0.1:50220 - "POST /node/69fc935755ff273b190baea5 HTTP/1.0" 202 Accepted 2026-05-09 13:28:05,084 - lava_callback - INFO - Starting async job submit for node 69fc935755ff273b190baea5 2026-05-09 13:28:05,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:28:05,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc935755ff273b190baea5 HTTP/1.1" 200 None 2026-05-09 13:28:05,099 - lava_callback - DEBUG - Processing node 69fc935755ff273b190baea5: baseline-arm64-clabbe 2026-05-09 13:28:05,100 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc935755ff273b190baea5 2026-05-09 13:28:05,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:28:05,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc935755ff273b190baea5 HTTP/1.1" 200 None 2026-05-09 13:28:05,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:28:05,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 13:28:05,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:28:05,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc935755ff273b190baea5 HTTP/1.1" 200 None 2026-05-09 13:28:05,150 - lava_callback - ERROR - Error processing callback for node 69fc935755ff273b190baea5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:29:19,908 - lava_callback - INFO - Received callback for node 69fc939f55ff273b190baecb INFO: 172.21.0.1:60434 - "POST /node/69fc939f55ff273b190baecb HTTP/1.0" 202 Accepted 2026-05-09 13:29:19,914 - lava_callback - INFO - Starting async job submit for node 69fc939f55ff273b190baecb 2026-05-09 13:29:19,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:29:19,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc939f55ff273b190baecb HTTP/1.1" 200 None 2026-05-09 13:29:19,938 - lava_callback - DEBUG - Processing node 69fc939f55ff273b190baecb: baseline-arm64-baylibre 2026-05-09 13:29:19,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc939f55ff273b190baecb 2026-05-09 13:29:19,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:29:19,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc939f55ff273b190baecb HTTP/1.1" 200 None 2026-05-09 13:29:19,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:29:19,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-09 13:29:19,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:29:19,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc939f55ff273b190baecb HTTP/1.1" 200 None 2026-05-09 13:29:19,992 - lava_callback - ERROR - Error processing callback for node 69fc939f55ff273b190baecb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:30:39,997 - lava_callback - INFO - Received callback for node 69fc93ef55ff273b190baee9 INFO: 172.21.0.1:53758 - "POST /node/69fc93ef55ff273b190baee9 HTTP/1.0" 202 Accepted 2026-05-09 13:30:40,003 - lava_callback - INFO - Starting async job submit for node 69fc93ef55ff273b190baee9 2026-05-09 13:30:40,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:30:40,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc93ef55ff273b190baee9 HTTP/1.1" 200 None 2026-05-09 13:30:40,018 - lava_callback - DEBUG - Processing node 69fc93ef55ff273b190baee9: baseline-arm64-baylibre 2026-05-09 13:30:40,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc93ef55ff273b190baee9 2026-05-09 13:30:40,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:30:40,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc93ef55ff273b190baee9 HTTP/1.1" 200 None 2026-05-09 13:30:40,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:30:40,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-09 13:30:40,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:30:40,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc93ef55ff273b190baee9 HTTP/1.1" 200 None 2026-05-09 13:30:40,115 - lava_callback - ERROR - Error processing callback for node 69fc93ef55ff273b190baee9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:31:25,525 - lava_callback - INFO - Received callback for node 69ff355e254d3291e98e1201 INFO: 172.21.0.1:35790 - "POST /node/69ff355e254d3291e98e1201 HTTP/1.0" 202 Accepted 2026-05-09 13:31:25,530 - lava_callback - INFO - Starting async job submit for node 69ff355e254d3291e98e1201 2026-05-09 13:31:25,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:31:25,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff355e254d3291e98e1201 HTTP/1.1" 200 None 2026-05-09 13:31:25,562 - lava_callback - DEBUG - Processing node 69ff355e254d3291e98e1201: baseline-arm64 2026-05-09 13:31:25,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:31:25,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:31:25,977 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff355e254d3291e98e1201/log.txt.gz 2026-05-09 13:31:26,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:31:26,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:31:26,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff355e254d3291e98e1201/lava-logs.yaml 2026-05-09 13:31:26,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-09 13:31:26,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-09 13:31:26,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ff355e254d3291e98e1201/lava_callback.json.gz 2026-05-09 13:31:26,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:35806 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:31:26,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ff355e254d3291e98e1201 HTTP/1.1" 200 None 2026-05-09 13:31:26,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:31:26,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fe7cf4ef513bcf3f028118 HTTP/1.1" 200 None 2026-05-09 13:31:26,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:31:26,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ff355e254d3291e98e1201 HTTP/1.1" 200 None 2026-05-09 13:31:26,603 - lava_callback - INFO - Completed processing callback for node 69ff355e254d3291e98e1201 INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:31:42,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:31:42,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:32:05,193 - lava_callback - INFO - Received callback for node 69fc944655ff273b190baf11 INFO: 172.21.0.1:47810 - "POST /node/69fc944655ff273b190baf11 HTTP/1.0" 202 Accepted 2026-05-09 13:32:05,198 - lava_callback - INFO - Starting async job submit for node 69fc944655ff273b190baf11 2026-05-09 13:32:05,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:32:05,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc944655ff273b190baf11 HTTP/1.1" 200 None 2026-05-09 13:32:05,215 - lava_callback - DEBUG - Processing node 69fc944655ff273b190baf11: baseline-arm64-clabbe 2026-05-09 13:32:05,216 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc944655ff273b190baf11 2026-05-09 13:32:05,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:32:05,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc944655ff273b190baf11 HTTP/1.1" 200 None 2026-05-09 13:32:05,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:32:05,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 13:32:05,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:32:05,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc944655ff273b190baf11 HTTP/1.1" 200 None 2026-05-09 13:32:05,268 - lava_callback - ERROR - Error processing callback for node 69fc944655ff273b190baf11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48292 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:33:20,054 - lava_callback - INFO - Received callback for node 69fc949055ff273b190baf36 INFO: 172.21.0.1:59154 - "POST /node/69fc949055ff273b190baf36 HTTP/1.0" 202 Accepted 2026-05-09 13:33:20,060 - lava_callback - INFO - Starting async job submit for node 69fc949055ff273b190baf36 2026-05-09 13:33:20,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:33:20,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc949055ff273b190baf36 HTTP/1.1" 200 None 2026-05-09 13:33:20,079 - lava_callback - DEBUG - Processing node 69fc949055ff273b190baf36: baseline-arm64-baylibre 2026-05-09 13:33:20,079 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc949055ff273b190baf36 2026-05-09 13:33:20,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:33:20,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc949055ff273b190baf36 HTTP/1.1" 200 None 2026-05-09 13:33:20,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:33:20,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-09 13:33:20,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:33:20,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc949055ff273b190baf36 HTTP/1.1" 200 None 2026-05-09 13:33:20,124 - lava_callback - ERROR - Error processing callback for node 69fc949055ff273b190baf36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:34:40,135 - lava_callback - INFO - Received callback for node 69fc94df55ff273b190baf58 INFO: 172.21.0.1:55660 - "POST /node/69fc94df55ff273b190baf58 HTTP/1.0" 202 Accepted 2026-05-09 13:34:40,141 - lava_callback - INFO - Starting async job submit for node 69fc94df55ff273b190baf58 2026-05-09 13:34:40,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:34:40,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc94df55ff273b190baf58 HTTP/1.1" 200 None 2026-05-09 13:34:40,156 - lava_callback - DEBUG - Processing node 69fc94df55ff273b190baf58: baseline-arm64-baylibre 2026-05-09 13:34:40,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc94df55ff273b190baf58 2026-05-09 13:34:40,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:34:40,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc94df55ff273b190baf58 HTTP/1.1" 200 None 2026-05-09 13:34:40,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:34:40,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-09 13:34:40,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:34:40,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc94df55ff273b190baf58 HTTP/1.1" 200 None 2026-05-09 13:34:40,206 - lava_callback - ERROR - Error processing callback for node 69fc94df55ff273b190baf58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:36:05,424 - lava_callback - INFO - Received callback for node 69fc953855ff273b190baf82 INFO: 172.21.0.1:57412 - "POST /node/69fc953855ff273b190baf82 HTTP/1.0" 202 Accepted 2026-05-09 13:36:05,430 - lava_callback - INFO - Starting async job submit for node 69fc953855ff273b190baf82 2026-05-09 13:36:05,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:36:05,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc953855ff273b190baf82 HTTP/1.1" 200 None 2026-05-09 13:36:05,445 - lava_callback - DEBUG - Processing node 69fc953855ff273b190baf82: baseline-arm64-clabbe 2026-05-09 13:36:05,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc953855ff273b190baf82 2026-05-09 13:36:05,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:36:05,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc953855ff273b190baf82 HTTP/1.1" 200 None 2026-05-09 13:36:05,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:36:05,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 13:36:05,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:36:05,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc953855ff273b190baf82 HTTP/1.1" 200 None 2026-05-09 13:36:05,491 - lava_callback - ERROR - Error processing callback for node 69fc953855ff273b190baf82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:37:25,476 - lava_callback - INFO - Received callback for node 69fc958d55ff273b190bafae INFO: 172.21.0.1:53688 - "POST /node/69fc958d55ff273b190bafae HTTP/1.0" 202 Accepted 2026-05-09 13:37:25,481 - lava_callback - INFO - Starting async job submit for node 69fc958d55ff273b190bafae 2026-05-09 13:37:25,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:37:25,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc958d55ff273b190bafae HTTP/1.1" 200 None 2026-05-09 13:37:25,496 - lava_callback - DEBUG - Processing node 69fc958d55ff273b190bafae: baseline-arm64-clabbe 2026-05-09 13:37:25,497 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc958d55ff273b190bafae 2026-05-09 13:37:25,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:37:25,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc958d55ff273b190bafae HTTP/1.1" 200 None 2026-05-09 13:37:25,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:37:25,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 13:37:25,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:37:25,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc958d55ff273b190bafae HTTP/1.1" 200 None 2026-05-09 13:37:25,544 - lava_callback - ERROR - Error processing callback for node 69fc958d55ff273b190bafae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:38:45,455 - lava_callback - INFO - Received callback for node 69fc95df55ff273b190bafda INFO: 172.21.0.1:45722 - "POST /node/69fc95df55ff273b190bafda HTTP/1.0" 202 Accepted 2026-05-09 13:38:45,461 - lava_callback - INFO - Starting async job submit for node 69fc95df55ff273b190bafda 2026-05-09 13:38:45,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:38:45,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc95df55ff273b190bafda HTTP/1.1" 200 None 2026-05-09 13:38:45,483 - lava_callback - DEBUG - Processing node 69fc95df55ff273b190bafda: baseline-arm64-clabbe 2026-05-09 13:38:45,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc95df55ff273b190bafda 2026-05-09 13:38:45,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:38:45,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc95df55ff273b190bafda HTTP/1.1" 200 None 2026-05-09 13:38:45,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:38:45,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-09 13:38:45,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:38:45,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc95df55ff273b190bafda HTTP/1.1" 200 None 2026-05-09 13:38:45,530 - lava_callback - ERROR - Error processing callback for node 69fc95df55ff273b190bafda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38762 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:40:05,610 - lava_callback - INFO - Received callback for node 69fc963155ff273b190bb009 INFO: 172.21.0.1:47412 - "POST /node/69fc963155ff273b190bb009 HTTP/1.0" 202 Accepted 2026-05-09 13:40:05,615 - lava_callback - INFO - Starting async job submit for node 69fc963155ff273b190bb009 2026-05-09 13:40:05,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:40:05,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc963155ff273b190bb009 HTTP/1.1" 200 None 2026-05-09 13:40:05,636 - lava_callback - DEBUG - Processing node 69fc963155ff273b190bb009: baseline-arm64-clabbe 2026-05-09 13:40:05,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc963155ff273b190bb009 2026-05-09 13:40:05,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:40:05,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc963155ff273b190bb009 HTTP/1.1" 200 None 2026-05-09 13:40:05,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:40:05,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 13:40:05,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:40:05,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc963155ff273b190bb009 HTTP/1.1" 200 None 2026-05-09 13:40:05,681 - lava_callback - ERROR - Error processing callback for node 69fc963155ff273b190bb009: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51174 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:41:25,602 - lava_callback - INFO - Received callback for node 69fc968255ff273b190bb022 INFO: 172.21.0.1:48770 - "POST /node/69fc968255ff273b190bb022 HTTP/1.0" 202 Accepted 2026-05-09 13:41:25,608 - lava_callback - INFO - Starting async job submit for node 69fc968255ff273b190bb022 2026-05-09 13:41:25,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:41:25,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc968255ff273b190bb022 HTTP/1.1" 200 None 2026-05-09 13:41:25,623 - lava_callback - DEBUG - Processing node 69fc968255ff273b190bb022: baseline-arm64-clabbe 2026-05-09 13:41:25,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc968255ff273b190bb022 2026-05-09 13:41:25,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:41:25,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc968255ff273b190bb022 HTTP/1.1" 200 None 2026-05-09 13:41:25,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:41:25,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-09 13:41:25,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:41:25,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc968255ff273b190bb022 HTTP/1.1" 200 None 2026-05-09 13:41:25,679 - lava_callback - ERROR - Error processing callback for node 69fc968255ff273b190bb022: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40154 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:43:05,664 - lava_callback - INFO - Received callback for node 69fc96d355ff273b190bb04a INFO: 172.21.0.1:41130 - "POST /node/69fc96d355ff273b190bb04a HTTP/1.0" 202 Accepted 2026-05-09 13:43:05,669 - lava_callback - INFO - Starting async job submit for node 69fc96d355ff273b190bb04a 2026-05-09 13:43:05,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:43:05,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc96d355ff273b190bb04a HTTP/1.1" 200 None 2026-05-09 13:43:05,685 - lava_callback - DEBUG - Processing node 69fc96d355ff273b190bb04a: baseline-arm64-clabbe 2026-05-09 13:43:05,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc96d355ff273b190bb04a 2026-05-09 13:43:05,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:43:05,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc96d355ff273b190bb04a HTTP/1.1" 200 None 2026-05-09 13:43:05,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:43:05,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 13:43:05,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:43:05,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc96d355ff273b190bb04a HTTP/1.1" 200 None 2026-05-09 13:43:05,752 - lava_callback - ERROR - Error processing callback for node 69fc96d355ff273b190bb04a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36958 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:44:25,660 - lava_callback - INFO - Received callback for node 69fc972455ff273b190bb077 INFO: 172.21.0.1:60554 - "POST /node/69fc972455ff273b190bb077 HTTP/1.0" 202 Accepted 2026-05-09 13:44:25,666 - lava_callback - INFO - Starting async job submit for node 69fc972455ff273b190bb077 2026-05-09 13:44:25,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:44:25,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc972455ff273b190bb077 HTTP/1.1" 200 None 2026-05-09 13:44:25,680 - lava_callback - DEBUG - Processing node 69fc972455ff273b190bb077: baseline-arm64-clabbe 2026-05-09 13:44:25,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc972455ff273b190bb077 2026-05-09 13:44:25,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:44:25,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc972455ff273b190bb077 HTTP/1.1" 200 None 2026-05-09 13:44:25,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:44:25,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-09 13:44:25,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:44:25,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc972455ff273b190bb077 HTTP/1.1" 200 None 2026-05-09 13:44:25,726 - lava_callback - ERROR - Error processing callback for node 69fc972455ff273b190bb077: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51258 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:45:45,705 - lava_callback - INFO - Received callback for node 69fc977455ff273b190bb090 INFO: 172.21.0.1:51746 - "POST /node/69fc977455ff273b190bb090 HTTP/1.0" 202 Accepted 2026-05-09 13:45:45,710 - lava_callback - INFO - Starting async job submit for node 69fc977455ff273b190bb090 2026-05-09 13:45:45,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:45:45,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc977455ff273b190bb090 HTTP/1.1" 200 None 2026-05-09 13:45:45,725 - lava_callback - DEBUG - Processing node 69fc977455ff273b190bb090: baseline-arm64-clabbe 2026-05-09 13:45:45,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc977455ff273b190bb090 2026-05-09 13:45:45,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:45:45,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc977455ff273b190bb090 HTTP/1.1" 200 None 2026-05-09 13:45:45,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:45:45,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-09 13:45:45,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:45:45,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc977455ff273b190bb090 HTTP/1.1" 200 None 2026-05-09 13:45:45,771 - lava_callback - ERROR - Error processing callback for node 69fc977455ff273b190bb090: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37458 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:47:05,729 - lava_callback - INFO - Received callback for node 69fc97c455ff273b190bb0b8 INFO: 172.21.0.1:38226 - "POST /node/69fc97c455ff273b190bb0b8 HTTP/1.0" 202 Accepted 2026-05-09 13:47:05,734 - lava_callback - INFO - Starting async job submit for node 69fc97c455ff273b190bb0b8 2026-05-09 13:47:05,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:47:05,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc97c455ff273b190bb0b8 HTTP/1.1" 200 None 2026-05-09 13:47:05,749 - lava_callback - DEBUG - Processing node 69fc97c455ff273b190bb0b8: baseline-arm64-clabbe 2026-05-09 13:47:05,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc97c455ff273b190bb0b8 2026-05-09 13:47:05,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:47:05,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc97c455ff273b190bb0b8 HTTP/1.1" 200 None 2026-05-09 13:47:05,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:47:05,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-09 13:47:05,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:47:05,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc97c455ff273b190bb0b8 HTTP/1.1" 200 None 2026-05-09 13:47:05,797 - lava_callback - ERROR - Error processing callback for node 69fc97c455ff273b190bb0b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43136 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:48:25,750 - lava_callback - INFO - Received callback for node 69fc981555ff273b190bb0e7 INFO: 172.21.0.1:48972 - "POST /node/69fc981555ff273b190bb0e7 HTTP/1.0" 202 Accepted 2026-05-09 13:48:25,756 - lava_callback - INFO - Starting async job submit for node 69fc981555ff273b190bb0e7 2026-05-09 13:48:25,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:48:25,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc981555ff273b190bb0e7 HTTP/1.1" 200 None 2026-05-09 13:48:25,771 - lava_callback - DEBUG - Processing node 69fc981555ff273b190bb0e7: baseline-arm64-clabbe 2026-05-09 13:48:25,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc981555ff273b190bb0e7 2026-05-09 13:48:25,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:48:25,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc981555ff273b190bb0e7 HTTP/1.1" 200 None 2026-05-09 13:48:25,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:48:25,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fbda0f474a995a18840a13 HTTP/1.1" 200 None 2026-05-09 13:48:25,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:48:25,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc981555ff273b190bb0e7 HTTP/1.1" 200 None 2026-05-09 13:48:25,826 - lava_callback - ERROR - Error processing callback for node 69fc981555ff273b190bb0e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET /node/67fcc78157bee17fc6342593%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:52:01,102 - lava_callback - INFO - Received callback for node 69fc98f955ff273b190bb145 INFO: 172.21.0.1:43648 - "POST /node/69fc98f955ff273b190bb145 HTTP/1.0" 202 Accepted 2026-05-09 13:52:01,108 - lava_callback - INFO - Starting async job submit for node 69fc98f955ff273b190bb145 2026-05-09 13:52:01,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:52:01,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc98f955ff273b190bb145 HTTP/1.1" 200 None 2026-05-09 13:52:01,124 - lava_callback - DEBUG - Processing node 69fc98f955ff273b190bb145: baseline-arm64-baylibre 2026-05-09 13:52:01,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc98f955ff273b190bb145 2026-05-09 13:52:01,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:52:01,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc98f955ff273b190bb145 HTTP/1.1" 200 None 2026-05-09 13:52:01,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:52:01,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 13:52:01,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:52:01,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc98f955ff273b190bb145 HTTP/1.1" 200 None 2026-05-09 13:52:01,173 - lava_callback - ERROR - Error processing callback for node 69fc98f955ff273b190bb145: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42138 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:53:26,023 - lava_callback - INFO - Received callback for node 69fc994a55ff273b190bb16d INFO: 172.21.0.1:57544 - "POST /node/69fc994a55ff273b190bb16d HTTP/1.0" 202 Accepted 2026-05-09 13:53:26,029 - lava_callback - INFO - Starting async job submit for node 69fc994a55ff273b190bb16d 2026-05-09 13:53:26,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:53:26,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc994a55ff273b190bb16d HTTP/1.1" 200 None 2026-05-09 13:53:26,065 - lava_callback - DEBUG - Processing node 69fc994a55ff273b190bb16d: baseline-arm64-clabbe 2026-05-09 13:53:26,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc994a55ff273b190bb16d 2026-05-09 13:53:26,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:53:26,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc994a55ff273b190bb16d HTTP/1.1" 200 None 2026-05-09 13:53:26,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:53:26,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 13:53:26,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:53:26,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc994a55ff273b190bb16d HTTP/1.1" 200 None 2026-05-09 13:53:26,153 - lava_callback - ERROR - Error processing callback for node 69fc994a55ff273b190bb16d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58526 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:54:46,014 - lava_callback - INFO - Received callback for node 69fc999955ff273b190bb199 INFO: 172.21.0.1:56292 - "POST /node/69fc999955ff273b190bb199 HTTP/1.0" 202 Accepted 2026-05-09 13:54:46,020 - lava_callback - INFO - Starting async job submit for node 69fc999955ff273b190bb199 2026-05-09 13:54:46,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:54:46,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc999955ff273b190bb199 HTTP/1.1" 200 None 2026-05-09 13:54:46,036 - lava_callback - DEBUG - Processing node 69fc999955ff273b190bb199: baseline-arm64-clabbe 2026-05-09 13:54:46,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc999955ff273b190bb199 2026-05-09 13:54:46,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:54:46,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc999955ff273b190bb199 HTTP/1.1" 200 None 2026-05-09 13:54:46,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:54:46,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 13:54:46,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:54:46,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc999955ff273b190bb199 HTTP/1.1" 200 None 2026-05-09 13:54:46,085 - lava_callback - ERROR - Error processing callback for node 69fc999955ff273b190bb199: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54618 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:56:01,552 - lava_callback - INFO - Received callback for node 69fc99e355ff273b190bb1b5 INFO: 172.21.0.1:57934 - "POST /node/69fc99e355ff273b190bb1b5 HTTP/1.0" 202 Accepted 2026-05-09 13:56:01,557 - lava_callback - INFO - Starting async job submit for node 69fc99e355ff273b190bb1b5 2026-05-09 13:56:01,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:56:01,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc99e355ff273b190bb1b5 HTTP/1.1" 200 None 2026-05-09 13:56:01,572 - lava_callback - DEBUG - Processing node 69fc99e355ff273b190bb1b5: baseline-arm64-baylibre 2026-05-09 13:56:01,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc99e355ff273b190bb1b5 2026-05-09 13:56:01,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:56:01,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc99e355ff273b190bb1b5 HTTP/1.1" 200 None 2026-05-09 13:56:01,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:56:01,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 13:56:01,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:56:01,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc99e355ff273b190bb1b5 HTTP/1.1" 200 None 2026-05-09 13:56:01,621 - lava_callback - ERROR - Error processing callback for node 69fc99e355ff273b190bb1b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45862 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:57:26,186 - lava_callback - INFO - Received callback for node 69fc9a3755ff273b190bb1db INFO: 172.21.0.1:49270 - "POST /node/69fc9a3755ff273b190bb1db HTTP/1.0" 202 Accepted 2026-05-09 13:57:26,192 - lava_callback - INFO - Starting async job submit for node 69fc9a3755ff273b190bb1db 2026-05-09 13:57:26,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:57:26,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9a3755ff273b190bb1db HTTP/1.1" 200 None 2026-05-09 13:57:26,230 - lava_callback - DEBUG - Processing node 69fc9a3755ff273b190bb1db: baseline-arm64-clabbe 2026-05-09 13:57:26,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc9a3755ff273b190bb1db 2026-05-09 13:57:26,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:57:26,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9a3755ff273b190bb1db HTTP/1.1" 200 None 2026-05-09 13:57:26,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:57:26,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 13:57:26,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:57:26,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc9a3755ff273b190bb1db HTTP/1.1" 200 None 2026-05-09 13:57:26,305 - lava_callback - ERROR - Error processing callback for node 69fc9a3755ff273b190bb1db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET / HTTP/1.0" 200 OK 2026-05-09 13:58:46,217 - lava_callback - INFO - Received callback for node 69fc9a8555ff273b190bb1fc INFO: 172.21.0.1:46306 - "POST /node/69fc9a8555ff273b190bb1fc HTTP/1.0" 202 Accepted 2026-05-09 13:58:46,222 - lava_callback - INFO - Starting async job submit for node 69fc9a8555ff273b190bb1fc 2026-05-09 13:58:46,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:58:46,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9a8555ff273b190bb1fc HTTP/1.1" 200 None 2026-05-09 13:58:46,238 - lava_callback - DEBUG - Processing node 69fc9a8555ff273b190bb1fc: baseline-arm64-clabbe 2026-05-09 13:58:46,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc9a8555ff273b190bb1fc 2026-05-09 13:58:46,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:58:46,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9a8555ff273b190bb1fc HTTP/1.1" 200 None 2026-05-09 13:58:46,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:58:46,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 13:58:46,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 13:58:46,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc9a8555ff273b190bb1fc HTTP/1.1" 200 None 2026-05-09 13:58:46,288 - lava_callback - ERROR - Error processing callback for node 69fc9a8555ff273b190bb1fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39862 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:00:06,744 - lava_callback - INFO - Received callback for node 69fc9ad455ff273b190bb226 INFO: 172.21.0.1:39870 - "POST /node/69fc9ad455ff273b190bb226 HTTP/1.0" 202 Accepted 2026-05-09 14:00:06,749 - lava_callback - INFO - Starting async job submit for node 69fc9ad455ff273b190bb226 2026-05-09 14:00:06,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:00:06,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9ad455ff273b190bb226 HTTP/1.1" 200 None 2026-05-09 14:00:06,764 - lava_callback - DEBUG - Processing node 69fc9ad455ff273b190bb226: baseline-arm64-clabbe 2026-05-09 14:00:06,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc9ad455ff273b190bb226 2026-05-09 14:00:06,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:00:06,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9ad455ff273b190bb226 HTTP/1.1" 200 None 2026-05-09 14:00:06,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:00:06,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 14:00:06,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:00:06,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc9ad455ff273b190bb226 HTTP/1.1" 200 None 2026-05-09 14:00:06,814 - lava_callback - ERROR - Error processing callback for node 69fc9ad455ff273b190bb226: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42700 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:01:26,261 - lava_callback - INFO - Received callback for node 69fc9b2455ff273b190bb251 INFO: 172.21.0.1:45478 - "POST /node/69fc9b2455ff273b190bb251 HTTP/1.0" 202 Accepted 2026-05-09 14:01:26,267 - lava_callback - INFO - Starting async job submit for node 69fc9b2455ff273b190bb251 2026-05-09 14:01:26,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:01:26,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9b2455ff273b190bb251 HTTP/1.1" 200 None 2026-05-09 14:01:26,285 - lava_callback - DEBUG - Processing node 69fc9b2455ff273b190bb251: baseline-arm64-clabbe 2026-05-09 14:01:26,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc9b2455ff273b190bb251 2026-05-09 14:01:26,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:01:26,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9b2455ff273b190bb251 HTTP/1.1" 200 None 2026-05-09 14:01:26,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:01:26,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 14:01:26,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:01:26,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc9b2455ff273b190bb251 HTTP/1.1" 200 None 2026-05-09 14:01:26,340 - lava_callback - ERROR - Error processing callback for node 69fc9b2455ff273b190bb251: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:03:26,356 - lava_callback - INFO - Received callback for node 69fc9b9c55ff273b190bb278 INFO: 172.21.0.1:59510 - "POST /node/69fc9b9c55ff273b190bb278 HTTP/1.0" 202 Accepted 2026-05-09 14:03:26,365 - lava_callback - INFO - Starting async job submit for node 69fc9b9c55ff273b190bb278 2026-05-09 14:03:26,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:03:26,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9b9c55ff273b190bb278 HTTP/1.1" 200 None 2026-05-09 14:03:26,383 - lava_callback - DEBUG - Processing node 69fc9b9c55ff273b190bb278: baseline-arm64-clabbe 2026-05-09 14:03:26,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc9b9c55ff273b190bb278 2026-05-09 14:03:26,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:03:26,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9b9c55ff273b190bb278 HTTP/1.1" 200 None 2026-05-09 14:03:26,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:03:26,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 14:03:26,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:03:26,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc9b9c55ff273b190bb278 HTTP/1.1" 200 None 2026-05-09 14:03:26,446 - lava_callback - ERROR - Error processing callback for node 69fc9b9c55ff273b190bb278: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:05:26,449 - lava_callback - INFO - Received callback for node 69fc9c1455ff273b190bb29b INFO: 172.21.0.1:50992 - "POST /node/69fc9c1455ff273b190bb29b HTTP/1.0" 202 Accepted 2026-05-09 14:05:26,454 - lava_callback - INFO - Starting async job submit for node 69fc9c1455ff273b190bb29b 2026-05-09 14:05:26,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:05:26,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9c1455ff273b190bb29b HTTP/1.1" 200 None 2026-05-09 14:05:26,469 - lava_callback - DEBUG - Processing node 69fc9c1455ff273b190bb29b: baseline-arm64-clabbe 2026-05-09 14:05:26,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc9c1455ff273b190bb29b 2026-05-09 14:05:26,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:05:26,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9c1455ff273b190bb29b HTTP/1.1" 200 None 2026-05-09 14:05:26,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:05:26,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 14:05:26,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:05:26,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc9c1455ff273b190bb29b HTTP/1.1" 200 None 2026-05-09 14:05:26,522 - lava_callback - ERROR - Error processing callback for node 69fc9c1455ff273b190bb29b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42896 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:06:46,407 - lava_callback - INFO - Received callback for node 69fc9c6255ff273b190bb2b7 INFO: 172.21.0.1:35222 - "POST /node/69fc9c6255ff273b190bb2b7 HTTP/1.0" 202 Accepted 2026-05-09 14:06:46,413 - lava_callback - INFO - Starting async job submit for node 69fc9c6255ff273b190bb2b7 2026-05-09 14:06:46,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:06:46,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9c6255ff273b190bb2b7 HTTP/1.1" 200 None 2026-05-09 14:06:46,427 - lava_callback - DEBUG - Processing node 69fc9c6255ff273b190bb2b7: baseline-arm64-clabbe 2026-05-09 14:06:46,428 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc9c6255ff273b190bb2b7 2026-05-09 14:06:46,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:06:46,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9c6255ff273b190bb2b7 HTTP/1.1" 200 None 2026-05-09 14:06:46,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:06:46,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 14:06:46,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:06:46,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc9c6255ff273b190bb2b7 HTTP/1.1" 200 None 2026-05-09 14:06:46,480 - lava_callback - ERROR - Error processing callback for node 69fc9c6255ff273b190bb2b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43098 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:08:06,561 - lava_callback - INFO - Received callback for node 69fc9cb155ff273b190bb2da INFO: 172.21.0.1:43104 - "POST /node/69fc9cb155ff273b190bb2da HTTP/1.0" 202 Accepted 2026-05-09 14:08:06,567 - lava_callback - INFO - Starting async job submit for node 69fc9cb155ff273b190bb2da 2026-05-09 14:08:06,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:08:06,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9cb155ff273b190bb2da HTTP/1.1" 200 None 2026-05-09 14:08:06,582 - lava_callback - DEBUG - Processing node 69fc9cb155ff273b190bb2da: baseline-arm64-clabbe 2026-05-09 14:08:06,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc9cb155ff273b190bb2da 2026-05-09 14:08:06,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:08:06,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9cb155ff273b190bb2da HTTP/1.1" 200 None 2026-05-09 14:08:06,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:08:06,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 14:08:06,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:08:06,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc9cb155ff273b190bb2da HTTP/1.1" 200 None 2026-05-09 14:08:06,628 - lava_callback - ERROR - Error processing callback for node 69fc9cb155ff273b190bb2da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:10:26,644 - lava_callback - INFO - Received callback for node 69fc9d4155ff273b190bb301 INFO: 172.21.0.1:44738 - "POST /node/69fc9d4155ff273b190bb301 HTTP/1.0" 202 Accepted 2026-05-09 14:10:26,650 - lava_callback - INFO - Starting async job submit for node 69fc9d4155ff273b190bb301 2026-05-09 14:10:26,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:10:26,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9d4155ff273b190bb301 HTTP/1.1" 200 None 2026-05-09 14:10:26,666 - lava_callback - DEBUG - Processing node 69fc9d4155ff273b190bb301: baseline-arm64-clabbe 2026-05-09 14:10:26,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc9d4155ff273b190bb301 2026-05-09 14:10:26,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:10:26,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9d4155ff273b190bb301 HTTP/1.1" 200 None 2026-05-09 14:10:26,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:10:26,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 14:10:26,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:10:26,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc9d4155ff273b190bb301 HTTP/1.1" 200 None 2026-05-09 14:10:26,721 - lava_callback - ERROR - Error processing callback for node 69fc9d4155ff273b190bb301: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47296 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:13:26,730 - lava_callback - INFO - Received callback for node 69fc9df655ff273b190bb322 INFO: 172.21.0.1:47312 - "POST /node/69fc9df655ff273b190bb322 HTTP/1.0" 202 Accepted 2026-05-09 14:13:26,736 - lava_callback - INFO - Starting async job submit for node 69fc9df655ff273b190bb322 2026-05-09 14:13:26,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:13:26,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9df655ff273b190bb322 HTTP/1.1" 200 None 2026-05-09 14:13:26,754 - lava_callback - DEBUG - Processing node 69fc9df655ff273b190bb322: baseline-arm64-clabbe 2026-05-09 14:13:26,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fc9df655ff273b190bb322 2026-05-09 14:13:26,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:13:26,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc9df655ff273b190bb322 HTTP/1.1" 200 None 2026-05-09 14:13:26,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:13:26,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-09 14:13:26,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:13:26,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fc9df655ff273b190bb322 HTTP/1.1" 200 None 2026-05-09 14:13:26,809 - lava_callback - ERROR - Error processing callback for node 69fc9df655ff273b190bb322: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56288 - "GET /node/681aadafda41de3b68994861%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57502 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:38:27,753 - lava_callback - INFO - Received callback for node 69fca3df55ff273b190bb351 INFO: 172.21.0.1:57504 - "POST /node/69fca3df55ff273b190bb351 HTTP/1.0" 202 Accepted 2026-05-09 14:38:27,759 - lava_callback - INFO - Starting async job submit for node 69fca3df55ff273b190bb351 2026-05-09 14:38:27,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:38:27,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca3df55ff273b190bb351 HTTP/1.1" 200 None 2026-05-09 14:38:27,783 - lava_callback - DEBUG - Processing node 69fca3df55ff273b190bb351: baseline-arm-clabbe 2026-05-09 14:38:27,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca3df55ff273b190bb351 2026-05-09 14:38:27,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:38:27,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca3df55ff273b190bb351 HTTP/1.1" 200 None 2026-05-09 14:38:27,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:38:27,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 14:38:27,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:38:27,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca3df55ff273b190bb351 HTTP/1.1" 200 None 2026-05-09 14:38:27,829 - lava_callback - ERROR - Error processing callback for node 69fca3df55ff273b190bb351: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34264 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:39:07,722 - lava_callback - INFO - Received callback for node 69fca40555ff273b190bb36a INFO: 172.21.0.1:34278 - "POST /node/69fca40555ff273b190bb36a HTTP/1.0" 202 Accepted 2026-05-09 14:39:07,728 - lava_callback - INFO - Starting async job submit for node 69fca40555ff273b190bb36a 2026-05-09 14:39:07,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:39:07,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca40555ff273b190bb36a HTTP/1.1" 200 None 2026-05-09 14:39:07,751 - lava_callback - DEBUG - Processing node 69fca40555ff273b190bb36a: baseline-arm-clabbe 2026-05-09 14:39:07,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca40555ff273b190bb36a 2026-05-09 14:39:07,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:39:07,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca40555ff273b190bb36a HTTP/1.1" 200 None 2026-05-09 14:39:07,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:39:07,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 14:39:07,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:39:07,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca40555ff273b190bb36a HTTP/1.1" 200 None 2026-05-09 14:39:07,802 - lava_callback - ERROR - Error processing callback for node 69fca40555ff273b190bb36a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET /node/67fc5cea9fa3bd529253c492%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:41:07,869 - lava_callback - INFO - Received callback for node 69fca47255ff273b190bb3b1 INFO: 172.21.0.1:60340 - "POST /node/69fca47255ff273b190bb3b1 HTTP/1.0" 202 Accepted 2026-05-09 14:41:07,874 - lava_callback - INFO - Starting async job submit for node 69fca47255ff273b190bb3b1 2026-05-09 14:41:07,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:41:07,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca47255ff273b190bb3b1 HTTP/1.1" 200 None 2026-05-09 14:41:07,890 - lava_callback - DEBUG - Processing node 69fca47255ff273b190bb3b1: baseline-arm-clabbe 2026-05-09 14:41:07,890 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca47255ff273b190bb3b1 2026-05-09 14:41:07,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:41:07,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca47255ff273b190bb3b1 HTTP/1.1" 200 None 2026-05-09 14:41:07,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:41:07,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 14:41:07,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:41:07,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca47255ff273b190bb3b1 HTTP/1.1" 200 None 2026-05-09 14:41:07,934 - lava_callback - ERROR - Error processing callback for node 69fca47255ff273b190bb3b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36982 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:41:44,087 - lava_callback - INFO - Received callback for node 69fca49255ff273b190bb3bb INFO: 172.21.0.1:57616 - "POST /node/69fca49255ff273b190bb3bb HTTP/1.0" 202 Accepted 2026-05-09 14:41:44,092 - lava_callback - INFO - Starting async job submit for node 69fca49255ff273b190bb3bb 2026-05-09 14:41:44,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:41:44,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca49255ff273b190bb3bb HTTP/1.1" 200 None 2026-05-09 14:41:44,106 - lava_callback - DEBUG - Processing node 69fca49255ff273b190bb3bb: baseline-arm-baylibre 2026-05-09 14:41:44,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca49255ff273b190bb3bb 2026-05-09 14:41:44,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:41:44,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca49255ff273b190bb3bb HTTP/1.1" 200 None 2026-05-09 14:41:44,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:41:44,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 14:41:44,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:41:44,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca49255ff273b190bb3bb HTTP/1.1" 200 None 2026-05-09 14:41:44,153 - lava_callback - ERROR - Error processing callback for node 69fca49255ff273b190bb3bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:42:07,910 - lava_callback - INFO - Received callback for node 69fca4bb55ff273b190bb3c9 INFO: 172.21.0.1:34794 - "POST /node/69fca4bb55ff273b190bb3c9 HTTP/1.0" 202 Accepted 2026-05-09 14:42:07,920 - lava_callback - INFO - Starting async job submit for node 69fca4bb55ff273b190bb3c9 2026-05-09 14:42:07,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:42:07,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca4bb55ff273b190bb3c9 HTTP/1.1" 200 None 2026-05-09 14:42:07,938 - lava_callback - DEBUG - Processing node 69fca4bb55ff273b190bb3c9: baseline-arm-clabbe 2026-05-09 14:42:07,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca4bb55ff273b190bb3c9 2026-05-09 14:42:07,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:42:07,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca4bb55ff273b190bb3c9 HTTP/1.1" 200 None 2026-05-09 14:42:07,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:42:07,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 14:42:07,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:42:07,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca4bb55ff273b190bb3c9 HTTP/1.1" 200 None 2026-05-09 14:42:07,987 - lava_callback - ERROR - Error processing callback for node 69fca4bb55ff273b190bb3c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:42:43,877 - lava_callback - INFO - Received callback for node 69fca4dc55ff273b190bb3d3 INFO: 172.21.0.1:47948 - "POST /node/69fca4dc55ff273b190bb3d3 HTTP/1.0" 202 Accepted 2026-05-09 14:42:43,883 - lava_callback - INFO - Starting async job submit for node 69fca4dc55ff273b190bb3d3 2026-05-09 14:42:43,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:42:43,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca4dc55ff273b190bb3d3 HTTP/1.1" 200 None 2026-05-09 14:42:43,899 - lava_callback - DEBUG - Processing node 69fca4dc55ff273b190bb3d3: baseline-arm-baylibre 2026-05-09 14:42:43,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca4dc55ff273b190bb3d3 2026-05-09 14:42:43,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:42:43,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca4dc55ff273b190bb3d3 HTTP/1.1" 200 None 2026-05-09 14:42:43,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:42:43,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 14:42:43,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:42:43,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca4dc55ff273b190bb3d3 HTTP/1.1" 200 None 2026-05-09 14:42:43,946 - lava_callback - ERROR - Error processing callback for node 69fca4dc55ff273b190bb3d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59856 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:43:23,937 - lava_callback - INFO - Received callback for node 69fca50155ff273b190bb3df INFO: 172.21.0.1:58542 - "POST /node/69fca50155ff273b190bb3df HTTP/1.0" 202 Accepted 2026-05-09 14:43:23,942 - lava_callback - INFO - Starting async job submit for node 69fca50155ff273b190bb3df 2026-05-09 14:43:23,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:43:23,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca50155ff273b190bb3df HTTP/1.1" 200 None 2026-05-09 14:43:23,963 - lava_callback - DEBUG - Processing node 69fca50155ff273b190bb3df: baseline-arm-baylibre 2026-05-09 14:43:23,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca50155ff273b190bb3df 2026-05-09 14:43:23,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:43:23,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca50155ff273b190bb3df HTTP/1.1" 200 None 2026-05-09 14:43:23,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:43:23,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 14:43:23,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:43:24,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca50155ff273b190bb3df HTTP/1.1" 200 None 2026-05-09 14:43:24,017 - lava_callback - ERROR - Error processing callback for node 69fca50155ff273b190bb3df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39130 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:44:03,921 - lava_callback - INFO - Received callback for node 69fca52755ff273b190bb3eb INFO: 172.21.0.1:38132 - "POST /node/69fca52755ff273b190bb3eb HTTP/1.0" 202 Accepted 2026-05-09 14:44:03,927 - lava_callback - INFO - Starting async job submit for node 69fca52755ff273b190bb3eb 2026-05-09 14:44:03,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:44:03,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca52755ff273b190bb3eb HTTP/1.1" 200 None 2026-05-09 14:44:03,941 - lava_callback - DEBUG - Processing node 69fca52755ff273b190bb3eb: baseline-arm-baylibre 2026-05-09 14:44:03,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca52755ff273b190bb3eb 2026-05-09 14:44:03,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:44:03,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca52755ff273b190bb3eb HTTP/1.1" 200 None 2026-05-09 14:44:03,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:44:03,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 14:44:03,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:44:04,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca52755ff273b190bb3eb HTTP/1.1" 200 None 2026-05-09 14:44:04,007 - lava_callback - ERROR - Error processing callback for node 69fca52755ff273b190bb3eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:44:43,976 - lava_callback - INFO - Received callback for node 69fca54e55ff273b190bb3f7 INFO: 172.21.0.1:43292 - "POST /node/69fca54e55ff273b190bb3f7 HTTP/1.0" 202 Accepted 2026-05-09 14:44:43,982 - lava_callback - INFO - Starting async job submit for node 69fca54e55ff273b190bb3f7 2026-05-09 14:44:43,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:44:43,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca54e55ff273b190bb3f7 HTTP/1.1" 200 None 2026-05-09 14:44:43,998 - lava_callback - DEBUG - Processing node 69fca54e55ff273b190bb3f7: baseline-arm-baylibre 2026-05-09 14:44:43,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca54e55ff273b190bb3f7 2026-05-09 14:44:43,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:44:44,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca54e55ff273b190bb3f7 HTTP/1.1" 200 None 2026-05-09 14:44:44,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:44:44,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 14:44:44,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:44:44,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca54e55ff273b190bb3f7 HTTP/1.1" 200 None 2026-05-09 14:44:44,043 - lava_callback - ERROR - Error processing callback for node 69fca54e55ff273b190bb3f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:45:24,012 - lava_callback - INFO - Received callback for node 69fca57655ff273b190bb407 INFO: 172.21.0.1:54852 - "POST /node/69fca57655ff273b190bb407 HTTP/1.0" 202 Accepted 2026-05-09 14:45:24,017 - lava_callback - INFO - Starting async job submit for node 69fca57655ff273b190bb407 2026-05-09 14:45:24,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:45:24,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca57655ff273b190bb407 HTTP/1.1" 200 None 2026-05-09 14:45:24,033 - lava_callback - DEBUG - Processing node 69fca57655ff273b190bb407: baseline-arm-baylibre 2026-05-09 14:45:24,033 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca57655ff273b190bb407 2026-05-09 14:45:24,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:45:24,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca57655ff273b190bb407 HTTP/1.1" 200 None 2026-05-09 14:45:24,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:45:24,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 14:45:24,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:45:24,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca57655ff273b190bb407 HTTP/1.1" 200 None 2026-05-09 14:45:24,082 - lava_callback - ERROR - Error processing callback for node 69fca57655ff273b190bb407: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:47:08,309 - lava_callback - INFO - Received callback for node 69fca5e555ff273b190bb42c INFO: 172.21.0.1:57422 - "POST /node/69fca5e555ff273b190bb42c HTTP/1.0" 202 Accepted 2026-05-09 14:47:08,317 - lava_callback - INFO - Starting async job submit for node 69fca5e555ff273b190bb42c 2026-05-09 14:47:08,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:47:08,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca5e555ff273b190bb42c HTTP/1.1" 200 None 2026-05-09 14:47:08,335 - lava_callback - DEBUG - Processing node 69fca5e555ff273b190bb42c: baseline-arm-clabbe 2026-05-09 14:47:08,335 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca5e555ff273b190bb42c 2026-05-09 14:47:08,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:47:08,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca5e555ff273b190bb42c HTTP/1.1" 200 None 2026-05-09 14:47:08,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:47:08,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 14:47:08,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:47:08,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca5e555ff273b190bb42c HTTP/1.1" 200 None 2026-05-09 14:47:08,403 - lava_callback - ERROR - Error processing callback for node 69fca5e555ff273b190bb42c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59588 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:47:48,073 - lava_callback - INFO - Received callback for node 69fca60b55ff273b190bb43a INFO: 172.21.0.1:59598 - "POST /node/69fca60b55ff273b190bb43a HTTP/1.0" 202 Accepted 2026-05-09 14:47:48,078 - lava_callback - INFO - Starting async job submit for node 69fca60b55ff273b190bb43a 2026-05-09 14:47:48,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:47:48,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca60b55ff273b190bb43a HTTP/1.1" 200 None 2026-05-09 14:47:48,101 - lava_callback - DEBUG - Processing node 69fca60b55ff273b190bb43a: baseline-arm-clabbe 2026-05-09 14:47:48,101 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca60b55ff273b190bb43a 2026-05-09 14:47:48,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:47:48,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca60b55ff273b190bb43a HTTP/1.1" 200 None 2026-05-09 14:47:48,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:47:48,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 14:47:48,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:47:48,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca60b55ff273b190bb43a HTTP/1.1" 200 None 2026-05-09 14:47:48,151 - lava_callback - ERROR - Error processing callback for node 69fca60b55ff273b190bb43a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:48:28,151 - lava_callback - INFO - Received callback for node 69fca63155ff273b190bb44a INFO: 172.21.0.1:48568 - "POST /node/69fca63155ff273b190bb44a HTTP/1.0" 202 Accepted 2026-05-09 14:48:28,157 - lava_callback - INFO - Starting async job submit for node 69fca63155ff273b190bb44a 2026-05-09 14:48:28,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:48:28,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca63155ff273b190bb44a HTTP/1.1" 200 None 2026-05-09 14:48:28,174 - lava_callback - DEBUG - Processing node 69fca63155ff273b190bb44a: baseline-arm-clabbe 2026-05-09 14:48:28,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca63155ff273b190bb44a 2026-05-09 14:48:28,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:48:28,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca63155ff273b190bb44a HTTP/1.1" 200 None 2026-05-09 14:48:28,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:48:28,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 14:48:28,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:48:28,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca63155ff273b190bb44a HTTP/1.1" 200 None 2026-05-09 14:48:28,226 - lava_callback - ERROR - Error processing callback for node 69fca63155ff273b190bb44a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:49:08,139 - lava_callback - INFO - Received callback for node 69fca65855ff273b190bb459 INFO: 172.21.0.1:50530 - "POST /node/69fca65855ff273b190bb459 HTTP/1.0" 202 Accepted 2026-05-09 14:49:08,144 - lava_callback - INFO - Starting async job submit for node 69fca65855ff273b190bb459 2026-05-09 14:49:08,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:49:08,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca65855ff273b190bb459 HTTP/1.1" 200 None 2026-05-09 14:49:08,168 - lava_callback - DEBUG - Processing node 69fca65855ff273b190bb459: baseline-arm-clabbe 2026-05-09 14:49:08,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca65855ff273b190bb459 2026-05-09 14:49:08,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:49:08,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca65855ff273b190bb459 HTTP/1.1" 200 None 2026-05-09 14:49:08,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:49:08,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 14:49:08,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:49:08,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca65855ff273b190bb459 HTTP/1.1" 200 None 2026-05-09 14:49:08,222 - lava_callback - ERROR - Error processing callback for node 69fca65855ff273b190bb459: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:49:48,227 - lava_callback - INFO - Received callback for node 69fca67d55ff273b190bb467 INFO: 172.21.0.1:50644 - "POST /node/69fca67d55ff273b190bb467 HTTP/1.0" 202 Accepted 2026-05-09 14:49:48,233 - lava_callback - INFO - Starting async job submit for node 69fca67d55ff273b190bb467 2026-05-09 14:49:48,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:49:48,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca67d55ff273b190bb467 HTTP/1.1" 200 None 2026-05-09 14:49:48,248 - lava_callback - DEBUG - Processing node 69fca67d55ff273b190bb467: baseline-arm-clabbe 2026-05-09 14:49:48,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca67d55ff273b190bb467 2026-05-09 14:49:48,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:49:48,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca67d55ff273b190bb467 HTTP/1.1" 200 None 2026-05-09 14:49:48,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:49:48,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 14:49:48,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:49:48,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca67d55ff273b190bb467 HTTP/1.1" 200 None 2026-05-09 14:49:48,300 - lava_callback - ERROR - Error processing callback for node 69fca67d55ff273b190bb467: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:50:28,209 - lava_callback - INFO - Received callback for node 69fca6a355ff273b190bb475 INFO: 172.21.0.1:42274 - "POST /node/69fca6a355ff273b190bb475 HTTP/1.0" 202 Accepted 2026-05-09 14:50:28,215 - lava_callback - INFO - Starting async job submit for node 69fca6a355ff273b190bb475 2026-05-09 14:50:28,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:50:28,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca6a355ff273b190bb475 HTTP/1.1" 200 None 2026-05-09 14:50:28,233 - lava_callback - DEBUG - Processing node 69fca6a355ff273b190bb475: baseline-arm-clabbe 2026-05-09 14:50:28,233 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca6a355ff273b190bb475 2026-05-09 14:50:28,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:50:28,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca6a355ff273b190bb475 HTTP/1.1" 200 None 2026-05-09 14:50:28,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:50:28,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-09 14:50:28,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:50:28,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca6a355ff273b190bb475 HTTP/1.1" 200 None 2026-05-09 14:50:28,283 - lava_callback - ERROR - Error processing callback for node 69fca6a355ff273b190bb475: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:51:08,406 - lava_callback - INFO - Received callback for node 69fca6c855ff273b190bb481 INFO: 172.21.0.1:56554 - "POST /node/69fca6c855ff273b190bb481 HTTP/1.0" 202 Accepted 2026-05-09 14:51:08,411 - lava_callback - INFO - Starting async job submit for node 69fca6c855ff273b190bb481 2026-05-09 14:51:08,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:51:08,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca6c855ff273b190bb481 HTTP/1.1" 200 None 2026-05-09 14:51:08,425 - lava_callback - DEBUG - Processing node 69fca6c855ff273b190bb481: baseline-arm-clabbe 2026-05-09 14:51:08,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca6c855ff273b190bb481 2026-05-09 14:51:08,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:51:08,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca6c855ff273b190bb481 HTTP/1.1" 200 None 2026-05-09 14:51:08,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:51:08,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 14:51:08,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:51:08,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca6c855ff273b190bb481 HTTP/1.1" 200 None 2026-05-09 14:51:08,497 - lava_callback - ERROR - Error processing callback for node 69fca6c855ff273b190bb481: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40338 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:51:24,390 - lava_callback - INFO - Received callback for node 69fca6e855ff273b190bb490 INFO: 172.21.0.1:51036 - "POST /node/69fca6e855ff273b190bb490 HTTP/1.0" 202 Accepted 2026-05-09 14:51:24,396 - lava_callback - INFO - Starting async job submit for node 69fca6e855ff273b190bb490 2026-05-09 14:51:24,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:51:24,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca6e855ff273b190bb490 HTTP/1.1" 200 None 2026-05-09 14:51:24,412 - lava_callback - DEBUG - Processing node 69fca6e855ff273b190bb490: baseline-arm-baylibre 2026-05-09 14:51:24,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca6e855ff273b190bb490 2026-05-09 14:51:24,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:51:24,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca6e855ff273b190bb490 HTTP/1.1" 200 None 2026-05-09 14:51:24,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:51:24,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 14:51:24,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:51:24,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca6e855ff273b190bb490 HTTP/1.1" 200 None 2026-05-09 14:51:24,462 - lava_callback - ERROR - Error processing callback for node 69fca6e855ff273b190bb490: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34074 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:52:04,363 - lava_callback - INFO - Received callback for node 69fca70c55ff273b190bb4a2 INFO: 172.21.0.1:56676 - "POST /node/69fca70c55ff273b190bb4a2 HTTP/1.0" 202 Accepted 2026-05-09 14:52:04,369 - lava_callback - INFO - Starting async job submit for node 69fca70c55ff273b190bb4a2 2026-05-09 14:52:04,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:52:04,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca70c55ff273b190bb4a2 HTTP/1.1" 200 None 2026-05-09 14:52:04,391 - lava_callback - DEBUG - Processing node 69fca70c55ff273b190bb4a2: baseline-arm-baylibre 2026-05-09 14:52:04,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca70c55ff273b190bb4a2 2026-05-09 14:52:04,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:52:04,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca70c55ff273b190bb4a2 HTTP/1.1" 200 None 2026-05-09 14:52:04,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:52:04,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 14:52:04,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:52:04,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca70c55ff273b190bb4a2 HTTP/1.1" 200 None 2026-05-09 14:52:04,440 - lava_callback - ERROR - Error processing callback for node 69fca70c55ff273b190bb4a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:52:44,444 - lava_callback - INFO - Received callback for node 69fca73255ff273b190bb4b0 INFO: 172.21.0.1:59926 - "POST /node/69fca73255ff273b190bb4b0 HTTP/1.0" 202 Accepted 2026-05-09 14:52:44,450 - lava_callback - INFO - Starting async job submit for node 69fca73255ff273b190bb4b0 2026-05-09 14:52:44,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:52:44,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca73255ff273b190bb4b0 HTTP/1.1" 200 None 2026-05-09 14:52:44,464 - lava_callback - DEBUG - Processing node 69fca73255ff273b190bb4b0: baseline-arm-baylibre 2026-05-09 14:52:44,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca73255ff273b190bb4b0 2026-05-09 14:52:44,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:52:44,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca73255ff273b190bb4b0 HTTP/1.1" 200 None 2026-05-09 14:52:44,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:52:44,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 14:52:44,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:52:44,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca73255ff273b190bb4b0 HTTP/1.1" 200 None 2026-05-09 14:52:44,510 - lava_callback - ERROR - Error processing callback for node 69fca73255ff273b190bb4b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:53:24,433 - lava_callback - INFO - Received callback for node 69fca75655ff273b190bb4be INFO: 172.21.0.1:52754 - "POST /node/69fca75655ff273b190bb4be HTTP/1.0" 202 Accepted 2026-05-09 14:53:24,440 - lava_callback - INFO - Starting async job submit for node 69fca75655ff273b190bb4be 2026-05-09 14:53:24,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:53:24,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca75655ff273b190bb4be HTTP/1.1" 200 None 2026-05-09 14:53:24,455 - lava_callback - DEBUG - Processing node 69fca75655ff273b190bb4be: baseline-arm-baylibre 2026-05-09 14:53:24,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca75655ff273b190bb4be 2026-05-09 14:53:24,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:53:24,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca75655ff273b190bb4be HTTP/1.1" 200 None 2026-05-09 14:53:24,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:53:24,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 14:53:24,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:53:24,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca75655ff273b190bb4be HTTP/1.1" 200 None 2026-05-09 14:53:24,509 - lava_callback - ERROR - Error processing callback for node 69fca75655ff273b190bb4be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60162 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:54:04,585 - lava_callback - INFO - Received callback for node 69fca77e55ff273b190bb4cd INFO: 172.21.0.1:39514 - "POST /node/69fca77e55ff273b190bb4cd HTTP/1.0" 202 Accepted 2026-05-09 14:54:04,590 - lava_callback - INFO - Starting async job submit for node 69fca77e55ff273b190bb4cd 2026-05-09 14:54:04,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:54:04,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca77e55ff273b190bb4cd HTTP/1.1" 200 None 2026-05-09 14:54:04,605 - lava_callback - DEBUG - Processing node 69fca77e55ff273b190bb4cd: baseline-arm-baylibre 2026-05-09 14:54:04,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca77e55ff273b190bb4cd 2026-05-09 14:54:04,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:54:04,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca77e55ff273b190bb4cd HTTP/1.1" 200 None 2026-05-09 14:54:04,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:54:04,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 14:54:04,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:54:04,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca77e55ff273b190bb4cd HTTP/1.1" 200 None 2026-05-09 14:54:04,651 - lava_callback - ERROR - Error processing callback for node 69fca77e55ff273b190bb4cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:54:48,438 - lava_callback - INFO - Received callback for node 69fca7a655ff273b190bb4dd INFO: 172.21.0.1:33306 - "POST /node/69fca7a655ff273b190bb4dd HTTP/1.0" 202 Accepted 2026-05-09 14:54:48,444 - lava_callback - INFO - Starting async job submit for node 69fca7a655ff273b190bb4dd 2026-05-09 14:54:48,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:54:48,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca7a655ff273b190bb4dd HTTP/1.1" 200 None 2026-05-09 14:54:48,459 - lava_callback - DEBUG - Processing node 69fca7a655ff273b190bb4dd: baseline-arm-clabbe 2026-05-09 14:54:48,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca7a655ff273b190bb4dd 2026-05-09 14:54:48,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:54:48,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca7a655ff273b190bb4dd HTTP/1.1" 200 None 2026-05-09 14:54:48,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:54:48,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 14:54:48,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:54:48,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca7a655ff273b190bb4dd HTTP/1.1" 200 None 2026-05-09 14:54:48,504 - lava_callback - ERROR - Error processing callback for node 69fca7a655ff273b190bb4dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48698 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:55:24,563 - lava_callback - INFO - Received callback for node 69fca7ca55ff273b190bb4f3 INFO: 172.21.0.1:38844 - "POST /node/69fca7ca55ff273b190bb4f3 HTTP/1.0" 202 Accepted 2026-05-09 14:55:24,568 - lava_callback - INFO - Starting async job submit for node 69fca7ca55ff273b190bb4f3 2026-05-09 14:55:24,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:55:24,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca7ca55ff273b190bb4f3 HTTP/1.1" 200 None 2026-05-09 14:55:24,583 - lava_callback - DEBUG - Processing node 69fca7ca55ff273b190bb4f3: baseline-arm-baylibre 2026-05-09 14:55:24,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca7ca55ff273b190bb4f3 2026-05-09 14:55:24,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:55:24,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca7ca55ff273b190bb4f3 HTTP/1.1" 200 None 2026-05-09 14:55:24,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:55:24,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 14:55:24,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:55:24,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca7ca55ff273b190bb4f3 HTTP/1.1" 200 None 2026-05-09 14:55:24,640 - lava_callback - ERROR - Error processing callback for node 69fca7ca55ff273b190bb4f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:55:44,552 - lava_callback - INFO - Received callback for node 69fca7eb55ff273b190bb501 INFO: 172.21.0.1:37786 - "POST /node/69fca7eb55ff273b190bb501 HTTP/1.0" 202 Accepted 2026-05-09 14:55:44,557 - lava_callback - INFO - Starting async job submit for node 69fca7eb55ff273b190bb501 2026-05-09 14:55:44,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:55:44,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca7eb55ff273b190bb501 HTTP/1.1" 200 None 2026-05-09 14:55:44,572 - lava_callback - DEBUG - Processing node 69fca7eb55ff273b190bb501: baseline-arm-baylibre 2026-05-09 14:55:44,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca7eb55ff273b190bb501 2026-05-09 14:55:44,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:55:44,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca7eb55ff273b190bb501 HTTP/1.1" 200 None 2026-05-09 14:55:44,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:55:44,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 14:55:44,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:55:44,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca7eb55ff273b190bb501 HTTP/1.1" 200 None 2026-05-09 14:55:44,624 - lava_callback - ERROR - Error processing callback for node 69fca7eb55ff273b190bb501: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41678 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:57:08,547 - lava_callback - INFO - Received callback for node 69fca83655ff273b190bb521 INFO: 172.21.0.1:41688 - "POST /node/69fca83655ff273b190bb521 HTTP/1.0" 202 Accepted 2026-05-09 14:57:08,553 - lava_callback - INFO - Starting async job submit for node 69fca83655ff273b190bb521 2026-05-09 14:57:08,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:57:08,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca83655ff273b190bb521 HTTP/1.1" 200 None 2026-05-09 14:57:08,571 - lava_callback - DEBUG - Processing node 69fca83655ff273b190bb521: baseline-arm-clabbe 2026-05-09 14:57:08,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca83655ff273b190bb521 2026-05-09 14:57:08,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:57:08,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca83655ff273b190bb521 HTTP/1.1" 200 None 2026-05-09 14:57:08,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:57:08,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 14:57:08,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:57:08,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca83655ff273b190bb521 HTTP/1.1" 200 None 2026-05-09 14:57:08,616 - lava_callback - ERROR - Error processing callback for node 69fca83655ff273b190bb521: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK 2026-05-09 14:58:48,573 - lava_callback - INFO - Received callback for node 69fca8a055ff273b190bb54e INFO: 172.21.0.1:52882 - "POST /node/69fca8a055ff273b190bb54e HTTP/1.0" 202 Accepted 2026-05-09 14:58:48,578 - lava_callback - INFO - Starting async job submit for node 69fca8a055ff273b190bb54e 2026-05-09 14:58:48,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:58:48,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca8a055ff273b190bb54e HTTP/1.1" 200 None 2026-05-09 14:58:48,593 - lava_callback - DEBUG - Processing node 69fca8a055ff273b190bb54e: baseline-arm-clabbe 2026-05-09 14:58:48,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca8a055ff273b190bb54e 2026-05-09 14:58:48,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:58:48,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca8a055ff273b190bb54e HTTP/1.1" 200 None 2026-05-09 14:58:48,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:58:48,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 14:58:48,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 14:58:48,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca8a055ff273b190bb54e HTTP/1.1" 200 None 2026-05-09 14:58:48,639 - lava_callback - ERROR - Error processing callback for node 69fca8a055ff273b190bb54e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43092 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:00:08,889 - lava_callback - INFO - Received callback for node 69fca8e855ff273b190bb56d INFO: 172.21.0.1:43102 - "POST /node/69fca8e855ff273b190bb56d HTTP/1.0" 202 Accepted 2026-05-09 15:00:08,895 - lava_callback - INFO - Starting async job submit for node 69fca8e855ff273b190bb56d 2026-05-09 15:00:08,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:00:08,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca8e855ff273b190bb56d HTTP/1.1" 200 None 2026-05-09 15:00:08,911 - lava_callback - DEBUG - Processing node 69fca8e855ff273b190bb56d: baseline-arm-clabbe 2026-05-09 15:00:08,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca8e855ff273b190bb56d 2026-05-09 15:00:08,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:00:08,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca8e855ff273b190bb56d HTTP/1.1" 200 None 2026-05-09 15:00:08,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:00:08,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 15:00:08,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:00:08,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca8e855ff273b190bb56d HTTP/1.1" 200 None 2026-05-09 15:00:08,957 - lava_callback - ERROR - Error processing callback for node 69fca8e855ff273b190bb56d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:00:48,632 - lava_callback - INFO - Received callback for node 69fca90d55ff273b190bb581 INFO: 172.21.0.1:60330 - "POST /node/69fca90d55ff273b190bb581 HTTP/1.0" 202 Accepted 2026-05-09 15:00:48,637 - lava_callback - INFO - Starting async job submit for node 69fca90d55ff273b190bb581 2026-05-09 15:00:48,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:00:48,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca90d55ff273b190bb581 HTTP/1.1" 200 None 2026-05-09 15:00:48,653 - lava_callback - DEBUG - Processing node 69fca90d55ff273b190bb581: baseline-arm-clabbe 2026-05-09 15:00:48,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca90d55ff273b190bb581 2026-05-09 15:00:48,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:00:48,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca90d55ff273b190bb581 HTTP/1.1" 200 None 2026-05-09 15:00:48,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:00:48,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 15:00:48,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:00:48,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca90d55ff273b190bb581 HTTP/1.1" 200 None 2026-05-09 15:00:48,700 - lava_callback - ERROR - Error processing callback for node 69fca90d55ff273b190bb581: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54112 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:01:48,665 - lava_callback - INFO - Received callback for node 69fca95555ff273b190bb5a2 INFO: 172.21.0.1:54128 - "POST /node/69fca95555ff273b190bb5a2 HTTP/1.0" 202 Accepted 2026-05-09 15:01:48,671 - lava_callback - INFO - Starting async job submit for node 69fca95555ff273b190bb5a2 2026-05-09 15:01:48,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:01:48,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca95555ff273b190bb5a2 HTTP/1.1" 200 None 2026-05-09 15:01:48,692 - lava_callback - DEBUG - Processing node 69fca95555ff273b190bb5a2: baseline-arm-clabbe 2026-05-09 15:01:48,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca95555ff273b190bb5a2 2026-05-09 15:01:48,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:01:48,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca95555ff273b190bb5a2 HTTP/1.1" 200 None 2026-05-09 15:01:48,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:01:48,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 15:01:48,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:01:48,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca95555ff273b190bb5a2 HTTP/1.1" 200 None 2026-05-09 15:01:48,737 - lava_callback - ERROR - Error processing callback for node 69fca95555ff273b190bb5a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:02:28,665 - lava_callback - INFO - Received callback for node 69fca97a55ff273b190bb5b5 INFO: 172.21.0.1:41064 - "POST /node/69fca97a55ff273b190bb5b5 HTTP/1.0" 202 Accepted 2026-05-09 15:02:28,671 - lava_callback - INFO - Starting async job submit for node 69fca97a55ff273b190bb5b5 2026-05-09 15:02:28,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:02:28,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca97a55ff273b190bb5b5 HTTP/1.1" 200 None 2026-05-09 15:02:28,686 - lava_callback - DEBUG - Processing node 69fca97a55ff273b190bb5b5: baseline-arm-clabbe 2026-05-09 15:02:28,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca97a55ff273b190bb5b5 2026-05-09 15:02:28,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:02:28,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca97a55ff273b190bb5b5 HTTP/1.1" 200 None 2026-05-09 15:02:28,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:02:28,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 15:02:28,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:02:28,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca97a55ff273b190bb5b5 HTTP/1.1" 200 None 2026-05-09 15:02:28,738 - lava_callback - ERROR - Error processing callback for node 69fca97a55ff273b190bb5b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:03:08,728 - lava_callback - INFO - Received callback for node 69fca99e55ff273b190bb5ca INFO: 172.21.0.1:44352 - "POST /node/69fca99e55ff273b190bb5ca HTTP/1.0" 202 Accepted 2026-05-09 15:03:08,734 - lava_callback - INFO - Starting async job submit for node 69fca99e55ff273b190bb5ca 2026-05-09 15:03:08,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:03:08,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca99e55ff273b190bb5ca HTTP/1.1" 200 None 2026-05-09 15:03:08,750 - lava_callback - DEBUG - Processing node 69fca99e55ff273b190bb5ca: baseline-arm-clabbe 2026-05-09 15:03:08,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca99e55ff273b190bb5ca 2026-05-09 15:03:08,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:03:08,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca99e55ff273b190bb5ca HTTP/1.1" 200 None 2026-05-09 15:03:08,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:03:08,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 15:03:08,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:03:08,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca99e55ff273b190bb5ca HTTP/1.1" 200 None 2026-05-09 15:03:08,802 - lava_callback - ERROR - Error processing callback for node 69fca99e55ff273b190bb5ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40296 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:03:48,682 - lava_callback - INFO - Received callback for node 69fca9c355ff273b190bb5da INFO: 172.21.0.1:40298 - "POST /node/69fca9c355ff273b190bb5da HTTP/1.0" 202 Accepted 2026-05-09 15:03:48,691 - lava_callback - INFO - Starting async job submit for node 69fca9c355ff273b190bb5da 2026-05-09 15:03:48,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:03:48,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca9c355ff273b190bb5da HTTP/1.1" 200 None 2026-05-09 15:03:48,707 - lava_callback - DEBUG - Processing node 69fca9c355ff273b190bb5da: baseline-arm-clabbe 2026-05-09 15:03:48,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca9c355ff273b190bb5da 2026-05-09 15:03:48,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:03:48,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca9c355ff273b190bb5da HTTP/1.1" 200 None 2026-05-09 15:03:48,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:03:48,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 15:03:48,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:03:48,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca9c355ff273b190bb5da HTTP/1.1" 200 None 2026-05-09 15:03:48,752 - lava_callback - ERROR - Error processing callback for node 69fca9c355ff273b190bb5da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55688 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:04:28,753 - lava_callback - INFO - Received callback for node 69fca9e955ff273b190bb5ee INFO: 172.21.0.1:55696 - "POST /node/69fca9e955ff273b190bb5ee HTTP/1.0" 202 Accepted 2026-05-09 15:04:28,762 - lava_callback - INFO - Starting async job submit for node 69fca9e955ff273b190bb5ee 2026-05-09 15:04:28,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:04:28,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca9e955ff273b190bb5ee HTTP/1.1" 200 None 2026-05-09 15:04:28,778 - lava_callback - DEBUG - Processing node 69fca9e955ff273b190bb5ee: baseline-arm-clabbe 2026-05-09 15:04:28,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fca9e955ff273b190bb5ee 2026-05-09 15:04:28,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:04:28,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fca9e955ff273b190bb5ee HTTP/1.1" 200 None 2026-05-09 15:04:28,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:04:28,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 15:04:28,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:04:28,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fca9e955ff273b190bb5ee HTTP/1.1" 200 None 2026-05-09 15:04:28,847 - lava_callback - ERROR - Error processing callback for node 69fca9e955ff273b190bb5ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:04:48,748 - lava_callback - INFO - Received callback for node 69fcaa0d55ff273b190bb5fc INFO: 172.21.0.1:37708 - "POST /node/69fcaa0d55ff273b190bb5fc HTTP/1.0" 202 Accepted 2026-05-09 15:04:48,755 - lava_callback - INFO - Starting async job submit for node 69fcaa0d55ff273b190bb5fc 2026-05-09 15:04:48,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:04:48,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaa0d55ff273b190bb5fc HTTP/1.1" 200 None 2026-05-09 15:04:48,771 - lava_callback - DEBUG - Processing node 69fcaa0d55ff273b190bb5fc: baseline-arm-clabbe 2026-05-09 15:04:48,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcaa0d55ff273b190bb5fc 2026-05-09 15:04:48,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:04:48,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaa0d55ff273b190bb5fc HTTP/1.1" 200 None 2026-05-09 15:04:48,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:04:48,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 15:04:48,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:04:48,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcaa0d55ff273b190bb5fc HTTP/1.1" 200 None 2026-05-09 15:04:48,826 - lava_callback - ERROR - Error processing callback for node 69fcaa0d55ff273b190bb5fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:05:28,809 - lava_callback - INFO - Received callback for node 69fcaa3255ff273b190bb611 INFO: 172.21.0.1:46568 - "POST /node/69fcaa3255ff273b190bb611 HTTP/1.0" 202 Accepted 2026-05-09 15:05:28,815 - lava_callback - INFO - Starting async job submit for node 69fcaa3255ff273b190bb611 2026-05-09 15:05:28,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:05:28,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaa3255ff273b190bb611 HTTP/1.1" 200 None 2026-05-09 15:05:28,830 - lava_callback - DEBUG - Processing node 69fcaa3255ff273b190bb611: baseline-arm-clabbe 2026-05-09 15:05:28,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcaa3255ff273b190bb611 2026-05-09 15:05:28,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:05:28,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaa3255ff273b190bb611 HTTP/1.1" 200 None 2026-05-09 15:05:28,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:05:28,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 15:05:28,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:05:28,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcaa3255ff273b190bb611 HTTP/1.1" 200 None 2026-05-09 15:05:28,876 - lava_callback - ERROR - Error processing callback for node 69fcaa3255ff273b190bb611: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:06:08,768 - lava_callback - INFO - Received callback for node 69fcaa5855ff273b190bb624 INFO: 172.21.0.1:47218 - "POST /node/69fcaa5855ff273b190bb624 HTTP/1.0" 202 Accepted 2026-05-09 15:06:08,773 - lava_callback - INFO - Starting async job submit for node 69fcaa5855ff273b190bb624 2026-05-09 15:06:08,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:06:08,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaa5855ff273b190bb624 HTTP/1.1" 200 None 2026-05-09 15:06:08,789 - lava_callback - DEBUG - Processing node 69fcaa5855ff273b190bb624: baseline-arm-clabbe 2026-05-09 15:06:08,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcaa5855ff273b190bb624 2026-05-09 15:06:08,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:06:08,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaa5855ff273b190bb624 HTTP/1.1" 200 None 2026-05-09 15:06:08,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:06:08,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 15:06:08,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:06:08,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcaa5855ff273b190bb624 HTTP/1.1" 200 None 2026-05-09 15:06:08,842 - lava_callback - ERROR - Error processing callback for node 69fcaa5855ff273b190bb624: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:06:48,979 - lava_callback - INFO - Received callback for node 69fcaa7c55ff273b190bb63c INFO: 172.21.0.1:56040 - "POST /node/69fcaa7c55ff273b190bb63c HTTP/1.0" 202 Accepted 2026-05-09 15:06:48,984 - lava_callback - INFO - Starting async job submit for node 69fcaa7c55ff273b190bb63c 2026-05-09 15:06:48,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:06:49,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaa7c55ff273b190bb63c HTTP/1.1" 200 None 2026-05-09 15:06:49,012 - lava_callback - DEBUG - Processing node 69fcaa7c55ff273b190bb63c: baseline-arm-clabbe 2026-05-09 15:06:49,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcaa7c55ff273b190bb63c 2026-05-09 15:06:49,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:06:49,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaa7c55ff273b190bb63c HTTP/1.1" 200 None 2026-05-09 15:06:49,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:06:49,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 15:06:49,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:06:49,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcaa7c55ff273b190bb63c HTTP/1.1" 200 None 2026-05-09 15:06:49,058 - lava_callback - ERROR - Error processing callback for node 69fcaa7c55ff273b190bb63c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET /node/680ed23f72604c9fe55c0385%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:07:28,824 - lava_callback - INFO - Received callback for node 69fcaaa155ff273b190bb646 INFO: 172.21.0.1:60978 - "POST /node/69fcaaa155ff273b190bb646 HTTP/1.0" 202 Accepted 2026-05-09 15:07:28,829 - lava_callback - INFO - Starting async job submit for node 69fcaaa155ff273b190bb646 2026-05-09 15:07:28,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:07:28,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaaa155ff273b190bb646 HTTP/1.1" 200 None 2026-05-09 15:07:28,845 - lava_callback - DEBUG - Processing node 69fcaaa155ff273b190bb646: baseline-arm-clabbe 2026-05-09 15:07:28,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcaaa155ff273b190bb646 2026-05-09 15:07:28,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:07:28,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaaa155ff273b190bb646 HTTP/1.1" 200 None 2026-05-09 15:07:28,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:07:28,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 15:07:28,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:07:28,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcaaa155ff273b190bb646 HTTP/1.1" 200 None 2026-05-09 15:07:28,912 - lava_callback - ERROR - Error processing callback for node 69fcaaa155ff273b190bb646: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39608 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:08:08,878 - lava_callback - INFO - Received callback for node 69fcaac555ff273b190bb656 INFO: 172.21.0.1:39614 - "POST /node/69fcaac555ff273b190bb656 HTTP/1.0" 202 Accepted 2026-05-09 15:08:08,885 - lava_callback - INFO - Starting async job submit for node 69fcaac555ff273b190bb656 2026-05-09 15:08:08,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:08:08,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaac555ff273b190bb656 HTTP/1.1" 200 None 2026-05-09 15:08:08,912 - lava_callback - DEBUG - Processing node 69fcaac555ff273b190bb656: baseline-arm-clabbe 2026-05-09 15:08:08,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcaac555ff273b190bb656 2026-05-09 15:08:08,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:08:08,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaac555ff273b190bb656 HTTP/1.1" 200 None 2026-05-09 15:08:08,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:08:08,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 15:08:08,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:08:08,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcaac555ff273b190bb656 HTTP/1.1" 200 None 2026-05-09 15:08:08,972 - lava_callback - ERROR - Error processing callback for node 69fcaac555ff273b190bb656: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:08:48,882 - lava_callback - INFO - Received callback for node 69fcaaeb55ff273b190bb66b INFO: 172.21.0.1:60380 - "POST /node/69fcaaeb55ff273b190bb66b HTTP/1.0" 202 Accepted 2026-05-09 15:08:48,888 - lava_callback - INFO - Starting async job submit for node 69fcaaeb55ff273b190bb66b 2026-05-09 15:08:48,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:08:48,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaaeb55ff273b190bb66b HTTP/1.1" 200 None 2026-05-09 15:08:48,904 - lava_callback - DEBUG - Processing node 69fcaaeb55ff273b190bb66b: baseline-arm-clabbe 2026-05-09 15:08:48,904 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcaaeb55ff273b190bb66b 2026-05-09 15:08:48,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:08:48,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaaeb55ff273b190bb66b HTTP/1.1" 200 None 2026-05-09 15:08:48,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:08:48,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 15:08:48,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:08:48,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcaaeb55ff273b190bb66b HTTP/1.1" 200 None 2026-05-09 15:08:48,954 - lava_callback - ERROR - Error processing callback for node 69fcaaeb55ff273b190bb66b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:09:08,933 - lava_callback - INFO - Received callback for node 69fcab1055ff273b190bb686 INFO: 172.21.0.1:53218 - "POST /node/69fcab1055ff273b190bb686 HTTP/1.0" 202 Accepted 2026-05-09 15:09:08,939 - lava_callback - INFO - Starting async job submit for node 69fcab1055ff273b190bb686 2026-05-09 15:09:08,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:09:08,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcab1055ff273b190bb686 HTTP/1.1" 200 None 2026-05-09 15:09:08,954 - lava_callback - DEBUG - Processing node 69fcab1055ff273b190bb686: baseline-arm-clabbe 2026-05-09 15:09:08,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcab1055ff273b190bb686 2026-05-09 15:09:08,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:09:08,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcab1055ff273b190bb686 HTTP/1.1" 200 None 2026-05-09 15:09:08,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:09:08,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7bf5b7e826894bd2e59 HTTP/1.1" 200 None 2026-05-09 15:09:08,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:09:09,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcab1055ff273b190bb686 HTTP/1.1" 200 None 2026-05-09 15:09:09,009 - lava_callback - ERROR - Error processing callback for node 69fcab1055ff273b190bb686: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:09:48,929 - lava_callback - INFO - Received callback for node 69fcab3555ff273b190bb691 INFO: 172.21.0.1:40070 - "POST /node/69fcab3555ff273b190bb691 HTTP/1.0" 202 Accepted 2026-05-09 15:09:48,938 - lava_callback - INFO - Starting async job submit for node 69fcab3555ff273b190bb691 2026-05-09 15:09:48,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:09:48,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcab3555ff273b190bb691 HTTP/1.1" 200 None 2026-05-09 15:09:48,955 - lava_callback - DEBUG - Processing node 69fcab3555ff273b190bb691: baseline-arm-clabbe 2026-05-09 15:09:48,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcab3555ff273b190bb691 2026-05-09 15:09:48,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:09:48,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcab3555ff273b190bb691 HTTP/1.1" 200 None 2026-05-09 15:09:48,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:09:48,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 15:09:48,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:09:49,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcab3555ff273b190bb691 HTTP/1.1" 200 None 2026-05-09 15:09:49,008 - lava_callback - ERROR - Error processing callback for node 69fcab3555ff273b190bb691: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33444 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:10:29,012 - lava_callback - INFO - Received callback for node 69fcab5955ff273b190bb6a0 INFO: 172.21.0.1:33454 - "POST /node/69fcab5955ff273b190bb6a0 HTTP/1.0" 202 Accepted 2026-05-09 15:10:29,017 - lava_callback - INFO - Starting async job submit for node 69fcab5955ff273b190bb6a0 2026-05-09 15:10:29,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:10:29,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcab5955ff273b190bb6a0 HTTP/1.1" 200 None 2026-05-09 15:10:29,034 - lava_callback - DEBUG - Processing node 69fcab5955ff273b190bb6a0: baseline-arm-clabbe 2026-05-09 15:10:29,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcab5955ff273b190bb6a0 2026-05-09 15:10:29,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:10:29,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcab5955ff273b190bb6a0 HTTP/1.1" 200 None 2026-05-09 15:10:29,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:10:29,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 15:10:29,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:10:29,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcab5955ff273b190bb6a0 HTTP/1.1" 200 None 2026-05-09 15:10:29,094 - lava_callback - ERROR - Error processing callback for node 69fcab5955ff273b190bb6a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:11:08,926 - lava_callback - INFO - Received callback for node 69fcab7e55ff273b190bb6b5 INFO: 172.21.0.1:48032 - "POST /node/69fcab7e55ff273b190bb6b5 HTTP/1.0" 202 Accepted 2026-05-09 15:11:08,932 - lava_callback - INFO - Starting async job submit for node 69fcab7e55ff273b190bb6b5 2026-05-09 15:11:08,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:11:08,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcab7e55ff273b190bb6b5 HTTP/1.1" 200 None 2026-05-09 15:11:08,946 - lava_callback - DEBUG - Processing node 69fcab7e55ff273b190bb6b5: baseline-arm-clabbe 2026-05-09 15:11:08,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcab7e55ff273b190bb6b5 2026-05-09 15:11:08,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:11:08,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcab7e55ff273b190bb6b5 HTTP/1.1" 200 None 2026-05-09 15:11:08,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:11:08,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 15:11:08,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:11:08,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcab7e55ff273b190bb6b5 HTTP/1.1" 200 None 2026-05-09 15:11:08,993 - lava_callback - ERROR - Error processing callback for node 69fcab7e55ff273b190bb6b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:11:49,007 - lava_callback - INFO - Received callback for node 69fcaba355ff273b190bb6c6 INFO: 172.21.0.1:46642 - "POST /node/69fcaba355ff273b190bb6c6 HTTP/1.0" 202 Accepted 2026-05-09 15:11:49,012 - lava_callback - INFO - Starting async job submit for node 69fcaba355ff273b190bb6c6 2026-05-09 15:11:49,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:11:49,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaba355ff273b190bb6c6 HTTP/1.1" 200 None 2026-05-09 15:11:49,028 - lava_callback - DEBUG - Processing node 69fcaba355ff273b190bb6c6: baseline-arm-clabbe 2026-05-09 15:11:49,028 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcaba355ff273b190bb6c6 2026-05-09 15:11:49,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:11:49,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaba355ff273b190bb6c6 HTTP/1.1" 200 None 2026-05-09 15:11:49,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:11:49,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-09 15:11:49,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:11:49,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcaba355ff273b190bb6c6 HTTP/1.1" 200 None 2026-05-09 15:11:49,087 - lava_callback - ERROR - Error processing callback for node 69fcaba355ff273b190bb6c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50896 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:12:25,520 - lava_callback - INFO - Received callback for node 69fcabd055ff273b190bb6d9 INFO: 172.21.0.1:44852 - "POST /node/69fcabd055ff273b190bb6d9 HTTP/1.0" 202 Accepted 2026-05-09 15:12:25,526 - lava_callback - INFO - Starting async job submit for node 69fcabd055ff273b190bb6d9 2026-05-09 15:12:25,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:12:25,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcabd055ff273b190bb6d9 HTTP/1.1" 200 None 2026-05-09 15:12:25,574 - lava_callback - DEBUG - Processing node 69fcabd055ff273b190bb6d9: baseline-arm64-baylibre 2026-05-09 15:12:25,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcabd055ff273b190bb6d9 2026-05-09 15:12:25,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:12:25,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcabd055ff273b190bb6d9 HTTP/1.1" 200 None 2026-05-09 15:12:25,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:12:25,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:12:25,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:12:25,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcabd055ff273b190bb6d9 HTTP/1.1" 200 None 2026-05-09 15:12:25,661 - lava_callback - ERROR - Error processing callback for node 69fcabd055ff273b190bb6d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55394 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:14:45,578 - lava_callback - INFO - Received callback for node 69fcac5955ff273b190bb6fe INFO: 172.21.0.1:42380 - "POST /node/69fcac5955ff273b190bb6fe HTTP/1.0" 202 Accepted 2026-05-09 15:14:45,584 - lava_callback - INFO - Starting async job submit for node 69fcac5955ff273b190bb6fe 2026-05-09 15:14:45,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:14:45,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcac5955ff273b190bb6fe HTTP/1.1" 200 None 2026-05-09 15:14:45,598 - lava_callback - DEBUG - Processing node 69fcac5955ff273b190bb6fe: baseline-arm64-baylibre 2026-05-09 15:14:45,599 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcac5955ff273b190bb6fe 2026-05-09 15:14:45,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:14:45,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcac5955ff273b190bb6fe HTTP/1.1" 200 None 2026-05-09 15:14:45,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:14:45,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:14:45,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:14:45,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcac5955ff273b190bb6fe HTTP/1.1" 200 None 2026-05-09 15:14:45,645 - lava_callback - ERROR - Error processing callback for node 69fcac5955ff273b190bb6fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55782 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:16:09,201 - lava_callback - INFO - Received callback for node 69fcacaa55ff273b190bb726 INFO: 172.21.0.1:55784 - "POST /node/69fcacaa55ff273b190bb726 HTTP/1.0" 202 Accepted 2026-05-09 15:16:09,207 - lava_callback - INFO - Starting async job submit for node 69fcacaa55ff273b190bb726 2026-05-09 15:16:09,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:16:09,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcacaa55ff273b190bb726 HTTP/1.1" 200 None 2026-05-09 15:16:09,222 - lava_callback - DEBUG - Processing node 69fcacaa55ff273b190bb726: baseline-arm64-clabbe 2026-05-09 15:16:09,223 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcacaa55ff273b190bb726 2026-05-09 15:16:09,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:16:09,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcacaa55ff273b190bb726 HTTP/1.1" 200 None 2026-05-09 15:16:09,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:16:09,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:16:09,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:16:09,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcacaa55ff273b190bb726 HTTP/1.1" 200 None 2026-05-09 15:16:09,275 - lava_callback - ERROR - Error processing callback for node 69fcacaa55ff273b190bb726: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38918 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:18:29,268 - lava_callback - INFO - Received callback for node 69fcad3555ff273b190bb759 INFO: 172.21.0.1:38926 - "POST /node/69fcad3555ff273b190bb759 HTTP/1.0" 202 Accepted 2026-05-09 15:18:29,274 - lava_callback - INFO - Starting async job submit for node 69fcad3555ff273b190bb759 2026-05-09 15:18:29,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:18:29,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcad3555ff273b190bb759 HTTP/1.1" 200 None 2026-05-09 15:18:29,290 - lava_callback - DEBUG - Processing node 69fcad3555ff273b190bb759: baseline-arm64-clabbe 2026-05-09 15:18:29,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcad3555ff273b190bb759 2026-05-09 15:18:29,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:18:29,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcad3555ff273b190bb759 HTTP/1.1" 200 None 2026-05-09 15:18:29,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:18:29,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:18:29,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:18:29,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcad3555ff273b190bb759 HTTP/1.1" 200 None 2026-05-09 15:18:29,348 - lava_callback - ERROR - Error processing callback for node 69fcad3555ff273b190bb759: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:19:49,304 - lava_callback - INFO - Received callback for node 69fcad8355ff273b190bb779 INFO: 172.21.0.1:44142 - "POST /node/69fcad8355ff273b190bb779 HTTP/1.0" 202 Accepted 2026-05-09 15:19:49,310 - lava_callback - INFO - Starting async job submit for node 69fcad8355ff273b190bb779 2026-05-09 15:19:49,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:19:49,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcad8355ff273b190bb779 HTTP/1.1" 200 None 2026-05-09 15:19:49,328 - lava_callback - DEBUG - Processing node 69fcad8355ff273b190bb779: baseline-arm64-clabbe 2026-05-09 15:19:49,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcad8355ff273b190bb779 2026-05-09 15:19:49,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:19:49,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcad8355ff273b190bb779 HTTP/1.1" 200 None 2026-05-09 15:19:49,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:19:49,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:19:49,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:19:49,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcad8355ff273b190bb779 HTTP/1.1" 200 None 2026-05-09 15:19:49,373 - lava_callback - ERROR - Error processing callback for node 69fcad8355ff273b190bb779: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35092 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:21:09,504 - lava_callback - INFO - Received callback for node 69fcadd155ff273b190bb79d INFO: 172.21.0.1:35104 - "POST /node/69fcadd155ff273b190bb79d HTTP/1.0" 202 Accepted 2026-05-09 15:21:09,512 - lava_callback - INFO - Starting async job submit for node 69fcadd155ff273b190bb79d 2026-05-09 15:21:09,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:21:09,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcadd155ff273b190bb79d HTTP/1.1" 200 None 2026-05-09 15:21:09,534 - lava_callback - DEBUG - Processing node 69fcadd155ff273b190bb79d: baseline-arm64-clabbe 2026-05-09 15:21:09,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcadd155ff273b190bb79d 2026-05-09 15:21:09,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:21:09,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcadd155ff273b190bb79d HTTP/1.1" 200 None 2026-05-09 15:21:09,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:21:09,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:21:09,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:21:09,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcadd155ff273b190bb79d HTTP/1.1" 200 None 2026-05-09 15:21:09,591 - lava_callback - ERROR - Error processing callback for node 69fcadd155ff273b190bb79d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:22:09,404 - lava_callback - INFO - Received callback for node 69fcae1c55ff273b190bb7cc INFO: 172.21.0.1:58804 - "POST /node/69fcae1c55ff273b190bb7cc HTTP/1.0" 202 Accepted 2026-05-09 15:22:09,409 - lava_callback - INFO - Starting async job submit for node 69fcae1c55ff273b190bb7cc 2026-05-09 15:22:09,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:22:09,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcae1c55ff273b190bb7cc HTTP/1.1" 200 None 2026-05-09 15:22:09,425 - lava_callback - DEBUG - Processing node 69fcae1c55ff273b190bb7cc: baseline-arm64-clabbe 2026-05-09 15:22:09,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcae1c55ff273b190bb7cc 2026-05-09 15:22:09,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:22:09,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcae1c55ff273b190bb7cc HTTP/1.1" 200 None 2026-05-09 15:22:09,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:22:09,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:22:09,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:22:09,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcae1c55ff273b190bb7cc HTTP/1.1" 200 None 2026-05-09 15:22:09,471 - lava_callback - ERROR - Error processing callback for node 69fcae1c55ff273b190bb7cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:23:26,079 - lava_callback - INFO - Received callback for node 69fcae6355ff273b190bb7e6 INFO: 172.21.0.1:51472 - "POST /node/69fcae6355ff273b190bb7e6 HTTP/1.0" 202 Accepted 2026-05-09 15:23:26,085 - lava_callback - INFO - Starting async job submit for node 69fcae6355ff273b190bb7e6 2026-05-09 15:23:26,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:23:26,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcae6355ff273b190bb7e6 HTTP/1.1" 200 None 2026-05-09 15:23:26,099 - lava_callback - DEBUG - Processing node 69fcae6355ff273b190bb7e6: baseline-arm64-baylibre 2026-05-09 15:23:26,100 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcae6355ff273b190bb7e6 2026-05-09 15:23:26,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:23:26,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcae6355ff273b190bb7e6 HTTP/1.1" 200 None 2026-05-09 15:23:26,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:23:26,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:23:26,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:23:26,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcae6355ff273b190bb7e6 HTTP/1.1" 200 None 2026-05-09 15:23:26,144 - lava_callback - ERROR - Error processing callback for node 69fcae6355ff273b190bb7e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35788 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:24:49,579 - lava_callback - INFO - Received callback for node 69fcaeb255ff273b190bb80e INFO: 172.21.0.1:35804 - "POST /node/69fcaeb255ff273b190bb80e HTTP/1.0" 202 Accepted 2026-05-09 15:24:49,585 - lava_callback - INFO - Starting async job submit for node 69fcaeb255ff273b190bb80e 2026-05-09 15:24:49,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:24:49,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaeb255ff273b190bb80e HTTP/1.1" 200 None 2026-05-09 15:24:49,600 - lava_callback - DEBUG - Processing node 69fcaeb255ff273b190bb80e: baseline-arm64-clabbe 2026-05-09 15:24:49,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcaeb255ff273b190bb80e 2026-05-09 15:24:49,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:24:49,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaeb255ff273b190bb80e HTTP/1.1" 200 None 2026-05-09 15:24:49,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:24:49,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:24:49,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:24:49,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcaeb255ff273b190bb80e HTTP/1.1" 200 None 2026-05-09 15:24:49,649 - lava_callback - ERROR - Error processing callback for node 69fcaeb255ff273b190bb80e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:26:09,598 - lava_callback - INFO - Received callback for node 69fcaefd55ff273b190bb82b INFO: 172.21.0.1:44916 - "POST /node/69fcaefd55ff273b190bb82b HTTP/1.0" 202 Accepted 2026-05-09 15:26:09,604 - lava_callback - INFO - Starting async job submit for node 69fcaefd55ff273b190bb82b 2026-05-09 15:26:09,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:26:09,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaefd55ff273b190bb82b HTTP/1.1" 200 None 2026-05-09 15:26:09,621 - lava_callback - DEBUG - Processing node 69fcaefd55ff273b190bb82b: baseline-arm64-clabbe 2026-05-09 15:26:09,621 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcaefd55ff273b190bb82b 2026-05-09 15:26:09,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:26:09,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaefd55ff273b190bb82b HTTP/1.1" 200 None 2026-05-09 15:26:09,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:26:09,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:26:09,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:26:09,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcaefd55ff273b190bb82b HTTP/1.1" 200 None 2026-05-09 15:26:09,677 - lava_callback - ERROR - Error processing callback for node 69fcaefd55ff273b190bb82b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:27:09,621 - lava_callback - INFO - Received callback for node 69fcaf4855ff273b190bb84c INFO: 172.21.0.1:59344 - "POST /node/69fcaf4855ff273b190bb84c HTTP/1.0" 202 Accepted 2026-05-09 15:27:09,629 - lava_callback - INFO - Starting async job submit for node 69fcaf4855ff273b190bb84c 2026-05-09 15:27:09,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:27:09,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaf4855ff273b190bb84c HTTP/1.1" 200 None 2026-05-09 15:27:09,650 - lava_callback - DEBUG - Processing node 69fcaf4855ff273b190bb84c: baseline-arm64-clabbe 2026-05-09 15:27:09,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcaf4855ff273b190bb84c 2026-05-09 15:27:09,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:27:09,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaf4855ff273b190bb84c HTTP/1.1" 200 None 2026-05-09 15:27:09,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:27:09,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:27:09,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:27:09,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcaf4855ff273b190bb84c HTTP/1.1" 200 None 2026-05-09 15:27:09,714 - lava_callback - ERROR - Error processing callback for node 69fcaf4855ff273b190bb84c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:28:29,658 - lava_callback - INFO - Received callback for node 69fcaf9455ff273b190bb870 INFO: 172.21.0.1:58020 - "POST /node/69fcaf9455ff273b190bb870 HTTP/1.0" 202 Accepted 2026-05-09 15:28:29,664 - lava_callback - INFO - Starting async job submit for node 69fcaf9455ff273b190bb870 2026-05-09 15:28:29,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:28:29,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaf9455ff273b190bb870 HTTP/1.1" 200 None 2026-05-09 15:28:29,679 - lava_callback - DEBUG - Processing node 69fcaf9455ff273b190bb870: baseline-arm64-clabbe 2026-05-09 15:28:29,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcaf9455ff273b190bb870 2026-05-09 15:28:29,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:28:29,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcaf9455ff273b190bb870 HTTP/1.1" 200 None 2026-05-09 15:28:29,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:28:29,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:28:29,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:28:29,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcaf9455ff273b190bb870 HTTP/1.1" 200 None 2026-05-09 15:28:29,733 - lava_callback - ERROR - Error processing callback for node 69fcaf9455ff273b190bb870: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:29:49,678 - lava_callback - INFO - Received callback for node 69fcafe055ff273b190bb897 INFO: 172.21.0.1:33818 - "POST /node/69fcafe055ff273b190bb897 HTTP/1.0" 202 Accepted 2026-05-09 15:29:49,683 - lava_callback - INFO - Starting async job submit for node 69fcafe055ff273b190bb897 2026-05-09 15:29:49,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:29:49,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcafe055ff273b190bb897 HTTP/1.1" 200 None 2026-05-09 15:29:49,698 - lava_callback - DEBUG - Processing node 69fcafe055ff273b190bb897: baseline-arm64-clabbe 2026-05-09 15:29:49,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcafe055ff273b190bb897 2026-05-09 15:29:49,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:29:49,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcafe055ff273b190bb897 HTTP/1.1" 200 None 2026-05-09 15:29:49,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:29:49,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:29:49,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:29:49,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcafe055ff273b190bb897 HTTP/1.1" 200 None 2026-05-09 15:29:49,749 - lava_callback - ERROR - Error processing callback for node 69fcafe055ff273b190bb897: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:31:09,775 - lava_callback - INFO - Received callback for node 69fcb02b55ff273b190bb8b0 INFO: 172.21.0.1:57360 - "POST /node/69fcb02b55ff273b190bb8b0 HTTP/1.0" 202 Accepted 2026-05-09 15:31:09,781 - lava_callback - INFO - Starting async job submit for node 69fcb02b55ff273b190bb8b0 2026-05-09 15:31:09,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:31:09,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb02b55ff273b190bb8b0 HTTP/1.1" 200 None 2026-05-09 15:31:09,797 - lava_callback - DEBUG - Processing node 69fcb02b55ff273b190bb8b0: baseline-arm64-clabbe 2026-05-09 15:31:09,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb02b55ff273b190bb8b0 2026-05-09 15:31:09,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:31:09,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb02b55ff273b190bb8b0 HTTP/1.1" 200 None 2026-05-09 15:31:09,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:31:09,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:31:09,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:31:09,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb02b55ff273b190bb8b0 HTTP/1.1" 200 None 2026-05-09 15:31:09,852 - lava_callback - ERROR - Error processing callback for node 69fcb02b55ff273b190bb8b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51852 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:32:09,782 - lava_callback - INFO - Received callback for node 69fcb07555ff273b190bb8db INFO: 172.21.0.1:46524 - "POST /node/69fcb07555ff273b190bb8db HTTP/1.0" 202 Accepted 2026-05-09 15:32:09,788 - lava_callback - INFO - Starting async job submit for node 69fcb07555ff273b190bb8db 2026-05-09 15:32:09,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:32:09,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb07555ff273b190bb8db HTTP/1.1" 200 None 2026-05-09 15:32:09,808 - lava_callback - DEBUG - Processing node 69fcb07555ff273b190bb8db: baseline-arm64-clabbe 2026-05-09 15:32:09,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb07555ff273b190bb8db 2026-05-09 15:32:09,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:32:09,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb07555ff273b190bb8db HTTP/1.1" 200 None 2026-05-09 15:32:09,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:32:09,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:32:09,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:32:09,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb07555ff273b190bb8db HTTP/1.1" 200 None 2026-05-09 15:32:09,859 - lava_callback - ERROR - Error processing callback for node 69fcb07555ff273b190bb8db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:33:29,846 - lava_callback - INFO - Received callback for node 69fcb0c055ff273b190bb8f3 INFO: 172.21.0.1:48798 - "POST /node/69fcb0c055ff273b190bb8f3 HTTP/1.0" 202 Accepted 2026-05-09 15:33:29,856 - lava_callback - INFO - Starting async job submit for node 69fcb0c055ff273b190bb8f3 2026-05-09 15:33:29,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:33:29,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb0c055ff273b190bb8f3 HTTP/1.1" 200 None 2026-05-09 15:33:29,871 - lava_callback - DEBUG - Processing node 69fcb0c055ff273b190bb8f3: baseline-arm64-clabbe 2026-05-09 15:33:29,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb0c055ff273b190bb8f3 2026-05-09 15:33:29,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:33:29,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb0c055ff273b190bb8f3 HTTP/1.1" 200 None 2026-05-09 15:33:29,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:33:29,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:33:29,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:33:29,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb0c055ff273b190bb8f3 HTTP/1.1" 200 None 2026-05-09 15:33:29,931 - lava_callback - ERROR - Error processing callback for node 69fcb0c055ff273b190bb8f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:34:49,870 - lava_callback - INFO - Received callback for node 69fcb10a55ff273b190bb916 INFO: 172.21.0.1:55510 - "POST /node/69fcb10a55ff273b190bb916 HTTP/1.0" 202 Accepted 2026-05-09 15:34:49,876 - lava_callback - INFO - Starting async job submit for node 69fcb10a55ff273b190bb916 2026-05-09 15:34:49,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:34:49,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb10a55ff273b190bb916 HTTP/1.1" 200 None 2026-05-09 15:34:49,892 - lava_callback - DEBUG - Processing node 69fcb10a55ff273b190bb916: baseline-arm64-clabbe 2026-05-09 15:34:49,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb10a55ff273b190bb916 2026-05-09 15:34:49,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:34:49,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb10a55ff273b190bb916 HTTP/1.1" 200 None 2026-05-09 15:34:49,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:34:49,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:34:49,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:34:49,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb10a55ff273b190bb916 HTTP/1.1" 200 None 2026-05-09 15:34:49,941 - lava_callback - ERROR - Error processing callback for node 69fcb10a55ff273b190bb916: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52178 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:36:09,979 - lava_callback - INFO - Received callback for node 69fcb15455ff273b190bb942 INFO: 172.21.0.1:57732 - "POST /node/69fcb15455ff273b190bb942 HTTP/1.0" 202 Accepted 2026-05-09 15:36:09,985 - lava_callback - INFO - Starting async job submit for node 69fcb15455ff273b190bb942 2026-05-09 15:36:09,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:36:10,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb15455ff273b190bb942 HTTP/1.1" 200 None 2026-05-09 15:36:10,003 - lava_callback - DEBUG - Processing node 69fcb15455ff273b190bb942: baseline-arm64-clabbe 2026-05-09 15:36:10,003 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb15455ff273b190bb942 2026-05-09 15:36:10,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:36:10,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb15455ff273b190bb942 HTTP/1.1" 200 None 2026-05-09 15:36:10,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:36:10,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:36:10,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:36:10,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb15455ff273b190bb942 HTTP/1.1" 200 None 2026-05-09 15:36:10,077 - lava_callback - ERROR - Error processing callback for node 69fcb15455ff273b190bb942: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:37:10,008 - lava_callback - INFO - Received callback for node 69fcb19f55ff273b190bb962 INFO: 172.21.0.1:50002 - "POST /node/69fcb19f55ff273b190bb962 HTTP/1.0" 202 Accepted 2026-05-09 15:37:10,014 - lava_callback - INFO - Starting async job submit for node 69fcb19f55ff273b190bb962 2026-05-09 15:37:10,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:37:10,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb19f55ff273b190bb962 HTTP/1.1" 200 None 2026-05-09 15:37:10,029 - lava_callback - DEBUG - Processing node 69fcb19f55ff273b190bb962: baseline-arm64-clabbe 2026-05-09 15:37:10,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb19f55ff273b190bb962 2026-05-09 15:37:10,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:37:10,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb19f55ff273b190bb962 HTTP/1.1" 200 None 2026-05-09 15:37:10,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:37:10,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:37:10,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:37:10,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb19f55ff273b190bb962 HTTP/1.1" 200 None 2026-05-09 15:37:10,083 - lava_callback - ERROR - Error processing callback for node 69fcb19f55ff273b190bb962: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:38:30,108 - lava_callback - INFO - Received callback for node 69fcb1e955ff273b190bb984 INFO: 172.21.0.1:35716 - "POST /node/69fcb1e955ff273b190bb984 HTTP/1.0" 202 Accepted 2026-05-09 15:38:30,114 - lava_callback - INFO - Starting async job submit for node 69fcb1e955ff273b190bb984 2026-05-09 15:38:30,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:38:30,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb1e955ff273b190bb984 HTTP/1.1" 200 None 2026-05-09 15:38:30,130 - lava_callback - DEBUG - Processing node 69fcb1e955ff273b190bb984: baseline-arm64-clabbe 2026-05-09 15:38:30,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb1e955ff273b190bb984 2026-05-09 15:38:30,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:38:30,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb1e955ff273b190bb984 HTTP/1.1" 200 None 2026-05-09 15:38:30,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:38:30,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:38:30,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:38:30,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb1e955ff273b190bb984 HTTP/1.1" 200 None 2026-05-09 15:38:30,176 - lava_callback - ERROR - Error processing callback for node 69fcb1e955ff273b190bb984: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:39:50,134 - lava_callback - INFO - Received callback for node 69fcb23455ff273b190bb9a4 INFO: 172.21.0.1:60152 - "POST /node/69fcb23455ff273b190bb9a4 HTTP/1.0" 202 Accepted 2026-05-09 15:39:50,140 - lava_callback - INFO - Starting async job submit for node 69fcb23455ff273b190bb9a4 2026-05-09 15:39:50,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:39:50,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb23455ff273b190bb9a4 HTTP/1.1" 200 None 2026-05-09 15:39:50,155 - lava_callback - DEBUG - Processing node 69fcb23455ff273b190bb9a4: baseline-arm64-clabbe 2026-05-09 15:39:50,155 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb23455ff273b190bb9a4 2026-05-09 15:39:50,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:39:50,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb23455ff273b190bb9a4 HTTP/1.1" 200 None 2026-05-09 15:39:50,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:39:50,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-09 15:39:50,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:39:50,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb23455ff273b190bb9a4 HTTP/1.1" 200 None 2026-05-09 15:39:50,200 - lava_callback - ERROR - Error processing callback for node 69fcb23455ff273b190bb9a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53150 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:45:47,438 - lava_callback - INFO - Received callback for node 69fcb39c55ff273b190bba72 INFO: 172.21.0.1:53154 - "POST /node/69fcb39c55ff273b190bba72 HTTP/1.0" 202 Accepted 2026-05-09 15:45:47,444 - lava_callback - INFO - Starting async job submit for node 69fcb39c55ff273b190bba72 2026-05-09 15:45:47,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:45:47,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb39c55ff273b190bba72 HTTP/1.1" 200 None 2026-05-09 15:45:47,459 - lava_callback - DEBUG - Processing node 69fcb39c55ff273b190bba72: baseline-arm64-baylibre 2026-05-09 15:45:47,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb39c55ff273b190bba72 2026-05-09 15:45:47,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:45:47,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb39c55ff273b190bba72 HTTP/1.1" 200 None 2026-05-09 15:45:47,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:45:47,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 15:45:47,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:45:47,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb39c55ff273b190bba72 HTTP/1.1" 200 None 2026-05-09 15:45:47,507 - lava_callback - ERROR - Error processing callback for node 69fcb39c55ff273b190bba72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:47:07,320 - lava_callback - INFO - Received callback for node 69fcb3e755ff273b190bba9e INFO: 172.21.0.1:42338 - "POST /node/69fcb3e755ff273b190bba9e HTTP/1.0" 202 Accepted 2026-05-09 15:47:07,326 - lava_callback - INFO - Starting async job submit for node 69fcb3e755ff273b190bba9e 2026-05-09 15:47:07,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:47:07,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb3e755ff273b190bba9e HTTP/1.1" 200 None 2026-05-09 15:47:07,340 - lava_callback - DEBUG - Processing node 69fcb3e755ff273b190bba9e: baseline-arm64-baylibre 2026-05-09 15:47:07,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb3e755ff273b190bba9e 2026-05-09 15:47:07,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:47:07,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb3e755ff273b190bba9e HTTP/1.1" 200 None 2026-05-09 15:47:07,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:47:07,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 15:47:07,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:47:07,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb3e755ff273b190bba9e HTTP/1.1" 200 None 2026-05-09 15:47:07,387 - lava_callback - ERROR - Error processing callback for node 69fcb3e755ff273b190bba9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:48:07,289 - lava_callback - INFO - Received callback for node 69fcb43155ff273b190bbabd INFO: 172.21.0.1:44792 - "POST /node/69fcb43155ff273b190bbabd HTTP/1.0" 202 Accepted 2026-05-09 15:48:07,298 - lava_callback - INFO - Starting async job submit for node 69fcb43155ff273b190bbabd 2026-05-09 15:48:07,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:48:07,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb43155ff273b190bbabd HTTP/1.1" 200 None 2026-05-09 15:48:07,314 - lava_callback - DEBUG - Processing node 69fcb43155ff273b190bbabd: baseline-arm64-baylibre 2026-05-09 15:48:07,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb43155ff273b190bbabd 2026-05-09 15:48:07,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:48:07,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb43155ff273b190bbabd HTTP/1.1" 200 None 2026-05-09 15:48:07,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:48:07,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 15:48:07,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:48:07,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb43155ff273b190bbabd HTTP/1.1" 200 None 2026-05-09 15:48:07,375 - lava_callback - ERROR - Error processing callback for node 69fcb43155ff273b190bbabd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42856 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:49:27,456 - lava_callback - INFO - Received callback for node 69fcb47b55ff273b190bbae1 INFO: 172.21.0.1:42864 - "POST /node/69fcb47b55ff273b190bbae1 HTTP/1.0" 202 Accepted 2026-05-09 15:49:27,461 - lava_callback - INFO - Starting async job submit for node 69fcb47b55ff273b190bbae1 2026-05-09 15:49:27,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:49:27,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb47b55ff273b190bbae1 HTTP/1.1" 200 None 2026-05-09 15:49:27,478 - lava_callback - DEBUG - Processing node 69fcb47b55ff273b190bbae1: baseline-arm64-baylibre 2026-05-09 15:49:27,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb47b55ff273b190bbae1 2026-05-09 15:49:27,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:49:27,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb47b55ff273b190bbae1 HTTP/1.1" 200 None 2026-05-09 15:49:27,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:49:27,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 15:49:27,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:49:27,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb47b55ff273b190bbae1 HTTP/1.1" 200 None 2026-05-09 15:49:27,523 - lava_callback - ERROR - Error processing callback for node 69fcb47b55ff273b190bbae1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47272 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:50:50,548 - lava_callback - INFO - Received callback for node 69fcb4c955ff273b190bbb00 INFO: 172.21.0.1:41120 - "POST /node/69fcb4c955ff273b190bbb00 HTTP/1.0" 202 Accepted 2026-05-09 15:50:50,553 - lava_callback - INFO - Starting async job submit for node 69fcb4c955ff273b190bbb00 2026-05-09 15:50:50,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:50:50,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb4c955ff273b190bbb00 HTTP/1.1" 200 None 2026-05-09 15:50:50,569 - lava_callback - DEBUG - Processing node 69fcb4c955ff273b190bbb00: baseline-arm64-clabbe 2026-05-09 15:50:50,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb4c955ff273b190bbb00 2026-05-09 15:50:50,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:50:50,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb4c955ff273b190bbb00 HTTP/1.1" 200 None 2026-05-09 15:50:50,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:50:50,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 15:50:50,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:50:50,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb4c955ff273b190bbb00 HTTP/1.1" 200 None 2026-05-09 15:50:50,625 - lava_callback - ERROR - Error processing callback for node 69fcb4c955ff273b190bbb00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:51:50,571 - lava_callback - INFO - Received callback for node 69fcb51355ff273b190bbb23 INFO: 172.21.0.1:43216 - "POST /node/69fcb51355ff273b190bbb23 HTTP/1.0" 202 Accepted 2026-05-09 15:51:50,576 - lava_callback - INFO - Starting async job submit for node 69fcb51355ff273b190bbb23 2026-05-09 15:51:50,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:51:50,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb51355ff273b190bbb23 HTTP/1.1" 200 None 2026-05-09 15:51:50,596 - lava_callback - DEBUG - Processing node 69fcb51355ff273b190bbb23: baseline-arm64-clabbe 2026-05-09 15:51:50,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb51355ff273b190bbb23 2026-05-09 15:51:50,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:51:50,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb51355ff273b190bbb23 HTTP/1.1" 200 None 2026-05-09 15:51:50,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:51:50,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 15:51:50,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:51:50,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb51355ff273b190bbb23 HTTP/1.1" 200 None 2026-05-09 15:51:50,654 - lava_callback - ERROR - Error processing callback for node 69fcb51355ff273b190bbb23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44750 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:53:10,612 - lava_callback - INFO - Received callback for node 69fcb56155ff273b190bbb41 INFO: 172.21.0.1:32796 - "POST /node/69fcb56155ff273b190bbb41 HTTP/1.0" 202 Accepted 2026-05-09 15:53:10,618 - lava_callback - INFO - Starting async job submit for node 69fcb56155ff273b190bbb41 2026-05-09 15:53:10,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:53:10,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb56155ff273b190bbb41 HTTP/1.1" 200 None 2026-05-09 15:53:10,638 - lava_callback - DEBUG - Processing node 69fcb56155ff273b190bbb41: baseline-arm64-clabbe 2026-05-09 15:53:10,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb56155ff273b190bbb41 2026-05-09 15:53:10,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:53:10,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb56155ff273b190bbb41 HTTP/1.1" 200 None 2026-05-09 15:53:10,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:53:10,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 15:53:10,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:53:10,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb56155ff273b190bbb41 HTTP/1.1" 200 None 2026-05-09 15:53:10,686 - lava_callback - ERROR - Error processing callback for node 69fcb56155ff273b190bbb41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47344 - "GET / HTTP/1.0" 200 OK 2026-05-09 15:54:30,685 - lava_callback - INFO - Received callback for node 69fcb5ac55ff273b190bbb67 INFO: 172.21.0.1:38268 - "POST /node/69fcb5ac55ff273b190bbb67 HTTP/1.0" 202 Accepted 2026-05-09 15:54:30,692 - lava_callback - INFO - Starting async job submit for node 69fcb5ac55ff273b190bbb67 2026-05-09 15:54:30,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:54:30,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb5ac55ff273b190bbb67 HTTP/1.1" 200 None 2026-05-09 15:54:30,709 - lava_callback - DEBUG - Processing node 69fcb5ac55ff273b190bbb67: baseline-arm64-clabbe 2026-05-09 15:54:30,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb5ac55ff273b190bbb67 2026-05-09 15:54:30,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:54:30,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb5ac55ff273b190bbb67 HTTP/1.1" 200 None 2026-05-09 15:54:30,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:54:30,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 15:54:30,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 15:54:30,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb5ac55ff273b190bbb67 HTTP/1.1" 200 None 2026-05-09 15:54:30,755 - lava_callback - ERROR - Error processing callback for node 69fcb5ac55ff273b190bbb67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK 2026-05-09 16:00:50,944 - lava_callback - INFO - Received callback for node 69fcb72155ff273b190bbc11 INFO: 172.21.0.1:51428 - "POST /node/69fcb72155ff273b190bbc11 HTTP/1.0" 202 Accepted 2026-05-09 16:00:50,949 - lava_callback - INFO - Starting async job submit for node 69fcb72155ff273b190bbc11 2026-05-09 16:00:50,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:00:50,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb72155ff273b190bbc11 HTTP/1.1" 200 None 2026-05-09 16:00:50,977 - lava_callback - DEBUG - Processing node 69fcb72155ff273b190bbc11: baseline-arm64-clabbe 2026-05-09 16:00:50,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb72155ff273b190bbc11 2026-05-09 16:00:50,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:00:50,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb72155ff273b190bbc11 HTTP/1.1" 200 None 2026-05-09 16:00:50,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:00:51,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb6a73df29cd80ecaa02b6 HTTP/1.1" 200 None 2026-05-09 16:00:51,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:00:51,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb72155ff273b190bbc11 HTTP/1.1" 200 None 2026-05-09 16:00:51,023 - lava_callback - ERROR - Error processing callback for node 69fcb72155ff273b190bbc11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK 2026-05-09 16:01:48,037 - lava_callback - INFO - Received callback for node 69fcb76855ff273b190bbc34 INFO: 172.21.0.1:49974 - "POST /node/69fcb76855ff273b190bbc34 HTTP/1.0" 202 Accepted 2026-05-09 16:01:48,043 - lava_callback - INFO - Starting async job submit for node 69fcb76855ff273b190bbc34 2026-05-09 16:01:48,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:01:48,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb76855ff273b190bbc34 HTTP/1.1" 200 None 2026-05-09 16:01:48,059 - lava_callback - DEBUG - Processing node 69fcb76855ff273b190bbc34: baseline-arm64-baylibre 2026-05-09 16:01:48,059 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb76855ff273b190bbc34 2026-05-09 16:01:48,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:01:48,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb76855ff273b190bbc34 HTTP/1.1" 200 None 2026-05-09 16:01:48,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:01:48,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 16:01:48,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:01:48,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb76855ff273b190bbc34 HTTP/1.1" 200 None 2026-05-09 16:01:48,104 - lava_callback - ERROR - Error processing callback for node 69fcb76855ff273b190bbc34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54398 - "GET / HTTP/1.0" 200 OK 2026-05-09 16:03:08,110 - lava_callback - INFO - Received callback for node 69fcb7b355ff273b190bbc50 INFO: 172.21.0.1:54410 - "POST /node/69fcb7b355ff273b190bbc50 HTTP/1.0" 202 Accepted 2026-05-09 16:03:08,116 - lava_callback - INFO - Starting async job submit for node 69fcb7b355ff273b190bbc50 2026-05-09 16:03:08,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:03:08,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb7b355ff273b190bbc50 HTTP/1.1" 200 None 2026-05-09 16:03:08,131 - lava_callback - DEBUG - Processing node 69fcb7b355ff273b190bbc50: baseline-arm64-baylibre 2026-05-09 16:03:08,131 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb7b355ff273b190bbc50 2026-05-09 16:03:08,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:03:08,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb7b355ff273b190bbc50 HTTP/1.1" 200 None 2026-05-09 16:03:08,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:03:08,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 16:03:08,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:03:08,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb7b355ff273b190bbc50 HTTP/1.1" 200 None 2026-05-09 16:03:08,188 - lava_callback - ERROR - Error processing callback for node 69fcb7b355ff273b190bbc50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46950 - "GET / HTTP/1.0" 200 OK 2026-05-09 16:04:28,384 - lava_callback - INFO - Received callback for node 69fcb7fd55ff273b190bbc72 INFO: 172.21.0.1:46960 - "POST /node/69fcb7fd55ff273b190bbc72 HTTP/1.0" 202 Accepted 2026-05-09 16:04:28,390 - lava_callback - INFO - Starting async job submit for node 69fcb7fd55ff273b190bbc72 2026-05-09 16:04:28,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:04:28,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb7fd55ff273b190bbc72 HTTP/1.1" 200 None 2026-05-09 16:04:28,405 - lava_callback - DEBUG - Processing node 69fcb7fd55ff273b190bbc72: baseline-arm64-baylibre 2026-05-09 16:04:28,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb7fd55ff273b190bbc72 2026-05-09 16:04:28,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:04:28,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb7fd55ff273b190bbc72 HTTP/1.1" 200 None 2026-05-09 16:04:28,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:04:28,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-09 16:04:28,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:04:28,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb7fd55ff273b190bbc72 HTTP/1.1" 200 None 2026-05-09 16:04:28,451 - lava_callback - ERROR - Error processing callback for node 69fcb7fd55ff273b190bbc72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK 2026-05-09 16:05:48,250 - lava_callback - INFO - Received callback for node 69fcb84855ff273b190bbc8f INFO: 172.21.0.1:43424 - "POST /node/69fcb84855ff273b190bbc8f HTTP/1.0" 202 Accepted 2026-05-09 16:05:48,256 - lava_callback - INFO - Starting async job submit for node 69fcb84855ff273b190bbc8f 2026-05-09 16:05:48,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:05:48,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb84855ff273b190bbc8f HTTP/1.1" 200 None 2026-05-09 16:05:48,271 - lava_callback - DEBUG - Processing node 69fcb84855ff273b190bbc8f: baseline-arm64-baylibre 2026-05-09 16:05:48,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb84855ff273b190bbc8f 2026-05-09 16:05:48,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:05:48,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb84855ff273b190bbc8f HTTP/1.1" 200 None 2026-05-09 16:05:48,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:05:48,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 16:05:48,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:05:48,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb84855ff273b190bbc8f HTTP/1.1" 200 None 2026-05-09 16:05:48,316 - lava_callback - ERROR - Error processing callback for node 69fcb84855ff273b190bbc8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46290 - "GET / HTTP/1.0" 200 OK 2026-05-09 16:06:48,466 - lava_callback - INFO - Received callback for node 69fcb89155ff273b190bbcb2 INFO: 172.21.0.1:46302 - "POST /node/69fcb89155ff273b190bbcb2 HTTP/1.0" 202 Accepted 2026-05-09 16:06:48,472 - lava_callback - INFO - Starting async job submit for node 69fcb89155ff273b190bbcb2 2026-05-09 16:06:48,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:06:48,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb89155ff273b190bbcb2 HTTP/1.1" 200 None 2026-05-09 16:06:48,492 - lava_callback - DEBUG - Processing node 69fcb89155ff273b190bbcb2: baseline-arm64-baylibre 2026-05-09 16:06:48,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb89155ff273b190bbcb2 2026-05-09 16:06:48,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:06:48,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb89155ff273b190bbcb2 HTTP/1.1" 200 None 2026-05-09 16:06:48,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:06:48,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 16:06:48,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:06:48,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb89155ff273b190bbcb2 HTTP/1.1" 200 None 2026-05-09 16:06:48,553 - lava_callback - ERROR - Error processing callback for node 69fcb89155ff273b190bbcb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51698 - "GET / HTTP/1.0" 200 OK 2026-05-09 16:08:11,238 - lava_callback - INFO - Received callback for node 69fcb8e155ff273b190bbcd0 INFO: 172.21.0.1:50682 - "POST /node/69fcb8e155ff273b190bbcd0 HTTP/1.0" 202 Accepted 2026-05-09 16:08:11,243 - lava_callback - INFO - Starting async job submit for node 69fcb8e155ff273b190bbcd0 2026-05-09 16:08:11,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:08:11,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb8e155ff273b190bbcd0 HTTP/1.1" 200 None 2026-05-09 16:08:11,279 - lava_callback - DEBUG - Processing node 69fcb8e155ff273b190bbcd0: baseline-arm64-clabbe 2026-05-09 16:08:11,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb8e155ff273b190bbcd0 2026-05-09 16:08:11,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:08:11,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb8e155ff273b190bbcd0 HTTP/1.1" 200 None 2026-05-09 16:08:11,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:08:11,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 16:08:11,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:08:11,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb8e155ff273b190bbcd0 HTTP/1.1" 200 None 2026-05-09 16:08:11,334 - lava_callback - ERROR - Error processing callback for node 69fcb8e155ff273b190bbcd0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET / HTTP/1.0" 200 OK 2026-05-09 16:09:31,269 - lava_callback - INFO - Received callback for node 69fcb92d55ff273b190bbcf3 INFO: 172.21.0.1:38920 - "POST /node/69fcb92d55ff273b190bbcf3 HTTP/1.0" 202 Accepted 2026-05-09 16:09:31,275 - lava_callback - INFO - Starting async job submit for node 69fcb92d55ff273b190bbcf3 2026-05-09 16:09:31,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:09:31,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb92d55ff273b190bbcf3 HTTP/1.1" 200 None 2026-05-09 16:09:31,291 - lava_callback - DEBUG - Processing node 69fcb92d55ff273b190bbcf3: baseline-arm64-clabbe 2026-05-09 16:09:31,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb92d55ff273b190bbcf3 2026-05-09 16:09:31,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:09:31,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb92d55ff273b190bbcf3 HTTP/1.1" 200 None 2026-05-09 16:09:31,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:09:31,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 16:09:31,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:09:31,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb92d55ff273b190bbcf3 HTTP/1.1" 200 None 2026-05-09 16:09:31,337 - lava_callback - ERROR - Error processing callback for node 69fcb92d55ff273b190bbcf3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39356 - "GET / HTTP/1.0" 200 OK 2026-05-09 16:10:51,370 - lava_callback - INFO - Received callback for node 69fcb97855ff273b190bbd10 INFO: 172.21.0.1:51252 - "POST /node/69fcb97855ff273b190bbd10 HTTP/1.0" 202 Accepted 2026-05-09 16:10:51,376 - lava_callback - INFO - Starting async job submit for node 69fcb97855ff273b190bbd10 2026-05-09 16:10:51,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:10:51,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb97855ff273b190bbd10 HTTP/1.1" 200 None 2026-05-09 16:10:51,408 - lava_callback - DEBUG - Processing node 69fcb97855ff273b190bbd10: baseline-arm64-clabbe 2026-05-09 16:10:51,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb97855ff273b190bbd10 2026-05-09 16:10:51,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:10:51,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb97855ff273b190bbd10 HTTP/1.1" 200 None 2026-05-09 16:10:51,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:10:51,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 16:10:51,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:10:51,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb97855ff273b190bbd10 HTTP/1.1" 200 None 2026-05-09 16:10:51,456 - lava_callback - ERROR - Error processing callback for node 69fcb97855ff273b190bbd10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK 2026-05-09 16:11:51,492 - lava_callback - INFO - Received callback for node 69fcb9c455ff273b190bbd33 INFO: 172.21.0.1:50834 - "POST /node/69fcb9c455ff273b190bbd33 HTTP/1.0" 202 Accepted 2026-05-09 16:11:51,498 - lava_callback - INFO - Starting async job submit for node 69fcb9c455ff273b190bbd33 2026-05-09 16:11:51,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:11:51,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb9c455ff273b190bbd33 HTTP/1.1" 200 None 2026-05-09 16:11:51,517 - lava_callback - DEBUG - Processing node 69fcb9c455ff273b190bbd33: baseline-arm64-clabbe 2026-05-09 16:11:51,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcb9c455ff273b190bbd33 2026-05-09 16:11:51,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:11:51,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcb9c455ff273b190bbd33 HTTP/1.1" 200 None 2026-05-09 16:11:51,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:11:51,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 16:11:51,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:11:51,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcb9c455ff273b190bbd33 HTTP/1.1" 200 None 2026-05-09 16:11:51,573 - lava_callback - ERROR - Error processing callback for node 69fcb9c455ff273b190bbd33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK 2026-05-09 16:13:11,367 - lava_callback - INFO - Received callback for node 69fcba0e55ff273b190bbd54 INFO: 172.21.0.1:58208 - "POST /node/69fcba0e55ff273b190bbd54 HTTP/1.0" 202 Accepted 2026-05-09 16:13:11,373 - lava_callback - INFO - Starting async job submit for node 69fcba0e55ff273b190bbd54 2026-05-09 16:13:11,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:13:11,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcba0e55ff273b190bbd54 HTTP/1.1" 200 None 2026-05-09 16:13:11,389 - lava_callback - DEBUG - Processing node 69fcba0e55ff273b190bbd54: baseline-arm64-clabbe 2026-05-09 16:13:11,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fcba0e55ff273b190bbd54 2026-05-09 16:13:11,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:13:11,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcba0e55ff273b190bbd54 HTTP/1.1" 200 None 2026-05-09 16:13:11,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:13:11,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-09 16:13:11,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-09 16:13:11,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fcba0e55ff273b190bbd54 HTTP/1.1" 200 None 2026-05-09 16:13:11,446 - lava_callback - ERROR - Error processing callback for node 69fcba0e55ff273b190bbd54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]