INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47938 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:21:39,217 - lava_callback - INFO - Received callback for node 69b90ea10ec88e58bad0d11e 2026-03-17 08:21:39,227 - lava_callback - INFO - Starting async job submit for node 69b90ea10ec88e58bad0d11e INFO: 172.20.0.1:47950 - "POST /node/69b90ea10ec88e58bad0d11e HTTP/1.0" 202 Accepted 2026-03-17 08:21:39,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:21:39,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ea10ec88e58bad0d11e HTTP/1.1" 200 None 2026-03-17 08:21:39,279 - lava_callback - DEBUG - Processing node 69b90ea10ec88e58bad0d11e: job-gcc-14-riscv-612-cip 2026-03-17 08:21:39,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:21:39,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:21:39,701 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-riscv-612-cip-69b90ea10ec88e58bad0d11e/log.txt.gz 2026-03-17 08:21:39,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:21:40,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:21:40,080 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-riscv-612-cip-69b90ea10ec88e58bad0d11e/lava-logs.yaml 2026-03-17 08:21:40,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:21:40,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:21:40,246 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-riscv-612-cip-69b90ea10ec88e58bad0d11e/lava_callback.json.gz 2026-03-17 08:21:40,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:21:40,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ea10ec88e58bad0d11e HTTP/1.1" 200 None 2026-03-17 08:21:40,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:21:40,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab4fbe29c53ae8604fa HTTP/1.1" 200 None 2026-03-17 08:21:40,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:21:40,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b90ea10ec88e58bad0d11e HTTP/1.1" 200 None 2026-03-17 08:21:40,333 - lava_callback - INFO - Completed processing callback for node 69b90ea10ec88e58bad0d11e INFO: 172.20.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35532 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:22:05,743 - lava_callback - INFO - Received callback for node 69b90f220ec88e58bad0d128 INFO: 172.20.0.1:41860 - "POST /node/69b90f220ec88e58bad0d128 HTTP/1.0" 202 Accepted 2026-03-17 08:22:05,749 - lava_callback - INFO - Starting async job submit for node 69b90f220ec88e58bad0d128 2026-03-17 08:22:05,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:05,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90f220ec88e58bad0d128 HTTP/1.1" 200 None 2026-03-17 08:22:05,834 - lava_callback - DEBUG - Processing node 69b90f220ec88e58bad0d128: job-gcc-14-x86-612-cip 2026-03-17 08:22:05,835 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:22:05,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:22:05,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:22:05,959 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f220ec88e58bad0d128/lava-logs.yaml 2026-03-17 08:22:05,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:22:06,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:22:06,140 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f220ec88e58bad0d128/lava_callback.json.gz 2026-03-17 08:22:06,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:06,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90f220ec88e58bad0d128 HTTP/1.1" 200 None 2026-03-17 08:22:06,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:06,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab6fbe29c53ae8604fd HTTP/1.1" 200 None 2026-03-17 08:22:06,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:06,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b90f220ec88e58bad0d128 HTTP/1.1" 200 None 2026-03-17 08:22:06,274 - lava_callback - INFO - Completed processing callback for node 69b90f220ec88e58bad0d128 INFO: 172.20.0.1:41864 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:22:10,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:10,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 08:22:11,009 - lava_callback - INFO - Received callback for node 69b90f2e0ec88e58bad0d133 INFO: 172.20.0.1:33182 - "POST /node/69b90f2e0ec88e58bad0d133 HTTP/1.0" 202 Accepted 2026-03-17 08:22:11,015 - lava_callback - INFO - Starting async job submit for node 69b90f2e0ec88e58bad0d133 2026-03-17 08:22:11,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:11,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90f2e0ec88e58bad0d133 HTTP/1.1" 200 None 2026-03-17 08:22:11,032 - lava_callback - DEBUG - Processing node 69b90f2e0ec88e58bad0d133: job-gcc-14-x86-612-cip 2026-03-17 08:22:11,034 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:22:11,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:22:11,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:22:11,226 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f2e0ec88e58bad0d133/lava-logs.yaml 2026-03-17 08:22:11,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:22:11,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:22:11,424 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f2e0ec88e58bad0d133/lava_callback.json.gz 2026-03-17 08:22:11,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:11,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90f2e0ec88e58bad0d133 HTTP/1.1" 200 None 2026-03-17 08:22:11,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:11,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab6fbe29c53ae8604fd HTTP/1.1" 200 None 2026-03-17 08:22:11,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:11,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b90f2e0ec88e58bad0d133 HTTP/1.1" 200 None 2026-03-17 08:22:11,493 - lava_callback - INFO - Completed processing callback for node 69b90f2e0ec88e58bad0d133 INFO: 172.20.0.1:33192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50784 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:22:32,607 - lava_callback - INFO - Received callback for node 69b90f330ec88e58bad0d13c INFO: 172.20.0.1:46778 - "POST /node/69b90f330ec88e58bad0d13c HTTP/1.0" 202 Accepted 2026-03-17 08:22:32,613 - lava_callback - INFO - Starting async job submit for node 69b90f330ec88e58bad0d13c 2026-03-17 08:22:32,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:32,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90f330ec88e58bad0d13c HTTP/1.1" 200 None 2026-03-17 08:22:32,630 - lava_callback - DEBUG - Processing node 69b90f330ec88e58bad0d13c: job-gcc-14-x86-612-cip 2026-03-17 08:22:32,632 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:22:32,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:22:32,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:22:32,835 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f330ec88e58bad0d13c/lava-logs.yaml 2026-03-17 08:22:32,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:22:32,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:22:32,948 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f330ec88e58bad0d13c/lava_callback.json.gz 2026-03-17 08:22:32,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:32,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90f330ec88e58bad0d13c HTTP/1.1" 200 None 2026-03-17 08:22:32,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:32,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab6fbe29c53ae8604fd HTTP/1.1" 200 None 2026-03-17 08:22:32,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:33,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b90f330ec88e58bad0d13c HTTP/1.1" 200 None 2026-03-17 08:22:33,021 - lava_callback - INFO - Completed processing callback for node 69b90f330ec88e58bad0d13c INFO: 172.20.0.1:46786 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:22:40,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:40,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54946 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:22:52,151 - lava_callback - INFO - Received callback for node 69b90f490ec88e58bad0d149 INFO: 172.20.0.1:52362 - "POST /node/69b90f490ec88e58bad0d149 HTTP/1.0" 202 Accepted 2026-03-17 08:22:52,157 - lava_callback - INFO - Starting async job submit for node 69b90f490ec88e58bad0d149 2026-03-17 08:22:52,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:52,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90f490ec88e58bad0d149 HTTP/1.1" 200 None 2026-03-17 08:22:52,241 - lava_callback - DEBUG - Processing node 69b90f490ec88e58bad0d149: job-gcc-14-x86-612-cip 2026-03-17 08:22:52,243 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:22:52,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:22:52,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:22:52,445 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f490ec88e58bad0d149/lava-logs.yaml 2026-03-17 08:22:52,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:22:52,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:22:52,636 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f490ec88e58bad0d149/lava_callback.json.gz 2026-03-17 08:22:52,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:52,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90f490ec88e58bad0d149 HTTP/1.1" 200 None 2026-03-17 08:22:52,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:52,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab6fbe29c53ae8604fd HTTP/1.1" 200 None 2026-03-17 08:22:52,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:22:52,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b90f490ec88e58bad0d149 HTTP/1.1" 200 None 2026-03-17 08:22:52,699 - lava_callback - INFO - Completed processing callback for node 69b90f490ec88e58bad0d149 INFO: 172.20.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58122 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:23:10,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:23:10,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33898 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:24:14,259 - lava_callback - INFO - Received callback for node 69b90f240ec88e58bad0d12e INFO: 172.20.0.1:60016 - "POST /node/69b90f240ec88e58bad0d12e HTTP/1.0" 202 Accepted 2026-03-17 08:24:14,265 - lava_callback - INFO - Starting async job submit for node 69b90f240ec88e58bad0d12e 2026-03-17 08:24:14,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:24:14,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90f240ec88e58bad0d12e HTTP/1.1" 200 None 2026-03-17 08:24:14,362 - lava_callback - DEBUG - Processing node 69b90f240ec88e58bad0d12e: job-gcc-14-x86-612-cip 2026-03-17 08:24:14,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:24:14,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:24:14,954 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f240ec88e58bad0d12e/log.txt.gz INFO: 172.20.0.1:60030 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 08:24:15,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:24:15,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:24:15,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f240ec88e58bad0d12e/lava-logs.yaml 2026-03-17 08:24:15,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:24:15,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:24:15,745 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f240ec88e58bad0d12e/lava_callback.json.gz 2026-03-17 08:24:15,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:24:15,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90f240ec88e58bad0d12e HTTP/1.1" 200 None 2026-03-17 08:24:15,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:24:15,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab6fbe29c53ae8604fd HTTP/1.1" 200 None 2026-03-17 08:24:15,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:24:15,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b90f240ec88e58bad0d12e HTTP/1.1" 200 None 2026-03-17 08:24:15,845 - lava_callback - INFO - Completed processing callback for node 69b90f240ec88e58bad0d12e INFO: 172.20.0.1:60032 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:24:20,593 - lava_callback - INFO - Received callback for node 69b90f230ec88e58bad0d12b INFO: 172.20.0.1:43682 - "POST /node/69b90f230ec88e58bad0d12b HTTP/1.0" 202 Accepted 2026-03-17 08:24:20,599 - lava_callback - INFO - Starting async job submit for node 69b90f230ec88e58bad0d12b 2026-03-17 08:24:20,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:24:20,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90f230ec88e58bad0d12b HTTP/1.1" 200 None 2026-03-17 08:24:20,658 - lava_callback - DEBUG - Processing node 69b90f230ec88e58bad0d12b: job-gcc-14-x86-612-cip 2026-03-17 08:24:21,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:24:21,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:24:21,211 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f230ec88e58bad0d12b/log.txt.gz 2026-03-17 08:24:21,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:24:21,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:24:21,658 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f230ec88e58bad0d12b/lava-logs.yaml 2026-03-17 08:24:21,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:24:21,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:24:21,820 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-69b90f230ec88e58bad0d12b/lava_callback.json.gz 2026-03-17 08:24:21,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:24:21,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90f230ec88e58bad0d12b HTTP/1.1" 200 None 2026-03-17 08:24:21,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:24:21,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab6fbe29c53ae8604fd HTTP/1.1" 200 None 2026-03-17 08:24:21,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:24:21,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b90f230ec88e58bad0d12b HTTP/1.1" 200 None 2026-03-17 08:24:21,902 - lava_callback - INFO - Completed processing callback for node 69b90f230ec88e58bad0d12b INFO: 172.20.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44852 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:24:40,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:24:40,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51684 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:30:40,186 - lava_callback - INFO - Received callback for node 69b910b70ec88e58bad0d71b INFO: 172.20.0.1:60776 - "POST /node/69b910b70ec88e58bad0d71b HTTP/1.0" 202 Accepted 2026-03-17 08:30:40,195 - lava_callback - INFO - Starting async job submit for node 69b910b70ec88e58bad0d71b 2026-03-17 08:30:40,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:30:40,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b910b70ec88e58bad0d71b HTTP/1.1" 200 None 2026-03-17 08:30:40,315 - lava_callback - DEBUG - Processing node 69b910b70ec88e58bad0d71b: baseline-arm 2026-03-17 08:30:40,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:30:41,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:30:41,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b910b70ec88e58bad0d71b/log.txt.gz 2026-03-17 08:30:41,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:30:41,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:30:41,919 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b910b70ec88e58bad0d71b/lava-logs.yaml 2026-03-17 08:30:41,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:30:42,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:30:42,447 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b910b70ec88e58bad0d71b/lava_callback.json.gz 2026-03-17 08:30:42,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:30:42,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b910b70ec88e58bad0d71b HTTP/1.1" 200 None 2026-03-17 08:30:42,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:30:42,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e3a0ec88e58bad0d0e3 HTTP/1.1" 200 None 2026-03-17 08:30:42,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:30:42,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b910b70ec88e58bad0d71b HTTP/1.1" 200 None 2026-03-17 08:30:42,599 - lava_callback - INFO - Completed processing callback for node 69b910b70ec88e58bad0d71b INFO: 172.20.0.1:60784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35128 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:31:10,225 - lava_callback - INFO - Received callback for node 69b911360ec88e58bad0d731 INFO: 172.20.0.1:46572 - "POST /node/69b911360ec88e58bad0d731 HTTP/1.0" 202 Accepted 2026-03-17 08:31:10,231 - lava_callback - INFO - Starting async job submit for node 69b911360ec88e58bad0d731 2026-03-17 08:31:10,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:31:10,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911360ec88e58bad0d731 HTTP/1.1" 200 None 2026-03-17 08:31:10,250 - lava_callback - DEBUG - Processing node 69b911360ec88e58bad0d731: job-gcc-14-arm64-612-cip 2026-03-17 08:31:10,255 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:31:10,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:31:10,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:31:10,390 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b911360ec88e58bad0d731/lava-logs.yaml 2026-03-17 08:31:10,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:31:10,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:31:10,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 08:31:10,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:31:10,598 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b911360ec88e58bad0d731/lava_callback.json.gz 2026-03-17 08:31:10,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:31:10,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911360ec88e58bad0d731 HTTP/1.1" 200 None 2026-03-17 08:31:10,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:31:10,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f1 HTTP/1.1" 200 None 2026-03-17 08:31:10,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:31:10,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911360ec88e58bad0d731 HTTP/1.1" 200 None 2026-03-17 08:31:10,663 - lava_callback - INFO - Completed processing callback for node 69b911360ec88e58bad0d731 INFO: 172.20.0.1:46578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52246 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:31:40,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:31:40,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40312 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:31:51,383 - lava_callback - INFO - Received callback for node 69b9114f0ec88e58bad0d73f INFO: 172.20.0.1:50366 - "POST /node/69b9114f0ec88e58bad0d73f HTTP/1.0" 202 Accepted 2026-03-17 08:31:51,390 - lava_callback - INFO - Starting async job submit for node 69b9114f0ec88e58bad0d73f 2026-03-17 08:31:51,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:31:51,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9114f0ec88e58bad0d73f HTTP/1.1" 200 None 2026-03-17 08:31:51,437 - lava_callback - DEBUG - Processing node 69b9114f0ec88e58bad0d73f: job-gcc-14-arm64-612-cip 2026-03-17 08:31:51,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:31:51,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:31:51,817 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b9114f0ec88e58bad0d73f/log.txt.gz 2026-03-17 08:31:51,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:31:52,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:31:52,102 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b9114f0ec88e58bad0d73f/lava-logs.yaml 2026-03-17 08:31:52,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:31:52,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:31:52,321 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b9114f0ec88e58bad0d73f/lava_callback.json.gz 2026-03-17 08:31:52,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:31:52,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9114f0ec88e58bad0d73f HTTP/1.1" 200 None 2026-03-17 08:31:52,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:31:52,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f1 HTTP/1.1" 200 None 2026-03-17 08:31:52,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:31:52,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9114f0ec88e58bad0d73f HTTP/1.1" 200 None 2026-03-17 08:31:52,408 - lava_callback - INFO - Completed processing callback for node 69b9114f0ec88e58bad0d73f INFO: 172.20.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60724 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:32:10,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:10,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 08:32:10,968 - lava_callback - INFO - Received callback for node 69b911380ec88e58bad0d737 INFO: 172.20.0.1:34634 - "POST /node/69b911380ec88e58bad0d737 HTTP/1.0" 202 Accepted 2026-03-17 08:32:10,975 - lava_callback - INFO - Starting async job submit for node 69b911380ec88e58bad0d737 2026-03-17 08:32:10,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:11,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911380ec88e58bad0d737 HTTP/1.1" 200 None 2026-03-17 08:32:11,016 - lava_callback - DEBUG - Processing node 69b911380ec88e58bad0d737: job-gcc-14-arm64-612-cip 2026-03-17 08:32:11,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:32:11,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:32:11,474 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b911380ec88e58bad0d737/log.txt.gz 2026-03-17 08:32:11,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:32:11,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:32:11,937 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b911380ec88e58bad0d737/lava-logs.yaml 2026-03-17 08:32:11,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:32:12,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:32:12,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b911380ec88e58bad0d737/lava_callback.json.gz 2026-03-17 08:32:12,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:12,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911380ec88e58bad0d737 HTTP/1.1" 200 None 2026-03-17 08:32:12,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:12,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f1 HTTP/1.1" 200 None 2026-03-17 08:32:12,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:12,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911380ec88e58bad0d737 HTTP/1.1" 200 None 2026-03-17 08:32:12,240 - lava_callback - INFO - Completed processing callback for node 69b911380ec88e58bad0d737 INFO: 172.20.0.1:34646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37380 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:32:40,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:40,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 08:32:42,510 - lava_callback - INFO - Received callback for node 69b911370ec88e58bad0d734 INFO: 172.20.0.1:56890 - "POST /node/69b911370ec88e58bad0d734 HTTP/1.0" 202 Accepted 2026-03-17 08:32:42,516 - lava_callback - INFO - Starting async job submit for node 69b911370ec88e58bad0d734 2026-03-17 08:32:42,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:42,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911370ec88e58bad0d734 HTTP/1.1" 200 None 2026-03-17 08:32:42,560 - lava_callback - DEBUG - Processing node 69b911370ec88e58bad0d734: job-gcc-14-arm64-612-cip 2026-03-17 08:32:42,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:32:43,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:32:43,025 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b911370ec88e58bad0d734/log.txt.gz INFO: 172.20.0.1:56894 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:32:43,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:32:43,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:32:43,403 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b911370ec88e58bad0d734/lava-logs.yaml 2026-03-17 08:32:43,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:32:43,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:32:43,572 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b911370ec88e58bad0d734/lava_callback.json.gz 2026-03-17 08:32:43,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:43,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911370ec88e58bad0d734 HTTP/1.1" 200 None 2026-03-17 08:32:43,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:43,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f1 HTTP/1.1" 200 None 2026-03-17 08:32:43,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:43,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911370ec88e58bad0d734 HTTP/1.1" 200 None 2026-03-17 08:32:43,726 - lava_callback - INFO - Completed processing callback for node 69b911370ec88e58bad0d734 2026-03-17 08:32:44,729 - lava_callback - INFO - Received callback for node 69b911350ec88e58bad0d72e INFO: 172.20.0.1:56910 - "POST /node/69b911350ec88e58bad0d72e HTTP/1.0" 202 Accepted 2026-03-17 08:32:44,735 - lava_callback - INFO - Starting async job submit for node 69b911350ec88e58bad0d72e 2026-03-17 08:32:44,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:44,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911350ec88e58bad0d72e HTTP/1.1" 200 None 2026-03-17 08:32:44,771 - lava_callback - DEBUG - Processing node 69b911350ec88e58bad0d72e: job-gcc-14-arm64-612-cip 2026-03-17 08:32:45,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:32:45,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:32:45,133 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b911350ec88e58bad0d72e/log.txt.gz 2026-03-17 08:32:45,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:32:45,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:32:45,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b911350ec88e58bad0d72e/lava-logs.yaml 2026-03-17 08:32:45,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:32:45,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:32:45,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-69b911350ec88e58bad0d72e/lava_callback.json.gz 2026-03-17 08:32:45,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:45,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911350ec88e58bad0d72e HTTP/1.1" 200 None 2026-03-17 08:32:45,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:45,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f1 HTTP/1.1" 200 None 2026-03-17 08:32:45,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:32:45,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911350ec88e58bad0d72e HTTP/1.1" 200 None 2026-03-17 08:32:45,698 - lava_callback - INFO - Completed processing callback for node 69b911350ec88e58bad0d72e INFO: 172.20.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47150 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:33:10,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:33:10,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39938 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:33:51,622 - lava_callback - INFO - Received callback for node 69b911e60ec88e58bad0d77b INFO: 172.20.0.1:53258 - "POST /node/69b911e60ec88e58bad0d77b HTTP/1.0" 202 Accepted 2026-03-17 08:33:51,630 - lava_callback - INFO - Starting async job submit for node 69b911e60ec88e58bad0d77b 2026-03-17 08:33:51,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:33:51,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e60ec88e58bad0d77b HTTP/1.1" 200 None 2026-03-17 08:33:51,649 - lava_callback - DEBUG - Processing node 69b911e60ec88e58bad0d77b: rt-tests-cyclicdeadline 2026-03-17 08:33:51,651 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:33:51,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:33:51,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:33:51,849 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b911e60ec88e58bad0d77b/lava-logs.yaml 2026-03-17 08:33:51,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:33:52,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:33:52,058 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b911e60ec88e58bad0d77b/lava_callback.json.gz 2026-03-17 08:33:52,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:33:52,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e60ec88e58bad0d77b HTTP/1.1" 200 None 2026-03-17 08:33:52,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:33:52,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:33:52,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:33:52,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911e60ec88e58bad0d77b HTTP/1.1" 200 None 2026-03-17 08:33:52,124 - lava_callback - INFO - Completed processing callback for node 69b911e60ec88e58bad0d77b 2026-03-17 08:33:54,095 - lava_callback - INFO - Received callback for node 69b911e40ec88e58bad0d772 INFO: 172.20.0.1:53274 - "POST /node/69b911e40ec88e58bad0d772 HTTP/1.0" 202 Accepted 2026-03-17 08:33:54,101 - lava_callback - INFO - Starting async job submit for node 69b911e40ec88e58bad0d772 2026-03-17 08:33:54,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:33:54,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e40ec88e58bad0d772 HTTP/1.1" 200 None 2026-03-17 08:33:54,119 - lava_callback - DEBUG - Processing node 69b911e40ec88e58bad0d772: job-gcc-14-x86-612-cip-rt 2026-03-17 08:33:54,120 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:33:54,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:33:54,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:33:54,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b911e40ec88e58bad0d772/lava-logs.yaml 2026-03-17 08:33:54,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:33:54,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:33:54,522 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b911e40ec88e58bad0d772/lava_callback.json.gz 2026-03-17 08:33:54,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:33:54,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e40ec88e58bad0d772 HTTP/1.1" 200 None 2026-03-17 08:33:54,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:33:54,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:33:54,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:33:54,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911e40ec88e58bad0d772 HTTP/1.1" 200 None 2026-03-17 08:33:54,581 - lava_callback - INFO - Completed processing callback for node 69b911e40ec88e58bad0d772 INFO: 172.20.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58820 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:34:06,592 - lava_callback - INFO - Received callback for node 69b911e80ec88e58bad0d784 INFO: 172.20.0.1:58836 - "POST /node/69b911e80ec88e58bad0d784 HTTP/1.0" 202 Accepted 2026-03-17 08:34:06,598 - lava_callback - INFO - Starting async job submit for node 69b911e80ec88e58bad0d784 2026-03-17 08:34:06,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:06,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e80ec88e58bad0d784 HTTP/1.1" 200 None 2026-03-17 08:34:06,681 - lava_callback - DEBUG - Processing node 69b911e80ec88e58bad0d784: rt-tests-cyclictest 2026-03-17 08:34:06,682 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:34:06,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:06,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:06,875 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b911e80ec88e58bad0d784/lava-logs.yaml 2026-03-17 08:34:06,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:07,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:07,056 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b911e80ec88e58bad0d784/lava_callback.json.gz 2026-03-17 08:34:07,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:07,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e80ec88e58bad0d784 HTTP/1.1" 200 None 2026-03-17 08:34:07,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:07,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:34:07,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:07,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911e80ec88e58bad0d784 HTTP/1.1" 200 None 2026-03-17 08:34:07,126 - lava_callback - INFO - Completed processing callback for node 69b911e80ec88e58bad0d784 2026-03-17 08:34:10,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:10,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 08:34:11,040 - lava_callback - INFO - Received callback for node 69b911f10ec88e58bad0d79a INFO: 172.20.0.1:44390 - "POST /node/69b911f10ec88e58bad0d79a HTTP/1.0" 202 Accepted 2026-03-17 08:34:11,045 - lava_callback - INFO - Starting async job submit for node 69b911f10ec88e58bad0d79a 2026-03-17 08:34:11,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:11,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911f10ec88e58bad0d79a HTTP/1.1" 200 None 2026-03-17 08:34:11,062 - lava_callback - DEBUG - Processing node 69b911f10ec88e58bad0d79a: rt-tests-cyclicdeadline 2026-03-17 08:34:11,064 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:34:11,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:11,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:11,255 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b911f10ec88e58bad0d79a/lava-logs.yaml 2026-03-17 08:34:11,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:11,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:11,376 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b911f10ec88e58bad0d79a/lava_callback.json.gz 2026-03-17 08:34:11,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:11,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911f10ec88e58bad0d79a HTTP/1.1" 200 None 2026-03-17 08:34:11,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:11,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:34:11,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:11,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911f10ec88e58bad0d79a HTTP/1.1" 200 None 2026-03-17 08:34:11,433 - lava_callback - INFO - Completed processing callback for node 69b911f10ec88e58bad0d79a 2026-03-17 08:34:12,447 - lava_callback - INFO - Received callback for node 69b911f30ec88e58bad0d79f INFO: 172.20.0.1:44400 - "POST /node/69b911f30ec88e58bad0d79f HTTP/1.0" 202 Accepted 2026-03-17 08:34:12,457 - lava_callback - INFO - Starting async job submit for node 69b911f30ec88e58bad0d79f 2026-03-17 08:34:12,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:12,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911f30ec88e58bad0d79f HTTP/1.1" 200 None 2026-03-17 08:34:12,518 - lava_callback - DEBUG - Processing node 69b911f30ec88e58bad0d79f: job-gcc-14-x86-612-cip-rt 2026-03-17 08:34:12,520 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:34:12,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:12,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:12,721 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b911f30ec88e58bad0d79f/lava-logs.yaml 2026-03-17 08:34:12,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:12,894 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:12,896 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b911f30ec88e58bad0d79f/lava_callback.json.gz 2026-03-17 08:34:12,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:12,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911f30ec88e58bad0d79f HTTP/1.1" 200 None 2026-03-17 08:34:12,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:12,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:34:12,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:13,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911f30ec88e58bad0d79f HTTP/1.1" 200 None 2026-03-17 08:34:13,023 - lava_callback - INFO - Completed processing callback for node 69b911f30ec88e58bad0d79f INFO: 172.20.0.1:44404 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 08:34:16,163 - lava_callback - INFO - Received callback for node 69b912010ec88e58bad0d7a4 INFO: 172.20.0.1:44406 - "POST /node/69b912010ec88e58bad0d7a4 HTTP/1.0" 202 Accepted 2026-03-17 08:34:16,173 - lava_callback - INFO - Starting async job submit for node 69b912010ec88e58bad0d7a4 2026-03-17 08:34:16,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:16,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912010ec88e58bad0d7a4 HTTP/1.1" 200 None 2026-03-17 08:34:16,201 - lava_callback - DEBUG - Processing node 69b912010ec88e58bad0d7a4: rt-tests-cyclictest 2026-03-17 08:34:16,203 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:34:16,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:16,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:16,327 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b912010ec88e58bad0d7a4/lava-logs.yaml 2026-03-17 08:34:16,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:16,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:16,449 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b912010ec88e58bad0d7a4/lava_callback.json.gz 2026-03-17 08:34:16,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:16,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912010ec88e58bad0d7a4 HTTP/1.1" 200 None 2026-03-17 08:34:16,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:16,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:34:16,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:16,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912010ec88e58bad0d7a4 HTTP/1.1" 200 None 2026-03-17 08:34:16,515 - lava_callback - INFO - Completed processing callback for node 69b912010ec88e58bad0d7a4 INFO: 172.20.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46494 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:34:27,322 - lava_callback - INFO - Received callback for node 69b9120a0ec88e58bad0d7ca INFO: 172.20.0.1:46510 - "POST /node/69b9120a0ec88e58bad0d7ca HTTP/1.0" 202 Accepted 2026-03-17 08:34:27,328 - lava_callback - INFO - Starting async job submit for node 69b9120a0ec88e58bad0d7ca 2026-03-17 08:34:27,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:27,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9120a0ec88e58bad0d7ca HTTP/1.1" 200 None 2026-03-17 08:34:27,357 - lava_callback - DEBUG - Processing node 69b9120a0ec88e58bad0d7ca: rt-tests-cyclictest 2026-03-17 08:34:27,359 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:34:27,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:27,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:27,485 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b9120a0ec88e58bad0d7ca/lava-logs.yaml 2026-03-17 08:34:27,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:27,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:27,622 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b9120a0ec88e58bad0d7ca/lava_callback.json.gz 2026-03-17 08:34:27,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:27,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9120a0ec88e58bad0d7ca HTTP/1.1" 200 None 2026-03-17 08:34:27,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:27,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:34:27,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:27,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9120a0ec88e58bad0d7ca HTTP/1.1" 200 None 2026-03-17 08:34:27,697 - lava_callback - INFO - Completed processing callback for node 69b9120a0ec88e58bad0d7ca 2026-03-17 08:34:31,061 - lava_callback - INFO - Received callback for node 69b912040ec88e58bad0d7ac INFO: 172.20.0.1:52818 - "POST /node/69b912040ec88e58bad0d7ac HTTP/1.0" 202 Accepted 2026-03-17 08:34:31,066 - lava_callback - INFO - Starting async job submit for node 69b912040ec88e58bad0d7ac 2026-03-17 08:34:31,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:31,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912040ec88e58bad0d7ac HTTP/1.1" 200 None 2026-03-17 08:34:31,084 - lava_callback - DEBUG - Processing node 69b912040ec88e58bad0d7ac: rt-tests-cyclicdeadline 2026-03-17 08:34:31,086 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:34:31,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:31,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:31,225 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b912040ec88e58bad0d7ac/lava-logs.yaml 2026-03-17 08:34:31,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:31,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:31,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b912040ec88e58bad0d7ac/lava_callback.json.gz 2026-03-17 08:34:31,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:31,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912040ec88e58bad0d7ac HTTP/1.1" 200 None 2026-03-17 08:34:31,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:31,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:34:31,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:31,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912040ec88e58bad0d7ac HTTP/1.1" 200 None 2026-03-17 08:34:31,418 - lava_callback - INFO - Completed processing callback for node 69b912040ec88e58bad0d7ac 2026-03-17 08:34:32,472 - lava_callback - INFO - Received callback for node 69b912060ec88e58bad0d7b1 INFO: 172.20.0.1:52824 - "POST /node/69b912060ec88e58bad0d7b1 HTTP/1.0" 202 Accepted 2026-03-17 08:34:32,478 - lava_callback - INFO - Starting async job submit for node 69b912060ec88e58bad0d7b1 2026-03-17 08:34:32,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:32,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912060ec88e58bad0d7b1 HTTP/1.1" 200 None 2026-03-17 08:34:32,499 - lava_callback - DEBUG - Processing node 69b912060ec88e58bad0d7b1: job-gcc-14-x86-612-cip-rt 2026-03-17 08:34:32,500 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:34:32,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:32,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:32,614 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b912060ec88e58bad0d7b1/lava-logs.yaml 2026-03-17 08:34:32,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:32,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:32,850 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b912060ec88e58bad0d7b1/lava_callback.json.gz 2026-03-17 08:34:32,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:32,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912060ec88e58bad0d7b1 HTTP/1.1" 200 None 2026-03-17 08:34:32,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:32,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:34:32,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:32,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912060ec88e58bad0d7b1 HTTP/1.1" 200 None 2026-03-17 08:34:32,919 - lava_callback - INFO - Completed processing callback for node 69b912060ec88e58bad0d7b1 INFO: 172.20.0.1:52836 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:34:40,174 - lava_callback - INFO - Received callback for node 69b9121a0ec88e58bad0d7d9 INFO: 172.20.0.1:40650 - "POST /node/69b9121a0ec88e58bad0d7d9 HTTP/1.0" 202 Accepted 2026-03-17 08:34:40,180 - lava_callback - INFO - Starting async job submit for node 69b9121a0ec88e58bad0d7d9 2026-03-17 08:34:40,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:40,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9121a0ec88e58bad0d7d9 HTTP/1.1" 200 None 2026-03-17 08:34:40,197 - lava_callback - DEBUG - Processing node 69b9121a0ec88e58bad0d7d9: job-gcc-14-x86-612-cip-rt 2026-03-17 08:34:40,199 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:34:40,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:40,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:40,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b9121a0ec88e58bad0d7d9/lava-logs.yaml 2026-03-17 08:34:40,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:40,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:40,434 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b9121a0ec88e58bad0d7d9/lava_callback.json.gz 2026-03-17 08:34:40,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:40,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9121a0ec88e58bad0d7d9 HTTP/1.1" 200 None 2026-03-17 08:34:40,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:40,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:34:40,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:40,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9121a0ec88e58bad0d7d9 HTTP/1.1" 200 None 2026-03-17 08:34:40,506 - lava_callback - INFO - Completed processing callback for node 69b9121a0ec88e58bad0d7d9 2026-03-17 08:34:40,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:40,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40662 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:34:45,862 - lava_callback - INFO - Received callback for node 69b912180ec88e58bad0d7d4 INFO: 172.20.0.1:40664 - "POST /node/69b912180ec88e58bad0d7d4 HTTP/1.0" 202 Accepted 2026-03-17 08:34:45,868 - lava_callback - INFO - Starting async job submit for node 69b912180ec88e58bad0d7d4 2026-03-17 08:34:45,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:45,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912180ec88e58bad0d7d4 HTTP/1.1" 200 None 2026-03-17 08:34:45,885 - lava_callback - DEBUG - Processing node 69b912180ec88e58bad0d7d4: rt-tests-cyclicdeadline 2026-03-17 08:34:45,887 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:34:45,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:46,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:46,076 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b912180ec88e58bad0d7d4/lava-logs.yaml 2026-03-17 08:34:46,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:46,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:46,273 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b912180ec88e58bad0d7d4/lava_callback.json.gz 2026-03-17 08:34:46,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:46,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912180ec88e58bad0d7d4 HTTP/1.1" 200 None 2026-03-17 08:34:46,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:46,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:34:46,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:46,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912180ec88e58bad0d7d4 HTTP/1.1" 200 None 2026-03-17 08:34:46,335 - lava_callback - INFO - Completed processing callback for node 69b912180ec88e58bad0d7d4 INFO: 172.20.0.1:40680 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:34:46,758 - lava_callback - INFO - Received callback for node 69b912150ec88e58bad0d7cf INFO: 172.20.0.1:40694 - "POST /node/69b912150ec88e58bad0d7cf HTTP/1.0" 202 Accepted 2026-03-17 08:34:46,764 - lava_callback - INFO - Starting async job submit for node 69b912150ec88e58bad0d7cf 2026-03-17 08:34:46,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:46,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912150ec88e58bad0d7cf HTTP/1.1" 200 None 2026-03-17 08:34:46,782 - lava_callback - DEBUG - Processing node 69b912150ec88e58bad0d7cf: rt-tests-cyclictest 2026-03-17 08:34:46,784 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:34:46,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:46,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:46,901 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b912150ec88e58bad0d7cf/lava-logs.yaml 2026-03-17 08:34:46,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:34:47,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:34:47,017 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b912150ec88e58bad0d7cf/lava_callback.json.gz 2026-03-17 08:34:47,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:47,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912150ec88e58bad0d7cf HTTP/1.1" 200 None 2026-03-17 08:34:47,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:47,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:34:47,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:34:47,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912150ec88e58bad0d7cf HTTP/1.1" 200 None 2026-03-17 08:34:47,151 - lava_callback - INFO - Completed processing callback for node 69b912150ec88e58bad0d7cf INFO: 172.20.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39000 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:35:10,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:35:10,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51702 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:36:08,442 - lava_callback - INFO - Received callback for node 69b911e40ec88e58bad0d775 INFO: 172.20.0.1:51708 - "POST /node/69b911e40ec88e58bad0d775 HTTP/1.0" 202 Accepted 2026-03-17 08:36:08,463 - lava_callback - INFO - Starting async job submit for node 69b911e40ec88e58bad0d775 2026-03-17 08:36:08,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:36:08,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e40ec88e58bad0d775 HTTP/1.1" 200 None 2026-03-17 08:36:08,534 - lava_callback - DEBUG - Processing node 69b911e40ec88e58bad0d775: job-gcc-14-x86-612-cip-rt 2026-03-17 08:36:09,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:36:09,250 - lava_callback - INFO - Received callback for node 69b911e50ec88e58bad0d778 2026-03-17 08:36:09,264 - lava_callback - INFO - Starting async job submit for node 69b911e50ec88e58bad0d778 INFO: 172.20.0.1:51714 - "POST /node/69b911e50ec88e58bad0d778 HTTP/1.0" 202 Accepted 2026-03-17 08:36:09,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:36:09,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e50ec88e58bad0d778 HTTP/1.1" 200 None 2026-03-17 08:36:09,436 - lava_callback - DEBUG - Processing node 69b911e50ec88e58bad0d778: job-gcc-14-x86-612-cip-rt 2026-03-17 08:36:09,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:36:09,808 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b911e40ec88e58bad0d775/log.txt.gz 2026-03-17 08:36:10,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:36:10,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:36:10,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:36:10,830 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b911e50ec88e58bad0d778/log.txt.gz 2026-03-17 08:36:11,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:36:11,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:36:11,198 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b911e40ec88e58bad0d775/lava-logs.yaml 2026-03-17 08:36:11,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:36:11,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:36:11,843 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b911e50ec88e58bad0d778/lava-logs.yaml 2026-03-17 08:36:11,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:36:11,856 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b911e40ec88e58bad0d775/lava_callback.json.gz 2026-03-17 08:36:11,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:36:11,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:36:11,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e40ec88e58bad0d775 HTTP/1.1" 200 None 2026-03-17 08:36:11,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:36:11,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:36:11,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:36:12,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911e40ec88e58bad0d775 HTTP/1.1" 200 None 2026-03-17 08:36:12,009 - lava_callback - INFO - Completed processing callback for node 69b911e40ec88e58bad0d775 2026-03-17 08:36:12,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:36:12,505 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-x86-612-cip-rt-69b911e50ec88e58bad0d778/lava_callback.json.gz 2026-03-17 08:36:12,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:36:12,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e50ec88e58bad0d778 HTTP/1.1" 200 None 2026-03-17 08:36:12,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:36:12,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:36:12,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:36:12,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911e50ec88e58bad0d778 HTTP/1.1" 200 None 2026-03-17 08:36:12,636 - lava_callback - INFO - Completed processing callback for node 69b911e50ec88e58bad0d778 INFO: 172.20.0.1:40878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50852 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:36:40,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:36:40,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35628 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:37:26,903 - lava_callback - INFO - Received callback for node 69b66fb91727ff69d6f27394 INFO: 172.20.0.1:35632 - "POST /node/69b66fb91727ff69d6f27394 HTTP/1.0" 202 Accepted 2026-03-17 08:37:26,909 - lava_callback - INFO - Starting async job submit for node 69b66fb91727ff69d6f27394 2026-03-17 08:37:26,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:37:26,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b66fb91727ff69d6f27394 HTTP/1.1" 200 None 2026-03-17 08:37:26,932 - lava_callback - DEBUG - Processing node 69b66fb91727ff69d6f27394: baseline-arm-baylibre 2026-03-17 08:37:26,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b66fb91727ff69d6f27394 2026-03-17 08:37:26,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:37:26,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b66fb91727ff69d6f27394 HTTP/1.1" 200 None 2026-03-17 08:37:26,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:37:26,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 08:37:26,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:37:27,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b66fb91727ff69d6f27394 HTTP/1.1" 200 None 2026-03-17 08:37:27,011 - lava_callback - ERROR - Error processing callback for node 69b66fb91727ff69d6f27394: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33638 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:38:00,352 - lava_callback - INFO - Received callback for node 69b847430b8ad4124cec6414 INFO: 172.20.0.1:59262 - "POST /node/69b847430b8ad4124cec6414 HTTP/1.0" 202 Accepted 2026-03-17 08:38:00,362 - lava_callback - INFO - Starting async job submit for node 69b847430b8ad4124cec6414 2026-03-17 08:38:00,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:00,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b847430b8ad4124cec6414 HTTP/1.1" 200 None 2026-03-17 08:38:00,427 - lava_callback - DEBUG - Processing node 69b847430b8ad4124cec6414: baseline-arm64-broonie 2026-03-17 08:38:00,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:38:01,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:38:01,234 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b847430b8ad4124cec6414/log.txt.gz 2026-03-17 08:38:01,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:38:01,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:38:01,885 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b847430b8ad4124cec6414/lava-logs.yaml 2026-03-17 08:38:01,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:38:02,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:38:02,122 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b847430b8ad4124cec6414/lava_callback.json.gz 2026-03-17 08:38:02,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:02,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b847430b8ad4124cec6414 HTTP/1.1" 200 None 2026-03-17 08:38:02,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:02,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-17 08:38:02,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:02,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b847430b8ad4124cec6414 HTTP/1.1" 200 None 2026-03-17 08:38:02,314 - lava_callback - INFO - Completed processing callback for node 69b847430b8ad4124cec6414 INFO: 172.20.0.1:59270 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:38:06,820 - lava_callback - INFO - Received callback for node 69b66fde1727ff69d6f273ab INFO: 172.20.0.1:59284 - "POST /node/69b66fde1727ff69d6f273ab HTTP/1.0" 202 Accepted 2026-03-17 08:38:06,826 - lava_callback - INFO - Starting async job submit for node 69b66fde1727ff69d6f273ab 2026-03-17 08:38:06,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:06,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b66fde1727ff69d6f273ab HTTP/1.1" 200 None 2026-03-17 08:38:06,853 - lava_callback - DEBUG - Processing node 69b66fde1727ff69d6f273ab: baseline-arm-baylibre 2026-03-17 08:38:06,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b66fde1727ff69d6f273ab 2026-03-17 08:38:06,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:06,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b66fde1727ff69d6f273ab HTTP/1.1" 200 None 2026-03-17 08:38:06,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:06,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 08:38:06,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:06,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b66fde1727ff69d6f273ab HTTP/1.1" 200 None 2026-03-17 08:38:06,905 - lava_callback - ERROR - Error processing callback for node 69b66fde1727ff69d6f273ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 08:38:10,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:10,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60558 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:38:30,649 - lava_callback - INFO - Received callback for node 69b912ed0ec88e58bad0d827 INFO: 172.20.0.1:58568 - "POST /node/69b912ed0ec88e58bad0d827 HTTP/1.0" 202 Accepted 2026-03-17 08:38:30,656 - lava_callback - INFO - Starting async job submit for node 69b912ed0ec88e58bad0d827 2026-03-17 08:38:30,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:30,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912ed0ec88e58bad0d827 HTTP/1.1" 200 None 2026-03-17 08:38:30,675 - lava_callback - DEBUG - Processing node 69b912ed0ec88e58bad0d827: baseline-arm 2026-03-17 08:38:30,680 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:38:30,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:38:30,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:38:30,820 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b912ed0ec88e58bad0d827/lava-logs.yaml 2026-03-17 08:38:30,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:38:30,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:38:30,944 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b912ed0ec88e58bad0d827/lava_callback.json.gz 2026-03-17 08:38:30,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:30,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912ed0ec88e58bad0d827 HTTP/1.1" 200 None 2026-03-17 08:38:30,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:30,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:38:30,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:31,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912ed0ec88e58bad0d827 HTTP/1.1" 200 None 2026-03-17 08:38:31,020 - lava_callback - INFO - Completed processing callback for node 69b912ed0ec88e58bad0d827 INFO: 172.20.0.1:58578 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:38:40,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:40,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44430 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:38:46,880 - lava_callback - INFO - Received callback for node 69b670021727ff69d6f273b4 INFO: 172.20.0.1:44436 - "POST /node/69b670021727ff69d6f273b4 HTTP/1.0" 202 Accepted 2026-03-17 08:38:46,886 - lava_callback - INFO - Starting async job submit for node 69b670021727ff69d6f273b4 2026-03-17 08:38:46,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:46,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b670021727ff69d6f273b4 HTTP/1.1" 200 None 2026-03-17 08:38:46,902 - lava_callback - DEBUG - Processing node 69b670021727ff69d6f273b4: baseline-arm-baylibre 2026-03-17 08:38:46,902 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b670021727ff69d6f273b4 2026-03-17 08:38:46,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:46,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b670021727ff69d6f273b4 HTTP/1.1" 200 None 2026-03-17 08:38:46,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:46,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 08:38:46,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:38:46,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b670021727ff69d6f273b4 HTTP/1.1" 200 None 2026-03-17 08:38:46,960 - lava_callback - ERROR - Error processing callback for node 69b670021727ff69d6f273b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44916 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:39:03,208 - lava_callback - INFO - Received callback for node 69b912ee0ec88e58bad0d82a INFO: 172.20.0.1:36274 - "POST /node/69b912ee0ec88e58bad0d82a HTTP/1.0" 202 Accepted 2026-03-17 08:39:03,258 - lava_callback - INFO - Starting async job submit for node 69b912ee0ec88e58bad0d82a 2026-03-17 08:39:03,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:03,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912ee0ec88e58bad0d82a HTTP/1.1" 200 None 2026-03-17 08:39:03,313 - lava_callback - DEBUG - Processing node 69b912ee0ec88e58bad0d82a: baseline-arm 2026-03-17 08:39:03,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:03,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:03,737 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b912ee0ec88e58bad0d82a/log.txt.gz 2026-03-17 08:39:03,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:04,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:04,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b912ee0ec88e58bad0d82a/lava-logs.yaml 2026-03-17 08:39:04,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:04,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:04,277 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b912ee0ec88e58bad0d82a/lava_callback.json.gz 2026-03-17 08:39:04,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:04,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912ee0ec88e58bad0d82a HTTP/1.1" 200 None 2026-03-17 08:39:04,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:04,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:39:04,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:04,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912ee0ec88e58bad0d82a HTTP/1.1" 200 None 2026-03-17 08:39:04,355 - lava_callback - INFO - Completed processing callback for node 69b912ee0ec88e58bad0d82a INFO: 172.20.0.1:36276 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:39:06,890 - lava_callback - INFO - Received callback for node 69b670271727ff69d6f273bd INFO: 172.20.0.1:36282 - "POST /node/69b670271727ff69d6f273bd HTTP/1.0" 202 Accepted 2026-03-17 08:39:06,900 - lava_callback - INFO - Starting async job submit for node 69b670271727ff69d6f273bd 2026-03-17 08:39:06,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:06,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b670271727ff69d6f273bd HTTP/1.1" 200 None 2026-03-17 08:39:06,931 - lava_callback - DEBUG - Processing node 69b670271727ff69d6f273bd: baseline-arm-baylibre 2026-03-17 08:39:06,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b670271727ff69d6f273bd 2026-03-17 08:39:06,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:06,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b670271727ff69d6f273bd HTTP/1.1" 200 None 2026-03-17 08:39:06,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:06,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 08:39:06,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:06,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b670271727ff69d6f273bd HTTP/1.1" 200 None 2026-03-17 08:39:06,988 - lava_callback - ERROR - Error processing callback for node 69b670271727ff69d6f273bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 08:39:10,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:10,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33180 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:39:20,715 - lava_callback - INFO - Received callback for node 69b84b6f0b8ad4124cec645e INFO: 172.20.0.1:46352 - "POST /node/69b84b6f0b8ad4124cec645e HTTP/1.0" 202 Accepted 2026-03-17 08:39:20,723 - lava_callback - INFO - Starting async job submit for node 69b84b6f0b8ad4124cec645e 2026-03-17 08:39:20,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:20,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b84b6f0b8ad4124cec645e HTTP/1.1" 200 None 2026-03-17 08:39:20,757 - lava_callback - DEBUG - Processing node 69b84b6f0b8ad4124cec645e: baseline-arm64-broonie 2026-03-17 08:39:20,823 - lava_callback - INFO - Received callback for node 69b912ec0ec88e58bad0d824 INFO: 172.20.0.1:46354 - "POST /node/69b912ec0ec88e58bad0d824 HTTP/1.0" 202 Accepted 2026-03-17 08:39:20,834 - lava_callback - INFO - Starting async job submit for node 69b912ec0ec88e58bad0d824 2026-03-17 08:39:20,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:20,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912ec0ec88e58bad0d824 HTTP/1.1" 200 None 2026-03-17 08:39:20,996 - lava_callback - DEBUG - Processing node 69b912ec0ec88e58bad0d824: baseline-arm 2026-03-17 08:39:21,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:21,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:21,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:21,536 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b84b6f0b8ad4124cec645e/log.txt.gz 2026-03-17 08:39:21,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:21,617 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b912ec0ec88e58bad0d824/log.txt.gz 2026-03-17 08:39:21,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:21,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:22,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:22,081 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b912ec0ec88e58bad0d824/lava-logs.yaml 2026-03-17 08:39:22,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:22,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:22,107 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b84b6f0b8ad4124cec645e/lava-logs.yaml 2026-03-17 08:39:22,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:22,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:22,281 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b912ec0ec88e58bad0d824/lava_callback.json.gz 2026-03-17 08:39:22,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:22,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:22,309 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b84b6f0b8ad4124cec645e/lava_callback.json.gz 2026-03-17 08:39:22,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:22,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912ec0ec88e58bad0d824 HTTP/1.1" 200 None 2026-03-17 08:39:22,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:22,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b84b6f0b8ad4124cec645e HTTP/1.1" 200 None 2026-03-17 08:39:22,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:22,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:39:22,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:22,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-17 08:39:22,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:22,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912ec0ec88e58bad0d824 HTTP/1.1" 200 None 2026-03-17 08:39:22,416 - lava_callback - INFO - Completed processing callback for node 69b912ec0ec88e58bad0d824 2026-03-17 08:39:22,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b84b6f0b8ad4124cec645e HTTP/1.1" 200 None 2026-03-17 08:39:22,455 - lava_callback - INFO - Completed processing callback for node 69b84b6f0b8ad4124cec645e INFO: 172.20.0.1:46368 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:39:36,129 - lava_callback - INFO - Received callback for node 69b912f10ec88e58bad0d835 INFO: 172.20.0.1:59394 - "POST /node/69b912f10ec88e58bad0d835 HTTP/1.0" 202 Accepted 2026-03-17 08:39:36,177 - lava_callback - INFO - Starting async job submit for node 69b912f10ec88e58bad0d835 2026-03-17 08:39:36,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:36,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f10ec88e58bad0d835 HTTP/1.1" 200 None 2026-03-17 08:39:36,209 - lava_callback - DEBUG - Processing node 69b912f10ec88e58bad0d835: baseline-arm 2026-03-17 08:39:36,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:36,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:36,449 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b912f10ec88e58bad0d835/log.txt.gz INFO: 172.20.0.1:59408 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:39:36,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:36,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:36,701 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b912f10ec88e58bad0d835/lava-logs.yaml 2026-03-17 08:39:36,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:36,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:36,824 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b912f10ec88e58bad0d835/lava_callback.json.gz 2026-03-17 08:39:36,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:36,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f10ec88e58bad0d835 HTTP/1.1" 200 None 2026-03-17 08:39:36,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:36,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:39:36,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:36,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912f10ec88e58bad0d835 HTTP/1.1" 200 None 2026-03-17 08:39:36,907 - lava_callback - INFO - Completed processing callback for node 69b912f10ec88e58bad0d835 2026-03-17 08:39:38,652 - lava_callback - INFO - Received callback for node 69b913130ec88e58bad0d8b3 INFO: 172.20.0.1:59420 - "POST /node/69b913130ec88e58bad0d8b3 HTTP/1.0" 202 Accepted 2026-03-17 08:39:38,702 - lava_callback - INFO - Starting async job submit for node 69b913130ec88e58bad0d8b3 2026-03-17 08:39:38,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:38,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913130ec88e58bad0d8b3 HTTP/1.1" 200 None 2026-03-17 08:39:38,738 - lava_callback - DEBUG - Processing node 69b913130ec88e58bad0d8b3: baseline-arm-pengutronix 2026-03-17 08:39:38,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:38,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:38,968 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b913130ec88e58bad0d8b3/log.txt.gz 2026-03-17 08:39:39,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:39,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:39,261 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b913130ec88e58bad0d8b3/lava-logs.yaml 2026-03-17 08:39:39,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:39,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:39,383 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b913130ec88e58bad0d8b3/lava_callback.json.gz 2026-03-17 08:39:39,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:39,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913130ec88e58bad0d8b3 HTTP/1.1" 200 None 2026-03-17 08:39:39,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:39,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:39:39,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:39,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913130ec88e58bad0d8b3 HTTP/1.1" 200 None 2026-03-17 08:39:39,465 - lava_callback - INFO - Completed processing callback for node 69b913130ec88e58bad0d8b3 2026-03-17 08:39:40,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:40,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-17 08:39:41,358 - lava_callback - INFO - Received callback for node 69b912fe0ec88e58bad0d86e INFO: 172.20.0.1:58890 - "POST /node/69b912fe0ec88e58bad0d86e HTTP/1.0" 202 Accepted 2026-03-17 08:39:41,364 - lava_callback - INFO - Starting async job submit for node 69b912fe0ec88e58bad0d86e 2026-03-17 08:39:41,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:41,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912fe0ec88e58bad0d86e HTTP/1.1" 200 None 2026-03-17 08:39:41,409 - lava_callback - DEBUG - Processing node 69b912fe0ec88e58bad0d86e: baseline-arm-broonie 2026-03-17 08:39:41,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:41,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:41,759 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b912fe0ec88e58bad0d86e/log.txt.gz 2026-03-17 08:39:41,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:42,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:42,089 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b912fe0ec88e58bad0d86e/lava-logs.yaml 2026-03-17 08:39:42,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:42,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:42,230 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b912fe0ec88e58bad0d86e/lava_callback.json.gz 2026-03-17 08:39:42,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:42,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912fe0ec88e58bad0d86e HTTP/1.1" 200 None 2026-03-17 08:39:42,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:42,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:39:42,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:42,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912fe0ec88e58bad0d86e HTTP/1.1" 200 None 2026-03-17 08:39:42,317 - lava_callback - INFO - Completed processing callback for node 69b912fe0ec88e58bad0d86e INFO: 172.20.0.1:58892 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:39:43,548 - lava_callback - INFO - Received callback for node 69b913110ec88e58bad0d8ad INFO: 172.20.0.1:58900 - "POST /node/69b913110ec88e58bad0d8ad HTTP/1.0" 202 Accepted 2026-03-17 08:39:43,554 - lava_callback - INFO - Starting async job submit for node 69b913110ec88e58bad0d8ad 2026-03-17 08:39:43,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:43,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913110ec88e58bad0d8ad HTTP/1.1" 200 None 2026-03-17 08:39:43,588 - lava_callback - DEBUG - Processing node 69b913110ec88e58bad0d8ad: baseline-arm-pengutronix 2026-03-17 08:39:43,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:43,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:43,860 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b913110ec88e58bad0d8ad/log.txt.gz 2026-03-17 08:39:43,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:44,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:44,131 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b913110ec88e58bad0d8ad/lava-logs.yaml 2026-03-17 08:39:44,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:44,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:44,292 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b913110ec88e58bad0d8ad/lava_callback.json.gz 2026-03-17 08:39:44,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:44,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913110ec88e58bad0d8ad HTTP/1.1" 200 None 2026-03-17 08:39:44,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:44,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:39:44,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:44,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913110ec88e58bad0d8ad HTTP/1.1" 200 None 2026-03-17 08:39:44,388 - lava_callback - INFO - Completed processing callback for node 69b913110ec88e58bad0d8ad 2026-03-17 08:39:44,541 - lava_callback - INFO - Received callback for node 69b913100ec88e58bad0d8a9 INFO: 172.20.0.1:58906 - "POST /node/69b913100ec88e58bad0d8a9 HTTP/1.0" 202 Accepted 2026-03-17 08:39:44,551 - lava_callback - INFO - Starting async job submit for node 69b913100ec88e58bad0d8a9 2026-03-17 08:39:44,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:44,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913100ec88e58bad0d8a9 HTTP/1.1" 200 None 2026-03-17 08:39:44,606 - lava_callback - DEBUG - Processing node 69b913100ec88e58bad0d8a9: baseline-arm-pengutronix 2026-03-17 08:39:44,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:44,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:44,889 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b913100ec88e58bad0d8a9/log.txt.gz 2026-03-17 08:39:44,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:45,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:45,158 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b913100ec88e58bad0d8a9/lava-logs.yaml 2026-03-17 08:39:45,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:45,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:45,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b913100ec88e58bad0d8a9/lava_callback.json.gz 2026-03-17 08:39:45,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:45,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913100ec88e58bad0d8a9 HTTP/1.1" 200 None 2026-03-17 08:39:45,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:45,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:39:45,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:45,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913100ec88e58bad0d8a9 HTTP/1.1" 200 None 2026-03-17 08:39:45,373 - lava_callback - INFO - Completed processing callback for node 69b913100ec88e58bad0d8a9 INFO: 172.20.0.1:58918 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:39:50,612 - lava_callback - INFO - Received callback for node 69b913050ec88e58bad0d883 INFO: 172.20.0.1:46286 - "POST /node/69b913050ec88e58bad0d883 HTTP/1.0" 202 Accepted 2026-03-17 08:39:50,620 - lava_callback - INFO - Starting async job submit for node 69b913050ec88e58bad0d883 2026-03-17 08:39:50,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:50,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913050ec88e58bad0d883 HTTP/1.1" 200 None 2026-03-17 08:39:50,661 - lava_callback - DEBUG - Processing node 69b913050ec88e58bad0d883: baseline-arm-clabbe 2026-03-17 08:39:50,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:51,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:51,026 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b913050ec88e58bad0d883/log.txt.gz 2026-03-17 08:39:51,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:51,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:51,442 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b913050ec88e58bad0d883/lava-logs.yaml 2026-03-17 08:39:51,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:51,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:51,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b913050ec88e58bad0d883/lava_callback.json.gz 2026-03-17 08:39:51,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:51,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913050ec88e58bad0d883 HTTP/1.1" 200 None 2026-03-17 08:39:51,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:51,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:39:51,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:51,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913050ec88e58bad0d883 HTTP/1.1" 200 None 2026-03-17 08:39:51,742 - lava_callback - INFO - Completed processing callback for node 69b913050ec88e58bad0d883 2026-03-17 08:39:53,224 - lava_callback - INFO - Received callback for node 69b6704d1727ff69d6f273c8 INFO: 172.20.0.1:46292 - "POST /node/69b6704d1727ff69d6f273c8 HTTP/1.0" 202 Accepted 2026-03-17 08:39:53,231 - lava_callback - INFO - Starting async job submit for node 69b6704d1727ff69d6f273c8 2026-03-17 08:39:53,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:53,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6704d1727ff69d6f273c8 HTTP/1.1" 200 None 2026-03-17 08:39:53,256 - lava_callback - DEBUG - Processing node 69b6704d1727ff69d6f273c8: baseline-arm-clabbe 2026-03-17 08:39:53,257 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6704d1727ff69d6f273c8 2026-03-17 08:39:53,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:53,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6704d1727ff69d6f273c8 HTTP/1.1" 200 None 2026-03-17 08:39:53,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:53,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 08:39:53,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:53,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6704d1727ff69d6f273c8 HTTP/1.1" 200 None 2026-03-17 08:39:53,316 - lava_callback - ERROR - Error processing callback for node 69b6704d1727ff69d6f273c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46308 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:39:57,173 - lava_callback - INFO - Received callback for node 69b913010ec88e58bad0d874 INFO: 172.20.0.1:46310 - "POST /node/69b913010ec88e58bad0d874 HTTP/1.0" 202 Accepted 2026-03-17 08:39:57,181 - lava_callback - INFO - Starting async job submit for node 69b913010ec88e58bad0d874 2026-03-17 08:39:57,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:57,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913010ec88e58bad0d874 HTTP/1.1" 200 None 2026-03-17 08:39:57,220 - lava_callback - DEBUG - Processing node 69b913010ec88e58bad0d874: baseline-arm-broonie 2026-03-17 08:39:57,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:57,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:57,612 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b913010ec88e58bad0d874/log.txt.gz 2026-03-17 08:39:57,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:57,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:57,959 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b913010ec88e58bad0d874/lava-logs.yaml 2026-03-17 08:39:57,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:39:58,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:39:58,188 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b913010ec88e58bad0d874/lava_callback.json.gz 2026-03-17 08:39:58,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:58,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913010ec88e58bad0d874 HTTP/1.1" 200 None 2026-03-17 08:39:58,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:58,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:39:58,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:39:58,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913010ec88e58bad0d874 HTTP/1.1" 200 None 2026-03-17 08:39:58,300 - lava_callback - INFO - Completed processing callback for node 69b913010ec88e58bad0d874 2026-03-17 08:40:00,502 - lava_callback - INFO - Received callback for node 69b913000ec88e58bad0d871 INFO: 172.20.0.1:44318 - "POST /node/69b913000ec88e58bad0d871 HTTP/1.0" 202 Accepted 2026-03-17 08:40:00,511 - lava_callback - INFO - Starting async job submit for node 69b913000ec88e58bad0d871 2026-03-17 08:40:00,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:00,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913000ec88e58bad0d871 HTTP/1.1" 200 None 2026-03-17 08:40:00,569 - lava_callback - DEBUG - Processing node 69b913000ec88e58bad0d871: baseline-arm-broonie 2026-03-17 08:40:00,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:40:01,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:40:01,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b913000ec88e58bad0d871/log.txt.gz 2026-03-17 08:40:01,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:40:01,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:40:01,421 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b913000ec88e58bad0d871/lava-logs.yaml 2026-03-17 08:40:01,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:40:01,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:40:01,592 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b913000ec88e58bad0d871/lava_callback.json.gz 2026-03-17 08:40:01,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:01,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913000ec88e58bad0d871 HTTP/1.1" 200 None 2026-03-17 08:40:01,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:01,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:40:01,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:01,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913000ec88e58bad0d871 HTTP/1.1" 200 None 2026-03-17 08:40:01,678 - lava_callback - INFO - Completed processing callback for node 69b913000ec88e58bad0d871 INFO: 172.20.0.1:44328 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:40:10,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:10,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:36882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35110 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:40:26,995 - lava_callback - INFO - Received callback for node 69b6706f1727ff69d6f273cf INFO: 172.20.0.1:35126 - "POST /node/69b6706f1727ff69d6f273cf HTTP/1.0" 202 Accepted 2026-03-17 08:40:27,002 - lava_callback - INFO - Starting async job submit for node 69b6706f1727ff69d6f273cf 2026-03-17 08:40:27,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:27,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6706f1727ff69d6f273cf HTTP/1.1" 200 None 2026-03-17 08:40:27,020 - lava_callback - DEBUG - Processing node 69b6706f1727ff69d6f273cf: baseline-arm-baylibre 2026-03-17 08:40:27,020 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6706f1727ff69d6f273cf 2026-03-17 08:40:27,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:27,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6706f1727ff69d6f273cf HTTP/1.1" 200 None 2026-03-17 08:40:27,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:27,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 08:40:27,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:27,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6706f1727ff69d6f273cf HTTP/1.1" 200 None 2026-03-17 08:40:27,100 - lava_callback - ERROR - Error processing callback for node 69b6706f1727ff69d6f273cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 08:40:27,134 - lava_callback - INFO - Received callback for node 69b9130d0ec88e58bad0d89e INFO: 172.20.0.1:35142 - "POST /node/69b9130d0ec88e58bad0d89e HTTP/1.0" 202 Accepted 2026-03-17 08:40:27,144 - lava_callback - INFO - Starting async job submit for node 69b9130d0ec88e58bad0d89e 2026-03-17 08:40:27,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:27,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9130d0ec88e58bad0d89e HTTP/1.1" 200 None 2026-03-17 08:40:27,196 - lava_callback - DEBUG - Processing node 69b9130d0ec88e58bad0d89e: baseline-arm-kontron 2026-03-17 08:40:27,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:40:27,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:40:27,729 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b9130d0ec88e58bad0d89e/log.txt.gz 2026-03-17 08:40:27,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:40:28,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:40:28,183 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b9130d0ec88e58bad0d89e/lava-logs.yaml 2026-03-17 08:40:28,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:40:28,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:40:28,497 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b9130d0ec88e58bad0d89e/lava_callback.json.gz 2026-03-17 08:40:28,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:28,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9130d0ec88e58bad0d89e HTTP/1.1" 200 None 2026-03-17 08:40:28,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:28,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:40:28,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:28,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9130d0ec88e58bad0d89e HTTP/1.1" 200 None 2026-03-17 08:40:28,611 - lava_callback - INFO - Completed processing callback for node 69b9130d0ec88e58bad0d89e INFO: 172.20.0.1:54024 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:40:40,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:40,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33012 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:40:55,819 - lava_callback - INFO - Received callback for node 69b913820ec88e58bad0d997 INFO: 172.20.0.1:38514 - "POST /node/69b913820ec88e58bad0d997 HTTP/1.0" 202 Accepted 2026-03-17 08:40:55,825 - lava_callback - INFO - Starting async job submit for node 69b913820ec88e58bad0d997 2026-03-17 08:40:55,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:55,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913820ec88e58bad0d997 HTTP/1.1" 200 None 2026-03-17 08:40:55,844 - lava_callback - DEBUG - Processing node 69b913820ec88e58bad0d997: baseline-arm 2026-03-17 08:40:55,849 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:40:55,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:40:55,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:40:55,991 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b913820ec88e58bad0d997/lava-logs.yaml 2026-03-17 08:40:55,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:40:56,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:40:56,108 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b913820ec88e58bad0d997/lava_callback.json.gz 2026-03-17 08:40:56,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:56,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913820ec88e58bad0d997 HTTP/1.1" 200 None 2026-03-17 08:40:56,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:56,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:40:56,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:56,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913820ec88e58bad0d997 HTTP/1.1" 200 None 2026-03-17 08:40:56,178 - lava_callback - INFO - Completed processing callback for node 69b913820ec88e58bad0d997 INFO: 172.20.0.1:38530 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:40:57,260 - lava_callback - INFO - Received callback for node 69b912fd0ec88e58bad0d86b INFO: 172.20.0.1:38542 - "POST /node/69b912fd0ec88e58bad0d86b HTTP/1.0" 202 Accepted 2026-03-17 08:40:57,270 - lava_callback - INFO - Starting async job submit for node 69b912fd0ec88e58bad0d86b 2026-03-17 08:40:57,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:57,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912fd0ec88e58bad0d86b HTTP/1.1" 200 None 2026-03-17 08:40:57,312 - lava_callback - DEBUG - Processing node 69b912fd0ec88e58bad0d86b: baseline-arm-broonie 2026-03-17 08:40:57,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:40:57,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:40:57,793 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b912fd0ec88e58bad0d86b/log.txt.gz 2026-03-17 08:40:57,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:40:58,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:40:58,156 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b912fd0ec88e58bad0d86b/lava-logs.yaml 2026-03-17 08:40:58,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:40:58,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:40:58,373 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b912fd0ec88e58bad0d86b/lava_callback.json.gz 2026-03-17 08:40:58,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:58,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912fd0ec88e58bad0d86b HTTP/1.1" 200 None 2026-03-17 08:40:58,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:58,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:40:58,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:40:58,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912fd0ec88e58bad0d86b HTTP/1.1" 200 None 2026-03-17 08:40:58,460 - lava_callback - INFO - Completed processing callback for node 69b912fd0ec88e58bad0d86b 2026-03-17 08:41:00,461 - lava_callback - INFO - Received callback for node 69b8ab32fbe29c53ae85f7f4 INFO: 172.20.0.1:53872 - "POST /node/69b8ab32fbe29c53ae85f7f4 HTTP/1.0" 202 Accepted 2026-03-17 08:41:00,467 - lava_callback - INFO - Starting async job submit for node 69b8ab32fbe29c53ae85f7f4 2026-03-17 08:41:00,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:00,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab32fbe29c53ae85f7f4 HTTP/1.1" 200 None 2026-03-17 08:41:00,512 - lava_callback - DEBUG - Processing node 69b8ab32fbe29c53ae85f7f4: baseline-arm64-broonie 2026-03-17 08:41:00,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:41:01,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:41:01,090 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab32fbe29c53ae85f7f4/log.txt.gz 2026-03-17 08:41:01,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:41:01,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:41:01,601 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab32fbe29c53ae85f7f4/lava-logs.yaml 2026-03-17 08:41:01,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:41:01,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:41:01,760 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab32fbe29c53ae85f7f4/lava_callback.json.gz 2026-03-17 08:41:01,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:01,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab32fbe29c53ae85f7f4 HTTP/1.1" 200 None 2026-03-17 08:41:01,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:01,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 08:41:01,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:01,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab32fbe29c53ae85f7f4 HTTP/1.1" 200 None 2026-03-17 08:41:01,926 - lava_callback - INFO - Completed processing callback for node 69b8ab32fbe29c53ae85f7f4 INFO: 172.20.0.1:53886 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:41:10,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:10,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 08:41:13,143 - lava_callback - INFO - Received callback for node 69b670941727ff69d6f273d8 INFO: 172.20.0.1:34036 - "POST /node/69b670941727ff69d6f273d8 HTTP/1.0" 202 Accepted 2026-03-17 08:41:13,153 - lava_callback - INFO - Starting async job submit for node 69b670941727ff69d6f273d8 2026-03-17 08:41:13,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:13,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b670941727ff69d6f273d8 HTTP/1.1" 200 None 2026-03-17 08:41:13,188 - lava_callback - DEBUG - Processing node 69b670941727ff69d6f273d8: baseline-arm-clabbe 2026-03-17 08:41:13,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b670941727ff69d6f273d8 2026-03-17 08:41:13,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:13,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b670941727ff69d6f273d8 HTTP/1.1" 200 None 2026-03-17 08:41:13,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:13,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 08:41:13,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:13,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b670941727ff69d6f273d8 HTTP/1.1" 200 None 2026-03-17 08:41:13,273 - lava_callback - ERROR - Error processing callback for node 69b670941727ff69d6f273d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34066 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:41:20,502 - lava_callback - INFO - Received callback for node 69b90498fbe29c53ae860413 INFO: 172.20.0.1:46894 - "POST /node/69b90498fbe29c53ae860413 HTTP/1.0" 202 Accepted 2026-03-17 08:41:20,509 - lava_callback - INFO - Starting async job submit for node 69b90498fbe29c53ae860413 2026-03-17 08:41:20,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:20,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90498fbe29c53ae860413 HTTP/1.1" 200 None 2026-03-17 08:41:20,544 - lava_callback - DEBUG - Processing node 69b90498fbe29c53ae860413: baseline-arm64-broonie 2026-03-17 08:41:20,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:41:21,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:41:21,171 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b90498fbe29c53ae860413/log.txt.gz 2026-03-17 08:41:21,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:41:21,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:41:21,655 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b90498fbe29c53ae860413/lava-logs.yaml 2026-03-17 08:41:21,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:41:21,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:41:21,833 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b90498fbe29c53ae860413/lava_callback.json.gz 2026-03-17 08:41:21,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:21,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90498fbe29c53ae860413 HTTP/1.1" 200 None 2026-03-17 08:41:21,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:21,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 08:41:21,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:21,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b90498fbe29c53ae860413 HTTP/1.1" 200 None 2026-03-17 08:41:21,927 - lava_callback - INFO - Completed processing callback for node 69b90498fbe29c53ae860413 2026-03-17 08:41:25,088 - lava_callback - INFO - Received callback for node 69b913060ec88e58bad0d887 INFO: 172.20.0.1:46902 - "POST /node/69b913060ec88e58bad0d887 HTTP/1.0" 202 Accepted 2026-03-17 08:41:25,094 - lava_callback - INFO - Starting async job submit for node 69b913060ec88e58bad0d887 2026-03-17 08:41:25,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:25,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913060ec88e58bad0d887 HTTP/1.1" 200 None 2026-03-17 08:41:25,144 - lava_callback - DEBUG - Processing node 69b913060ec88e58bad0d887: baseline-arm-clabbe 2026-03-17 08:41:25,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:41:25,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:41:25,684 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b913060ec88e58bad0d887/log.txt.gz 2026-03-17 08:41:25,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:41:26,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:41:26,004 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b913060ec88e58bad0d887/lava-logs.yaml 2026-03-17 08:41:26,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:41:26,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:41:26,147 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b913060ec88e58bad0d887/lava_callback.json.gz 2026-03-17 08:41:26,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:26,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913060ec88e58bad0d887 HTTP/1.1" 200 None 2026-03-17 08:41:26,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:26,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:41:26,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:26,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913060ec88e58bad0d887 HTTP/1.1" 200 None 2026-03-17 08:41:26,256 - lava_callback - INFO - Completed processing callback for node 69b913060ec88e58bad0d887 INFO: 172.20.0.1:46910 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:41:33,245 - lava_callback - INFO - Received callback for node 69b670b81727ff69d6f273e1 INFO: 172.20.0.1:36138 - "POST /node/69b670b81727ff69d6f273e1 HTTP/1.0" 202 Accepted 2026-03-17 08:41:33,251 - lava_callback - INFO - Starting async job submit for node 69b670b81727ff69d6f273e1 2026-03-17 08:41:33,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:33,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b670b81727ff69d6f273e1 HTTP/1.1" 200 None 2026-03-17 08:41:33,268 - lava_callback - DEBUG - Processing node 69b670b81727ff69d6f273e1: baseline-arm-clabbe 2026-03-17 08:41:33,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b670b81727ff69d6f273e1 2026-03-17 08:41:33,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:33,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b670b81727ff69d6f273e1 HTTP/1.1" 200 None 2026-03-17 08:41:33,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:33,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 08:41:33,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:33,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b670b81727ff69d6f273e1 HTTP/1.1" 200 None 2026-03-17 08:41:33,341 - lava_callback - ERROR - Error processing callback for node 69b670b81727ff69d6f273e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36150 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:41:40,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:40,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41146 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:41:59,238 - lava_callback - INFO - Received callback for node 69b912f00ec88e58bad0d832 INFO: 172.20.0.1:41158 - "POST /node/69b912f00ec88e58bad0d832 HTTP/1.0" 202 Accepted 2026-03-17 08:41:59,245 - lava_callback - INFO - Starting async job submit for node 69b912f00ec88e58bad0d832 2026-03-17 08:41:59,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:41:59,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f00ec88e58bad0d832 HTTP/1.1" 200 None 2026-03-17 08:41:59,291 - lava_callback - DEBUG - Processing node 69b912f00ec88e58bad0d832: baseline-arm 2026-03-17 08:41:59,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:41:59,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:41:59,651 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b912f00ec88e58bad0d832/log.txt.gz 2026-03-17 08:41:59,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:00,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:00,018 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b912f00ec88e58bad0d832/lava-logs.yaml 2026-03-17 08:42:00,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:00,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:00,209 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b912f00ec88e58bad0d832/lava_callback.json.gz 2026-03-17 08:42:00,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:00,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f00ec88e58bad0d832 HTTP/1.1" 200 None 2026-03-17 08:42:00,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:00,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:42:00,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:00,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912f00ec88e58bad0d832 HTTP/1.1" 200 None 2026-03-17 08:42:00,296 - lava_callback - INFO - Completed processing callback for node 69b912f00ec88e58bad0d832 INFO: 172.20.0.1:47218 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:42:10,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:10,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 08:42:13,370 - lava_callback - INFO - Received callback for node 69b670dc1727ff69d6f273ea INFO: 172.20.0.1:49298 - "POST /node/69b670dc1727ff69d6f273ea HTTP/1.0" 202 Accepted 2026-03-17 08:42:13,376 - lava_callback - INFO - Starting async job submit for node 69b670dc1727ff69d6f273ea 2026-03-17 08:42:13,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:13,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b670dc1727ff69d6f273ea HTTP/1.1" 200 None 2026-03-17 08:42:13,392 - lava_callback - DEBUG - Processing node 69b670dc1727ff69d6f273ea: baseline-arm-clabbe 2026-03-17 08:42:13,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b670dc1727ff69d6f273ea 2026-03-17 08:42:13,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:13,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b670dc1727ff69d6f273ea HTTP/1.1" 200 None 2026-03-17 08:42:13,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:13,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 08:42:13,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:13,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b670dc1727ff69d6f273ea HTTP/1.1" 200 None 2026-03-17 08:42:13,445 - lava_callback - ERROR - Error processing callback for node 69b670dc1727ff69d6f273ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 08:42:14,149 - lava_callback - INFO - Received callback for node 69b913d80ec88e58bad0d9e9 INFO: 172.20.0.1:49314 - "POST /node/69b913d80ec88e58bad0d9e9 HTTP/1.0" 202 Accepted 2026-03-17 08:42:14,157 - lava_callback - INFO - Starting async job submit for node 69b913d80ec88e58bad0d9e9 2026-03-17 08:42:14,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:14,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d80ec88e58bad0d9e9 HTTP/1.1" 200 None 2026-03-17 08:42:14,176 - lava_callback - DEBUG - Processing node 69b913d80ec88e58bad0d9e9: rt-tests-cyclicdeadline 2026-03-17 08:42:14,177 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:42:14,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:14,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:14,307 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b913d80ec88e58bad0d9e9/lava-logs.yaml 2026-03-17 08:42:14,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:14,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:14,449 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b913d80ec88e58bad0d9e9/lava_callback.json.gz 2026-03-17 08:42:14,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:14,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d80ec88e58bad0d9e9 HTTP/1.1" 200 None 2026-03-17 08:42:14,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:14,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 08:42:14,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:14,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913d80ec88e58bad0d9e9 HTTP/1.1" 200 None 2026-03-17 08:42:14,514 - lava_callback - INFO - Completed processing callback for node 69b913d80ec88e58bad0d9e9 INFO: 172.20.0.1:49316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49324 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:42:23,262 - lava_callback - INFO - Received callback for node 69b913dc0ec88e58bad0d9f9 INFO: 172.20.0.1:37898 - "POST /node/69b913dc0ec88e58bad0d9f9 HTTP/1.0" 202 Accepted 2026-03-17 08:42:23,268 - lava_callback - INFO - Starting async job submit for node 69b913dc0ec88e58bad0d9f9 2026-03-17 08:42:23,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:23,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913dc0ec88e58bad0d9f9 HTTP/1.1" 200 None 2026-03-17 08:42:23,286 - lava_callback - DEBUG - Processing node 69b913dc0ec88e58bad0d9f9: rt-tests-cyclictest 2026-03-17 08:42:23,287 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:42:23,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:23,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:23,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b913dc0ec88e58bad0d9f9/lava-logs.yaml 2026-03-17 08:42:23,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:23,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:23,548 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b913dc0ec88e58bad0d9f9/lava_callback.json.gz 2026-03-17 08:42:23,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:23,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913dc0ec88e58bad0d9f9 HTTP/1.1" 200 None 2026-03-17 08:42:23,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:23,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 08:42:23,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:23,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913dc0ec88e58bad0d9f9 HTTP/1.1" 200 None 2026-03-17 08:42:23,617 - lava_callback - INFO - Completed processing callback for node 69b913dc0ec88e58bad0d9f9 INFO: 172.20.0.1:37910 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:42:29,534 - lava_callback - INFO - Received callback for node 69b9132b0ec88e58bad0d8f4 INFO: 172.20.0.1:37926 - "POST /node/69b9132b0ec88e58bad0d8f4 HTTP/1.0" 202 Accepted 2026-03-17 08:42:29,541 - lava_callback - INFO - Starting async job submit for node 69b9132b0ec88e58bad0d8f4 2026-03-17 08:42:29,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:29,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9132b0ec88e58bad0d8f4 HTTP/1.1" 200 None 2026-03-17 08:42:29,580 - lava_callback - DEBUG - Processing node 69b9132b0ec88e58bad0d8f4: ltp-dio 2026-03-17 08:42:29,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:30,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:30,114 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69b9132b0ec88e58bad0d8f4/log.txt.gz 2026-03-17 08:42:30,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:30,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:30,566 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69b9132b0ec88e58bad0d8f4/lava-logs.yaml 2026-03-17 08:42:30,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:30,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:30,721 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69b9132b0ec88e58bad0d8f4/lava_callback.json.gz 2026-03-17 08:42:30,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:30,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9132b0ec88e58bad0d8f4 HTTP/1.1" 200 None 2026-03-17 08:42:30,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:30,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:42:30,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:30,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9132b0ec88e58bad0d8f4 HTTP/1.1" 200 None 2026-03-17 08:42:30,811 - lava_callback - INFO - Completed processing callback for node 69b9132b0ec88e58bad0d8f4 INFO: 172.20.0.1:59304 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:42:40,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:40,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37012 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:42:50,478 - lava_callback - INFO - Received callback for node 69b913d50ec88e58bad0d9d9 INFO: 172.20.0.1:49092 - "POST /node/69b913d50ec88e58bad0d9d9 HTTP/1.0" 202 Accepted 2026-03-17 08:42:50,484 - lava_callback - INFO - Starting async job submit for node 69b913d50ec88e58bad0d9d9 2026-03-17 08:42:50,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:50,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d50ec88e58bad0d9d9 HTTP/1.1" 200 None 2026-03-17 08:42:50,519 - lava_callback - DEBUG - Processing node 69b913d50ec88e58bad0d9d9: job-gcc-14-arm64-612-cip-rt 2026-03-17 08:42:50,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:50,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:50,833 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-rt-69b913d50ec88e58bad0d9d9/log.txt.gz 2026-03-17 08:42:50,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:51,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:51,134 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-rt-69b913d50ec88e58bad0d9d9/lava-logs.yaml 2026-03-17 08:42:51,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:51,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:51,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-rt-69b913d50ec88e58bad0d9d9/lava_callback.json.gz 2026-03-17 08:42:51,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:51,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d50ec88e58bad0d9d9 HTTP/1.1" 200 None 2026-03-17 08:42:51,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:51,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 08:42:51,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:51,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913d50ec88e58bad0d9d9 HTTP/1.1" 200 None 2026-03-17 08:42:51,364 - lava_callback - INFO - Completed processing callback for node 69b913d50ec88e58bad0d9d9 2026-03-17 08:42:53,317 - lava_callback - INFO - Received callback for node 69b671001727ff69d6f273f5 INFO: 172.20.0.1:49106 - "POST /node/69b671001727ff69d6f273f5 HTTP/1.0" 202 Accepted 2026-03-17 08:42:53,323 - lava_callback - INFO - Starting async job submit for node 69b671001727ff69d6f273f5 2026-03-17 08:42:53,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:53,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b671001727ff69d6f273f5 HTTP/1.1" 200 None 2026-03-17 08:42:53,352 - lava_callback - DEBUG - Processing node 69b671001727ff69d6f273f5: baseline-arm-clabbe 2026-03-17 08:42:53,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b671001727ff69d6f273f5 2026-03-17 08:42:53,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:53,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b671001727ff69d6f273f5 HTTP/1.1" 200 None 2026-03-17 08:42:53,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:53,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 08:42:53,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:53,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b671001727ff69d6f273f5 HTTP/1.1" 200 None 2026-03-17 08:42:53,406 - lava_callback - ERROR - Error processing callback for node 69b671001727ff69d6f273f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49116 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:42:57,779 - lava_callback - INFO - Received callback for node 69b913240ec88e58bad0d8e2 INFO: 172.20.0.1:49128 - "POST /node/69b913240ec88e58bad0d8e2 HTTP/1.0" 202 Accepted 2026-03-17 08:42:57,785 - lava_callback - INFO - Starting async job submit for node 69b913240ec88e58bad0d8e2 2026-03-17 08:42:57,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:57,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913240ec88e58bad0d8e2 HTTP/1.1" 200 None 2026-03-17 08:42:57,827 - lava_callback - DEBUG - Processing node 69b913240ec88e58bad0d8e2: ltp-cap_bounds 2026-03-17 08:42:58,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:58,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:58,370 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b913240ec88e58bad0d8e2/log.txt.gz 2026-03-17 08:42:58,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:58,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:58,781 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b913240ec88e58bad0d8e2/lava-logs.yaml 2026-03-17 08:42:58,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:42:58,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:42:58,956 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b913240ec88e58bad0d8e2/lava_callback.json.gz 2026-03-17 08:42:58,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:58,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913240ec88e58bad0d8e2 HTTP/1.1" 200 None 2026-03-17 08:42:58,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:59,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:42:59,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:59,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913240ec88e58bad0d8e2 HTTP/1.1" 200 None 2026-03-17 08:42:59,046 - lava_callback - INFO - Completed processing callback for node 69b913240ec88e58bad0d8e2 2026-03-17 08:42:59,428 - lava_callback - INFO - Received callback for node 69b913270ec88e58bad0d8e8 INFO: 172.20.0.1:49142 - "POST /node/69b913270ec88e58bad0d8e8 HTTP/1.0" 202 Accepted 2026-03-17 08:42:59,440 - lava_callback - INFO - Starting async job submit for node 69b913270ec88e58bad0d8e8 2026-03-17 08:42:59,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:42:59,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913270ec88e58bad0d8e8 HTTP/1.1" 200 None 2026-03-17 08:42:59,495 - lava_callback - DEBUG - Processing node 69b913270ec88e58bad0d8e8: ltp-controllers 2026-03-17 08:42:59,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:00,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:00,147 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69b913270ec88e58bad0d8e8/log.txt.gz 2026-03-17 08:43:00,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:00,419 - lava_callback - INFO - Received callback for node 69b913090ec88e58bad0d895 INFO: 172.20.0.1:51112 - "POST /node/69b913090ec88e58bad0d895 HTTP/1.0" 202 Accepted 2026-03-17 08:43:00,429 - lava_callback - INFO - Starting async job submit for node 69b913090ec88e58bad0d895 2026-03-17 08:43:00,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:00,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913090ec88e58bad0d895 HTTP/1.1" 200 None 2026-03-17 08:43:00,476 - lava_callback - DEBUG - Processing node 69b913090ec88e58bad0d895: baseline-arm-clabbe 2026-03-17 08:43:00,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:00,701 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69b913270ec88e58bad0d8e8/lava-logs.yaml 2026-03-17 08:43:00,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:00,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:00,812 - lava_callback - INFO - Received callback for node 69b913250ec88e58bad0d8e5 2026-03-17 08:43:00,819 - lava_callback - INFO - Starting async job submit for node 69b913250ec88e58bad0d8e5 INFO: 172.20.0.1:51122 - "POST /node/69b913250ec88e58bad0d8e5 HTTP/1.0" 202 Accepted 2026-03-17 08:43:00,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:00,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:00,876 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b913090ec88e58bad0d895/log.txt.gz 2026-03-17 08:43:00,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:00,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913250ec88e58bad0d8e5 HTTP/1.1" 200 None 2026-03-17 08:43:00,953 - lava_callback - DEBUG - Processing node 69b913250ec88e58bad0d8e5: ltp-containers 2026-03-17 08:43:01,087 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69b913270ec88e58bad0d8e8/lava_callback.json.gz 2026-03-17 08:43:01,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:01,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:01,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913270ec88e58bad0d8e8 HTTP/1.1" 200 None 2026-03-17 08:43:01,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:01,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:43:01,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:01,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:01,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913270ec88e58bad0d8e8 HTTP/1.1" 200 None 2026-03-17 08:43:01,462 - lava_callback - INFO - Completed processing callback for node 69b913270ec88e58bad0d8e8 2026-03-17 08:43:01,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:01,474 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b913090ec88e58bad0d895/lava-logs.yaml 2026-03-17 08:43:01,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:01,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:01,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69b913250ec88e58bad0d8e5/log.txt.gz 2026-03-17 08:43:01,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:01,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b913090ec88e58bad0d895/lava_callback.json.gz 2026-03-17 08:43:01,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:01,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913090ec88e58bad0d895 HTTP/1.1" 200 None 2026-03-17 08:43:01,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:01,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:43:01,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:01,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:02,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913090ec88e58bad0d895 HTTP/1.1" 200 None 2026-03-17 08:43:02,011 - lava_callback - INFO - Completed processing callback for node 69b913090ec88e58bad0d895 2026-03-17 08:43:02,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:02,270 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69b913250ec88e58bad0d8e5/lava-logs.yaml 2026-03-17 08:43:02,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:02,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:02,441 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69b913250ec88e58bad0d8e5/lava_callback.json.gz 2026-03-17 08:43:02,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:02,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913250ec88e58bad0d8e5 HTTP/1.1" 200 None 2026-03-17 08:43:02,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:02,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:43:02,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:02,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913250ec88e58bad0d8e5 HTTP/1.1" 200 None 2026-03-17 08:43:02,537 - lava_callback - INFO - Completed processing callback for node 69b913250ec88e58bad0d8e5 INFO: 172.20.0.1:51132 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:43:10,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:10,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:34326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34340 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:43:17,991 - lava_callback - INFO - Received callback for node 69b913370ec88e58bad0d91f INFO: 172.20.0.1:34344 - "POST /node/69b913370ec88e58bad0d91f HTTP/1.0" 202 Accepted 2026-03-17 08:43:17,998 - lava_callback - INFO - Starting async job submit for node 69b913370ec88e58bad0d91f 2026-03-17 08:43:18,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:18,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913370ec88e58bad0d91f HTTP/1.1" 200 None 2026-03-17 08:43:18,045 - lava_callback - DEBUG - Processing node 69b913370ec88e58bad0d91f: ltp-syscalls 2026-03-17 08:43:18,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:19,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:19,074 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b913370ec88e58bad0d91f/log.txt.gz 2026-03-17 08:43:19,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:19,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:19,907 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b913370ec88e58bad0d91f/lava-logs.yaml 2026-03-17 08:43:19,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:20,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:20,135 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b913370ec88e58bad0d91f/lava_callback.json.gz 2026-03-17 08:43:20,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:20,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913370ec88e58bad0d91f HTTP/1.1" 200 None 2026-03-17 08:43:20,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:20,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:43:20,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:20,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913370ec88e58bad0d91f HTTP/1.1" 200 None 2026-03-17 08:43:20,227 - lava_callback - INFO - Completed processing callback for node 69b913370ec88e58bad0d91f INFO: 172.20.0.1:54354 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:43:30,525 - lava_callback - INFO - Received callback for node 69b913d70ec88e58bad0d9df INFO: 172.20.0.1:55242 - "POST /node/69b913d70ec88e58bad0d9df HTTP/1.0" 202 Accepted 2026-03-17 08:43:30,532 - lava_callback - INFO - Starting async job submit for node 69b913d70ec88e58bad0d9df 2026-03-17 08:43:30,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:30,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d70ec88e58bad0d9df HTTP/1.1" 200 None 2026-03-17 08:43:30,577 - lava_callback - DEBUG - Processing node 69b913d70ec88e58bad0d9df: job-gcc-14-arm64-612-cip-rt 2026-03-17 08:43:30,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:31,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:31,049 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-rt-69b913d70ec88e58bad0d9df/log.txt.gz 2026-03-17 08:43:31,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:31,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:31,413 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-rt-69b913d70ec88e58bad0d9df/lava-logs.yaml 2026-03-17 08:43:31,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:31,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:31,565 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-rt-69b913d70ec88e58bad0d9df/lava_callback.json.gz 2026-03-17 08:43:31,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:31,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d70ec88e58bad0d9df HTTP/1.1" 200 None 2026-03-17 08:43:31,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:31,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 08:43:31,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:31,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913d70ec88e58bad0d9df HTTP/1.1" 200 None 2026-03-17 08:43:31,657 - lava_callback - INFO - Completed processing callback for node 69b913d70ec88e58bad0d9df INFO: 172.20.0.1:55246 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:43:40,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:40,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48442 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:43:59,168 - lava_callback - INFO - Received callback for node 69b913d40ec88e58bad0d9d6 INFO: 172.20.0.1:48456 - "POST /node/69b913d40ec88e58bad0d9d6 HTTP/1.0" 202 Accepted 2026-03-17 08:43:59,176 - lava_callback - INFO - Starting async job submit for node 69b913d40ec88e58bad0d9d6 2026-03-17 08:43:59,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:43:59,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d40ec88e58bad0d9d6 HTTP/1.1" 200 None 2026-03-17 08:43:59,231 - lava_callback - DEBUG - Processing node 69b913d40ec88e58bad0d9d6: job-gcc-14-arm64-612-cip-rt 2026-03-17 08:43:59,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:43:59,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:43:59,699 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-rt-69b913d40ec88e58bad0d9d6/log.txt.gz 2026-03-17 08:43:59,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:44:00,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:44:00,191 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-rt-69b913d40ec88e58bad0d9d6/lava-logs.yaml 2026-03-17 08:44:00,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:44:00,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:44:00,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-rt-69b913d40ec88e58bad0d9d6/lava_callback.json.gz 2026-03-17 08:44:00,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:00,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d40ec88e58bad0d9d6 HTTP/1.1" 200 None 2026-03-17 08:44:00,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:00,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 08:44:00,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:00,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913d40ec88e58bad0d9d6 HTTP/1.1" 200 None 2026-03-17 08:44:00,493 - lava_callback - INFO - Completed processing callback for node 69b913d40ec88e58bad0d9d6 INFO: 172.20.0.1:42942 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:44:10,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:11,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46660 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:44:27,759 - lava_callback - INFO - Received callback for node 69b913d60ec88e58bad0d9dc INFO: 172.20.0.1:46674 - "POST /node/69b913d60ec88e58bad0d9dc HTTP/1.0" 202 Accepted 2026-03-17 08:44:27,766 - lava_callback - INFO - Starting async job submit for node 69b913d60ec88e58bad0d9dc 2026-03-17 08:44:27,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:27,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d60ec88e58bad0d9dc HTTP/1.1" 200 None 2026-03-17 08:44:27,845 - lava_callback - DEBUG - Processing node 69b913d60ec88e58bad0d9dc: job-gcc-14-arm64-612-cip-rt 2026-03-17 08:44:28,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:44:28,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:44:28,321 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-rt-69b913d60ec88e58bad0d9dc/log.txt.gz 2026-03-17 08:44:28,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:44:28,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:44:28,827 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-rt-69b913d60ec88e58bad0d9dc/lava-logs.yaml 2026-03-17 08:44:28,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:44:29,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:44:29,067 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm64-612-cip-rt-69b913d60ec88e58bad0d9dc/lava_callback.json.gz 2026-03-17 08:44:29,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:29,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d60ec88e58bad0d9dc HTTP/1.1" 200 None 2026-03-17 08:44:29,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:29,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 08:44:29,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:29,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913d60ec88e58bad0d9dc HTTP/1.1" 200 None 2026-03-17 08:44:29,168 - lava_callback - INFO - Completed processing callback for node 69b913d60ec88e58bad0d9dc 2026-03-17 08:44:31,293 - lava_callback - INFO - Received callback for node 69b9130a0ec88e58bad0d898 INFO: 172.20.0.1:40112 - "POST /node/69b9130a0ec88e58bad0d898 HTTP/1.0" 202 Accepted 2026-03-17 08:44:31,302 - lava_callback - INFO - Starting async job submit for node 69b9130a0ec88e58bad0d898 2026-03-17 08:44:31,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:31,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9130a0ec88e58bad0d898 HTTP/1.1" 200 None 2026-03-17 08:44:31,365 - lava_callback - DEBUG - Processing node 69b9130a0ec88e58bad0d898: baseline-arm-clabbe 2026-03-17 08:44:31,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:44:31,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:44:31,876 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b9130a0ec88e58bad0d898/log.txt.gz 2026-03-17 08:44:32,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:44:32,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:44:32,270 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b9130a0ec88e58bad0d898/lava-logs.yaml 2026-03-17 08:44:32,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:44:32,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:44:32,485 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b9130a0ec88e58bad0d898/lava_callback.json.gz 2026-03-17 08:44:32,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:32,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9130a0ec88e58bad0d898 HTTP/1.1" 200 None 2026-03-17 08:44:32,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:32,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:44:32,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:32,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9130a0ec88e58bad0d898 HTTP/1.1" 200 None 2026-03-17 08:44:32,667 - lava_callback - INFO - Completed processing callback for node 69b9130a0ec88e58bad0d898 INFO: 172.20.0.1:40122 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:44:41,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:41,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36248 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:44:53,384 - lava_callback - INFO - Received callback for node 69b671761727ff69d6f27400 INFO: 172.20.0.1:41268 - "POST /node/69b671761727ff69d6f27400 HTTP/1.0" 202 Accepted 2026-03-17 08:44:53,390 - lava_callback - INFO - Starting async job submit for node 69b671761727ff69d6f27400 2026-03-17 08:44:53,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:53,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b671761727ff69d6f27400 HTTP/1.1" 200 None 2026-03-17 08:44:53,415 - lava_callback - DEBUG - Processing node 69b671761727ff69d6f27400: baseline-arm-clabbe 2026-03-17 08:44:53,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b671761727ff69d6f27400 2026-03-17 08:44:53,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:53,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b671761727ff69d6f27400 HTTP/1.1" 200 None 2026-03-17 08:44:53,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:53,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 08:44:53,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:44:53,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b671761727ff69d6f27400 HTTP/1.1" 200 None 2026-03-17 08:44:53,481 - lava_callback - ERROR - Error processing callback for node 69b671761727ff69d6f27400: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41274 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:45:04,019 - lava_callback - INFO - Received callback for node 69b911e70ec88e58bad0d781 INFO: 172.20.0.1:43856 - "POST /node/69b911e70ec88e58bad0d781 HTTP/1.0" 202 Accepted 2026-03-17 08:45:04,025 - lava_callback - INFO - Starting async job submit for node 69b911e70ec88e58bad0d781 2026-03-17 08:45:04,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:04,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e70ec88e58bad0d781 HTTP/1.1" 200 None 2026-03-17 08:45:04,072 - lava_callback - DEBUG - Processing node 69b911e70ec88e58bad0d781: rt-tests-cyclicdeadline 2026-03-17 08:45:04,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:45:04,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:45:04,771 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b911e70ec88e58bad0d781/log.txt.gz 2026-03-17 08:45:05,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:45:05,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:45:05,373 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b911e70ec88e58bad0d781/lava-logs.yaml 2026-03-17 08:45:05,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:45:05,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:45:05,528 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b911e70ec88e58bad0d781/lava_callback.json.gz 2026-03-17 08:45:05,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:05,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e70ec88e58bad0d781 HTTP/1.1" 200 None 2026-03-17 08:45:05,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:05,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:45:05,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:05,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911e70ec88e58bad0d781 HTTP/1.1" 200 None 2026-03-17 08:45:05,696 - lava_callback - INFO - Completed processing callback for node 69b911e70ec88e58bad0d781 INFO: 172.20.0.1:43872 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:45:10,385 - lava_callback - INFO - Received callback for node 69b911e90ec88e58bad0d787 INFO: 172.20.0.1:42964 - "POST /node/69b911e90ec88e58bad0d787 HTTP/1.0" 202 Accepted 2026-03-17 08:45:10,392 - lava_callback - INFO - Starting async job submit for node 69b911e90ec88e58bad0d787 2026-03-17 08:45:10,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:10,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e90ec88e58bad0d787 HTTP/1.1" 200 None 2026-03-17 08:45:10,441 - lava_callback - DEBUG - Processing node 69b911e90ec88e58bad0d787: rt-tests-cyclictest 2026-03-17 08:45:10,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:45:11,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:11,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-17 08:45:11,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:45:11,173 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b911e90ec88e58bad0d787/log.txt.gz 2026-03-17 08:45:11,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:45:11,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:45:11,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b911e90ec88e58bad0d787/lava-logs.yaml 2026-03-17 08:45:11,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:45:11,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:45:11,920 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b911e90ec88e58bad0d787/lava_callback.json.gz 2026-03-17 08:45:11,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:11,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e90ec88e58bad0d787 HTTP/1.1" 200 None 2026-03-17 08:45:11,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:11,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:45:11,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:12,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911e90ec88e58bad0d787 HTTP/1.1" 200 None 2026-03-17 08:45:12,045 - lava_callback - INFO - Completed processing callback for node 69b911e90ec88e58bad0d787 INFO: 172.20.0.1:42980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42996 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:45:18,336 - lava_callback - INFO - Received callback for node 69b913290ec88e58bad0d8ef INFO: 172.20.0.1:43010 - "POST /node/69b913290ec88e58bad0d8ef HTTP/1.0" 202 Accepted 2026-03-17 08:45:18,345 - lava_callback - INFO - Starting async job submit for node 69b913290ec88e58bad0d8ef 2026-03-17 08:45:18,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:18,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913290ec88e58bad0d8ef HTTP/1.1" 200 None 2026-03-17 08:45:18,393 - lava_callback - DEBUG - Processing node 69b913290ec88e58bad0d8ef: ltp-cve 2026-03-17 08:45:18,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:45:19,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:45:19,023 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69b913290ec88e58bad0d8ef/log.txt.gz 2026-03-17 08:45:19,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:45:19,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:45:19,637 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69b913290ec88e58bad0d8ef/lava-logs.yaml 2026-03-17 08:45:19,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:45:19,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:45:19,883 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69b913290ec88e58bad0d8ef/lava_callback.json.gz 2026-03-17 08:45:19,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:19,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913290ec88e58bad0d8ef HTTP/1.1" 200 None 2026-03-17 08:45:19,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:19,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:45:19,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:19,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913290ec88e58bad0d8ef HTTP/1.1" 200 None 2026-03-17 08:45:19,980 - lava_callback - INFO - Completed processing callback for node 69b913290ec88e58bad0d8ef INFO: 172.20.0.1:38446 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:45:34,015 - lava_callback - INFO - Received callback for node 69b6719d1727ff69d6f27409 INFO: 172.20.0.1:41248 - "POST /node/69b6719d1727ff69d6f27409 HTTP/1.0" 202 Accepted 2026-03-17 08:45:34,025 - lava_callback - INFO - Starting async job submit for node 69b6719d1727ff69d6f27409 2026-03-17 08:45:34,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:34,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6719d1727ff69d6f27409 HTTP/1.1" 200 None 2026-03-17 08:45:34,060 - lava_callback - DEBUG - Processing node 69b6719d1727ff69d6f27409: baseline-arm-clabbe 2026-03-17 08:45:34,060 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6719d1727ff69d6f27409 2026-03-17 08:45:34,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:34,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6719d1727ff69d6f27409 HTTP/1.1" 200 None 2026-03-17 08:45:34,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:34,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 08:45:34,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:34,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6719d1727ff69d6f27409 HTTP/1.1" 200 None 2026-03-17 08:45:34,257 - lava_callback - ERROR - Error processing callback for node 69b6719d1727ff69d6f27409: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41264 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:45:41,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:41,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59426 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:45:47,483 - lava_callback - INFO - Received callback for node 69b911ea0ec88e58bad0d78a INFO: 172.20.0.1:59440 - "POST /node/69b911ea0ec88e58bad0d78a HTTP/1.0" 202 Accepted 2026-03-17 08:45:47,493 - lava_callback - INFO - Starting async job submit for node 69b911ea0ec88e58bad0d78a 2026-03-17 08:45:47,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:47,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911ea0ec88e58bad0d78a HTTP/1.1" 200 None 2026-03-17 08:45:47,576 - lava_callback - DEBUG - Processing node 69b911ea0ec88e58bad0d78a: rt-tests-cyclictest 2026-03-17 08:45:48,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:45:48,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:45:48,834 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b911ea0ec88e58bad0d78a/log.txt.gz 2026-03-17 08:45:49,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:45:50,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:45:50,110 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b911ea0ec88e58bad0d78a/lava-logs.yaml 2026-03-17 08:45:50,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:45:50,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:45:50,693 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b911ea0ec88e58bad0d78a/lava_callback.json.gz 2026-03-17 08:45:50,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:50,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911ea0ec88e58bad0d78a HTTP/1.1" 200 None 2026-03-17 08:45:50,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:50,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:45:50,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:45:50,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911ea0ec88e58bad0d78a HTTP/1.1" 200 None 2026-03-17 08:45:50,898 - lava_callback - INFO - Completed processing callback for node 69b911ea0ec88e58bad0d78a INFO: 172.20.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33834 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:46:11,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:11,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-17 08:46:13,459 - lava_callback - INFO - Received callback for node 69b671c51727ff69d6f27414 INFO: 172.20.0.1:55666 - "POST /node/69b671c51727ff69d6f27414 HTTP/1.0" 202 Accepted 2026-03-17 08:46:13,468 - lava_callback - INFO - Starting async job submit for node 69b671c51727ff69d6f27414 2026-03-17 08:46:13,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:13,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b671c51727ff69d6f27414 HTTP/1.1" 200 None 2026-03-17 08:46:13,509 - lava_callback - DEBUG - Processing node 69b671c51727ff69d6f27414: baseline-arm-clabbe 2026-03-17 08:46:13,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b671c51727ff69d6f27414 2026-03-17 08:46:13,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:13,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b671c51727ff69d6f27414 HTTP/1.1" 200 None 2026-03-17 08:46:13,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:13,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 08:46:13,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:13,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b671c51727ff69d6f27414 HTTP/1.1" 200 None 2026-03-17 08:46:13,635 - lava_callback - ERROR - Error processing callback for node 69b671c51727ff69d6f27414: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55684 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:46:19,578 - lava_callback - INFO - Received callback for node 69b911e70ec88e58bad0d77e INFO: 172.20.0.1:55690 - "POST /node/69b911e70ec88e58bad0d77e HTTP/1.0" 202 Accepted 2026-03-17 08:46:19,589 - lava_callback - INFO - Starting async job submit for node 69b911e70ec88e58bad0d77e 2026-03-17 08:46:19,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:19,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e70ec88e58bad0d77e HTTP/1.1" 200 None 2026-03-17 08:46:19,673 - lava_callback - DEBUG - Processing node 69b911e70ec88e58bad0d77e: rt-tests-cyclicdeadline 2026-03-17 08:46:20,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:46:21,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:46:21,335 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b911e70ec88e58bad0d77e/log.txt.gz 2026-03-17 08:46:21,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:46:22,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:46:22,905 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b911e70ec88e58bad0d77e/lava-logs.yaml 2026-03-17 08:46:22,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:46:23,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:46:23,727 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b911e70ec88e58bad0d77e/lava_callback.json.gz 2026-03-17 08:46:23,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:23,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b911e70ec88e58bad0d77e HTTP/1.1" 200 None 2026-03-17 08:46:23,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:23,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab8fbe29c53ae860500 HTTP/1.1" 200 None 2026-03-17 08:46:23,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:23,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b911e70ec88e58bad0d77e HTTP/1.1" 200 None 2026-03-17 08:46:23,939 - lava_callback - INFO - Completed processing callback for node 69b911e70ec88e58bad0d77e INFO: 172.20.0.1:45628 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:46:32,848 - lava_callback - INFO - Received callback for node 69b914e40ec88e58bad0db1b INFO: 172.20.0.1:49646 - "POST /node/69b914e40ec88e58bad0db1b HTTP/1.0" 202 Accepted 2026-03-17 08:46:32,858 - lava_callback - INFO - Starting async job submit for node 69b914e40ec88e58bad0db1b 2026-03-17 08:46:32,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:32,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914e40ec88e58bad0db1b HTTP/1.1" 200 None 2026-03-17 08:46:32,888 - lava_callback - DEBUG - Processing node 69b914e40ec88e58bad0db1b: job-gcc-14-arm-612-cip 2026-03-17 08:46:32,890 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:46:32,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:46:33,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:46:33,468 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b914e40ec88e58bad0db1b/lava-logs.yaml 2026-03-17 08:46:33,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:46:34,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:46:34,263 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b914e40ec88e58bad0db1b/lava_callback.json.gz 2026-03-17 08:46:34,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:34,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914e40ec88e58bad0db1b HTTP/1.1" 200 None 2026-03-17 08:46:34,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:34,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab1fbe29c53ae8604f7 HTTP/1.1" 200 None 2026-03-17 08:46:34,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:34,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b914e40ec88e58bad0db1b HTTP/1.1" 200 None 2026-03-17 08:46:34,366 - lava_callback - INFO - Completed processing callback for node 69b914e40ec88e58bad0db1b INFO: 172.20.0.1:49654 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:46:41,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:41,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35658 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:46:50,787 - lava_callback - INFO - Received callback for node 69b914e30ec88e58bad0db18 INFO: 172.20.0.1:60376 - "POST /node/69b914e30ec88e58bad0db18 HTTP/1.0" 202 Accepted 2026-03-17 08:46:50,796 - lava_callback - INFO - Starting async job submit for node 69b914e30ec88e58bad0db18 2026-03-17 08:46:50,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:50,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914e30ec88e58bad0db18 HTTP/1.1" 200 None 2026-03-17 08:46:50,832 - lava_callback - DEBUG - Processing node 69b914e30ec88e58bad0db18: job-gcc-14-arm-612-cip 2026-03-17 08:46:50,841 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:46:50,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:46:51,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:46:51,293 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b914e30ec88e58bad0db18/lava-logs.yaml 2026-03-17 08:46:51,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:46:52,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:46:52,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b914e30ec88e58bad0db18/lava_callback.json.gz 2026-03-17 08:46:52,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:52,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914e30ec88e58bad0db18 HTTP/1.1" 200 None 2026-03-17 08:46:52,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:52,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab1fbe29c53ae8604f7 HTTP/1.1" 200 None 2026-03-17 08:46:52,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:52,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b914e30ec88e58bad0db18 HTTP/1.1" 200 None 2026-03-17 08:46:52,124 - lava_callback - INFO - Completed processing callback for node 69b914e30ec88e58bad0db18 INFO: 172.20.0.1:60380 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:46:57,630 - lava_callback - INFO - Received callback for node 69b9132c0ec88e58bad0d8f7 INFO: 172.20.0.1:60392 - "POST /node/69b9132c0ec88e58bad0d8f7 HTTP/1.0" 202 Accepted 2026-03-17 08:46:57,641 - lava_callback - INFO - Starting async job submit for node 69b9132c0ec88e58bad0d8f7 2026-03-17 08:46:57,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:57,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9132c0ec88e58bad0d8f7 HTTP/1.1" 200 None 2026-03-17 08:46:57,719 - lava_callback - DEBUG - Processing node 69b9132c0ec88e58bad0d8f7: ltp-fs_bind 2026-03-17 08:46:58,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:46:58,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:46:58,965 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b9132c0ec88e58bad0d8f7/log.txt.gz 2026-03-17 08:46:59,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:46:59,248 - lava_callback - INFO - Received callback for node 69b9132f0ec88e58bad0d900 INFO: 172.20.0.1:60398 - "POST /node/69b9132f0ec88e58bad0d900 HTTP/1.0" 202 Accepted 2026-03-17 08:46:59,259 - lava_callback - INFO - Starting async job submit for node 69b9132f0ec88e58bad0d900 2026-03-17 08:46:59,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:46:59,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9132f0ec88e58bad0d900 HTTP/1.1" 200 None 2026-03-17 08:46:59,320 - lava_callback - DEBUG - Processing node 69b9132f0ec88e58bad0d900: ltp-input 2026-03-17 08:46:59,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:46:59,820 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b9132c0ec88e58bad0d8f7/lava-logs.yaml 2026-03-17 08:46:59,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:46:59,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:47:00,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:47:00,075 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69b9132f0ec88e58bad0d900/log.txt.gz 2026-03-17 08:47:00,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:47:00,126 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b9132c0ec88e58bad0d8f7/lava_callback.json.gz 2026-03-17 08:47:00,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:00,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9132c0ec88e58bad0d8f7 HTTP/1.1" 200 None 2026-03-17 08:47:00,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:00,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:47:00,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:00,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9132c0ec88e58bad0d8f7 HTTP/1.1" 200 None 2026-03-17 08:47:00,449 - lava_callback - INFO - Completed processing callback for node 69b9132c0ec88e58bad0d8f7 2026-03-17 08:47:00,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:47:00,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:47:00,941 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69b9132f0ec88e58bad0d900/lava-logs.yaml 2026-03-17 08:47:00,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:47:01,163 - lava_callback - INFO - Received callback for node 69b9132e0ec88e58bad0d8fa INFO: 172.20.0.1:36016 - "POST /node/69b9132e0ec88e58bad0d8fa HTTP/1.0" 202 Accepted 2026-03-17 08:47:01,173 - lava_callback - INFO - Starting async job submit for node 69b9132e0ec88e58bad0d8fa 2026-03-17 08:47:01,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:01,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9132e0ec88e58bad0d8fa HTTP/1.1" 200 None 2026-03-17 08:47:01,254 - lava_callback - DEBUG - Processing node 69b9132e0ec88e58bad0d8fa: ltp-fsx 2026-03-17 08:47:01,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:47:01,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69b9132f0ec88e58bad0d900/lava_callback.json.gz 2026-03-17 08:47:01,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:01,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9132f0ec88e58bad0d900 HTTP/1.1" 200 None 2026-03-17 08:47:01,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:01,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:47:01,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:47:01,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:01,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9132f0ec88e58bad0d900 HTTP/1.1" 200 None 2026-03-17 08:47:01,862 - lava_callback - INFO - Completed processing callback for node 69b9132f0ec88e58bad0d900 2026-03-17 08:47:02,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:47:02,269 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69b9132e0ec88e58bad0d8fa/log.txt.gz 2026-03-17 08:47:02,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:47:03,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:47:03,066 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69b9132e0ec88e58bad0d8fa/lava-logs.yaml 2026-03-17 08:47:03,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:47:03,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:47:03,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69b9132e0ec88e58bad0d8fa/lava_callback.json.gz 2026-03-17 08:47:03,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:03,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9132e0ec88e58bad0d8fa HTTP/1.1" 200 None 2026-03-17 08:47:03,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:03,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:47:03,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:03,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9132e0ec88e58bad0d8fa HTTP/1.1" 200 None 2026-03-17 08:47:03,338 - lava_callback - INFO - Completed processing callback for node 69b9132e0ec88e58bad0d8fa INFO: 172.20.0.1:36028 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:47:11,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:11,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-17 08:47:13,458 - lava_callback - INFO - Received callback for node 69b672021727ff69d6f2741f INFO: 172.20.0.1:54956 - "POST /node/69b672021727ff69d6f2741f HTTP/1.0" 202 Accepted 2026-03-17 08:47:13,464 - lava_callback - INFO - Starting async job submit for node 69b672021727ff69d6f2741f 2026-03-17 08:47:13,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:13,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b672021727ff69d6f2741f HTTP/1.1" 200 None 2026-03-17 08:47:13,480 - lava_callback - DEBUG - Processing node 69b672021727ff69d6f2741f: baseline-arm-clabbe 2026-03-17 08:47:13,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b672021727ff69d6f2741f 2026-03-17 08:47:13,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:13,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b672021727ff69d6f2741f HTTP/1.1" 200 None 2026-03-17 08:47:13,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:13,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 08:47:13,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:13,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b672021727ff69d6f2741f HTTP/1.1" 200 None 2026-03-17 08:47:13,536 - lava_callback - ERROR - Error processing callback for node 69b672021727ff69d6f2741f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59326 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:47:50,788 - lava_callback - INFO - Received callback for node 69b9151f0ec88e58bad0db5f INFO: 172.20.0.1:59608 - "POST /node/69b9151f0ec88e58bad0db5f HTTP/1.0" 202 Accepted 2026-03-17 08:47:50,801 - lava_callback - INFO - Starting async job submit for node 69b9151f0ec88e58bad0db5f 2026-03-17 08:47:50,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:50,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9151f0ec88e58bad0db5f HTTP/1.1" 200 None 2026-03-17 08:47:50,840 - lava_callback - DEBUG - Processing node 69b9151f0ec88e58bad0db5f: baseline-arm 2026-03-17 08:47:50,848 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:47:50,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:47:51,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:47:51,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b9151f0ec88e58bad0db5f/lava-logs.yaml 2026-03-17 08:47:51,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:47:51,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:47:51,828 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b9151f0ec88e58bad0db5f/lava_callback.json.gz 2026-03-17 08:47:51,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:51,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9151f0ec88e58bad0db5f HTTP/1.1" 200 None 2026-03-17 08:47:51,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:51,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:47:51,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:51,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9151f0ec88e58bad0db5f HTTP/1.1" 200 None 2026-03-17 08:47:51,953 - lava_callback - INFO - Completed processing callback for node 69b9151f0ec88e58bad0db5f 2026-03-17 08:47:53,582 - lava_callback - INFO - Received callback for node 69b672291727ff69d6f2742c INFO: 172.20.0.1:59620 - "POST /node/69b672291727ff69d6f2742c HTTP/1.0" 202 Accepted 2026-03-17 08:47:53,591 - lava_callback - INFO - Starting async job submit for node 69b672291727ff69d6f2742c 2026-03-17 08:47:53,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:53,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b672291727ff69d6f2742c HTTP/1.1" 200 None 2026-03-17 08:47:53,636 - lava_callback - DEBUG - Processing node 69b672291727ff69d6f2742c: baseline-arm-clabbe 2026-03-17 08:47:53,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b672291727ff69d6f2742c 2026-03-17 08:47:53,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:53,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b672291727ff69d6f2742c HTTP/1.1" 200 None 2026-03-17 08:47:53,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:53,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 08:47:53,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:47:53,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b672291727ff69d6f2742c HTTP/1.1" 200 None 2026-03-17 08:47:53,821 - lava_callback - ERROR - Error processing callback for node 69b672291727ff69d6f2742c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50942 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:48:11,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:48:11,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49034 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:48:21,905 - lava_callback - INFO - Received callback for node 69b910b80ec88e58bad0d71e INFO: 172.20.0.1:38504 - "POST /node/69b910b80ec88e58bad0d71e HTTP/1.0" 202 Accepted 2026-03-17 08:48:21,918 - lava_callback - INFO - Starting async job submit for node 69b910b80ec88e58bad0d71e 2026-03-17 08:48:22,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:48:22,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b910b80ec88e58bad0d71e HTTP/1.1" 200 None 2026-03-17 08:48:22,082 - lava_callback - DEBUG - Processing node 69b910b80ec88e58bad0d71e: ltp-smoke 2026-03-17 08:48:22,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:48:23,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:48:23,401 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b910b80ec88e58bad0d71e/log.txt.gz 2026-03-17 08:48:23,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:48:24,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:48:24,705 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b910b80ec88e58bad0d71e/lava-logs.yaml 2026-03-17 08:48:24,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:48:25,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:48:25,642 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b910b80ec88e58bad0d71e/lava_callback.json.gz 2026-03-17 08:48:25,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:48:25,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b910b80ec88e58bad0d71e HTTP/1.1" 200 None 2026-03-17 08:48:25,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:48:25,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e3a0ec88e58bad0d0e3 HTTP/1.1" 200 None 2026-03-17 08:48:25,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:48:25,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b910b80ec88e58bad0d71e HTTP/1.1" 200 None 2026-03-17 08:48:26,150 - lava_callback - INFO - Completed processing callback for node 69b910b80ec88e58bad0d71e INFO: 172.20.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47600 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:48:41,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:48:41,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58568 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:49:01,779 - lava_callback - INFO - Received callback for node 69b914e40ec88e58bad0db1e INFO: 172.20.0.1:42266 - "POST /node/69b914e40ec88e58bad0db1e HTTP/1.0" 202 Accepted 2026-03-17 08:49:01,790 - lava_callback - INFO - Starting async job submit for node 69b914e40ec88e58bad0db1e 2026-03-17 08:49:01,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:01,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914e40ec88e58bad0db1e HTTP/1.1" 200 None 2026-03-17 08:49:01,897 - lava_callback - DEBUG - Processing node 69b914e40ec88e58bad0db1e: job-gcc-14-arm-612-cip 2026-03-17 08:49:02,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:02,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:02,836 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b914e40ec88e58bad0db1e/log.txt.gz 2026-03-17 08:49:03,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:04,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:04,171 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b914e40ec88e58bad0db1e/lava-logs.yaml 2026-03-17 08:49:04,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:04,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:04,766 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b914e40ec88e58bad0db1e/lava_callback.json.gz 2026-03-17 08:49:04,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:04,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914e40ec88e58bad0db1e HTTP/1.1" 200 None 2026-03-17 08:49:04,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:04,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab1fbe29c53ae8604f7 HTTP/1.1" 200 None 2026-03-17 08:49:04,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:04,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b914e40ec88e58bad0db1e HTTP/1.1" 200 None 2026-03-17 08:49:04,904 - lava_callback - INFO - Completed processing callback for node 69b914e40ec88e58bad0db1e INFO: 172.20.0.1:42280 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:49:11,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:11,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 08:49:13,668 - lava_callback - INFO - Received callback for node 69b915660ec88e58bad0db83 INFO: 172.20.0.1:35704 - "POST /node/69b915660ec88e58bad0db83 HTTP/1.0" 202 Accepted 2026-03-17 08:49:13,678 - lava_callback - INFO - Starting async job submit for node 69b915660ec88e58bad0db83 2026-03-17 08:49:13,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:13,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b915660ec88e58bad0db83 HTTP/1.1" 200 None 2026-03-17 08:49:13,744 - lava_callback - DEBUG - Processing node 69b915660ec88e58bad0db83: baseline-x86 2026-03-17 08:49:14,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:14,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:14,471 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b915660ec88e58bad0db83/log.txt.gz 2026-03-17 08:49:14,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:35716 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 08:49:15,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:15,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b915660ec88e58bad0db83/lava-logs.yaml 2026-03-17 08:49:15,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:16,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:16,057 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b915660ec88e58bad0db83/lava_callback.json.gz 2026-03-17 08:49:16,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:16,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b915660ec88e58bad0db83 HTTP/1.1" 200 None 2026-03-17 08:49:16,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:16,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e550ec88e58bad0d108 HTTP/1.1" 200 None 2026-03-17 08:49:16,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:16,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b915660ec88e58bad0db83 HTTP/1.1" 200 None 2026-03-17 08:49:16,217 - lava_callback - INFO - Completed processing callback for node 69b915660ec88e58bad0db83 INFO: 172.20.0.1:35726 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:49:25,232 - lava_callback - INFO - Received callback for node 69b914e10ec88e58bad0db15 INFO: 172.20.0.1:60418 - "POST /node/69b914e10ec88e58bad0db15 HTTP/1.0" 202 Accepted 2026-03-17 08:49:25,243 - lava_callback - INFO - Starting async job submit for node 69b914e10ec88e58bad0db15 2026-03-17 08:49:25,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:25,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914e10ec88e58bad0db15 HTTP/1.1" 200 None 2026-03-17 08:49:25,311 - lava_callback - DEBUG - Processing node 69b914e10ec88e58bad0db15: job-gcc-14-arm-612-cip 2026-03-17 08:49:25,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:25,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:25,954 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b914e10ec88e58bad0db15/log.txt.gz 2026-03-17 08:49:26,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:26,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:26,509 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b914e10ec88e58bad0db15/lava-logs.yaml INFO: 172.20.0.1:60426 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:49:26,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:26,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:26,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b914e10ec88e58bad0db15/lava_callback.json.gz 2026-03-17 08:49:26,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:26,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914e10ec88e58bad0db15 HTTP/1.1" 200 None 2026-03-17 08:49:26,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:26,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab1fbe29c53ae8604f7 HTTP/1.1" 200 None 2026-03-17 08:49:26,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:26,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b914e10ec88e58bad0db15 HTTP/1.1" 200 None 2026-03-17 08:49:26,781 - lava_callback - INFO - Completed processing callback for node 69b914e10ec88e58bad0db15 2026-03-17 08:49:33,826 - lava_callback - INFO - Received callback for node 69b915690ec88e58bad0db8f INFO: 172.20.0.1:37774 - "POST /node/69b915690ec88e58bad0db8f HTTP/1.0" 202 Accepted 2026-03-17 08:49:33,832 - lava_callback - INFO - Starting async job submit for node 69b915690ec88e58bad0db8f 2026-03-17 08:49:33,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:33,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b915690ec88e58bad0db8f HTTP/1.1" 200 None 2026-03-17 08:49:33,871 - lava_callback - DEBUG - Processing node 69b915690ec88e58bad0db8f: baseline-x86 2026-03-17 08:49:34,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:34,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:34,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b915690ec88e58bad0db8f/log.txt.gz 2026-03-17 08:49:34,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:34,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:34,675 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b915690ec88e58bad0db8f/lava-logs.yaml 2026-03-17 08:49:34,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:34,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:34,814 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b915690ec88e58bad0db8f/lava_callback.json.gz 2026-03-17 08:49:34,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:34,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b915690ec88e58bad0db8f HTTP/1.1" 200 None 2026-03-17 08:49:34,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:34,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e550ec88e58bad0d108 HTTP/1.1" 200 None 2026-03-17 08:49:34,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:34,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b915690ec88e58bad0db8f HTTP/1.1" 200 None 2026-03-17 08:49:34,909 - lava_callback - INFO - Completed processing callback for node 69b915690ec88e58bad0db8f INFO: 172.20.0.1:37788 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:49:37,740 - lava_callback - INFO - Received callback for node 69b913310ec88e58bad0d903 INFO: 172.20.0.1:37800 - "POST /node/69b913310ec88e58bad0d903 HTTP/1.0" 202 Accepted 2026-03-17 08:49:37,747 - lava_callback - INFO - Starting async job submit for node 69b913310ec88e58bad0d903 2026-03-17 08:49:37,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:37,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913310ec88e58bad0d903 HTTP/1.1" 200 None 2026-03-17 08:49:37,790 - lava_callback - DEBUG - Processing node 69b913310ec88e58bad0d903: ltp-ipc 2026-03-17 08:49:38,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:38,433 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:38,435 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69b913310ec88e58bad0d903/log.txt.gz 2026-03-17 08:49:38,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:38,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:38,941 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69b913310ec88e58bad0d903/lava-logs.yaml 2026-03-17 08:49:38,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:49:39,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:49:39,205 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69b913310ec88e58bad0d903/lava_callback.json.gz 2026-03-17 08:49:39,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:39,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913310ec88e58bad0d903 HTTP/1.1" 200 None 2026-03-17 08:49:39,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:39,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:49:39,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:39,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913310ec88e58bad0d903 HTTP/1.1" 200 None 2026-03-17 08:49:39,386 - lava_callback - INFO - Completed processing callback for node 69b913310ec88e58bad0d903 2026-03-17 08:49:41,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:49:41,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58514 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:50:00,479 - lava_callback - INFO - Received callback for node 69b915670ec88e58bad0db86 INFO: 172.20.0.1:44366 - "POST /node/69b915670ec88e58bad0db86 HTTP/1.0" 202 Accepted 2026-03-17 08:50:00,489 - lava_callback - INFO - Starting async job submit for node 69b915670ec88e58bad0db86 2026-03-17 08:50:00,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:50:00,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b915670ec88e58bad0db86 HTTP/1.1" 200 None 2026-03-17 08:50:00,543 - lava_callback - DEBUG - Processing node 69b915670ec88e58bad0db86: baseline-x86 2026-03-17 08:50:00,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:50:01,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:50:01,411 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b915670ec88e58bad0db86/log.txt.gz 2026-03-17 08:50:01,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:50:02,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:50:02,160 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b915670ec88e58bad0db86/lava-logs.yaml 2026-03-17 08:50:02,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:50:02,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:50:02,666 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b915670ec88e58bad0db86/lava_callback.json.gz 2026-03-17 08:50:02,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:50:02,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b915670ec88e58bad0db86 HTTP/1.1" 200 None 2026-03-17 08:50:02,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:50:02,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e550ec88e58bad0d108 HTTP/1.1" 200 None 2026-03-17 08:50:02,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:50:02,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b915670ec88e58bad0db86 HTTP/1.1" 200 None 2026-03-17 08:50:02,786 - lava_callback - INFO - Completed processing callback for node 69b915670ec88e58bad0db86 INFO: 172.20.0.1:44378 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:50:11,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:50:11,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47102 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:50:57,810 - lava_callback - INFO - Received callback for node 69b913330ec88e58bad0d906 INFO: 172.20.0.1:47114 - "POST /node/69b913330ec88e58bad0d906 HTTP/1.0" 202 Accepted 2026-03-17 08:50:57,821 - lava_callback - INFO - Starting async job submit for node 69b913330ec88e58bad0d906 2026-03-17 08:50:57,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:50:57,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913330ec88e58bad0d906 HTTP/1.1" 200 None 2026-03-17 08:50:57,887 - lava_callback - DEBUG - Processing node 69b913330ec88e58bad0d906: ltp-pty 2026-03-17 08:50:58,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:50:59,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:50:59,184 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69b913330ec88e58bad0d906/log.txt.gz 2026-03-17 08:50:59,414 - lava_callback - INFO - Received callback for node 69b913360ec88e58bad0d91c INFO: 172.20.0.1:47128 - "POST /node/69b913360ec88e58bad0d91c HTTP/1.0" 202 Accepted 2026-03-17 08:50:59,431 - lava_callback - INFO - Starting async job submit for node 69b913360ec88e58bad0d91c 2026-03-17 08:50:59,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:50:59,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913360ec88e58bad0d91c HTTP/1.1" 200 None 2026-03-17 08:50:59,557 - lava_callback - DEBUG - Processing node 69b913360ec88e58bad0d91c: ltp-smoke 2026-03-17 08:50:59,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:51:00,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:51:00,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:51:00,676 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69b913330ec88e58bad0d906/lava-logs.yaml 2026-03-17 08:51:00,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:51:00,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:51:00,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b913360ec88e58bad0d91c/log.txt.gz 2026-03-17 08:51:00,981 - lava_callback - INFO - Received callback for node 69b913340ec88e58bad0d917 INFO: 172.20.0.1:43536 - "POST /node/69b913340ec88e58bad0d917 HTTP/1.0" 202 Accepted 2026-03-17 08:51:01,022 - lava_callback - INFO - Starting async job submit for node 69b913340ec88e58bad0d917 2026-03-17 08:51:01,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:01,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913340ec88e58bad0d917 HTTP/1.1" 200 None 2026-03-17 08:51:01,186 - lava_callback - DEBUG - Processing node 69b913340ec88e58bad0d917: ltp-sched 2026-03-17 08:51:01,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:51:01,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:51:01,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69b913330ec88e58bad0d906/lava_callback.json.gz 2026-03-17 08:51:01,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:01,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:51:01,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913330ec88e58bad0d906 HTTP/1.1" 200 None 2026-03-17 08:51:01,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:01,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:51:01,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:01,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913330ec88e58bad0d906 HTTP/1.1" 200 None 2026-03-17 08:51:01,961 - lava_callback - INFO - Completed processing callback for node 69b913330ec88e58bad0d906 2026-03-17 08:51:02,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:51:02,550 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b913360ec88e58bad0d91c/lava-logs.yaml 2026-03-17 08:51:02,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:51:02,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:51:02,816 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69b913340ec88e58bad0d917/log.txt.gz 2026-03-17 08:51:03,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:51:03,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:51:03,574 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b913360ec88e58bad0d91c/lava_callback.json.gz 2026-03-17 08:51:03,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:03,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913360ec88e58bad0d91c HTTP/1.1" 200 None 2026-03-17 08:51:03,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:03,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:51:03,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:03,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913360ec88e58bad0d91c HTTP/1.1" 200 None 2026-03-17 08:51:03,703 - lava_callback - INFO - Completed processing callback for node 69b913360ec88e58bad0d91c 2026-03-17 08:51:04,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:51:04,105 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69b913340ec88e58bad0d917/lava-logs.yaml 2026-03-17 08:51:04,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:51:04,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:51:04,924 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69b913340ec88e58bad0d917/lava_callback.json.gz 2026-03-17 08:51:04,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:04,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913340ec88e58bad0d917 HTTP/1.1" 200 None 2026-03-17 08:51:04,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:04,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:51:05,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:05,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913340ec88e58bad0d917 HTTP/1.1" 200 None 2026-03-17 08:51:05,053 - lava_callback - INFO - Completed processing callback for node 69b913340ec88e58bad0d917 INFO: 172.20.0.1:43538 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:51:11,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:11,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57984 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:51:27,591 - lava_callback - INFO - Received callback for node 69b6730b1727ff69d6f2743f INFO: 172.20.0.1:57998 - "POST /node/69b6730b1727ff69d6f2743f HTTP/1.0" 202 Accepted 2026-03-17 08:51:27,600 - lava_callback - INFO - Starting async job submit for node 69b6730b1727ff69d6f2743f 2026-03-17 08:51:27,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:27,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6730b1727ff69d6f2743f HTTP/1.1" 200 None 2026-03-17 08:51:27,626 - lava_callback - DEBUG - Processing node 69b6730b1727ff69d6f2743f: baseline-arm64-baylibre 2026-03-17 08:51:27,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6730b1727ff69d6f2743f 2026-03-17 08:51:27,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:27,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6730b1727ff69d6f2743f HTTP/1.1" 200 None 2026-03-17 08:51:27,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:27,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 08:51:27,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:51:27,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6730b1727ff69d6f2743f HTTP/1.1" 200 None 2026-03-17 08:51:27,719 - lava_callback - ERROR - Error processing callback for node 69b6730b1727ff69d6f2743f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47628 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:52:47,813 - lava_callback - INFO - Received callback for node 69b673571727ff69d6f27456 INFO: 172.20.0.1:47642 - "POST /node/69b673571727ff69d6f27456 HTTP/1.0" 202 Accepted 2026-03-17 08:52:47,818 - lava_callback - INFO - Starting async job submit for node 69b673571727ff69d6f27456 2026-03-17 08:52:47,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:52:47,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b673571727ff69d6f27456 HTTP/1.1" 200 None 2026-03-17 08:52:47,834 - lava_callback - DEBUG - Processing node 69b673571727ff69d6f27456: baseline-arm64-baylibre 2026-03-17 08:52:47,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b673571727ff69d6f27456 2026-03-17 08:52:47,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:52:47,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b673571727ff69d6f27456 HTTP/1.1" 200 None 2026-03-17 08:52:47,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:52:47,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 08:52:47,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:52:47,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b673571727ff69d6f27456 HTTP/1.1" 200 None 2026-03-17 08:52:47,891 - lava_callback - ERROR - Error processing callback for node 69b673571727ff69d6f27456: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 08:52:51,874 - lava_callback - INFO - Received callback for node 69b9164f0ec88e58bad0dc26 INFO: 172.20.0.1:45822 - "POST /node/69b9164f0ec88e58bad0dc26 HTTP/1.0" 202 Accepted 2026-03-17 08:52:51,880 - lava_callback - INFO - Starting async job submit for node 69b9164f0ec88e58bad0dc26 2026-03-17 08:52:51,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:52:51,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9164f0ec88e58bad0dc26 HTTP/1.1" 200 None 2026-03-17 08:52:51,897 - lava_callback - DEBUG - Processing node 69b9164f0ec88e58bad0dc26: rt-tests-cyclicdeadline 2026-03-17 08:52:51,899 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:52:51,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:52:52,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:52:52,024 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b9164f0ec88e58bad0dc26/lava-logs.yaml 2026-03-17 08:52:52,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:52:52,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:52:52,214 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b9164f0ec88e58bad0dc26/lava_callback.json.gz 2026-03-17 08:52:52,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:52:52,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9164f0ec88e58bad0dc26 HTTP/1.1" 200 None 2026-03-17 08:52:52,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:52:52,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 08:52:52,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:52:52,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9164f0ec88e58bad0dc26 HTTP/1.1" 200 None 2026-03-17 08:52:52,285 - lava_callback - INFO - Completed processing callback for node 69b9164f0ec88e58bad0dc26 2026-03-17 08:52:53,189 - lava_callback - INFO - Received callback for node 69b916530ec88e58bad0dc2b INFO: 172.20.0.1:45826 - "POST /node/69b916530ec88e58bad0dc2b HTTP/1.0" 202 Accepted 2026-03-17 08:52:53,195 - lava_callback - INFO - Starting async job submit for node 69b916530ec88e58bad0dc2b 2026-03-17 08:52:53,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:52:53,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b916530ec88e58bad0dc2b HTTP/1.1" 200 None 2026-03-17 08:52:53,301 - lava_callback - DEBUG - Processing node 69b916530ec88e58bad0dc2b: rt-tests-cyclictest 2026-03-17 08:52:53,302 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:52:53,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:52:53,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:52:53,510 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b916530ec88e58bad0dc2b/lava-logs.yaml 2026-03-17 08:52:53,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:52:53,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:52:53,639 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b916530ec88e58bad0dc2b/lava_callback.json.gz 2026-03-17 08:52:53,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:52:53,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b916530ec88e58bad0dc2b HTTP/1.1" 200 None 2026-03-17 08:52:53,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:52:53,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 08:52:53,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:52:53,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b916530ec88e58bad0dc2b HTTP/1.1" 200 None 2026-03-17 08:52:53,712 - lava_callback - INFO - Completed processing callback for node 69b916530ec88e58bad0dc2b INFO: 172.20.0.1:45836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37320 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:53:11,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:53:11,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58930 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:53:22,920 - lava_callback - INFO - Received callback for node 69b913da0ec88e58bad0d9f3 INFO: 172.20.0.1:53394 - "POST /node/69b913da0ec88e58bad0d9f3 HTTP/1.0" 202 Accepted 2026-03-17 08:53:22,927 - lava_callback - INFO - Starting async job submit for node 69b913da0ec88e58bad0d9f3 2026-03-17 08:53:22,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:53:22,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913da0ec88e58bad0d9f3 HTTP/1.1" 200 None 2026-03-17 08:53:22,975 - lava_callback - DEBUG - Processing node 69b913da0ec88e58bad0d9f3: rt-tests-cyclicdeadline 2026-03-17 08:53:23,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:53:23,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:53:23,478 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b913da0ec88e58bad0d9f3/log.txt.gz 2026-03-17 08:53:23,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:53:23,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:53:23,900 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b913da0ec88e58bad0d9f3/lava-logs.yaml 2026-03-17 08:53:23,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:53:24,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:53:24,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b913da0ec88e58bad0d9f3/lava_callback.json.gz 2026-03-17 08:53:24,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:53:24,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913da0ec88e58bad0d9f3 HTTP/1.1" 200 None 2026-03-17 08:53:24,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:53:24,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 08:53:24,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:53:24,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913da0ec88e58bad0d9f3 HTTP/1.1" 200 None 2026-03-17 08:53:24,194 - lava_callback - INFO - Completed processing callback for node 69b913da0ec88e58bad0d9f3 INFO: 172.20.0.1:53410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53284 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:53:41,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:53:41,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58756 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:53:57,925 - lava_callback - INFO - Received callback for node 69b913390ec88e58bad0d922 INFO: 172.20.0.1:58760 - "POST /node/69b913390ec88e58bad0d922 HTTP/1.0" 202 Accepted 2026-03-17 08:53:57,932 - lava_callback - INFO - Starting async job submit for node 69b913390ec88e58bad0d922 2026-03-17 08:53:57,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:53:57,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913390ec88e58bad0d922 HTTP/1.1" 200 None 2026-03-17 08:53:57,982 - lava_callback - DEBUG - Processing node 69b913390ec88e58bad0d922: ltp-syscalls-ipc 2026-03-17 08:53:58,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:53:58,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:53:58,635 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b913390ec88e58bad0d922/log.txt.gz 2026-03-17 08:53:58,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:53:59,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:53:59,155 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b913390ec88e58bad0d922/lava-logs.yaml 2026-03-17 08:53:59,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:53:59,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:53:59,393 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b913390ec88e58bad0d922/lava_callback.json.gz 2026-03-17 08:53:59,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:53:59,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913390ec88e58bad0d922 HTTP/1.1" 200 None 2026-03-17 08:53:59,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:53:59,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:53:59,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:53:59,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913390ec88e58bad0d922 HTTP/1.1" 200 None 2026-03-17 08:53:59,484 - lava_callback - INFO - Completed processing callback for node 69b913390ec88e58bad0d922 INFO: 172.20.0.1:59428 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:54:07,755 - lava_callback - INFO - Received callback for node 69b673a11727ff69d6f2745b INFO: 172.20.0.1:59436 - "POST /node/69b673a11727ff69d6f2745b HTTP/1.0" 202 Accepted 2026-03-17 08:54:07,760 - lava_callback - INFO - Starting async job submit for node 69b673a11727ff69d6f2745b 2026-03-17 08:54:07,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:07,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b673a11727ff69d6f2745b HTTP/1.1" 200 None 2026-03-17 08:54:07,776 - lava_callback - DEBUG - Processing node 69b673a11727ff69d6f2745b: baseline-arm64-baylibre 2026-03-17 08:54:07,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b673a11727ff69d6f2745b 2026-03-17 08:54:07,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:07,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b673a11727ff69d6f2745b HTTP/1.1" 200 None 2026-03-17 08:54:07,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:07,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 08:54:07,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:07,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b673a11727ff69d6f2745b HTTP/1.1" 200 None 2026-03-17 08:54:07,850 - lava_callback - ERROR - Error processing callback for node 69b673a11727ff69d6f2745b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 08:54:08,940 - lava_callback - INFO - Received callback for node 69b913d90ec88e58bad0d9f0 INFO: 172.20.0.1:59444 - "POST /node/69b913d90ec88e58bad0d9f0 HTTP/1.0" 202 Accepted 2026-03-17 08:54:08,947 - lava_callback - INFO - Starting async job submit for node 69b913d90ec88e58bad0d9f0 2026-03-17 08:54:08,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:08,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d90ec88e58bad0d9f0 HTTP/1.1" 200 None 2026-03-17 08:54:08,997 - lava_callback - DEBUG - Processing node 69b913d90ec88e58bad0d9f0: rt-tests-cyclicdeadline 2026-03-17 08:54:09,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:09,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:09,585 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b913d90ec88e58bad0d9f0/log.txt.gz 2026-03-17 08:54:09,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:10,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:10,074 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b913d90ec88e58bad0d9f0/lava-logs.yaml 2026-03-17 08:54:10,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:10,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:10,316 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b913d90ec88e58bad0d9f0/lava_callback.json.gz 2026-03-17 08:54:10,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:10,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d90ec88e58bad0d9f0 HTTP/1.1" 200 None 2026-03-17 08:54:10,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:10,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 08:54:10,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:10,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913d90ec88e58bad0d9f0 HTTP/1.1" 200 None 2026-03-17 08:54:10,442 - lava_callback - INFO - Completed processing callback for node 69b913d90ec88e58bad0d9f0 2026-03-17 08:54:11,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:11,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:34312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34314 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:54:16,753 - lava_callback - INFO - Received callback for node 69b913dc0ec88e58bad0d9fc INFO: 172.20.0.1:34326 - "POST /node/69b913dc0ec88e58bad0d9fc HTTP/1.0" 202 Accepted 2026-03-17 08:54:16,759 - lava_callback - INFO - Starting async job submit for node 69b913dc0ec88e58bad0d9fc 2026-03-17 08:54:16,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:16,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913dc0ec88e58bad0d9fc HTTP/1.1" 200 None 2026-03-17 08:54:16,810 - lava_callback - DEBUG - Processing node 69b913dc0ec88e58bad0d9fc: rt-tests-cyclictest 2026-03-17 08:54:17,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:17,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:17,321 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b913dc0ec88e58bad0d9fc/log.txt.gz 2026-03-17 08:54:17,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:17,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:17,804 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b913dc0ec88e58bad0d9fc/lava-logs.yaml 2026-03-17 08:54:17,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:18,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:18,032 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b913dc0ec88e58bad0d9fc/lava_callback.json.gz 2026-03-17 08:54:18,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:18,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913dc0ec88e58bad0d9fc HTTP/1.1" 200 None 2026-03-17 08:54:18,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:18,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 08:54:18,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:18,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913dc0ec88e58bad0d9fc HTTP/1.1" 200 None 2026-03-17 08:54:18,163 - lava_callback - INFO - Completed processing callback for node 69b913dc0ec88e58bad0d9fc INFO: 172.20.0.1:34962 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:54:30,840 - lava_callback - INFO - Received callback for node 69b912ee0ec88e58bad0d82e INFO: 172.20.0.1:33704 - "POST /node/69b912ee0ec88e58bad0d82e HTTP/1.0" 202 Accepted 2026-03-17 08:54:30,847 - lava_callback - INFO - Starting async job submit for node 69b912ee0ec88e58bad0d82e 2026-03-17 08:54:30,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:30,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912ee0ec88e58bad0d82e HTTP/1.1" 200 None 2026-03-17 08:54:30,937 - lava_callback - DEBUG - Processing node 69b912ee0ec88e58bad0d82e: baseline-arm 2026-03-17 08:54:31,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:31,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:31,825 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b912ee0ec88e58bad0d82e/log.txt.gz 2026-03-17 08:54:32,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:32,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:32,442 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b912ee0ec88e58bad0d82e/lava-logs.yaml 2026-03-17 08:54:32,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:32,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:32,641 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b912ee0ec88e58bad0d82e/lava_callback.json.gz DEBUG: Setup failed for 69b912ee0ec88e58bad0d82e. Transitting job node result: incomplete -> fail 2026-03-17 08:54:32,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:32,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912ee0ec88e58bad0d82e HTTP/1.1" 200 None 2026-03-17 08:54:32,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:32,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:54:32,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:32,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912ee0ec88e58bad0d82e HTTP/1.1" 200 None 2026-03-17 08:54:32,976 - lava_callback - INFO - Completed processing callback for node 69b912ee0ec88e58bad0d82e INFO: 172.20.0.1:33718 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:54:41,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:41,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57868 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:54:57,225 - lava_callback - INFO - Received callback for node 69b913dd0ec88e58bad0d9ff INFO: 172.20.0.1:57876 - "POST /node/69b913dd0ec88e58bad0d9ff HTTP/1.0" 202 Accepted 2026-03-17 08:54:57,232 - lava_callback - INFO - Starting async job submit for node 69b913dd0ec88e58bad0d9ff 2026-03-17 08:54:57,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:57,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913dd0ec88e58bad0d9ff HTTP/1.1" 200 None 2026-03-17 08:54:57,282 - lava_callback - DEBUG - Processing node 69b913dd0ec88e58bad0d9ff: rt-tests-cyclictest 2026-03-17 08:54:57,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:57,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:57,808 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b913dd0ec88e58bad0d9ff/log.txt.gz 2026-03-17 08:54:57,943 - lava_callback - INFO - Received callback for node 69b9133a0ec88e58bad0d92d INFO: 172.20.0.1:57888 - "POST /node/69b9133a0ec88e58bad0d92d HTTP/1.0" 202 Accepted 2026-03-17 08:54:57,973 - lava_callback - INFO - Starting async job submit for node 69b9133a0ec88e58bad0d92d 2026-03-17 08:54:58,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:58,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:58,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9133a0ec88e58bad0d92d HTTP/1.1" 200 None 2026-03-17 08:54:58,071 - lava_callback - DEBUG - Processing node 69b9133a0ec88e58bad0d92d: ltp-timers 2026-03-17 08:54:58,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:58,473 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b913dd0ec88e58bad0d9ff/lava-logs.yaml 2026-03-17 08:54:58,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:58,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:58,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:58,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69b9133a0ec88e58bad0d92d/log.txt.gz 2026-03-17 08:54:58,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:58,734 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b913dd0ec88e58bad0d9ff/lava_callback.json.gz 2026-03-17 08:54:58,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:58,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:58,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913dd0ec88e58bad0d9ff HTTP/1.1" 200 None 2026-03-17 08:54:58,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:58,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 08:54:58,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:58,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913dd0ec88e58bad0d9ff HTTP/1.1" 200 None 2026-03-17 08:54:58,951 - lava_callback - INFO - Completed processing callback for node 69b913dd0ec88e58bad0d9ff 2026-03-17 08:54:59,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:59,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69b9133a0ec88e58bad0d92d/lava-logs.yaml 2026-03-17 08:54:59,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:54:59,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:54:59,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69b9133a0ec88e58bad0d92d/lava_callback.json.gz 2026-03-17 08:54:59,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:59,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9133a0ec88e58bad0d92d HTTP/1.1" 200 None 2026-03-17 08:54:59,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:59,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:54:59,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:54:59,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9133a0ec88e58bad0d92d HTTP/1.1" 200 None 2026-03-17 08:54:59,448 - lava_callback - INFO - Completed processing callback for node 69b9133a0ec88e58bad0d92d 2026-03-17 08:55:01,108 - lava_callback - INFO - Received callback for node 69b9133c0ec88e58bad0d930 INFO: 172.20.0.1:38152 - "POST /node/69b9133c0ec88e58bad0d930 HTTP/1.0" 202 Accepted 2026-03-17 08:55:01,114 - lava_callback - INFO - Starting async job submit for node 69b9133c0ec88e58bad0d930 2026-03-17 08:55:01,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:55:01,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9133c0ec88e58bad0d930 HTTP/1.1" 200 None 2026-03-17 08:55:01,154 - lava_callback - DEBUG - Processing node 69b9133c0ec88e58bad0d930: ltp-watchqueue 2026-03-17 08:55:01,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:55:01,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:55:01,695 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b9133c0ec88e58bad0d930/log.txt.gz 2026-03-17 08:55:01,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:55:02,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:55:02,109 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b9133c0ec88e58bad0d930/lava-logs.yaml 2026-03-17 08:55:02,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:55:02,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:55:02,266 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b9133c0ec88e58bad0d930/lava_callback.json.gz 2026-03-17 08:55:02,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:55:02,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9133c0ec88e58bad0d930 HTTP/1.1" 200 None 2026-03-17 08:55:02,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:55:02,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:55:02,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:55:02,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9133c0ec88e58bad0d930 HTTP/1.1" 200 None 2026-03-17 08:55:02,353 - lava_callback - INFO - Completed processing callback for node 69b9133c0ec88e58bad0d930 INFO: 172.20.0.1:38156 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:55:11,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:55:11,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:52296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40182 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:55:27,792 - lava_callback - INFO - Received callback for node 69b673ec1727ff69d6f27466 INFO: 172.20.0.1:40198 - "POST /node/69b673ec1727ff69d6f27466 HTTP/1.0" 202 Accepted 2026-03-17 08:55:27,798 - lava_callback - INFO - Starting async job submit for node 69b673ec1727ff69d6f27466 2026-03-17 08:55:27,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:55:27,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b673ec1727ff69d6f27466 HTTP/1.1" 200 None 2026-03-17 08:55:27,814 - lava_callback - DEBUG - Processing node 69b673ec1727ff69d6f27466: baseline-arm64-baylibre 2026-03-17 08:55:27,814 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b673ec1727ff69d6f27466 2026-03-17 08:55:27,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:55:27,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b673ec1727ff69d6f27466 HTTP/1.1" 200 None 2026-03-17 08:55:27,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:55:27,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 08:55:27,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:55:27,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b673ec1727ff69d6f27466 HTTP/1.1" 200 None 2026-03-17 08:55:27,884 - lava_callback - ERROR - Error processing callback for node 69b673ec1727ff69d6f27466: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51404 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:55:40,649 - lava_callback - INFO - Received callback for node 69b913d80ec88e58bad0d9e2 INFO: 172.20.0.1:33578 - "POST /node/69b913d80ec88e58bad0d9e2 HTTP/1.0" 202 Accepted 2026-03-17 08:55:40,655 - lava_callback - INFO - Starting async job submit for node 69b913d80ec88e58bad0d9e2 2026-03-17 08:55:40,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:55:40,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d80ec88e58bad0d9e2 HTTP/1.1" 200 None 2026-03-17 08:55:40,702 - lava_callback - DEBUG - Processing node 69b913d80ec88e58bad0d9e2: rt-tests-cyclicdeadline 2026-03-17 08:55:41,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:55:41,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:55:41,275 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b913d80ec88e58bad0d9e2/log.txt.gz 2026-03-17 08:55:41,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:55:41,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:55:41,751 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b913d80ec88e58bad0d9e2/lava-logs.yaml 2026-03-17 08:55:41,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:55:41,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:55:41,918 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b913d80ec88e58bad0d9e2/lava_callback.json.gz 2026-03-17 08:55:41,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:55:41,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913d80ec88e58bad0d9e2 HTTP/1.1" 200 None 2026-03-17 08:55:41,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:55:41,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 08:55:41,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:55:42,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913d80ec88e58bad0d9e2 HTTP/1.1" 200 None 2026-03-17 08:55:42,036 - lava_callback - INFO - Completed processing callback for node 69b913d80ec88e58bad0d9e2 INFO: 172.20.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45276 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:56:11,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:56:11,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:58500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48128 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:56:27,802 - lava_callback - INFO - Received callback for node 69b674361727ff69d6f2746c INFO: 172.20.0.1:48132 - "POST /node/69b674361727ff69d6f2746c HTTP/1.0" 202 Accepted 2026-03-17 08:56:27,807 - lava_callback - INFO - Starting async job submit for node 69b674361727ff69d6f2746c 2026-03-17 08:56:27,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:56:27,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b674361727ff69d6f2746c HTTP/1.1" 200 None 2026-03-17 08:56:27,824 - lava_callback - DEBUG - Processing node 69b674361727ff69d6f2746c: baseline-arm64-baylibre 2026-03-17 08:56:27,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b674361727ff69d6f2746c 2026-03-17 08:56:27,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:56:27,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b674361727ff69d6f2746c HTTP/1.1" 200 None 2026-03-17 08:56:27,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:56:27,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 08:56:27,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:56:27,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b674361727ff69d6f2746c HTTP/1.1" 200 None 2026-03-17 08:56:27,883 - lava_callback - ERROR - Error processing callback for node 69b674361727ff69d6f2746c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53974 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:57:32,534 - lava_callback - INFO - Received callback for node 69b917710ec88e58bad0dd2c INFO: 172.20.0.1:37830 - "POST /node/69b917710ec88e58bad0dd2c HTTP/1.0" 202 Accepted 2026-03-17 08:57:32,545 - lava_callback - INFO - Starting async job submit for node 69b917710ec88e58bad0dd2c 2026-03-17 08:57:32,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:57:32,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b917710ec88e58bad0dd2c HTTP/1.1" 200 None 2026-03-17 08:57:32,572 - lava_callback - DEBUG - Processing node 69b917710ec88e58bad0dd2c: job-gcc-14-arm-612-cip 2026-03-17 08:57:32,574 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:57:32,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:57:32,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:57:32,744 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b917710ec88e58bad0dd2c/lava-logs.yaml 2026-03-17 08:57:32,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:57:32,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:57:32,861 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b917710ec88e58bad0dd2c/lava_callback.json.gz 2026-03-17 08:57:32,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:57:32,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b917710ec88e58bad0dd2c HTTP/1.1" 200 None 2026-03-17 08:57:32,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:57:32,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab1fbe29c53ae8604f7 HTTP/1.1" 200 None 2026-03-17 08:57:32,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:57:32,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b917710ec88e58bad0dd2c HTTP/1.1" 200 None 2026-03-17 08:57:32,926 - lava_callback - INFO - Completed processing callback for node 69b917710ec88e58bad0dd2c INFO: 172.20.0.1:37832 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:57:41,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:57:41,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60694 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:57:44,203 - lava_callback - INFO - Received callback for node 69b917730ec88e58bad0dd2f INFO: 172.20.0.1:60698 - "POST /node/69b917730ec88e58bad0dd2f HTTP/1.0" 202 Accepted 2026-03-17 08:57:44,210 - lava_callback - INFO - Starting async job submit for node 69b917730ec88e58bad0dd2f 2026-03-17 08:57:44,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:57:44,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b917730ec88e58bad0dd2f HTTP/1.1" 200 None 2026-03-17 08:57:44,227 - lava_callback - DEBUG - Processing node 69b917730ec88e58bad0dd2f: job-gcc-14-arm-612-cip 2026-03-17 08:57:44,232 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:57:44,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:57:44,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:57:44,425 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b917730ec88e58bad0dd2f/lava-logs.yaml 2026-03-17 08:57:44,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:57:44,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:57:44,553 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b917730ec88e58bad0dd2f/lava_callback.json.gz 2026-03-17 08:57:44,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:57:44,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b917730ec88e58bad0dd2f HTTP/1.1" 200 None 2026-03-17 08:57:44,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:57:44,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab1fbe29c53ae8604f7 HTTP/1.1" 200 None 2026-03-17 08:57:44,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:57:44,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b917730ec88e58bad0dd2f HTTP/1.1" 200 None 2026-03-17 08:57:44,618 - lava_callback - INFO - Completed processing callback for node 69b917730ec88e58bad0dd2f INFO: 172.20.0.1:60714 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:57:48,032 - lava_callback - INFO - Received callback for node 69b6747f1727ff69d6f27472 INFO: 172.20.0.1:60728 - "POST /node/69b6747f1727ff69d6f27472 HTTP/1.0" 202 Accepted 2026-03-17 08:57:48,037 - lava_callback - INFO - Starting async job submit for node 69b6747f1727ff69d6f27472 2026-03-17 08:57:48,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:57:48,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6747f1727ff69d6f27472 HTTP/1.1" 200 None 2026-03-17 08:57:48,053 - lava_callback - DEBUG - Processing node 69b6747f1727ff69d6f27472: baseline-arm64-baylibre 2026-03-17 08:57:48,054 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6747f1727ff69d6f27472 2026-03-17 08:57:48,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:57:48,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6747f1727ff69d6f27472 HTTP/1.1" 200 None 2026-03-17 08:57:48,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:57:48,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 08:57:48,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:57:48,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6747f1727ff69d6f27472 HTTP/1.1" 200 None 2026-03-17 08:57:48,106 - lava_callback - ERROR - Error processing callback for node 69b6747f1727ff69d6f27472: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54556 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:58:06,228 - lava_callback - INFO - Received callback for node 69b913120ec88e58bad0d8b0 INFO: 172.20.0.1:48674 - "POST /node/69b913120ec88e58bad0d8b0 HTTP/1.0" 202 Accepted 2026-03-17 08:58:06,273 - lava_callback - INFO - Starting async job submit for node 69b913120ec88e58bad0d8b0 2026-03-17 08:58:06,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:58:06,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913120ec88e58bad0d8b0 HTTP/1.1" 200 None 2026-03-17 08:58:06,324 - lava_callback - DEBUG - Processing node 69b913120ec88e58bad0d8b0: baseline-arm-pengutronix 2026-03-17 08:58:06,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:48678 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:58:06,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:58:06,593 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b913120ec88e58bad0d8b0/log.txt.gz 2026-03-17 08:58:06,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:58:06,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:58:06,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b913120ec88e58bad0d8b0/lava-logs.yaml 2026-03-17 08:58:06,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:58:07,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:58:07,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b913120ec88e58bad0d8b0/lava_callback.json.gz DEBUG: Setup failed for 69b913120ec88e58bad0d8b0. Transitting job node result: incomplete -> fail 2026-03-17 08:58:07,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:58:07,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913120ec88e58bad0d8b0 HTTP/1.1" 200 None 2026-03-17 08:58:07,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:58:07,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:58:07,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:58:07,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913120ec88e58bad0d8b0 HTTP/1.1" 200 None 2026-03-17 08:58:07,193 - lava_callback - INFO - Completed processing callback for node 69b913120ec88e58bad0d8b0 2026-03-17 08:58:11,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:58:11,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35790 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:58:20,068 - lava_callback - INFO - Received callback for node 69b917990ec88e58bad0dd49 INFO: 172.20.0.1:40976 - "POST /node/69b917990ec88e58bad0dd49 HTTP/1.0" 202 Accepted 2026-03-17 08:58:20,074 - lava_callback - INFO - Starting async job submit for node 69b917990ec88e58bad0dd49 2026-03-17 08:58:20,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:58:20,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b917990ec88e58bad0dd49 HTTP/1.1" 200 None 2026-03-17 08:58:20,092 - lava_callback - DEBUG - Processing node 69b917990ec88e58bad0dd49: baseline-arm 2026-03-17 08:58:20,098 - lava_callback - WARNING - Failed to upload log 2026-03-17 08:58:20,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:58:20,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:58:20,226 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b917990ec88e58bad0dd49/lava-logs.yaml 2026-03-17 08:58:20,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 08:58:20,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 08:58:20,415 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b917990ec88e58bad0dd49/lava_callback.json.gz 2026-03-17 08:58:20,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:58:20,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b917990ec88e58bad0dd49 HTTP/1.1" 200 None 2026-03-17 08:58:20,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:58:20,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 08:58:20,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:58:20,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b917990ec88e58bad0dd49 HTTP/1.1" 200 None 2026-03-17 08:58:20,477 - lava_callback - INFO - Completed processing callback for node 69b917990ec88e58bad0dd49 INFO: 172.20.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39936 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:58:41,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:58:41,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53330 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:59:14,112 - lava_callback - INFO - Received callback for node 69b674cd1727ff69d6f2747d INFO: 172.20.0.1:53264 - "POST /node/69b674cd1727ff69d6f2747d HTTP/1.0" 202 Accepted 2026-03-17 08:59:14,123 - lava_callback - INFO - Starting async job submit for node 69b674cd1727ff69d6f2747d 2026-03-17 08:59:14,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:59:14,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b674cd1727ff69d6f2747d HTTP/1.1" 200 None 2026-03-17 08:59:14,154 - lava_callback - DEBUG - Processing node 69b674cd1727ff69d6f2747d: baseline-arm64-clabbe 2026-03-17 08:59:14,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b674cd1727ff69d6f2747d 2026-03-17 08:59:14,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:59:14,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b674cd1727ff69d6f2747d HTTP/1.1" 200 None 2026-03-17 08:59:14,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:59:14,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 08:59:14,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:59:14,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b674cd1727ff69d6f2747d HTTP/1.1" 200 None 2026-03-17 08:59:14,233 - lava_callback - ERROR - Error processing callback for node 69b674cd1727ff69d6f2747d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50092 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:00:14,212 - lava_callback - INFO - Received callback for node 69b675161727ff69d6f27483 INFO: 172.20.0.1:46494 - "POST /node/69b675161727ff69d6f27483 HTTP/1.0" 202 Accepted 2026-03-17 09:00:14,218 - lava_callback - INFO - Starting async job submit for node 69b675161727ff69d6f27483 2026-03-17 09:00:14,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:00:14,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b675161727ff69d6f27483 HTTP/1.1" 200 None 2026-03-17 09:00:14,324 - lava_callback - DEBUG - Processing node 69b675161727ff69d6f27483: baseline-arm64-clabbe 2026-03-17 09:00:14,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b675161727ff69d6f27483 2026-03-17 09:00:14,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:00:14,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b675161727ff69d6f27483 HTTP/1.1" 200 None 2026-03-17 09:00:14,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:00:14,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 09:00:14,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:00:14,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b675161727ff69d6f27483 HTTP/1.1" 200 None 2026-03-17 09:00:14,471 - lava_callback - ERROR - Error processing callback for node 69b675161727ff69d6f27483: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39806 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:01:34,181 - lava_callback - INFO - Received callback for node 69b675611727ff69d6f2748d INFO: 172.20.0.1:45468 - "POST /node/69b675611727ff69d6f2748d HTTP/1.0" 202 Accepted 2026-03-17 09:01:34,187 - lava_callback - INFO - Starting async job submit for node 69b675611727ff69d6f2748d 2026-03-17 09:01:34,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:01:34,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b675611727ff69d6f2748d HTTP/1.1" 200 None 2026-03-17 09:01:34,203 - lava_callback - DEBUG - Processing node 69b675611727ff69d6f2748d: baseline-arm64-clabbe 2026-03-17 09:01:34,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b675611727ff69d6f2748d 2026-03-17 09:01:34,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:01:34,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b675611727ff69d6f2748d HTTP/1.1" 200 None 2026-03-17 09:01:34,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:01:34,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 09:01:34,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:01:34,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b675611727ff69d6f2748d HTTP/1.1" 200 None 2026-03-17 09:01:34,263 - lava_callback - ERROR - Error processing callback for node 69b675611727ff69d6f2748d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56348 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:02:54,235 - lava_callback - INFO - Received callback for node 69b675aa1727ff69d6f27493 INFO: 172.20.0.1:59162 - "POST /node/69b675aa1727ff69d6f27493 HTTP/1.0" 202 Accepted 2026-03-17 09:02:54,240 - lava_callback - INFO - Starting async job submit for node 69b675aa1727ff69d6f27493 2026-03-17 09:02:54,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:02:54,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b675aa1727ff69d6f27493 HTTP/1.1" 200 None 2026-03-17 09:02:54,263 - lava_callback - DEBUG - Processing node 69b675aa1727ff69d6f27493: baseline-arm64-clabbe 2026-03-17 09:02:54,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b675aa1727ff69d6f27493 2026-03-17 09:02:54,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:02:54,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b675aa1727ff69d6f27493 HTTP/1.1" 200 None 2026-03-17 09:02:54,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:02:54,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 09:02:54,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:02:54,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b675aa1727ff69d6f27493 HTTP/1.1" 200 None 2026-03-17 09:02:54,328 - lava_callback - ERROR - Error processing callback for node 69b675aa1727ff69d6f27493: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41612 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:03:54,293 - lava_callback - INFO - Received callback for node 69b675f31727ff69d6f274a0 INFO: 172.20.0.1:48322 - "POST /node/69b675f31727ff69d6f274a0 HTTP/1.0" 202 Accepted 2026-03-17 09:03:54,299 - lava_callback - INFO - Starting async job submit for node 69b675f31727ff69d6f274a0 2026-03-17 09:03:54,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:03:54,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b675f31727ff69d6f274a0 HTTP/1.1" 200 None 2026-03-17 09:03:54,315 - lava_callback - DEBUG - Processing node 69b675f31727ff69d6f274a0: baseline-arm64-clabbe 2026-03-17 09:03:54,315 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b675f31727ff69d6f274a0 2026-03-17 09:03:54,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:03:54,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b675f31727ff69d6f274a0 HTTP/1.1" 200 None 2026-03-17 09:03:54,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:03:54,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 09:03:54,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:03:54,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b675f31727ff69d6f274a0 HTTP/1.1" 200 None 2026-03-17 09:03:54,380 - lava_callback - ERROR - Error processing callback for node 69b675f31727ff69d6f274a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52562 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:04:18,767 - lava_callback - INFO - Received callback for node 69b915680ec88e58bad0db89 INFO: 172.20.0.1:52564 - "POST /node/69b915680ec88e58bad0db89 HTTP/1.0" 202 Accepted 2026-03-17 09:04:18,783 - lava_callback - INFO - Starting async job submit for node 69b915680ec88e58bad0db89 2026-03-17 09:04:18,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:04:18,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b915680ec88e58bad0db89 HTTP/1.1" 200 None 2026-03-17 09:04:18,894 - lava_callback - DEBUG - Processing node 69b915680ec88e58bad0db89: baseline-x86 2026-03-17 09:04:19,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:04:19,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:04:19,859 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b915680ec88e58bad0db89/log.txt.gz 2026-03-17 09:04:20,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:04:20,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:04:20,605 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b915680ec88e58bad0db89/lava-logs.yaml 2026-03-17 09:04:20,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:04:20,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:04:20,878 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b915680ec88e58bad0db89/lava_callback.json.gz DEBUG: Setup failed for 69b915680ec88e58bad0db89. Transitting job node result: incomplete -> fail 2026-03-17 09:04:20,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:04:21,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b915680ec88e58bad0db89 HTTP/1.1" 200 None 2026-03-17 09:04:21,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:04:21,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e550ec88e58bad0d108 HTTP/1.1" 200 None 2026-03-17 09:04:21,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:04:21,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b915680ec88e58bad0db89 HTTP/1.1" 200 None 2026-03-17 09:04:21,148 - lava_callback - INFO - Completed processing callback for node 69b915680ec88e58bad0db89 INFO: 172.20.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60006 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:04:41,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:04:41,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 09:04:43,353 - lava_callback - INFO - Received callback for node 69b919280ec88e58bad0ddc5 INFO: 172.20.0.1:35718 - "POST /node/69b919280ec88e58bad0ddc5 HTTP/1.0" 202 Accepted 2026-03-17 09:04:43,359 - lava_callback - INFO - Starting async job submit for node 69b919280ec88e58bad0ddc5 2026-03-17 09:04:43,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:04:43,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919280ec88e58bad0ddc5 HTTP/1.1" 200 None 2026-03-17 09:04:43,376 - lava_callback - DEBUG - Processing node 69b919280ec88e58bad0ddc5: rt-tests-cyclicdeadline 2026-03-17 09:04:43,377 - lava_callback - WARNING - Failed to upload log 2026-03-17 09:04:43,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:35720 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:04:43,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:04:43,590 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b919280ec88e58bad0ddc5/lava-logs.yaml 2026-03-17 09:04:43,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:04:43,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:04:43,724 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b919280ec88e58bad0ddc5/lava_callback.json.gz 2026-03-17 09:04:43,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:04:43,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919280ec88e58bad0ddc5 HTTP/1.1" 200 None 2026-03-17 09:04:43,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:04:43,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 09:04:43,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:04:43,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919280ec88e58bad0ddc5 HTTP/1.1" 200 None 2026-03-17 09:04:43,789 - lava_callback - INFO - Completed processing callback for node 69b919280ec88e58bad0ddc5 INFO: 172.20.0.1:35726 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:04:54,146 - lava_callback - INFO - Received callback for node 69b9192c0ec88e58bad0ddce INFO: 172.20.0.1:54996 - "POST /node/69b9192c0ec88e58bad0ddce HTTP/1.0" 202 Accepted 2026-03-17 09:04:54,152 - lava_callback - INFO - Starting async job submit for node 69b9192c0ec88e58bad0ddce 2026-03-17 09:04:54,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:04:54,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9192c0ec88e58bad0ddce HTTP/1.1" 200 None 2026-03-17 09:04:54,169 - lava_callback - DEBUG - Processing node 69b9192c0ec88e58bad0ddce: rt-tests-cyclictest 2026-03-17 09:04:54,170 - lava_callback - WARNING - Failed to upload log 2026-03-17 09:04:54,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:04:54,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:04:54,294 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b9192c0ec88e58bad0ddce/lava-logs.yaml 2026-03-17 09:04:54,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:04:54,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:04:54,492 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b9192c0ec88e58bad0ddce/lava_callback.json.gz 2026-03-17 09:04:54,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:04:54,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9192c0ec88e58bad0ddce HTTP/1.1" 200 None 2026-03-17 09:04:54,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:04:54,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 09:04:54,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:04:54,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9192c0ec88e58bad0ddce HTTP/1.1" 200 None 2026-03-17 09:04:54,569 - lava_callback - INFO - Completed processing callback for node 69b9192c0ec88e58bad0ddce INFO: 172.20.0.1:55008 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:55012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35014 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:05:11,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:05:11,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 09:05:14,290 - lava_callback - INFO - Received callback for node 69b6763d1727ff69d6f274a8 INFO: 172.20.0.1:45506 - "POST /node/69b6763d1727ff69d6f274a8 HTTP/1.0" 202 Accepted 2026-03-17 09:05:14,299 - lava_callback - INFO - Starting async job submit for node 69b6763d1727ff69d6f274a8 2026-03-17 09:05:14,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:05:14,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6763d1727ff69d6f274a8 HTTP/1.1" 200 None 2026-03-17 09:05:14,319 - lava_callback - DEBUG - Processing node 69b6763d1727ff69d6f274a8: baseline-arm64-clabbe 2026-03-17 09:05:14,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6763d1727ff69d6f274a8 2026-03-17 09:05:14,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:05:14,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6763d1727ff69d6f274a8 HTTP/1.1" 200 None 2026-03-17 09:05:14,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:05:14,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 09:05:14,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:05:14,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6763d1727ff69d6f274a8 HTTP/1.1" 200 None 2026-03-17 09:05:14,417 - lava_callback - ERROR - Error processing callback for node 69b6763d1727ff69d6f274a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48316 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:06:08,410 - lava_callback - INFO - Received callback for node 69b676741727ff69d6f274af INFO: 172.20.0.1:48328 - "POST /node/69b676741727ff69d6f274af HTTP/1.0" 202 Accepted 2026-03-17 09:06:08,419 - lava_callback - INFO - Starting async job submit for node 69b676741727ff69d6f274af 2026-03-17 09:06:08,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:06:08,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b676741727ff69d6f274af HTTP/1.1" 200 None 2026-03-17 09:06:08,444 - lava_callback - DEBUG - Processing node 69b676741727ff69d6f274af: baseline-arm-baylibre 2026-03-17 09:06:08,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b676741727ff69d6f274af 2026-03-17 09:06:08,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:06:08,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b676741727ff69d6f274af HTTP/1.1" 200 None 2026-03-17 09:06:08,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:06:08,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-17 09:06:08,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:06:08,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b676741727ff69d6f274af HTTP/1.1" 200 None 2026-03-17 09:06:08,520 - lava_callback - ERROR - Error processing callback for node 69b676741727ff69d6f274af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38206 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:06:48,310 - lava_callback - INFO - Received callback for node 69b676991727ff69d6f274b9 INFO: 172.20.0.1:38220 - "POST /node/69b676991727ff69d6f274b9 HTTP/1.0" 202 Accepted 2026-03-17 09:06:48,319 - lava_callback - INFO - Starting async job submit for node 69b676991727ff69d6f274b9 2026-03-17 09:06:48,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:06:48,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b676991727ff69d6f274b9 HTTP/1.1" 200 None 2026-03-17 09:06:48,351 - lava_callback - DEBUG - Processing node 69b676991727ff69d6f274b9: baseline-arm-baylibre 2026-03-17 09:06:48,351 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b676991727ff69d6f274b9 2026-03-17 09:06:48,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:06:48,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b676991727ff69d6f274b9 HTTP/1.1" 200 None 2026-03-17 09:06:48,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:06:48,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-17 09:06:48,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:06:48,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b676991727ff69d6f274b9 HTTP/1.1" 200 None 2026-03-17 09:06:48,418 - lava_callback - ERROR - Error processing callback for node 69b676991727ff69d6f274b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53546 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:07:20,852 - lava_callback - INFO - Received callback for node 69b913db0ec88e58bad0d9f6 INFO: 172.20.0.1:34974 - "POST /node/69b913db0ec88e58bad0d9f6 HTTP/1.0" 202 Accepted 2026-03-17 09:07:20,858 - lava_callback - INFO - Starting async job submit for node 69b913db0ec88e58bad0d9f6 2026-03-17 09:07:20,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:07:20,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913db0ec88e58bad0d9f6 HTTP/1.1" 200 None 2026-03-17 09:07:20,905 - lava_callback - DEBUG - Processing node 69b913db0ec88e58bad0d9f6: rt-tests-cyclictest 2026-03-17 09:07:21,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:07:21,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:07:21,413 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b913db0ec88e58bad0d9f6/log.txt.gz 2026-03-17 09:07:21,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:07:21,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:07:21,853 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b913db0ec88e58bad0d9f6/lava-logs.yaml 2026-03-17 09:07:21,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:07:22,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:07:22,014 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b913db0ec88e58bad0d9f6/lava_callback.json.gz 2026-03-17 09:07:22,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:07:22,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913db0ec88e58bad0d9f6 HTTP/1.1" 200 None 2026-03-17 09:07:22,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:07:22,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 09:07:22,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:07:22,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913db0ec88e58bad0d9f6 HTTP/1.1" 200 None 2026-03-17 09:07:22,161 - lava_callback - INFO - Completed processing callback for node 69b913db0ec88e58bad0d9f6 INFO: 172.20.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45258 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:07:41,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:07:41,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52760 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:08:07,689 - lava_callback - INFO - Received callback for node 69b919e20ec88e58bad0de78 INFO: 172.20.0.1:52766 - "POST /node/69b919e20ec88e58bad0de78 HTTP/1.0" 202 Accepted 2026-03-17 09:08:07,698 - lava_callback - INFO - Starting async job submit for node 69b919e20ec88e58bad0de78 2026-03-17 09:08:07,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:07,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919e20ec88e58bad0de78 HTTP/1.1" 200 None 2026-03-17 09:08:07,717 - lava_callback - DEBUG - Processing node 69b919e20ec88e58bad0de78: baseline-nfs-arm64 2026-03-17 09:08:07,718 - lava_callback - WARNING - Failed to upload log 2026-03-17 09:08:07,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:07,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:07,914 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e20ec88e58bad0de78/lava-logs.yaml 2026-03-17 09:08:07,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:08,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:08,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e20ec88e58bad0de78/lava_callback.json.gz 2026-03-17 09:08:08,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:08,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919e20ec88e58bad0de78 HTTP/1.1" 200 None 2026-03-17 09:08:08,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:08,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:08:08,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:08,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919e20ec88e58bad0de78 HTTP/1.1" 200 None 2026-03-17 09:08:08,136 - lava_callback - INFO - Completed processing callback for node 69b919e20ec88e58bad0de78 2026-03-17 09:08:11,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:11,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45416 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:08:28,456 - lava_callback - INFO - Received callback for node 69b676fe1727ff69d6f274c4 INFO: 172.20.0.1:45430 - "POST /node/69b676fe1727ff69d6f274c4 HTTP/1.0" 202 Accepted 2026-03-17 09:08:28,464 - lava_callback - INFO - Starting async job submit for node 69b676fe1727ff69d6f274c4 2026-03-17 09:08:28,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:28,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b676fe1727ff69d6f274c4 HTTP/1.1" 200 None 2026-03-17 09:08:28,482 - lava_callback - DEBUG - Processing node 69b676fe1727ff69d6f274c4: baseline-arm-baylibre 2026-03-17 09:08:28,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b676fe1727ff69d6f274c4 2026-03-17 09:08:28,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:28,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b676fe1727ff69d6f274c4 HTTP/1.1" 200 None 2026-03-17 09:08:28,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:28,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-17 09:08:28,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:28,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b676fe1727ff69d6f274c4 HTTP/1.1" 200 None 2026-03-17 09:08:28,573 - lava_callback - ERROR - Error processing callback for node 69b676fe1727ff69d6f274c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 09:08:32,355 - lava_callback - INFO - Received callback for node 69b919c60ec88e58bad0de10 INFO: 172.20.0.1:45336 - "POST /node/69b919c60ec88e58bad0de10 HTTP/1.0" 202 Accepted 2026-03-17 09:08:32,365 - lava_callback - INFO - Starting async job submit for node 69b919c60ec88e58bad0de10 2026-03-17 09:08:32,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:32,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919c60ec88e58bad0de10 HTTP/1.1" 200 None 2026-03-17 09:08:32,407 - lava_callback - DEBUG - Processing node 69b919c60ec88e58bad0de10: baseline-arm64 2026-03-17 09:08:32,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:32,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:32,747 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919c60ec88e58bad0de10/log.txt.gz 2026-03-17 09:08:32,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:33,010 - lava_callback - INFO - Received callback for node 69b919ca0ec88e58bad0de2b INFO: 172.20.0.1:45344 - "POST /node/69b919ca0ec88e58bad0de2b HTTP/1.0" 202 Accepted 2026-03-17 09:08:33,022 - lava_callback - INFO - Starting async job submit for node 69b919ca0ec88e58bad0de2b 2026-03-17 09:08:33,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:33,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ca0ec88e58bad0de2b HTTP/1.1" 200 None 2026-03-17 09:08:33,108 - lava_callback - DEBUG - Processing node 69b919ca0ec88e58bad0de2b: baseline-arm64 2026-03-17 09:08:33,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:33,142 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919c60ec88e58bad0de10/lava-logs.yaml 2026-03-17 09:08:33,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:33,357 - lava_callback - WARNING - Failed to upload log 2026-03-17 09:08:33,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:33,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:33,440 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919c60ec88e58bad0de10/lava_callback.json.gz 2026-03-17 09:08:33,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:33,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919c60ec88e58bad0de10 HTTP/1.1" 200 None 2026-03-17 09:08:33,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:33,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:08:33,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:33,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919c60ec88e58bad0de10 HTTP/1.1" 200 None 2026-03-17 09:08:33,592 - lava_callback - INFO - Completed processing callback for node 69b919c60ec88e58bad0de10 2026-03-17 09:08:33,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:33,782 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919ca0ec88e58bad0de2b/lava-logs.yaml 2026-03-17 09:08:33,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:33,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:33,978 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919ca0ec88e58bad0de2b/lava_callback.json.gz 2026-03-17 09:08:34,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:34,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ca0ec88e58bad0de2b HTTP/1.1" 200 None 2026-03-17 09:08:34,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:34,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:08:34,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:34,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919ca0ec88e58bad0de2b HTTP/1.1" 200 None 2026-03-17 09:08:34,168 - lava_callback - INFO - Completed processing callback for node 69b919ca0ec88e58bad0de2b INFO: 172.20.0.1:45360 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:08:37,505 - lava_callback - INFO - Received callback for node 69b919d30ec88e58bad0de41 INFO: 172.20.0.1:45362 - "POST /node/69b919d30ec88e58bad0de41 HTTP/1.0" 202 Accepted 2026-03-17 09:08:37,515 - lava_callback - INFO - Starting async job submit for node 69b919d30ec88e58bad0de41 2026-03-17 09:08:37,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:37,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d30ec88e58bad0de41 HTTP/1.1" 200 None 2026-03-17 09:08:37,566 - lava_callback - DEBUG - Processing node 69b919d30ec88e58bad0de41: baseline-arm64 2026-03-17 09:08:37,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:37,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:37,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d30ec88e58bad0de41/log.txt.gz 2026-03-17 09:08:38,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:38,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:38,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d30ec88e58bad0de41/lava-logs.yaml 2026-03-17 09:08:38,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:38,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:38,394 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d30ec88e58bad0de41/lava_callback.json.gz 2026-03-17 09:08:38,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:38,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d30ec88e58bad0de41 HTTP/1.1" 200 None 2026-03-17 09:08:38,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:38,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:08:38,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:38,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919d30ec88e58bad0de41 HTTP/1.1" 200 None 2026-03-17 09:08:38,475 - lava_callback - INFO - Completed processing callback for node 69b919d30ec88e58bad0de41 2026-03-17 09:08:38,854 - lava_callback - INFO - Received callback for node 69b919cf0ec88e58bad0de38 INFO: 172.20.0.1:45368 - "POST /node/69b919cf0ec88e58bad0de38 HTTP/1.0" 202 Accepted 2026-03-17 09:08:38,860 - lava_callback - INFO - Starting async job submit for node 69b919cf0ec88e58bad0de38 2026-03-17 09:08:38,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:38,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919cf0ec88e58bad0de38 HTTP/1.1" 200 None 2026-03-17 09:08:38,901 - lava_callback - DEBUG - Processing node 69b919cf0ec88e58bad0de38: baseline-arm64 2026-03-17 09:08:39,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:39,354 - lava_callback - INFO - Received callback for node 69b919c80ec88e58bad0de18 INFO: 172.20.0.1:45374 - "POST /node/69b919c80ec88e58bad0de18 HTTP/1.0" 202 Accepted 2026-03-17 09:08:39,364 - lava_callback - INFO - Starting async job submit for node 69b919c80ec88e58bad0de18 2026-03-17 09:08:39,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:39,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919c80ec88e58bad0de18 HTTP/1.1" 200 None 2026-03-17 09:08:39,407 - lava_callback - DEBUG - Processing node 69b919c80ec88e58bad0de18: baseline-arm64 2026-03-17 09:08:39,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:39,517 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919cf0ec88e58bad0de38/log.txt.gz 2026-03-17 09:08:39,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:39,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:40,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:40,083 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919c80ec88e58bad0de18/log.txt.gz 2026-03-17 09:08:40,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:40,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919cf0ec88e58bad0de38/lava-logs.yaml 2026-03-17 09:08:40,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:40,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:40,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:40,419 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919cf0ec88e58bad0de38/lava_callback.json.gz 2026-03-17 09:08:40,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:40,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919cf0ec88e58bad0de38 HTTP/1.1" 200 None 2026-03-17 09:08:40,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:40,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:08:40,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:40,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919cf0ec88e58bad0de38 HTTP/1.1" 200 None 2026-03-17 09:08:40,542 - lava_callback - INFO - Completed processing callback for node 69b919cf0ec88e58bad0de38 2026-03-17 09:08:40,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:40,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919c80ec88e58bad0de18/lava-logs.yaml 2026-03-17 09:08:40,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:40,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:40,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919c80ec88e58bad0de18/lava_callback.json.gz 2026-03-17 09:08:40,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:40,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919c80ec88e58bad0de18 HTTP/1.1" 200 None 2026-03-17 09:08:40,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:40,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:08:40,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:41,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919c80ec88e58bad0de18 HTTP/1.1" 200 None 2026-03-17 09:08:41,019 - lava_callback - INFO - Completed processing callback for node 69b919c80ec88e58bad0de18 2026-03-17 09:08:41,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:41,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-17 09:08:42,148 - lava_callback - INFO - Received callback for node 69b919d00ec88e58bad0de3b INFO: 172.20.0.1:53524 - "POST /node/69b919d00ec88e58bad0de3b HTTP/1.0" 202 Accepted 2026-03-17 09:08:42,155 - lava_callback - INFO - Starting async job submit for node 69b919d00ec88e58bad0de3b 2026-03-17 09:08:42,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:42,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d00ec88e58bad0de3b HTTP/1.1" 200 None 2026-03-17 09:08:42,201 - lava_callback - DEBUG - Processing node 69b919d00ec88e58bad0de3b: baseline-arm64 2026-03-17 09:08:42,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:42,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:42,676 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d00ec88e58bad0de3b/log.txt.gz 2026-03-17 09:08:42,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:43,093 - lava_callback - INFO - Received callback for node 69b919cc0ec88e58bad0de2e INFO: 172.20.0.1:53534 - "POST /node/69b919cc0ec88e58bad0de2e HTTP/1.0" 202 Accepted 2026-03-17 09:08:43,100 - lava_callback - INFO - Starting async job submit for node 69b919cc0ec88e58bad0de2e 2026-03-17 09:08:43,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:43,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:43,137 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d00ec88e58bad0de3b/lava-logs.yaml 2026-03-17 09:08:43,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:43,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919cc0ec88e58bad0de2e HTTP/1.1" 200 None 2026-03-17 09:08:43,155 - lava_callback - DEBUG - Processing node 69b919cc0ec88e58bad0de2e: baseline-arm64 2026-03-17 09:08:43,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:43,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d00ec88e58bad0de3b/lava_callback.json.gz 2026-03-17 09:08:43,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:43,397 - lava_callback - WARNING - Failed to upload log 2026-03-17 09:08:43,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d00ec88e58bad0de3b HTTP/1.1" 200 None 2026-03-17 09:08:43,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:43,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:43,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:08:43,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:43,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919d00ec88e58bad0de3b HTTP/1.1" 200 None 2026-03-17 09:08:43,572 - lava_callback - INFO - Completed processing callback for node 69b919d00ec88e58bad0de3b INFO: 172.20.0.1:53548 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:08:43,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:43,751 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919cc0ec88e58bad0de2e/lava-logs.yaml 2026-03-17 09:08:43,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:43,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:43,868 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919cc0ec88e58bad0de2e/lava_callback.json.gz 2026-03-17 09:08:43,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:43,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919cc0ec88e58bad0de2e HTTP/1.1" 200 None 2026-03-17 09:08:43,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:43,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:08:43,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:43,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919cc0ec88e58bad0de2e HTTP/1.1" 200 None 2026-03-17 09:08:44,038 - lava_callback - INFO - Completed processing callback for node 69b919cc0ec88e58bad0de2e INFO: 172.20.0.1:53556 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:08:47,379 - lava_callback - INFO - Received callback for node 69b919ce0ec88e58bad0de35 INFO: 172.20.0.1:53566 - "POST /node/69b919ce0ec88e58bad0de35 HTTP/1.0" 202 Accepted 2026-03-17 09:08:47,385 - lava_callback - INFO - Starting async job submit for node 69b919ce0ec88e58bad0de35 2026-03-17 09:08:47,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:47,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ce0ec88e58bad0de35 HTTP/1.1" 200 None 2026-03-17 09:08:47,422 - lava_callback - DEBUG - Processing node 69b919ce0ec88e58bad0de35: baseline-arm64 2026-03-17 09:08:47,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:47,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:47,811 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919ce0ec88e58bad0de35/log.txt.gz 2026-03-17 09:08:47,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:48,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:48,173 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919ce0ec88e58bad0de35/lava-logs.yaml 2026-03-17 09:08:48,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:48,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:48,320 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919ce0ec88e58bad0de35/lava_callback.json.gz 2026-03-17 09:08:48,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:48,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ce0ec88e58bad0de35 HTTP/1.1" 200 None 2026-03-17 09:08:48,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:48,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:08:48,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:48,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919ce0ec88e58bad0de35 HTTP/1.1" 200 None 2026-03-17 09:08:48,410 - lava_callback - INFO - Completed processing callback for node 69b919ce0ec88e58bad0de35 2026-03-17 09:08:49,979 - lava_callback - INFO - Received callback for node 69b919d40ec88e58bad0de44 INFO: 172.20.0.1:35036 - "POST /node/69b919d40ec88e58bad0de44 HTTP/1.0" 202 Accepted 2026-03-17 09:08:49,987 - lava_callback - INFO - Starting async job submit for node 69b919d40ec88e58bad0de44 2026-03-17 09:08:50,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:50,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d40ec88e58bad0de44 HTTP/1.1" 200 None 2026-03-17 09:08:50,032 - lava_callback - DEBUG - Processing node 69b919d40ec88e58bad0de44: baseline-arm64 2026-03-17 09:08:50,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:50,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:50,393 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d40ec88e58bad0de44/log.txt.gz 2026-03-17 09:08:50,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:50,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:50,717 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d40ec88e58bad0de44/lava-logs.yaml 2026-03-17 09:08:50,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:50,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:50,869 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d40ec88e58bad0de44/lava_callback.json.gz 2026-03-17 09:08:50,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:50,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d40ec88e58bad0de44 HTTP/1.1" 200 None 2026-03-17 09:08:50,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:50,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:08:50,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:50,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919d40ec88e58bad0de44 HTTP/1.1" 200 None 2026-03-17 09:08:50,969 - lava_callback - INFO - Completed processing callback for node 69b919d40ec88e58bad0de44 2026-03-17 09:08:54,804 - lava_callback - INFO - Received callback for node 69b919c70ec88e58bad0de15 INFO: 172.20.0.1:35040 - "POST /node/69b919c70ec88e58bad0de15 HTTP/1.0" 202 Accepted 2026-03-17 09:08:54,810 - lava_callback - INFO - Starting async job submit for node 69b919c70ec88e58bad0de15 2026-03-17 09:08:54,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:54,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919c70ec88e58bad0de15 HTTP/1.1" 200 None 2026-03-17 09:08:54,847 - lava_callback - DEBUG - Processing node 69b919c70ec88e58bad0de15: baseline-arm64 2026-03-17 09:08:55,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:55,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:55,205 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919c70ec88e58bad0de15/log.txt.gz 2026-03-17 09:08:55,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:55,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:55,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919c70ec88e58bad0de15/lava-logs.yaml 2026-03-17 09:08:55,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:08:55,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:08:55,677 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919c70ec88e58bad0de15/lava_callback.json.gz 2026-03-17 09:08:55,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:55,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919c70ec88e58bad0de15 HTTP/1.1" 200 None 2026-03-17 09:08:55,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:55,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:08:55,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:08:55,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919c70ec88e58bad0de15 HTTP/1.1" 200 None 2026-03-17 09:08:55,764 - lava_callback - INFO - Completed processing callback for node 69b919c70ec88e58bad0de15 INFO: 172.20.0.1:35044 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:09:03,513 - lava_callback - INFO - Received callback for node 69b919d60ec88e58bad0de4a INFO: 172.20.0.1:35796 - "POST /node/69b919d60ec88e58bad0de4a HTTP/1.0" 202 Accepted 2026-03-17 09:09:03,520 - lava_callback - INFO - Starting async job submit for node 69b919d60ec88e58bad0de4a 2026-03-17 09:09:03,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:03,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d60ec88e58bad0de4a HTTP/1.1" 200 None 2026-03-17 09:09:03,557 - lava_callback - DEBUG - Processing node 69b919d60ec88e58bad0de4a: baseline-arm64 2026-03-17 09:09:03,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:03,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:03,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d60ec88e58bad0de4a/log.txt.gz 2026-03-17 09:09:04,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:04,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:04,364 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d60ec88e58bad0de4a/lava-logs.yaml 2026-03-17 09:09:04,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:04,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:04,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d60ec88e58bad0de4a/lava_callback.json.gz 2026-03-17 09:09:04,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:04,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d60ec88e58bad0de4a HTTP/1.1" 200 None 2026-03-17 09:09:04,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:04,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:04,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:04,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919d60ec88e58bad0de4a HTTP/1.1" 200 None 2026-03-17 09:09:04,592 - lava_callback - INFO - Completed processing callback for node 69b919d60ec88e58bad0de4a INFO: 172.20.0.1:35802 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:09:11,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:11,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-17 09:09:11,829 - lava_callback - INFO - Received callback for node 69b919e10ec88e58bad0de75 INFO: 172.20.0.1:44150 - "POST /node/69b919e10ec88e58bad0de75 HTTP/1.0" 202 Accepted 2026-03-17 09:09:11,836 - lava_callback - INFO - Starting async job submit for node 69b919e10ec88e58bad0de75 2026-03-17 09:09:11,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:11,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919e10ec88e58bad0de75 HTTP/1.1" 200 None 2026-03-17 09:09:11,876 - lava_callback - DEBUG - Processing node 69b919e10ec88e58bad0de75: baseline-nfs-arm64 2026-03-17 09:09:12,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:12,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:12,496 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e10ec88e58bad0de75/log.txt.gz 2026-03-17 09:09:12,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:12,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:12,977 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e10ec88e58bad0de75/lava-logs.yaml 2026-03-17 09:09:12,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:13,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:13,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e10ec88e58bad0de75/lava_callback.json.gz 2026-03-17 09:09:13,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:13,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919e10ec88e58bad0de75 HTTP/1.1" 200 None 2026-03-17 09:09:13,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:13,230 - lava_callback - INFO - Received callback for node 69b919e00ec88e58bad0de6f INFO: 172.20.0.1:44162 - "POST /node/69b919e00ec88e58bad0de6f HTTP/1.0" 202 Accepted 2026-03-17 09:09:13,237 - lava_callback - INFO - Starting async job submit for node 69b919e00ec88e58bad0de6f 2026-03-17 09:09:13,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:13,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:13,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:13,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919e00ec88e58bad0de6f HTTP/1.1" 200 None 2026-03-17 09:09:13,282 - lava_callback - DEBUG - Processing node 69b919e00ec88e58bad0de6f: baseline-nfs-arm64 2026-03-17 09:09:13,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919e10ec88e58bad0de75 HTTP/1.1" 200 None 2026-03-17 09:09:13,338 - lava_callback - INFO - Completed processing callback for node 69b919e10ec88e58bad0de75 2026-03-17 09:09:13,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:13,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:13,999 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e00ec88e58bad0de6f/log.txt.gz 2026-03-17 09:09:14,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:14,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:14,432 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e00ec88e58bad0de6f/lava-logs.yaml 2026-03-17 09:09:14,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:14,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:14,603 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e00ec88e58bad0de6f/lava_callback.json.gz 2026-03-17 09:09:14,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:14,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919e00ec88e58bad0de6f HTTP/1.1" 200 None 2026-03-17 09:09:14,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:14,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:14,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:14,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919e00ec88e58bad0de6f HTTP/1.1" 200 None 2026-03-17 09:09:14,684 - lava_callback - INFO - Completed processing callback for node 69b919e00ec88e58bad0de6f 2026-03-17 09:09:14,892 - lava_callback - INFO - Received callback for node 69b919dd0ec88e58bad0de69 INFO: 172.20.0.1:44176 - "POST /node/69b919dd0ec88e58bad0de69 HTTP/1.0" 202 Accepted 2026-03-17 09:09:14,899 - lava_callback - INFO - Starting async job submit for node 69b919dd0ec88e58bad0de69 2026-03-17 09:09:14,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:14,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919dd0ec88e58bad0de69 HTTP/1.1" 200 None 2026-03-17 09:09:14,939 - lava_callback - DEBUG - Processing node 69b919dd0ec88e58bad0de69: baseline-nfs-arm64 INFO: 172.20.0.1:44186 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 09:09:15,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:15,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:15,471 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919dd0ec88e58bad0de69/log.txt.gz 2026-03-17 09:09:15,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:15,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:15,877 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919dd0ec88e58bad0de69/lava-logs.yaml 2026-03-17 09:09:15,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:16,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:16,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919dd0ec88e58bad0de69/lava_callback.json.gz 2026-03-17 09:09:16,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:16,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919dd0ec88e58bad0de69 HTTP/1.1" 200 None 2026-03-17 09:09:16,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:16,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:16,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:16,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919dd0ec88e58bad0de69 HTTP/1.1" 200 None 2026-03-17 09:09:16,114 - lava_callback - INFO - Completed processing callback for node 69b919dd0ec88e58bad0de69 INFO: 172.20.0.1:44194 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:09:17,164 - lava_callback - INFO - Received callback for node 69b91a0d0ec88e58bad0df13 INFO: 172.20.0.1:44196 - "POST /node/69b91a0d0ec88e58bad0df13 HTTP/1.0" 202 Accepted 2026-03-17 09:09:17,170 - lava_callback - INFO - Starting async job submit for node 69b91a0d0ec88e58bad0df13 2026-03-17 09:09:17,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:17,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a0d0ec88e58bad0df13 HTTP/1.1" 200 None 2026-03-17 09:09:17,208 - lava_callback - DEBUG - Processing node 69b91a0d0ec88e58bad0df13: baseline-arm64-pengutronix 2026-03-17 09:09:17,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:17,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:17,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b91a0d0ec88e58bad0df13/log.txt.gz 2026-03-17 09:09:17,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:17,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:17,811 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b91a0d0ec88e58bad0df13/lava-logs.yaml 2026-03-17 09:09:17,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:17,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:17,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b91a0d0ec88e58bad0df13/lava_callback.json.gz 2026-03-17 09:09:17,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:18,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a0d0ec88e58bad0df13 HTTP/1.1" 200 None 2026-03-17 09:09:18,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:18,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:18,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:18,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a0d0ec88e58bad0df13 HTTP/1.1" 200 None 2026-03-17 09:09:18,053 - lava_callback - INFO - Completed processing callback for node 69b91a0d0ec88e58bad0df13 2026-03-17 09:09:21,530 - lava_callback - INFO - Received callback for node 69b919ff0ec88e58bad0deda INFO: 172.20.0.1:54488 - "POST /node/69b919ff0ec88e58bad0deda HTTP/1.0" 202 Accepted 2026-03-17 09:09:21,536 - lava_callback - INFO - Starting async job submit for node 69b919ff0ec88e58bad0deda 2026-03-17 09:09:21,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:21,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ff0ec88e58bad0deda HTTP/1.1" 200 None 2026-03-17 09:09:21,574 - lava_callback - DEBUG - Processing node 69b919ff0ec88e58bad0deda: baseline-arm64-broonie 2026-03-17 09:09:21,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:21,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:21,924 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919ff0ec88e58bad0deda/log.txt.gz 2026-03-17 09:09:22,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:22,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:22,348 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919ff0ec88e58bad0deda/lava-logs.yaml 2026-03-17 09:09:22,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:22,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:22,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919ff0ec88e58bad0deda/lava_callback.json.gz 2026-03-17 09:09:22,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:22,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ff0ec88e58bad0deda HTTP/1.1" 200 None 2026-03-17 09:09:22,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:22,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:22,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:22,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919ff0ec88e58bad0deda HTTP/1.1" 200 None 2026-03-17 09:09:22,573 - lava_callback - INFO - Completed processing callback for node 69b919ff0ec88e58bad0deda 2026-03-17 09:09:24,364 - lava_callback - INFO - Received callback for node 69b91a100ec88e58bad0df1d INFO: 172.20.0.1:54502 - "POST /node/69b91a100ec88e58bad0df1d HTTP/1.0" 202 Accepted 2026-03-17 09:09:24,370 - lava_callback - INFO - Starting async job submit for node 69b91a100ec88e58bad0df1d 2026-03-17 09:09:24,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:24,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a100ec88e58bad0df1d HTTP/1.1" 200 None 2026-03-17 09:09:24,407 - lava_callback - DEBUG - Processing node 69b91a100ec88e58bad0df1d: baseline-arm64-foundriesio 2026-03-17 09:09:24,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:24,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:24,816 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b91a100ec88e58bad0df1d/log.txt.gz 2026-03-17 09:09:24,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:25,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:25,117 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b91a100ec88e58bad0df1d/lava-logs.yaml 2026-03-17 09:09:25,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:25,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:25,334 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b91a100ec88e58bad0df1d/lava_callback.json.gz 2026-03-17 09:09:25,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:25,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a100ec88e58bad0df1d HTTP/1.1" 200 None 2026-03-17 09:09:25,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:25,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:25,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:25,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a100ec88e58bad0df1d HTTP/1.1" 200 None 2026-03-17 09:09:25,438 - lava_callback - INFO - Completed processing callback for node 69b91a100ec88e58bad0df1d 2026-03-17 09:09:25,575 - lava_callback - INFO - Received callback for node 69b91a110ec88e58bad0df24 INFO: 172.20.0.1:54512 - "POST /node/69b91a110ec88e58bad0df24 HTTP/1.0" 202 Accepted 2026-03-17 09:09:25,588 - lava_callback - INFO - Starting async job submit for node 69b91a110ec88e58bad0df24 2026-03-17 09:09:25,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:25,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a110ec88e58bad0df24 HTTP/1.1" 200 None 2026-03-17 09:09:25,656 - lava_callback - DEBUG - Processing node 69b91a110ec88e58bad0df24: baseline-arm64-foundriesio 2026-03-17 09:09:26,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:26,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:26,331 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b91a110ec88e58bad0df24/log.txt.gz INFO: 172.20.0.1:54528 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:09:26,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:26,718 - lava_callback - INFO - Received callback for node 69b919d80ec88e58bad0de51 INFO: 172.20.0.1:54534 - "POST /node/69b919d80ec88e58bad0de51 HTTP/1.0" 202 Accepted 2026-03-17 09:09:26,725 - lava_callback - INFO - Starting async job submit for node 69b919d80ec88e58bad0de51 2026-03-17 09:09:26,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:26,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d80ec88e58bad0de51 HTTP/1.1" 200 None 2026-03-17 09:09:26,769 - lava_callback - DEBUG - Processing node 69b919d80ec88e58bad0de51: baseline-arm64 2026-03-17 09:09:26,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:26,954 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b91a110ec88e58bad0df24/lava-logs.yaml 2026-03-17 09:09:27,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:27,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:27,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:27,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b91a110ec88e58bad0df24/lava_callback.json.gz 2026-03-17 09:09:27,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:27,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:27,368 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d80ec88e58bad0de51/log.txt.gz 2026-03-17 09:09:27,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a110ec88e58bad0df24 HTTP/1.1" 200 None 2026-03-17 09:09:27,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:27,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:27,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:27,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:27,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a110ec88e58bad0df24 HTTP/1.1" 200 None 2026-03-17 09:09:27,638 - lava_callback - INFO - Completed processing callback for node 69b91a110ec88e58bad0df24 2026-03-17 09:09:27,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:27,910 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d80ec88e58bad0de51/lava-logs.yaml 2026-03-17 09:09:27,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:28,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:28,105 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d80ec88e58bad0de51/lava_callback.json.gz 2026-03-17 09:09:28,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:28,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d80ec88e58bad0de51 HTTP/1.1" 200 None 2026-03-17 09:09:28,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:28,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:28,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:28,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919d80ec88e58bad0de51 HTTP/1.1" 200 None 2026-03-17 09:09:28,197 - lava_callback - INFO - Completed processing callback for node 69b919d80ec88e58bad0de51 2026-03-17 09:09:29,429 - lava_callback - INFO - Received callback for node 69b91a0e0ec88e58bad0df17 INFO: 172.20.0.1:54544 - "POST /node/69b91a0e0ec88e58bad0df17 HTTP/1.0" 202 Accepted 2026-03-17 09:09:29,437 - lava_callback - INFO - Starting async job submit for node 69b91a0e0ec88e58bad0df17 2026-03-17 09:09:29,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:29,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a0e0ec88e58bad0df17 HTTP/1.1" 200 None 2026-03-17 09:09:29,480 - lava_callback - DEBUG - Processing node 69b91a0e0ec88e58bad0df17: baseline-arm64-pengutronix 2026-03-17 09:09:29,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:29,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:29,810 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b91a0e0ec88e58bad0df17/log.txt.gz 2026-03-17 09:09:29,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:30,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:30,140 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b91a0e0ec88e58bad0df17/lava-logs.yaml 2026-03-17 09:09:30,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:30,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:30,350 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b91a0e0ec88e58bad0df17/lava_callback.json.gz 2026-03-17 09:09:30,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:30,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a0e0ec88e58bad0df17 HTTP/1.1" 200 None 2026-03-17 09:09:30,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:30,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:30,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:30,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a0e0ec88e58bad0df17 HTTP/1.1" 200 None 2026-03-17 09:09:30,432 - lava_callback - INFO - Completed processing callback for node 69b91a0e0ec88e58bad0df17 2026-03-17 09:09:32,388 - lava_callback - INFO - Received callback for node 69b919e80ec88e58bad0dea1 INFO: 172.20.0.1:48932 - "POST /node/69b919e80ec88e58bad0dea1 HTTP/1.0" 202 Accepted 2026-03-17 09:09:32,395 - lava_callback - INFO - Starting async job submit for node 69b919e80ec88e58bad0dea1 2026-03-17 09:09:32,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:32,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919e80ec88e58bad0dea1 HTTP/1.1" 200 None 2026-03-17 09:09:32,445 - lava_callback - DEBUG - Processing node 69b919e80ec88e58bad0dea1: baseline-nfs-arm64 2026-03-17 09:09:32,782 - lava_callback - INFO - Received callback for node 69b91a0f0ec88e58bad0df1a INFO: 172.20.0.1:48946 - "POST /node/69b91a0f0ec88e58bad0df1a HTTP/1.0" 202 Accepted 2026-03-17 09:09:32,800 - lava_callback - INFO - Starting async job submit for node 69b91a0f0ec88e58bad0df1a 2026-03-17 09:09:32,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:32,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:32,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a0f0ec88e58bad0df1a HTTP/1.1" 200 None 2026-03-17 09:09:32,845 - lava_callback - DEBUG - Processing node 69b91a0f0ec88e58bad0df1a: baseline-arm64-pengutronix 2026-03-17 09:09:32,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:33,044 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e80ec88e58bad0dea1/log.txt.gz 2026-03-17 09:09:33,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:33,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:33,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:33,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b91a0f0ec88e58bad0df1a/log.txt.gz 2026-03-17 09:09:33,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:33,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e80ec88e58bad0dea1/lava-logs.yaml 2026-03-17 09:09:33,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:33,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:33,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:33,735 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b91a0f0ec88e58bad0df1a/lava-logs.yaml 2026-03-17 09:09:33,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:33,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:33,790 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e80ec88e58bad0dea1/lava_callback.json.gz 2026-03-17 09:09:33,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:33,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919e80ec88e58bad0dea1 HTTP/1.1" 200 None 2026-03-17 09:09:33,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:33,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:33,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:33,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919e80ec88e58bad0dea1 HTTP/1.1" 200 None 2026-03-17 09:09:33,885 - lava_callback - INFO - Completed processing callback for node 69b919e80ec88e58bad0dea1 2026-03-17 09:09:33,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:33,968 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b91a0f0ec88e58bad0df1a/lava_callback.json.gz 2026-03-17 09:09:33,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:34,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a0f0ec88e58bad0df1a HTTP/1.1" 200 None 2026-03-17 09:09:34,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:34,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:34,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:34,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a0f0ec88e58bad0df1a HTTP/1.1" 200 None 2026-03-17 09:09:34,101 - lava_callback - INFO - Completed processing callback for node 69b91a0f0ec88e58bad0df1a INFO: 172.20.0.1:48960 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:09:38,157 - lava_callback - INFO - Received callback for node 69b919e30ec88e58bad0de7b INFO: 172.20.0.1:48962 - "POST /node/69b919e30ec88e58bad0de7b HTTP/1.0" 202 Accepted 2026-03-17 09:09:38,164 - lava_callback - INFO - Starting async job submit for node 69b919e30ec88e58bad0de7b 2026-03-17 09:09:38,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:38,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919e30ec88e58bad0de7b HTTP/1.1" 200 None 2026-03-17 09:09:38,207 - lava_callback - DEBUG - Processing node 69b919e30ec88e58bad0de7b: baseline-nfs-arm64 2026-03-17 09:09:38,354 - lava_callback - INFO - Received callback for node 69b919ea0ec88e58bad0dea8 INFO: 172.20.0.1:48964 - "POST /node/69b919ea0ec88e58bad0dea8 HTTP/1.0" 202 Accepted 2026-03-17 09:09:38,390 - lava_callback - INFO - Starting async job submit for node 69b919ea0ec88e58bad0dea8 2026-03-17 09:09:38,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:38,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ea0ec88e58bad0dea8 HTTP/1.1" 200 None 2026-03-17 09:09:38,570 - lava_callback - DEBUG - Processing node 69b919ea0ec88e58bad0dea8: baseline-nfs-arm64 2026-03-17 09:09:38,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:38,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:38,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:38,968 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e30ec88e58bad0de7b/log.txt.gz 2026-03-17 09:09:39,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:39,164 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919ea0ec88e58bad0dea8/log.txt.gz 2026-03-17 09:09:39,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:39,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:39,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:39,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e30ec88e58bad0de7b/lava-logs.yaml 2026-03-17 09:09:39,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:39,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:39,586 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e30ec88e58bad0de7b/lava_callback.json.gz 2026-03-17 09:09:39,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:39,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:39,623 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919ea0ec88e58bad0dea8/lava-logs.yaml 2026-03-17 09:09:39,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919e30ec88e58bad0de7b HTTP/1.1" 200 None 2026-03-17 09:09:39,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:39,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:39,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:39,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:39,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919e30ec88e58bad0de7b HTTP/1.1" 200 None 2026-03-17 09:09:39,681 - lava_callback - INFO - Completed processing callback for node 69b919e30ec88e58bad0de7b 2026-03-17 09:09:39,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:39,864 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919ea0ec88e58bad0dea8/lava_callback.json.gz 2026-03-17 09:09:39,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:39,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ea0ec88e58bad0dea8 HTTP/1.1" 200 None 2026-03-17 09:09:39,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:39,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:39,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:39,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919ea0ec88e58bad0dea8 HTTP/1.1" 200 None 2026-03-17 09:09:39,990 - lava_callback - INFO - Completed processing callback for node 69b919ea0ec88e58bad0dea8 2026-03-17 09:09:41,482 - lava_callback - INFO - Received callback for node 69b919f60ec88e58bad0dec1 INFO: 172.20.0.1:42194 - "POST /node/69b919f60ec88e58bad0dec1 HTTP/1.0" 202 Accepted 2026-03-17 09:09:41,488 - lava_callback - INFO - Starting async job submit for node 69b919f60ec88e58bad0dec1 2026-03-17 09:09:41,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:41,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919f60ec88e58bad0dec1 HTTP/1.1" 200 None 2026-03-17 09:09:41,538 - lava_callback - DEBUG - Processing node 69b919f60ec88e58bad0dec1: baseline-arm64-broonie 2026-03-17 09:09:41,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:41,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-17 09:09:41,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:41,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:41,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919f60ec88e58bad0dec1/log.txt.gz 2026-03-17 09:09:42,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:42,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:42,259 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919f60ec88e58bad0dec1/lava-logs.yaml 2026-03-17 09:09:42,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:42,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:42,422 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919f60ec88e58bad0dec1/lava_callback.json.gz 2026-03-17 09:09:42,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:42,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919f60ec88e58bad0dec1 HTTP/1.1" 200 None 2026-03-17 09:09:42,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:42,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:42,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:42,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919f60ec88e58bad0dec1 HTTP/1.1" 200 None 2026-03-17 09:09:42,506 - lava_callback - INFO - Completed processing callback for node 69b919f60ec88e58bad0dec1 INFO: 172.20.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42218 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:09:47,777 - lava_callback - INFO - Received callback for node 69b91a090ec88e58bad0df09 INFO: 172.20.0.1:42222 - "POST /node/69b91a090ec88e58bad0df09 HTTP/1.0" 202 Accepted 2026-03-17 09:09:47,783 - lava_callback - INFO - Starting async job submit for node 69b91a090ec88e58bad0df09 2026-03-17 09:09:47,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:47,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a090ec88e58bad0df09 HTTP/1.1" 200 None 2026-03-17 09:09:47,820 - lava_callback - DEBUG - Processing node 69b91a090ec88e58bad0df09: baseline-arm64-clabbe 2026-03-17 09:09:48,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:48,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:48,162 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b91a090ec88e58bad0df09/log.txt.gz 2026-03-17 09:09:48,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:48,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:48,482 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b91a090ec88e58bad0df09/lava-logs.yaml 2026-03-17 09:09:48,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:48,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:48,630 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b91a090ec88e58bad0df09/lava_callback.json.gz 2026-03-17 09:09:48,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:48,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a090ec88e58bad0df09 HTTP/1.1" 200 None 2026-03-17 09:09:48,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:48,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:48,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:48,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a090ec88e58bad0df09 HTTP/1.1" 200 None 2026-03-17 09:09:48,718 - lava_callback - INFO - Completed processing callback for node 69b91a090ec88e58bad0df09 2026-03-17 09:09:49,765 - lava_callback - INFO - Received callback for node 69b919d20ec88e58bad0de3e INFO: 172.20.0.1:55892 - "POST /node/69b919d20ec88e58bad0de3e HTTP/1.0" 202 Accepted 2026-03-17 09:09:49,772 - lava_callback - INFO - Starting async job submit for node 69b919d20ec88e58bad0de3e 2026-03-17 09:09:49,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:49,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d20ec88e58bad0de3e HTTP/1.1" 200 None 2026-03-17 09:09:49,810 - lava_callback - DEBUG - Processing node 69b919d20ec88e58bad0de3e: baseline-arm64 2026-03-17 09:09:50,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:50,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:50,311 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d20ec88e58bad0de3e/log.txt.gz 2026-03-17 09:09:50,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:50,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:50,720 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d20ec88e58bad0de3e/lava-logs.yaml 2026-03-17 09:09:50,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:50,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:50,861 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d20ec88e58bad0de3e/lava_callback.json.gz 2026-03-17 09:09:50,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:50,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d20ec88e58bad0de3e HTTP/1.1" 200 None 2026-03-17 09:09:50,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:50,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:50,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:50,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919d20ec88e58bad0de3e HTTP/1.1" 200 None 2026-03-17 09:09:51,008 - lava_callback - INFO - Completed processing callback for node 69b919d20ec88e58bad0de3e INFO: 172.20.0.1:55908 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:09:58,625 - lava_callback - INFO - Received callback for node 69b919fb0ec88e58bad0decc INFO: 172.20.0.1:55918 - "POST /node/69b919fb0ec88e58bad0decc HTTP/1.0" 202 Accepted 2026-03-17 09:09:58,631 - lava_callback - INFO - Starting async job submit for node 69b919fb0ec88e58bad0decc 2026-03-17 09:09:58,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:58,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919fb0ec88e58bad0decc HTTP/1.1" 200 None 2026-03-17 09:09:58,674 - lava_callback - DEBUG - Processing node 69b919fb0ec88e58bad0decc: baseline-arm64-broonie 2026-03-17 09:09:58,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:59,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:59,060 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919fb0ec88e58bad0decc/log.txt.gz 2026-03-17 09:09:59,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:59,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:59,446 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919fb0ec88e58bad0decc/lava-logs.yaml 2026-03-17 09:09:59,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:09:59,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:09:59,590 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919fb0ec88e58bad0decc/lava_callback.json.gz 2026-03-17 09:09:59,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:59,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919fb0ec88e58bad0decc HTTP/1.1" 200 None 2026-03-17 09:09:59,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:59,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:09:59,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:09:59,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919fb0ec88e58bad0decc HTTP/1.1" 200 None 2026-03-17 09:09:59,681 - lava_callback - INFO - Completed processing callback for node 69b919fb0ec88e58bad0decc 2026-03-17 09:10:00,089 - lava_callback - INFO - Received callback for node 69b919fc0ec88e58bad0ded3 INFO: 172.20.0.1:58774 - "POST /node/69b919fc0ec88e58bad0ded3 HTTP/1.0" 202 Accepted 2026-03-17 09:10:00,096 - lava_callback - INFO - Starting async job submit for node 69b919fc0ec88e58bad0ded3 2026-03-17 09:10:00,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:00,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919fc0ec88e58bad0ded3 HTTP/1.1" 200 None 2026-03-17 09:10:00,136 - lava_callback - DEBUG - Processing node 69b919fc0ec88e58bad0ded3: baseline-arm64-broonie 2026-03-17 09:10:00,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:00,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:00,536 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919fc0ec88e58bad0ded3/log.txt.gz 2026-03-17 09:10:00,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:00,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:00,868 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919fc0ec88e58bad0ded3/lava-logs.yaml 2026-03-17 09:10:00,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:01,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:01,031 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919fc0ec88e58bad0ded3/lava_callback.json.gz 2026-03-17 09:10:01,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:01,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919fc0ec88e58bad0ded3 HTTP/1.1" 200 None 2026-03-17 09:10:01,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:01,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:10:01,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:01,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919fc0ec88e58bad0ded3 HTTP/1.1" 200 None 2026-03-17 09:10:01,124 - lava_callback - INFO - Completed processing callback for node 69b919fc0ec88e58bad0ded3 2026-03-17 09:10:01,469 - lava_callback - INFO - Received callback for node 69b919f90ec88e58bad0dec9 INFO: 172.20.0.1:58786 - "POST /node/69b919f90ec88e58bad0dec9 HTTP/1.0" 202 Accepted 2026-03-17 09:10:01,479 - lava_callback - INFO - Starting async job submit for node 69b919f90ec88e58bad0dec9 2026-03-17 09:10:01,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:01,506 - lava_callback - INFO - Received callback for node 69b91a020ec88e58bad0def7 INFO: 172.20.0.1:58802 - "POST /node/69b91a020ec88e58bad0def7 HTTP/1.0" 202 Accepted 2026-03-17 09:10:01,515 - lava_callback - INFO - Starting async job submit for node 69b91a020ec88e58bad0def7 2026-03-17 09:10:01,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919f90ec88e58bad0dec9 HTTP/1.1" 200 None 2026-03-17 09:10:01,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:01,543 - lava_callback - DEBUG - Processing node 69b919f90ec88e58bad0dec9: baseline-arm64-broonie 2026-03-17 09:10:01,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a020ec88e58bad0def7 HTTP/1.1" 200 None 2026-03-17 09:10:01,634 - lava_callback - DEBUG - Processing node 69b91a020ec88e58bad0def7: baseline-arm64-broonie 2026-03-17 09:10:02,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:02,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:02,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:02,277 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919f90ec88e58bad0dec9/log.txt.gz 2026-03-17 09:10:02,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:02,343 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b91a020ec88e58bad0def7/log.txt.gz 2026-03-17 09:10:02,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:02,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:02,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:02,853 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b91a020ec88e58bad0def7/lava-logs.yaml 2026-03-17 09:10:02,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:02,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:02,919 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919f90ec88e58bad0dec9/lava-logs.yaml 2026-03-17 09:10:02,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:02,942 - lava_callback - INFO - Received callback for node 69b91a040ec88e58bad0defa INFO: 172.20.0.1:58814 - "POST /node/69b91a040ec88e58bad0defa HTTP/1.0" 202 Accepted 2026-03-17 09:10:02,949 - lava_callback - INFO - Starting async job submit for node 69b91a040ec88e58bad0defa 2026-03-17 09:10:02,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:02,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a040ec88e58bad0defa HTTP/1.1" 200 None 2026-03-17 09:10:02,999 - lava_callback - DEBUG - Processing node 69b91a040ec88e58bad0defa: baseline-arm64-broonie 2026-03-17 09:10:03,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:03,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:03,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b91a020ec88e58bad0def7/lava_callback.json.gz 2026-03-17 09:10:03,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:03,206 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919f90ec88e58bad0dec9/lava_callback.json.gz 2026-03-17 09:10:03,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:03,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:03,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a020ec88e58bad0def7 HTTP/1.1" 200 None 2026-03-17 09:10:03,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919f90ec88e58bad0dec9 HTTP/1.1" 200 None 2026-03-17 09:10:03,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:03,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:03,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:10:03,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:03,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:10:03,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:03,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919f90ec88e58bad0dec9 HTTP/1.1" 200 None 2026-03-17 09:10:03,371 - lava_callback - INFO - Completed processing callback for node 69b919f90ec88e58bad0dec9 2026-03-17 09:10:03,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a020ec88e58bad0def7 HTTP/1.1" 200 None 2026-03-17 09:10:03,423 - lava_callback - INFO - Completed processing callback for node 69b91a020ec88e58bad0def7 2026-03-17 09:10:03,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:03,541 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b91a040ec88e58bad0defa/log.txt.gz 2026-03-17 09:10:03,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:04,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:04,004 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b91a040ec88e58bad0defa/lava-logs.yaml 2026-03-17 09:10:04,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:04,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:04,185 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b91a040ec88e58bad0defa/lava_callback.json.gz 2026-03-17 09:10:04,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:04,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a040ec88e58bad0defa HTTP/1.1" 200 None 2026-03-17 09:10:04,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:04,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:10:04,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:04,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a040ec88e58bad0defa HTTP/1.1" 200 None 2026-03-17 09:10:04,269 - lava_callback - INFO - Completed processing callback for node 69b91a040ec88e58bad0defa INFO: 172.20.0.1:58818 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:10:11,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:11,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:33190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33198 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:10:18,364 - lava_callback - INFO - Received callback for node 69b91a000ec88e58bad0dedd INFO: 172.20.0.1:33210 - "POST /node/69b91a000ec88e58bad0dedd HTTP/1.0" 202 Accepted 2026-03-17 09:10:18,374 - lava_callback - INFO - Starting async job submit for node 69b91a000ec88e58bad0dedd 2026-03-17 09:10:18,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:18,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a000ec88e58bad0dedd HTTP/1.1" 200 None 2026-03-17 09:10:18,416 - lava_callback - DEBUG - Processing node 69b91a000ec88e58bad0dedd: baseline-arm64-broonie 2026-03-17 09:10:18,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:18,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:18,836 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b91a000ec88e58bad0dedd/log.txt.gz 2026-03-17 09:10:19,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:19,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:19,179 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b91a000ec88e58bad0dedd/lava-logs.yaml 2026-03-17 09:10:19,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:19,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:19,393 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b91a000ec88e58bad0dedd/lava_callback.json.gz 2026-03-17 09:10:19,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:19,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a000ec88e58bad0dedd HTTP/1.1" 200 None 2026-03-17 09:10:19,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:19,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:10:19,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:19,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a000ec88e58bad0dedd HTTP/1.1" 200 None 2026-03-17 09:10:19,496 - lava_callback - INFO - Completed processing callback for node 69b91a000ec88e58bad0dedd INFO: 172.20.0.1:33836 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:10:28,590 - lava_callback - INFO - Received callback for node 69b677771727ff69d6f274cf INFO: 172.20.0.1:33848 - "POST /node/69b677771727ff69d6f274cf HTTP/1.0" 202 Accepted 2026-03-17 09:10:28,595 - lava_callback - INFO - Starting async job submit for node 69b677771727ff69d6f274cf 2026-03-17 09:10:28,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:28,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b677771727ff69d6f274cf HTTP/1.1" 200 None 2026-03-17 09:10:28,612 - lava_callback - DEBUG - Processing node 69b677771727ff69d6f274cf: baseline-arm-baylibre 2026-03-17 09:10:28,612 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b677771727ff69d6f274cf 2026-03-17 09:10:28,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:28,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b677771727ff69d6f274cf HTTP/1.1" 200 None 2026-03-17 09:10:28,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:28,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-17 09:10:28,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:28,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b677771727ff69d6f274cf HTTP/1.1" 200 None 2026-03-17 09:10:28,683 - lava_callback - ERROR - Error processing callback for node 69b677771727ff69d6f274cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36574 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:10:37,834 - lava_callback - INFO - Received callback for node 69b919cd0ec88e58bad0de32 INFO: 172.20.0.1:36590 - "POST /node/69b919cd0ec88e58bad0de32 HTTP/1.0" 202 Accepted 2026-03-17 09:10:37,840 - lava_callback - INFO - Starting async job submit for node 69b919cd0ec88e58bad0de32 2026-03-17 09:10:37,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:37,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919cd0ec88e58bad0de32 HTTP/1.1" 200 None 2026-03-17 09:10:37,876 - lava_callback - DEBUG - Processing node 69b919cd0ec88e58bad0de32: baseline-arm64 2026-03-17 09:10:38,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:38,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:38,419 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919cd0ec88e58bad0de32/log.txt.gz 2026-03-17 09:10:38,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:38,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:38,846 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919cd0ec88e58bad0de32/lava-logs.yaml 2026-03-17 09:10:38,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:39,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:39,063 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919cd0ec88e58bad0de32/lava_callback.json.gz 2026-03-17 09:10:39,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:39,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919cd0ec88e58bad0de32 HTTP/1.1" 200 None 2026-03-17 09:10:39,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:39,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:10:39,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:39,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919cd0ec88e58bad0de32 HTTP/1.1" 200 None 2026-03-17 09:10:39,162 - lava_callback - INFO - Completed processing callback for node 69b919cd0ec88e58bad0de32 2026-03-17 09:10:41,626 - lava_callback - INFO - Received callback for node 69b919f80ec88e58bad0dec5 INFO: 172.20.0.1:59360 - "POST /node/69b919f80ec88e58bad0dec5 HTTP/1.0" 202 Accepted 2026-03-17 09:10:41,632 - lava_callback - INFO - Starting async job submit for node 69b919f80ec88e58bad0dec5 2026-03-17 09:10:41,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:41,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919f80ec88e58bad0dec5 HTTP/1.1" 200 None 2026-03-17 09:10:41,670 - lava_callback - DEBUG - Processing node 69b919f80ec88e58bad0dec5: baseline-arm64-broonie 2026-03-17 09:10:41,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:41,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:41,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 09:10:42,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:42,159 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919f80ec88e58bad0dec5/log.txt.gz 2026-03-17 09:10:42,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:42,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:42,495 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919f80ec88e58bad0dec5/lava-logs.yaml 2026-03-17 09:10:42,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:10:42,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:10:42,632 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919f80ec88e58bad0dec5/lava_callback.json.gz 2026-03-17 09:10:42,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:42,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919f80ec88e58bad0dec5 HTTP/1.1" 200 None 2026-03-17 09:10:42,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:42,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:10:42,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:10:42,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919f80ec88e58bad0dec5 HTTP/1.1" 200 None 2026-03-17 09:10:42,717 - lava_callback - INFO - Completed processing callback for node 69b919f80ec88e58bad0dec5 INFO: 172.20.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34568 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:11:11,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:11:11,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33432 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:11:41,597 - lava_callback - INFO - Received callback for node 69b919fd0ec88e58bad0ded6 INFO: 172.20.0.1:47640 - "POST /node/69b919fd0ec88e58bad0ded6 HTTP/1.0" 202 Accepted 2026-03-17 09:11:41,603 - lava_callback - INFO - Starting async job submit for node 69b919fd0ec88e58bad0ded6 2026-03-17 09:11:41,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:11:41,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919fd0ec88e58bad0ded6 HTTP/1.1" 200 None 2026-03-17 09:11:41,641 - lava_callback - DEBUG - Processing node 69b919fd0ec88e58bad0ded6: baseline-arm64-broonie 2026-03-17 09:11:41,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:11:42,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:11:42,105 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919fd0ec88e58bad0ded6/log.txt.gz 2026-03-17 09:11:42,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:11:42,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:11:42,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919fd0ec88e58bad0ded6/lava-logs.yaml 2026-03-17 09:11:42,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:11:42,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:11:42,745 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b919fd0ec88e58bad0ded6/lava_callback.json.gz 2026-03-17 09:11:42,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:11:42,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919fd0ec88e58bad0ded6 HTTP/1.1" 200 None 2026-03-17 09:11:42,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:11:42,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:11:42,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:11:42,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919fd0ec88e58bad0ded6 HTTP/1.1" 200 None 2026-03-17 09:11:42,833 - lava_callback - INFO - Completed processing callback for node 69b919fd0ec88e58bad0ded6 INFO: 172.20.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57530 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:11:57,023 - lava_callback - INFO - Received callback for node 69b919dc0ec88e58bad0de5a INFO: 172.20.0.1:57538 - "POST /node/69b919dc0ec88e58bad0de5a HTTP/1.0" 202 Accepted 2026-03-17 09:11:57,029 - lava_callback - INFO - Starting async job submit for node 69b919dc0ec88e58bad0de5a 2026-03-17 09:11:57,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:11:57,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919dc0ec88e58bad0de5a HTTP/1.1" 200 None 2026-03-17 09:11:57,067 - lava_callback - DEBUG - Processing node 69b919dc0ec88e58bad0de5a: baseline-nfs-arm64 2026-03-17 09:11:57,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:11:57,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:11:57,647 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919dc0ec88e58bad0de5a/log.txt.gz 2026-03-17 09:11:57,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:11:58,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:11:58,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919dc0ec88e58bad0de5a/lava-logs.yaml 2026-03-17 09:11:58,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:11:58,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:11:58,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919dc0ec88e58bad0de5a/lava_callback.json.gz 2026-03-17 09:11:58,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:11:58,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919dc0ec88e58bad0de5a HTTP/1.1" 200 None 2026-03-17 09:11:58,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:11:58,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:11:58,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:11:58,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919dc0ec88e58bad0de5a HTTP/1.1" 200 None 2026-03-17 09:11:58,448 - lava_callback - INFO - Completed processing callback for node 69b919dc0ec88e58bad0de5a INFO: 172.20.0.1:39926 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:12:08,677 - lava_callback - INFO - Received callback for node 69b677dc1727ff69d6f274db INFO: 172.20.0.1:39932 - "POST /node/69b677dc1727ff69d6f274db HTTP/1.0" 202 Accepted 2026-03-17 09:12:08,683 - lava_callback - INFO - Starting async job submit for node 69b677dc1727ff69d6f274db 2026-03-17 09:12:08,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:12:08,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b677dc1727ff69d6f274db HTTP/1.1" 200 None 2026-03-17 09:12:08,710 - lava_callback - DEBUG - Processing node 69b677dc1727ff69d6f274db: baseline-arm-baylibre 2026-03-17 09:12:08,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b677dc1727ff69d6f274db 2026-03-17 09:12:08,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:12:08,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b677dc1727ff69d6f274db HTTP/1.1" 200 None 2026-03-17 09:12:08,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:12:08,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-17 09:12:08,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:12:08,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b677dc1727ff69d6f274db HTTP/1.1" 200 None 2026-03-17 09:12:08,772 - lava_callback - ERROR - Error processing callback for node 69b677dc1727ff69d6f274db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 09:12:11,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:12:11,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42160 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:12:48,635 - lava_callback - INFO - Received callback for node 69b678041727ff69d6f274e6 INFO: 172.20.0.1:42172 - "POST /node/69b678041727ff69d6f274e6 HTTP/1.0" 202 Accepted 2026-03-17 09:12:48,641 - lava_callback - INFO - Starting async job submit for node 69b678041727ff69d6f274e6 2026-03-17 09:12:48,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:12:48,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b678041727ff69d6f274e6 HTTP/1.1" 200 None 2026-03-17 09:12:48,673 - lava_callback - DEBUG - Processing node 69b678041727ff69d6f274e6: baseline-arm-baylibre 2026-03-17 09:12:48,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b678041727ff69d6f274e6 2026-03-17 09:12:48,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:12:48,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b678041727ff69d6f274e6 HTTP/1.1" 200 None 2026-03-17 09:12:48,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:12:48,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-17 09:12:48,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:12:48,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b678041727ff69d6f274e6 HTTP/1.1" 200 None 2026-03-17 09:12:48,732 - lava_callback - ERROR - Error processing callback for node 69b678041727ff69d6f274e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48494 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:13:08,340 - lava_callback - INFO - Received callback for node 69b91b150ec88e58bad0e057 INFO: 172.20.0.1:48508 - "POST /node/69b91b150ec88e58bad0e057 HTTP/1.0" 202 Accepted 2026-03-17 09:13:08,346 - lava_callback - INFO - Starting async job submit for node 69b91b150ec88e58bad0e057 2026-03-17 09:13:08,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:08,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91b150ec88e58bad0e057 HTTP/1.1" 200 None 2026-03-17 09:13:08,363 - lava_callback - DEBUG - Processing node 69b91b150ec88e58bad0e057: job-gcc-14-arm-612-cip 2026-03-17 09:13:08,365 - lava_callback - WARNING - Failed to upload log 2026-03-17 09:13:08,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:13:08,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:13:08,559 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b91b150ec88e58bad0e057/lava-logs.yaml 2026-03-17 09:13:08,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:13:08,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:13:08,746 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b91b150ec88e58bad0e057/lava_callback.json.gz 2026-03-17 09:13:08,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:08,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91b150ec88e58bad0e057 HTTP/1.1" 200 None 2026-03-17 09:13:08,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:08,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab1fbe29c53ae8604f7 HTTP/1.1" 200 None 2026-03-17 09:13:08,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:08,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91b150ec88e58bad0e057 HTTP/1.1" 200 None 2026-03-17 09:13:08,806 - lava_callback - INFO - Completed processing callback for node 69b91b150ec88e58bad0e057 2026-03-17 09:13:11,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:11,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57592 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:13:16,954 - lava_callback - INFO - Received callback for node 69b91b170ec88e58bad0e05a INFO: 172.20.0.1:57602 - "POST /node/69b91b170ec88e58bad0e05a HTTP/1.0" 202 Accepted 2026-03-17 09:13:16,960 - lava_callback - INFO - Starting async job submit for node 69b91b170ec88e58bad0e05a 2026-03-17 09:13:16,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:16,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91b170ec88e58bad0e05a HTTP/1.1" 200 None 2026-03-17 09:13:16,978 - lava_callback - DEBUG - Processing node 69b91b170ec88e58bad0e05a: job-gcc-14-arm-612-cip 2026-03-17 09:13:16,983 - lava_callback - WARNING - Failed to upload log 2026-03-17 09:13:16,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:13:17,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:13:17,172 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b91b170ec88e58bad0e05a/lava-logs.yaml 2026-03-17 09:13:17,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:13:17,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:13:17,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b91b170ec88e58bad0e05a/lava_callback.json.gz 2026-03-17 09:13:17,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:17,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91b170ec88e58bad0e05a HTTP/1.1" 200 None 2026-03-17 09:13:17,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:17,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab1fbe29c53ae8604f7 HTTP/1.1" 200 None 2026-03-17 09:13:17,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:17,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91b170ec88e58bad0e05a HTTP/1.1" 200 None 2026-03-17 09:13:17,373 - lava_callback - INFO - Completed processing callback for node 69b91b170ec88e58bad0e05a INFO: 172.20.0.1:42056 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:13:34,761 - lava_callback - INFO - Received callback for node 69b6782f1727ff69d6f274f1 INFO: 172.20.0.1:52130 - "POST /node/69b6782f1727ff69d6f274f1 HTTP/1.0" 202 Accepted 2026-03-17 09:13:34,767 - lava_callback - INFO - Starting async job submit for node 69b6782f1727ff69d6f274f1 2026-03-17 09:13:34,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:34,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6782f1727ff69d6f274f1 HTTP/1.1" 200 None 2026-03-17 09:13:34,783 - lava_callback - DEBUG - Processing node 69b6782f1727ff69d6f274f1: baseline-arm-clabbe 2026-03-17 09:13:34,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6782f1727ff69d6f274f1 2026-03-17 09:13:34,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:34,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6782f1727ff69d6f274f1 HTTP/1.1" 200 None 2026-03-17 09:13:34,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:34,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-17 09:13:34,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:34,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6782f1727ff69d6f274f1 HTTP/1.1" 200 None 2026-03-17 09:13:34,840 - lava_callback - ERROR - Error processing callback for node 69b6782f1727ff69d6f274f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52146 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:13:41,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:13:42,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33022 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:14:14,736 - lava_callback - INFO - Received callback for node 69b678571727ff69d6f274fc INFO: 172.20.0.1:40788 - "POST /node/69b678571727ff69d6f274fc HTTP/1.0" 202 Accepted 2026-03-17 09:14:14,742 - lava_callback - INFO - Starting async job submit for node 69b678571727ff69d6f274fc 2026-03-17 09:14:14,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:14:14,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b678571727ff69d6f274fc HTTP/1.1" 200 None 2026-03-17 09:14:14,758 - lava_callback - DEBUG - Processing node 69b678571727ff69d6f274fc: baseline-arm-clabbe 2026-03-17 09:14:14,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b678571727ff69d6f274fc 2026-03-17 09:14:14,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:14:14,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b678571727ff69d6f274fc HTTP/1.1" 200 None 2026-03-17 09:14:14,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:14:14,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-17 09:14:14,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:14:14,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b678571727ff69d6f274fc HTTP/1.1" 200 None 2026-03-17 09:14:14,818 - lava_callback - ERROR - Error processing callback for node 69b678571727ff69d6f274fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39162 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:15:01,891 - lava_callback - INFO - Received callback for node 69b919d90ec88e58bad0de54 INFO: 172.20.0.1:42040 - "POST /node/69b919d90ec88e58bad0de54 HTTP/1.0" 202 Accepted 2026-03-17 09:15:01,899 - lava_callback - INFO - Starting async job submit for node 69b919d90ec88e58bad0de54 2026-03-17 09:15:01,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:15:01,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d90ec88e58bad0de54 HTTP/1.1" 200 None 2026-03-17 09:15:01,949 - lava_callback - DEBUG - Processing node 69b919d90ec88e58bad0de54: baseline-arm64 2026-03-17 09:15:02,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:15:02,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:15:02,520 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d90ec88e58bad0de54/log.txt.gz 2026-03-17 09:15:02,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:15:03,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:15:03,021 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d90ec88e58bad0de54/lava-logs.yaml 2026-03-17 09:15:03,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:15:03,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:15:03,263 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d90ec88e58bad0de54/lava_callback.json.gz DEBUG: Setup failed for 69b919d90ec88e58bad0de54. Transitting job node result: incomplete -> fail 2026-03-17 09:15:03,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:15:03,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d90ec88e58bad0de54 HTTP/1.1" 200 None 2026-03-17 09:15:03,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:15:03,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:15:03,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:15:03,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919d90ec88e58bad0de54 HTTP/1.1" 200 None 2026-03-17 09:15:03,502 - lava_callback - INFO - Completed processing callback for node 69b919d90ec88e58bad0de54 INFO: 172.20.0.1:42054 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:15:12,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:15:12,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59902 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:15:34,866 - lava_callback - INFO - Received callback for node 69b678a71727ff69d6f27507 INFO: 172.20.0.1:36864 - "POST /node/69b678a71727ff69d6f27507 HTTP/1.0" 202 Accepted 2026-03-17 09:15:34,872 - lava_callback - INFO - Starting async job submit for node 69b678a71727ff69d6f27507 2026-03-17 09:15:34,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:15:34,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b678a71727ff69d6f27507 HTTP/1.1" 200 None 2026-03-17 09:15:34,892 - lava_callback - DEBUG - Processing node 69b678a71727ff69d6f27507: baseline-arm-clabbe 2026-03-17 09:15:34,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b678a71727ff69d6f27507 2026-03-17 09:15:34,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:15:34,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b678a71727ff69d6f27507 HTTP/1.1" 200 None 2026-03-17 09:15:34,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:15:34,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-17 09:15:34,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:15:34,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b678a71727ff69d6f27507 HTTP/1.1" 200 None 2026-03-17 09:15:34,959 - lava_callback - ERROR - Error processing callback for node 69b678a71727ff69d6f27507: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56248 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:16:14,834 - lava_callback - INFO - Received callback for node 69b678cc1727ff69d6f27512 INFO: 172.20.0.1:58242 - "POST /node/69b678cc1727ff69d6f27512 HTTP/1.0" 202 Accepted 2026-03-17 09:16:14,840 - lava_callback - INFO - Starting async job submit for node 69b678cc1727ff69d6f27512 2026-03-17 09:16:14,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:16:14,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b678cc1727ff69d6f27512 HTTP/1.1" 200 None 2026-03-17 09:16:14,858 - lava_callback - DEBUG - Processing node 69b678cc1727ff69d6f27512: baseline-arm-clabbe 2026-03-17 09:16:14,859 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b678cc1727ff69d6f27512 2026-03-17 09:16:14,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:16:14,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b678cc1727ff69d6f27512 HTTP/1.1" 200 None 2026-03-17 09:16:14,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:16:14,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-17 09:16:14,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:16:14,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b678cc1727ff69d6f27512 HTTP/1.1" 200 None 2026-03-17 09:16:14,997 - lava_callback - ERROR - Error processing callback for node 69b678cc1727ff69d6f27512: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33454 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:16:41,947 - lava_callback - INFO - Received callback for node 69b917e10ec88e58bad0dd66 INFO: 172.20.0.1:36772 - "POST /node/69b917e10ec88e58bad0dd66 HTTP/1.0" 202 Accepted 2026-03-17 09:16:41,954 - lava_callback - INFO - Starting async job submit for node 69b917e10ec88e58bad0dd66 2026-03-17 09:16:42,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:16:42,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b917e10ec88e58bad0dd66 HTTP/1.1" 200 None 2026-03-17 09:16:42,028 - lava_callback - DEBUG - Processing node 69b917e10ec88e58bad0dd66: ltp-smoke 2026-03-17 09:16:42,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:16:42,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:16:42,719 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b917e10ec88e58bad0dd66/log.txt.gz 2026-03-17 09:16:42,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:16:43,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:16:43,310 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b917e10ec88e58bad0dd66/lava-logs.yaml 2026-03-17 09:16:43,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:16:43,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:16:43,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b917e10ec88e58bad0dd66/lava_callback.json.gz 2026-03-17 09:16:43,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:36780 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:16:43,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b917e10ec88e58bad0dd66 HTTP/1.1" 200 None 2026-03-17 09:16:43,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:16:43,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e3a0ec88e58bad0d0e3 HTTP/1.1" 200 None 2026-03-17 09:16:43,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:16:43,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b917e10ec88e58bad0dd66 HTTP/1.1" 200 None 2026-03-17 09:16:43,894 - lava_callback - INFO - Completed processing callback for node 69b917e10ec88e58bad0dd66 INFO: 172.20.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55796 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:17:12,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:17:12,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33750 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:18:23,661 - lava_callback - INFO - Received callback for node 69b919e50ec88e58bad0de9d INFO: 172.20.0.1:52562 - "POST /node/69b919e50ec88e58bad0de9d HTTP/1.0" 202 Accepted 2026-03-17 09:18:23,668 - lava_callback - INFO - Starting async job submit for node 69b919e50ec88e58bad0de9d 2026-03-17 09:18:23,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:18:23,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919e50ec88e58bad0de9d HTTP/1.1" 200 None 2026-03-17 09:18:23,780 - lava_callback - DEBUG - Processing node 69b919e50ec88e58bad0de9d: baseline-nfs-arm64 2026-03-17 09:18:24,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:18:24,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:18:24,510 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e50ec88e58bad0de9d/log.txt.gz 2026-03-17 09:18:24,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:18:25,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:18:25,089 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e50ec88e58bad0de9d/lava-logs.yaml 2026-03-17 09:18:25,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:18:25,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:18:25,262 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919e50ec88e58bad0de9d/lava_callback.json.gz 2026-03-17 09:18:25,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:18:25,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919e50ec88e58bad0de9d HTTP/1.1" 200 None 2026-03-17 09:18:25,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:18:25,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:18:25,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:18:25,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919e50ec88e58bad0de9d HTTP/1.1" 200 None 2026-03-17 09:18:25,414 - lava_callback - INFO - Completed processing callback for node 69b919e50ec88e58bad0de9d INFO: 172.20.0.1:52574 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:18:27,545 - lava_callback - INFO - Received callback for node 69b919d50ec88e58bad0de47 INFO: 172.20.0.1:52586 - "POST /node/69b919d50ec88e58bad0de47 HTTP/1.0" 202 Accepted 2026-03-17 09:18:27,556 - lava_callback - INFO - Starting async job submit for node 69b919d50ec88e58bad0de47 2026-03-17 09:18:27,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:18:27,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d50ec88e58bad0de47 HTTP/1.1" 200 None 2026-03-17 09:18:27,597 - lava_callback - DEBUG - Processing node 69b919d50ec88e58bad0de47: baseline-arm64 2026-03-17 09:18:28,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:18:28,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:18:28,316 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d50ec88e58bad0de47/log.txt.gz 2026-03-17 09:18:28,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:18:28,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:18:28,872 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d50ec88e58bad0de47/lava-logs.yaml 2026-03-17 09:18:28,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:18:29,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:18:29,084 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919d50ec88e58bad0de47/lava_callback.json.gz 2026-03-17 09:18:29,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:18:29,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919d50ec88e58bad0de47 HTTP/1.1" 200 None 2026-03-17 09:18:29,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:18:29,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:18:29,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:18:29,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919d50ec88e58bad0de47 HTTP/1.1" 200 None 2026-03-17 09:18:29,221 - lava_callback - INFO - Completed processing callback for node 69b919d50ec88e58bad0de47 INFO: 172.20.0.1:59738 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:18:42,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:18:42,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54158 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:19:35,045 - lava_callback - INFO - Received callback for node 69b679971727ff69d6f2751d INFO: 172.20.0.1:55522 - "POST /node/69b679971727ff69d6f2751d HTTP/1.0" 202 Accepted 2026-03-17 09:19:35,051 - lava_callback - INFO - Starting async job submit for node 69b679971727ff69d6f2751d 2026-03-17 09:19:35,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:19:35,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b679971727ff69d6f2751d HTTP/1.1" 200 None 2026-03-17 09:19:35,067 - lava_callback - DEBUG - Processing node 69b679971727ff69d6f2751d: baseline-arm-clabbe 2026-03-17 09:19:35,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b679971727ff69d6f2751d 2026-03-17 09:19:35,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:19:35,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b679971727ff69d6f2751d HTTP/1.1" 200 None 2026-03-17 09:19:35,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:19:35,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-17 09:19:35,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:19:35,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b679971727ff69d6f2751d HTTP/1.1" 200 None 2026-03-17 09:19:35,129 - lava_callback - ERROR - Error processing callback for node 69b679971727ff69d6f2751d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46968 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:22:30,105 - lava_callback - INFO - Received callback for node 69b9197d0ec88e58bad0dde6 INFO: 172.20.0.1:48448 - "POST /node/69b9197d0ec88e58bad0dde6 HTTP/1.0" 202 Accepted 2026-03-17 09:22:30,112 - lava_callback - INFO - Starting async job submit for node 69b9197d0ec88e58bad0dde6 2026-03-17 09:22:30,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:22:30,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9197d0ec88e58bad0dde6 HTTP/1.1" 200 None 2026-03-17 09:22:30,202 - lava_callback - DEBUG - Processing node 69b9197d0ec88e58bad0dde6: baseline-arm 2026-03-17 09:22:30,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:22:30,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:22:30,994 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b9197d0ec88e58bad0dde6/log.txt.gz 2026-03-17 09:22:31,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:22:31,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:22:31,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b9197d0ec88e58bad0dde6/lava-logs.yaml 2026-03-17 09:22:31,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:22:31,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:22:31,901 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b9197d0ec88e58bad0dde6/lava_callback.json.gz DEBUG: Setup failed for 69b9197d0ec88e58bad0dde6. Transitting job node result: incomplete -> fail 2026-03-17 09:22:32,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:22:32,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9197d0ec88e58bad0dde6 HTTP/1.1" 200 None 2026-03-17 09:22:32,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:22:32,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 09:22:32,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:22:32,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9197d0ec88e58bad0dde6 HTTP/1.1" 200 None 2026-03-17 09:22:32,224 - lava_callback - INFO - Completed processing callback for node 69b9197d0ec88e58bad0dde6 INFO: 172.20.0.1:48454 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:22:42,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:22:42,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43898 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:23:22,024 - lava_callback - INFO - Received callback for node 69b915570ec88e58bad0db7b INFO: 172.20.0.1:45532 - "POST /node/69b915570ec88e58bad0db7b HTTP/1.0" 202 Accepted 2026-03-17 09:23:22,029 - lava_callback - INFO - Starting async job submit for node 69b915570ec88e58bad0db7b 2026-03-17 09:23:22,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:23:22,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b915570ec88e58bad0db7b HTTP/1.1" 200 None 2026-03-17 09:23:22,064 - lava_callback - DEBUG - Processing node 69b915570ec88e58bad0db7b: baseline-arm64-broonie 2026-03-17 09:23:22,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:23:22,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:23:22,289 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b915570ec88e58bad0db7b/log.txt.gz 2026-03-17 09:23:22,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:23:22,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:23:22,469 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b915570ec88e58bad0db7b/lava-logs.yaml 2026-03-17 09:23:22,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:23:22,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:23:22,590 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b915570ec88e58bad0db7b/lava_callback.json.gz 2026-03-17 09:23:22,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:23:22,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b915570ec88e58bad0db7b HTTP/1.1" 200 None 2026-03-17 09:23:22,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:23:22,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 09:23:22,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:23:22,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b915570ec88e58bad0db7b HTTP/1.1" 200 None 2026-03-17 09:23:22,716 - lava_callback - INFO - Completed processing callback for node 69b915570ec88e58bad0db7b INFO: 172.20.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59052 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:23:42,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:23:42,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36650 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:27:47,450 - lava_callback - INFO - Received callback for node 69b919de0ec88e58bad0de6c INFO: 172.20.0.1:36660 - "POST /node/69b919de0ec88e58bad0de6c HTTP/1.0" 202 Accepted 2026-03-17 09:27:47,459 - lava_callback - INFO - Starting async job submit for node 69b919de0ec88e58bad0de6c 2026-03-17 09:27:47,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:27:47,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919de0ec88e58bad0de6c HTTP/1.1" 200 None 2026-03-17 09:27:47,524 - lava_callback - DEBUG - Processing node 69b919de0ec88e58bad0de6c: baseline-nfs-arm64 2026-03-17 09:27:48,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:27:48,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:27:48,792 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919de0ec88e58bad0de6c/log.txt.gz 2026-03-17 09:27:49,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:27:49,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:27:49,697 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919de0ec88e58bad0de6c/lava-logs.yaml 2026-03-17 09:27:49,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:27:49,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:27:49,898 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919de0ec88e58bad0de6c/lava_callback.json.gz DEBUG: Setup failed for 69b919de0ec88e58bad0de6c. Transitting job node result: incomplete -> fail 2026-03-17 09:27:49,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:27:50,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919de0ec88e58bad0de6c HTTP/1.1" 200 None 2026-03-17 09:27:50,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:27:50,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:27:50,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:27:50,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919de0ec88e58bad0de6c HTTP/1.1" 200 None 2026-03-17 09:27:50,135 - lava_callback - INFO - Completed processing callback for node 69b919de0ec88e58bad0de6c INFO: 172.20.0.1:50906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46438 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:28:09,599 - lava_callback - INFO - Received callback for node 69b67ba51727ff69d6f2752f INFO: 172.20.0.1:46454 - "POST /node/69b67ba51727ff69d6f2752f HTTP/1.0" 202 Accepted 2026-03-17 09:28:09,604 - lava_callback - INFO - Starting async job submit for node 69b67ba51727ff69d6f2752f 2026-03-17 09:28:09,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:28:09,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67ba51727ff69d6f2752f HTTP/1.1" 200 None 2026-03-17 09:28:09,631 - lava_callback - DEBUG - Processing node 69b67ba51727ff69d6f2752f: baseline-arm64-baylibre 2026-03-17 09:28:09,631 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b67ba51727ff69d6f2752f 2026-03-17 09:28:09,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:28:09,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67ba51727ff69d6f2752f HTTP/1.1" 200 None 2026-03-17 09:28:09,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:28:09,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-17 09:28:09,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:28:09,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b67ba51727ff69d6f2752f HTTP/1.1" 200 None 2026-03-17 09:28:09,729 - lava_callback - ERROR - Error processing callback for node 69b67ba51727ff69d6f2752f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 09:28:12,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:28:12,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41982 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:29:54,293 - lava_callback - INFO - Received callback for node 69b91f070ec88e58bad0e10a INFO: 172.20.0.1:58728 - "POST /node/69b91f070ec88e58bad0e10a HTTP/1.0" 202 Accepted 2026-03-17 09:29:54,299 - lava_callback - INFO - Starting async job submit for node 69b91f070ec88e58bad0e10a 2026-03-17 09:29:54,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:29:54,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91f070ec88e58bad0e10a HTTP/1.1" 200 None 2026-03-17 09:29:54,318 - lava_callback - DEBUG - Processing node 69b91f070ec88e58bad0e10a: rt-tests-cyclictest 2026-03-17 09:29:54,319 - lava_callback - WARNING - Failed to upload log 2026-03-17 09:29:54,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:29:54,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:29:54,533 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b91f070ec88e58bad0e10a/lava-logs.yaml 2026-03-17 09:29:54,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:29:54,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:29:54,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclictest-69b91f070ec88e58bad0e10a/lava_callback.json.gz 2026-03-17 09:29:54,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:29:54,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91f070ec88e58bad0e10a HTTP/1.1" 200 None 2026-03-17 09:29:54,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:29:54,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 09:29:54,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:29:54,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91f070ec88e58bad0e10a HTTP/1.1" 200 None 2026-03-17 09:29:54,802 - lava_callback - INFO - Completed processing callback for node 69b91f070ec88e58bad0e10a 2026-03-17 09:29:55,210 - lava_callback - INFO - Received callback for node 69b91f030ec88e58bad0e107 INFO: 172.20.0.1:58732 - "POST /node/69b91f030ec88e58bad0e107 HTTP/1.0" 202 Accepted 2026-03-17 09:29:55,216 - lava_callback - INFO - Starting async job submit for node 69b91f030ec88e58bad0e107 2026-03-17 09:29:55,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:29:55,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91f030ec88e58bad0e107 HTTP/1.1" 200 None 2026-03-17 09:29:55,234 - lava_callback - DEBUG - Processing node 69b91f030ec88e58bad0e107: rt-tests-cyclicdeadline 2026-03-17 09:29:55,235 - lava_callback - WARNING - Failed to upload log 2026-03-17 09:29:55,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:29:55,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:29:55,381 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b91f030ec88e58bad0e107/lava-logs.yaml 2026-03-17 09:29:55,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:29:55,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:29:55,526 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/rt-tests-cyclicdeadline-69b91f030ec88e58bad0e107/lava_callback.json.gz 2026-03-17 09:29:55,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:29:55,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91f030ec88e58bad0e107 HTTP/1.1" 200 None 2026-03-17 09:29:55,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:29:55,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90aaefbe29c53ae8604f4 HTTP/1.1" 200 None 2026-03-17 09:29:55,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:29:55,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91f030ec88e58bad0e107 HTTP/1.1" 200 None 2026-03-17 09:29:55,599 - lava_callback - INFO - Completed processing callback for node 69b91f030ec88e58bad0e107 INFO: 172.20.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50578 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:30:09,615 - lava_callback - INFO - Received callback for node 69b67c1e1727ff69d6f27539 INFO: 172.20.0.1:50580 - "POST /node/69b67c1e1727ff69d6f27539 HTTP/1.0" 202 Accepted 2026-03-17 09:30:09,620 - lava_callback - INFO - Starting async job submit for node 69b67c1e1727ff69d6f27539 2026-03-17 09:30:09,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:30:09,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67c1e1727ff69d6f27539 HTTP/1.1" 200 None 2026-03-17 09:30:09,635 - lava_callback - DEBUG - Processing node 69b67c1e1727ff69d6f27539: baseline-arm64-baylibre 2026-03-17 09:30:09,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b67c1e1727ff69d6f27539 2026-03-17 09:30:09,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:30:09,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67c1e1727ff69d6f27539 HTTP/1.1" 200 None 2026-03-17 09:30:09,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:30:09,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-17 09:30:09,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:30:09,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b67c1e1727ff69d6f27539 HTTP/1.1" 200 None 2026-03-17 09:30:09,705 - lava_callback - ERROR - Error processing callback for node 69b67c1e1727ff69d6f27539: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 09:30:12,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:30:12,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40358 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:31:29,696 - lava_callback - INFO - Received callback for node 69b67c6d1727ff69d6f27543 INFO: 172.20.0.1:40362 - "POST /node/69b67c6d1727ff69d6f27543 HTTP/1.0" 202 Accepted 2026-03-17 09:31:29,701 - lava_callback - INFO - Starting async job submit for node 69b67c6d1727ff69d6f27543 2026-03-17 09:31:29,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:31:29,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67c6d1727ff69d6f27543 HTTP/1.1" 200 None 2026-03-17 09:31:29,717 - lava_callback - DEBUG - Processing node 69b67c6d1727ff69d6f27543: baseline-arm64-baylibre 2026-03-17 09:31:29,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b67c6d1727ff69d6f27543 2026-03-17 09:31:29,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:31:29,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67c6d1727ff69d6f27543 HTTP/1.1" 200 None 2026-03-17 09:31:29,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:31:29,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-17 09:31:29,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:31:29,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b67c6d1727ff69d6f27543 HTTP/1.1" 200 None 2026-03-17 09:31:29,781 - lava_callback - ERROR - Error processing callback for node 69b67c6d1727ff69d6f27543: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35166 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:32:49,808 - lava_callback - INFO - Received callback for node 69b67cbf1727ff69d6f2754f INFO: 172.20.0.1:53844 - "POST /node/69b67cbf1727ff69d6f2754f HTTP/1.0" 202 Accepted 2026-03-17 09:32:49,814 - lava_callback - INFO - Starting async job submit for node 69b67cbf1727ff69d6f2754f 2026-03-17 09:32:49,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:32:49,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67cbf1727ff69d6f2754f HTTP/1.1" 200 None 2026-03-17 09:32:49,830 - lava_callback - DEBUG - Processing node 69b67cbf1727ff69d6f2754f: baseline-arm64-baylibre 2026-03-17 09:32:49,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b67cbf1727ff69d6f2754f 2026-03-17 09:32:49,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:32:49,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67cbf1727ff69d6f2754f HTTP/1.1" 200 None 2026-03-17 09:32:49,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:32:49,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-17 09:32:49,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:32:49,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b67cbf1727ff69d6f2754f HTTP/1.1" 200 None 2026-03-17 09:32:49,880 - lava_callback - ERROR - Error processing callback for node 69b67cbf1727ff69d6f2754f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33860 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:33:41,207 - lava_callback - INFO - Received callback for node 69b91b730ec88e58bad0e077 INFO: 172.20.0.1:42624 - "POST /node/69b91b730ec88e58bad0e077 HTTP/1.0" 202 Accepted 2026-03-17 09:33:41,253 - lava_callback - INFO - Starting async job submit for node 69b91b730ec88e58bad0e077 2026-03-17 09:33:41,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:33:41,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91b730ec88e58bad0e077 HTTP/1.1" 200 None 2026-03-17 09:33:41,292 - lava_callback - DEBUG - Processing node 69b91b730ec88e58bad0e077: baseline-arm-pengutronix 2026-03-17 09:33:41,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:33:41,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:33:41,619 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b91b730ec88e58bad0e077/log.txt.gz 2026-03-17 09:33:41,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:33:41,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:33:41,844 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b91b730ec88e58bad0e077/lava-logs.yaml 2026-03-17 09:33:41,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:33:41,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:33:41,998 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b91b730ec88e58bad0e077/lava_callback.json.gz DEBUG: Setup failed for 69b91b730ec88e58bad0e077. Transitting job node result: incomplete -> fail 2026-03-17 09:33:42,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:33:42,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91b730ec88e58bad0e077 HTTP/1.1" 200 None 2026-03-17 09:33:42,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:33:42,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 09:33:42,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:33:42,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91b730ec88e58bad0e077 HTTP/1.1" 200 None 2026-03-17 09:33:42,159 - lava_callback - INFO - Completed processing callback for node 69b91b730ec88e58bad0e077 INFO: 172.20.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48026 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:34:12,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:34:12,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49306 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:34:29,867 - lava_callback - INFO - Received callback for node 69b67d231727ff69d6f27557 INFO: 172.20.0.1:48828 - "POST /node/69b67d231727ff69d6f27557 HTTP/1.0" 202 Accepted 2026-03-17 09:34:29,873 - lava_callback - INFO - Starting async job submit for node 69b67d231727ff69d6f27557 2026-03-17 09:34:29,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:34:29,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67d231727ff69d6f27557 HTTP/1.1" 200 None 2026-03-17 09:34:29,889 - lava_callback - DEBUG - Processing node 69b67d231727ff69d6f27557: baseline-arm64-baylibre 2026-03-17 09:34:29,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b67d231727ff69d6f27557 2026-03-17 09:34:29,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:34:29,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67d231727ff69d6f27557 HTTP/1.1" 200 None 2026-03-17 09:34:29,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:34:29,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-17 09:34:29,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:34:29,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b67d231727ff69d6f27557 HTTP/1.1" 200 None 2026-03-17 09:34:29,941 - lava_callback - ERROR - Error processing callback for node 69b67d231727ff69d6f27557: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33764 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:37:30,059 - lava_callback - INFO - Received callback for node 69b67dc41727ff69d6f27564 INFO: 172.20.0.1:39842 - "POST /node/69b67dc41727ff69d6f27564 HTTP/1.0" 202 Accepted 2026-03-17 09:37:30,064 - lava_callback - INFO - Starting async job submit for node 69b67dc41727ff69d6f27564 2026-03-17 09:37:30,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:37:30,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67dc41727ff69d6f27564 HTTP/1.1" 200 None 2026-03-17 09:37:30,081 - lava_callback - DEBUG - Processing node 69b67dc41727ff69d6f27564: baseline-arm64-baylibre 2026-03-17 09:37:30,081 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b67dc41727ff69d6f27564 2026-03-17 09:37:30,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:37:30,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67dc41727ff69d6f27564 HTTP/1.1" 200 None 2026-03-17 09:37:30,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:37:30,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-17 09:37:30,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:37:30,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b67dc41727ff69d6f27564 HTTP/1.1" 200 None 2026-03-17 09:37:30,132 - lava_callback - ERROR - Error processing callback for node 69b67dc41727ff69d6f27564: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54884 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:37:48,701 - lava_callback - INFO - Received callback for node 69b920d80ec88e58bad0e15b INFO: 172.20.0.1:54886 - "POST /node/69b920d80ec88e58bad0e15b HTTP/1.0" 202 Accepted 2026-03-17 09:37:48,709 - lava_callback - INFO - Starting async job submit for node 69b920d80ec88e58bad0e15b 2026-03-17 09:37:48,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:37:48,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b920d80ec88e58bad0e15b HTTP/1.1" 200 None 2026-03-17 09:37:48,730 - lava_callback - DEBUG - Processing node 69b920d80ec88e58bad0e15b: baseline-nfs-arm64 2026-03-17 09:37:48,732 - lava_callback - WARNING - Failed to upload log 2026-03-17 09:37:48,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:37:48,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:37:48,939 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b920d80ec88e58bad0e15b/lava-logs.yaml 2026-03-17 09:37:48,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:37:49,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:37:49,122 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b920d80ec88e58bad0e15b/lava_callback.json.gz 2026-03-17 09:37:49,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:37:49,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b920d80ec88e58bad0e15b HTTP/1.1" 200 None 2026-03-17 09:37:49,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:37:49,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:37:49,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:37:49,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b920d80ec88e58bad0e15b HTTP/1.1" 200 None 2026-03-17 09:37:49,188 - lava_callback - INFO - Completed processing callback for node 69b920d80ec88e58bad0e15b INFO: 172.20.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50198 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:38:12,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:38:12,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49934 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:39:35,986 - lava_callback - INFO - Received callback for node 69b67e421727ff69d6f2756f INFO: 172.20.0.1:43808 - "POST /node/69b67e421727ff69d6f2756f HTTP/1.0" 202 Accepted 2026-03-17 09:39:35,992 - lava_callback - INFO - Starting async job submit for node 69b67e421727ff69d6f2756f 2026-03-17 09:39:35,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:39:36,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67e421727ff69d6f2756f HTTP/1.1" 200 None 2026-03-17 09:39:36,010 - lava_callback - DEBUG - Processing node 69b67e421727ff69d6f2756f: baseline-arm64-clabbe 2026-03-17 09:39:36,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b67e421727ff69d6f2756f 2026-03-17 09:39:36,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:39:36,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67e421727ff69d6f2756f HTTP/1.1" 200 None 2026-03-17 09:39:36,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:39:36,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-17 09:39:36,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:39:36,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b67e421727ff69d6f2756f HTTP/1.1" 200 None 2026-03-17 09:39:36,061 - lava_callback - ERROR - Error processing callback for node 69b67e421727ff69d6f2756f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33984 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:40:03,134 - lava_callback - INFO - Received callback for node 69b9211a0ec88e58bad0e166 INFO: 172.20.0.1:47630 - "POST /node/69b9211a0ec88e58bad0e166 HTTP/1.0" 202 Accepted 2026-03-17 09:40:03,140 - lava_callback - INFO - Starting async job submit for node 69b9211a0ec88e58bad0e166 2026-03-17 09:40:03,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:03,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9211a0ec88e58bad0e166 HTTP/1.1" 200 None 2026-03-17 09:40:03,185 - lava_callback - DEBUG - Processing node 69b9211a0ec88e58bad0e166: baseline-arm64 2026-03-17 09:40:03,329 - lava_callback - WARNING - Failed to upload log 2026-03-17 09:40:03,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:40:03,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:40:03,625 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b9211a0ec88e58bad0e166/lava-logs.yaml 2026-03-17 09:40:03,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:40:03,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:40:03,815 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b9211a0ec88e58bad0e166/lava_callback.json.gz 2026-03-17 09:40:03,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:03,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9211a0ec88e58bad0e166 HTTP/1.1" 200 None 2026-03-17 09:40:03,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:03,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:40:03,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:03,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9211a0ec88e58bad0e166 HTTP/1.1" 200 None 2026-03-17 09:40:03,978 - lava_callback - INFO - Completed processing callback for node 69b9211a0ec88e58bad0e166 INFO: 172.20.0.1:47638 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:40:12,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:12,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52600 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:40:28,344 - lava_callback - INFO - Received callback for node 69b921640ec88e58bad0e171 INFO: 172.20.0.1:52602 - "POST /node/69b921640ec88e58bad0e171 HTTP/1.0" 202 Accepted 2026-03-17 09:40:28,356 - lava_callback - INFO - Starting async job submit for node 69b921640ec88e58bad0e171 2026-03-17 09:40:28,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:28,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b921640ec88e58bad0e171 HTTP/1.1" 200 None 2026-03-17 09:40:28,407 - lava_callback - DEBUG - Processing node 69b921640ec88e58bad0e171: baseline-arm64 2026-03-17 09:40:28,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:40:28,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:40:28,663 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b921640ec88e58bad0e171/log.txt.gz 2026-03-17 09:40:28,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:40:28,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:40:28,928 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b921640ec88e58bad0e171/lava-logs.yaml 2026-03-17 09:40:28,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:40:29,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:40:29,128 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b921640ec88e58bad0e171/lava_callback.json.gz 2026-03-17 09:40:29,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:29,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b921640ec88e58bad0e171 HTTP/1.1" 200 None 2026-03-17 09:40:29,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:29,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:40:29,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:29,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b921640ec88e58bad0e171 HTTP/1.1" 200 None 2026-03-17 09:40:29,289 - lava_callback - INFO - Completed processing callback for node 69b921640ec88e58bad0e171 INFO: 172.20.0.1:40288 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:40:42,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:42,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37842 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:40:56,044 - lava_callback - INFO - Received callback for node 69b67e921727ff69d6f27576 INFO: 172.20.0.1:59988 - "POST /node/69b67e921727ff69d6f27576 HTTP/1.0" 202 Accepted 2026-03-17 09:40:56,050 - lava_callback - INFO - Starting async job submit for node 69b67e921727ff69d6f27576 2026-03-17 09:40:56,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:56,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67e921727ff69d6f27576 HTTP/1.1" 200 None 2026-03-17 09:40:56,070 - lava_callback - DEBUG - Processing node 69b67e921727ff69d6f27576: baseline-arm64-clabbe 2026-03-17 09:40:56,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b67e921727ff69d6f27576 2026-03-17 09:40:56,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:56,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67e921727ff69d6f27576 HTTP/1.1" 200 None 2026-03-17 09:40:56,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:56,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-17 09:40:56,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:40:56,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b67e921727ff69d6f27576 HTTP/1.1" 200 None 2026-03-17 09:40:56,130 - lava_callback - ERROR - Error processing callback for node 69b67e921727ff69d6f27576: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40334 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:42:36,124 - lava_callback - INFO - Received callback for node 69b67ef61727ff69d6f27584 INFO: 172.20.0.1:49640 - "POST /node/69b67ef61727ff69d6f27584 HTTP/1.0" 202 Accepted 2026-03-17 09:42:36,130 - lava_callback - INFO - Starting async job submit for node 69b67ef61727ff69d6f27584 2026-03-17 09:42:36,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:42:36,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67ef61727ff69d6f27584 HTTP/1.1" 200 None 2026-03-17 09:42:36,151 - lava_callback - DEBUG - Processing node 69b67ef61727ff69d6f27584: baseline-arm64-clabbe 2026-03-17 09:42:36,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b67ef61727ff69d6f27584 2026-03-17 09:42:36,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:42:36,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67ef61727ff69d6f27584 HTTP/1.1" 200 None 2026-03-17 09:42:36,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:42:36,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-17 09:42:36,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:42:36,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b67ef61727ff69d6f27584 HTTP/1.1" 200 None 2026-03-17 09:42:36,206 - lava_callback - ERROR - Error processing callback for node 69b67ef61727ff69d6f27584: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38434 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 09:45:16,121 - lava_callback - INFO - Received callback for node 69b67f961727ff69d6f2758d INFO: 172.20.0.1:38448 - "POST /node/69b67f961727ff69d6f2758d HTTP/1.0" 202 Accepted 2026-03-17 09:45:16,127 - lava_callback - INFO - Starting async job submit for node 69b67f961727ff69d6f2758d 2026-03-17 09:45:16,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:45:16,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67f961727ff69d6f2758d HTTP/1.1" 200 None 2026-03-17 09:45:16,143 - lava_callback - DEBUG - Processing node 69b67f961727ff69d6f2758d: baseline-arm64-clabbe 2026-03-17 09:45:16,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b67f961727ff69d6f2758d 2026-03-17 09:45:16,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:45:16,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67f961727ff69d6f2758d HTTP/1.1" 200 None 2026-03-17 09:45:16,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:45:16,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-17 09:45:16,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:45:16,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b67f961727ff69d6f2758d HTTP/1.1" 200 None 2026-03-17 09:45:16,201 - lava_callback - ERROR - Error processing callback for node 69b67f961727ff69d6f2758d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38456 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:45:18,619 - lava_callback - INFO - Received callback for node 69b91eff0ec88e58bad0e104 INFO: 172.20.0.1:38460 - "POST /node/69b91eff0ec88e58bad0e104 HTTP/1.0" 202 Accepted 2026-03-17 09:45:18,626 - lava_callback - INFO - Starting async job submit for node 69b91eff0ec88e58bad0e104 2026-03-17 09:45:18,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:45:18,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91eff0ec88e58bad0e104 HTTP/1.1" 200 None 2026-03-17 09:45:18,688 - lava_callback - DEBUG - Processing node 69b91eff0ec88e58bad0e104: baseline-x86 2026-03-17 09:45:19,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:45:19,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:45:19,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b91eff0ec88e58bad0e104/log.txt.gz 2026-03-17 09:45:20,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:45:20,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:45:20,354 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b91eff0ec88e58bad0e104/lava-logs.yaml 2026-03-17 09:45:20,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:45:20,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:45:20,606 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b91eff0ec88e58bad0e104/lava_callback.json.gz DEBUG: Setup failed for 69b91eff0ec88e58bad0e104. Transitting job node result: incomplete -> fail 2026-03-17 09:45:20,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:45:20,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91eff0ec88e58bad0e104 HTTP/1.1" 200 None 2026-03-17 09:45:20,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:45:20,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e550ec88e58bad0d108 HTTP/1.1" 200 None 2026-03-17 09:45:20,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:45:20,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91eff0ec88e58bad0e104 HTTP/1.1" 200 None 2026-03-17 09:45:20,852 - lava_callback - INFO - Completed processing callback for node 69b91eff0ec88e58bad0e104 INFO: 172.20.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59854 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:45:42,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:45:42,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56806 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:46:14,039 - lava_callback - INFO - Received callback for node 69b922df0ec88e58bad0e1ab INFO: 172.20.0.1:52316 - "POST /node/69b922df0ec88e58bad0e1ab HTTP/1.0" 202 Accepted 2026-03-17 09:46:14,044 - lava_callback - INFO - Starting async job submit for node 69b922df0ec88e58bad0e1ab 2026-03-17 09:46:14,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:46:14,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b922df0ec88e58bad0e1ab HTTP/1.1" 200 None 2026-03-17 09:46:14,063 - lava_callback - DEBUG - Processing node 69b922df0ec88e58bad0e1ab: job-gcc-14-arm-612-cip 2026-03-17 09:46:14,069 - lava_callback - WARNING - Failed to upload log 2026-03-17 09:46:14,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:46:14,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:46:14,266 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b922df0ec88e58bad0e1ab/lava-logs.yaml 2026-03-17 09:46:14,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:46:14,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:46:14,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b922df0ec88e58bad0e1ab/lava_callback.json.gz 2026-03-17 09:46:14,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:46:14,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b922df0ec88e58bad0e1ab HTTP/1.1" 200 None 2026-03-17 09:46:14,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:46:14,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab1fbe29c53ae8604f7 HTTP/1.1" 200 None 2026-03-17 09:46:14,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:46:14,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b922df0ec88e58bad0e1ab HTTP/1.1" 200 None 2026-03-17 09:46:14,450 - lava_callback - INFO - Completed processing callback for node 69b922df0ec88e58bad0e1ab 2026-03-17 09:46:14,894 - lava_callback - INFO - Received callback for node 69b922dd0ec88e58bad0e1a8 INFO: 172.20.0.1:52320 - "POST /node/69b922dd0ec88e58bad0e1a8 HTTP/1.0" 202 Accepted 2026-03-17 09:46:14,900 - lava_callback - INFO - Starting async job submit for node 69b922dd0ec88e58bad0e1a8 2026-03-17 09:46:14,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:46:14,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b922dd0ec88e58bad0e1a8 HTTP/1.1" 200 None 2026-03-17 09:46:14,922 - lava_callback - DEBUG - Processing node 69b922dd0ec88e58bad0e1a8: job-gcc-14-arm-612-cip 2026-03-17 09:46:14,923 - lava_callback - WARNING - Failed to upload log 2026-03-17 09:46:14,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:46:15,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:46:15,109 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b922dd0ec88e58bad0e1a8/lava-logs.yaml 2026-03-17 09:46:15,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:52334 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 09:46:15,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:46:15,281 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/job-gcc-14-arm-612-cip-69b922dd0ec88e58bad0e1a8/lava_callback.json.gz 2026-03-17 09:46:15,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:46:15,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b922dd0ec88e58bad0e1a8 HTTP/1.1" 200 None 2026-03-17 09:46:15,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:46:15,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90ab1fbe29c53ae8604f7 HTTP/1.1" 200 None 2026-03-17 09:46:15,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:46:15,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b922dd0ec88e58bad0e1a8 HTTP/1.1" 200 None 2026-03-17 09:46:15,346 - lava_callback - INFO - Completed processing callback for node 69b922dd0ec88e58bad0e1a8 INFO: 172.20.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54796 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:46:36,279 - lava_callback - INFO - Received callback for node 69b67fe61727ff69d6f27598 INFO: 172.20.0.1:45570 - "POST /node/69b67fe61727ff69d6f27598 HTTP/1.0" 202 Accepted 2026-03-17 09:46:36,284 - lava_callback - INFO - Starting async job submit for node 69b67fe61727ff69d6f27598 2026-03-17 09:46:36,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:46:36,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67fe61727ff69d6f27598 HTTP/1.1" 200 None 2026-03-17 09:46:36,301 - lava_callback - DEBUG - Processing node 69b67fe61727ff69d6f27598: baseline-arm64-clabbe 2026-03-17 09:46:36,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b67fe61727ff69d6f27598 2026-03-17 09:46:36,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:46:36,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b67fe61727ff69d6f27598 HTTP/1.1" 200 None 2026-03-17 09:46:36,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:46:36,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-17 09:46:36,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:46:36,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b67fe61727ff69d6f27598 HTTP/1.1" 200 None 2026-03-17 09:46:36,362 - lava_callback - ERROR - Error processing callback for node 69b67fe61727ff69d6f27598: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45580 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:46:42,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:46:42,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55302 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:47:56,319 - lava_callback - INFO - Received callback for node 69b680361727ff69d6f2759f INFO: 172.20.0.1:56260 - "POST /node/69b680361727ff69d6f2759f HTTP/1.0" 202 Accepted 2026-03-17 09:47:56,325 - lava_callback - INFO - Starting async job submit for node 69b680361727ff69d6f2759f 2026-03-17 09:47:56,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:47:56,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b680361727ff69d6f2759f HTTP/1.1" 200 None 2026-03-17 09:47:56,345 - lava_callback - DEBUG - Processing node 69b680361727ff69d6f2759f: baseline-arm64-clabbe 2026-03-17 09:47:56,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b680361727ff69d6f2759f 2026-03-17 09:47:56,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:47:56,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b680361727ff69d6f2759f HTTP/1.1" 200 None 2026-03-17 09:47:56,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:47:56,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-17 09:47:56,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:47:56,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b680361727ff69d6f2759f HTTP/1.1" 200 None 2026-03-17 09:47:56,401 - lava_callback - ERROR - Error processing callback for node 69b680361727ff69d6f2759f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42362 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:57:09,048 - lava_callback - INFO - Received callback for node 69b923800ec88e58bad0e1c8 INFO: 172.20.0.1:42378 - "POST /node/69b923800ec88e58bad0e1c8 HTTP/1.0" 202 Accepted 2026-03-17 09:57:09,055 - lava_callback - INFO - Starting async job submit for node 69b923800ec88e58bad0e1c8 2026-03-17 09:57:09,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:57:09,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b923800ec88e58bad0e1c8 HTTP/1.1" 200 None 2026-03-17 09:57:09,117 - lava_callback - DEBUG - Processing node 69b923800ec88e58bad0e1c8: baseline-arm64 2026-03-17 09:57:09,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:57:09,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:57:09,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b923800ec88e58bad0e1c8/log.txt.gz 2026-03-17 09:57:09,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:57:10,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:57:10,248 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b923800ec88e58bad0e1c8/lava-logs.yaml 2026-03-17 09:57:10,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:57:10,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:57:10,422 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b923800ec88e58bad0e1c8/lava_callback.json.gz DEBUG: Setup failed for 69b923800ec88e58bad0e1c8. Transitting job node result: incomplete -> fail 2026-03-17 09:57:10,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:57:10,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b923800ec88e58bad0e1c8 HTTP/1.1" 200 None 2026-03-17 09:57:10,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:57:10,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 09:57:10,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:57:10,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b923800ec88e58bad0e1c8 HTTP/1.1" 200 None 2026-03-17 09:57:10,648 - lava_callback - INFO - Completed processing callback for node 69b923800ec88e58bad0e1c8 2026-03-17 09:57:12,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:57:12,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33514 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:57:23,196 - lava_callback - INFO - Received callback for node 69b924d40ec88e58bad0e1f8 INFO: 172.20.0.1:45834 - "POST /node/69b924d40ec88e58bad0e1f8 HTTP/1.0" 202 Accepted 2026-03-17 09:57:23,202 - lava_callback - INFO - Starting async job submit for node 69b924d40ec88e58bad0e1f8 2026-03-17 09:57:23,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:57:23,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b924d40ec88e58bad0e1f8 HTTP/1.1" 200 None 2026-03-17 09:57:23,237 - lava_callback - DEBUG - Processing node 69b924d40ec88e58bad0e1f8: baseline-arm64-broonie 2026-03-17 09:57:23,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:57:23,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:57:23,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b924d40ec88e58bad0e1f8/log.txt.gz 2026-03-17 09:57:23,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:57:24,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:57:24,244 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b924d40ec88e58bad0e1f8/lava-logs.yaml 2026-03-17 09:57:24,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 09:57:24,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 09:57:24,426 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b924d40ec88e58bad0e1f8/lava_callback.json.gz 2026-03-17 09:57:24,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:57:24,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b924d40ec88e58bad0e1f8 HTTP/1.1" 200 None 2026-03-17 09:57:24,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:57:24,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 09:57:24,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:57:24,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b924d40ec88e58bad0e1f8 HTTP/1.1" 200 None 2026-03-17 09:57:24,597 - lava_callback - INFO - Completed processing callback for node 69b924d40ec88e58bad0e1f8 INFO: 172.20.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46148 - "GET / HTTP/1.0" 200 OK 2026-03-17 09:57:42,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 09:57:42,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41868 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:00:57,496 - lava_callback - INFO - Received callback for node 69b923d20ec88e58bad0e1d4 INFO: 172.20.0.1:41876 - "POST /node/69b923d20ec88e58bad0e1d4 HTTP/1.0" 202 Accepted 2026-03-17 10:00:57,502 - lava_callback - INFO - Starting async job submit for node 69b923d20ec88e58bad0e1d4 2026-03-17 10:00:57,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:00:57,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b923d20ec88e58bad0e1d4 HTTP/1.1" 200 None 2026-03-17 10:00:57,553 - lava_callback - DEBUG - Processing node 69b923d20ec88e58bad0e1d4: baseline-nfs-arm64 2026-03-17 10:00:58,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:00:58,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:00:58,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b923d20ec88e58bad0e1d4/log.txt.gz 2026-03-17 10:00:58,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:00:58,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:00:58,859 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b923d20ec88e58bad0e1d4/lava-logs.yaml 2026-03-17 10:00:58,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:00:59,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:00:59,094 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b923d20ec88e58bad0e1d4/lava_callback.json.gz 2026-03-17 10:00:59,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:00:59,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b923d20ec88e58bad0e1d4 HTTP/1.1" 200 None 2026-03-17 10:00:59,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:00:59,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:00:59,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:00:59,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b923d20ec88e58bad0e1d4 HTTP/1.1" 200 None 2026-03-17 10:00:59,246 - lava_callback - INFO - Completed processing callback for node 69b923d20ec88e58bad0e1d4 INFO: 172.20.0.1:48866 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:01:12,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:01:12,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56016 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:01:29,551 - lava_callback - INFO - Received callback for node 69b926610ec88e58bad0e249 INFO: 172.20.0.1:56022 - "POST /node/69b926610ec88e58bad0e249 HTTP/1.0" 202 Accepted 2026-03-17 10:01:29,556 - lava_callback - INFO - Starting async job submit for node 69b926610ec88e58bad0e249 2026-03-17 10:01:29,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:01:29,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b926610ec88e58bad0e249 HTTP/1.1" 200 None 2026-03-17 10:01:29,574 - lava_callback - DEBUG - Processing node 69b926610ec88e58bad0e249: baseline-nfs-arm64 2026-03-17 10:01:29,575 - lava_callback - WARNING - Failed to upload log 2026-03-17 10:01:29,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:01:29,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:01:29,704 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b926610ec88e58bad0e249/lava-logs.yaml 2026-03-17 10:01:29,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:01:29,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:01:29,894 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b926610ec88e58bad0e249/lava_callback.json.gz 2026-03-17 10:01:29,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:01:29,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b926610ec88e58bad0e249 HTTP/1.1" 200 None 2026-03-17 10:01:29,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:01:29,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:01:29,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:01:29,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b926610ec88e58bad0e249 HTTP/1.1" 200 None 2026-03-17 10:01:29,963 - lava_callback - INFO - Completed processing callback for node 69b926610ec88e58bad0e249 INFO: 172.20.0.1:34902 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:01:42,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:01:42,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50226 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:02:26,047 - lava_callback - INFO - Received callback for node 69b924180ec88e58bad0e1de INFO: 172.20.0.1:52534 - "POST /node/69b924180ec88e58bad0e1de HTTP/1.0" 202 Accepted 2026-03-17 10:02:26,053 - lava_callback - INFO - Starting async job submit for node 69b924180ec88e58bad0e1de 2026-03-17 10:02:26,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:02:26,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b924180ec88e58bad0e1de HTTP/1.1" 200 None 2026-03-17 10:02:26,104 - lava_callback - DEBUG - Processing node 69b924180ec88e58bad0e1de: baseline-arm64 INFO: 172.20.0.1:52540 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:02:26,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:02:26,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:02:26,819 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b924180ec88e58bad0e1de/log.txt.gz 2026-03-17 10:02:27,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:02:27,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:02:27,375 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b924180ec88e58bad0e1de/lava-logs.yaml 2026-03-17 10:02:27,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:02:27,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:02:27,565 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b924180ec88e58bad0e1de/lava_callback.json.gz 2026-03-17 10:02:27,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:02:27,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b924180ec88e58bad0e1de HTTP/1.1" 200 None 2026-03-17 10:02:27,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:02:27,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:02:27,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:02:27,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b924180ec88e58bad0e1de HTTP/1.1" 200 None 2026-03-17 10:02:27,707 - lava_callback - INFO - Completed processing callback for node 69b924180ec88e58bad0e1de INFO: 172.20.0.1:38352 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:02:38,125 - lava_callback - INFO - Received callback for node 69b921ff0ec88e58bad0e187 INFO: 172.20.0.1:38366 - "POST /node/69b921ff0ec88e58bad0e187 HTTP/1.0" 202 Accepted 2026-03-17 10:02:38,132 - lava_callback - INFO - Starting async job submit for node 69b921ff0ec88e58bad0e187 2026-03-17 10:02:38,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:02:38,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b921ff0ec88e58bad0e187 HTTP/1.1" 200 None 2026-03-17 10:02:38,168 - lava_callback - DEBUG - Processing node 69b921ff0ec88e58bad0e187: baseline-arm64 2026-03-17 10:02:38,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:02:38,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:02:38,713 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b921ff0ec88e58bad0e187/log.txt.gz 2026-03-17 10:02:38,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:02:39,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:02:39,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b921ff0ec88e58bad0e187/lava-logs.yaml 2026-03-17 10:02:39,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:02:39,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:02:39,441 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b921ff0ec88e58bad0e187/lava_callback.json.gz 2026-03-17 10:02:39,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:02:39,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b921ff0ec88e58bad0e187 HTTP/1.1" 200 None 2026-03-17 10:02:39,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:02:39,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:02:39,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:02:39,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b921ff0ec88e58bad0e187 HTTP/1.1" 200 None 2026-03-17 10:02:39,527 - lava_callback - INFO - Completed processing callback for node 69b921ff0ec88e58bad0e187 2026-03-17 10:02:42,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:02:42,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41500 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:03:03,387 - lava_callback - INFO - Received callback for node 69b926a40ec88e58bad0e258 INFO: 172.20.0.1:33072 - "POST /node/69b926a40ec88e58bad0e258 HTTP/1.0" 202 Accepted 2026-03-17 10:03:03,394 - lava_callback - INFO - Starting async job submit for node 69b926a40ec88e58bad0e258 2026-03-17 10:03:03,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:03:03,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b926a40ec88e58bad0e258 HTTP/1.1" 200 None 2026-03-17 10:03:03,439 - lava_callback - DEBUG - Processing node 69b926a40ec88e58bad0e258: baseline-arm64 2026-03-17 10:03:03,573 - lava_callback - WARNING - Failed to upload log 2026-03-17 10:03:03,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:03:03,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:03:03,801 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b926a40ec88e58bad0e258/lava-logs.yaml 2026-03-17 10:03:03,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:03:03,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:03:03,922 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b926a40ec88e58bad0e258/lava_callback.json.gz 2026-03-17 10:03:03,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:03:03,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b926a40ec88e58bad0e258 HTTP/1.1" 200 None 2026-03-17 10:03:03,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:03:03,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:03:03,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:03:04,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b926a40ec88e58bad0e258 HTTP/1.1" 200 None 2026-03-17 10:03:04,072 - lava_callback - INFO - Completed processing callback for node 69b926a40ec88e58bad0e258 INFO: 172.20.0.1:33080 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:03:12,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:03:12,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53256 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:04:28,713 - lava_callback - INFO - Received callback for node 69b926ee0ec88e58bad0e271 INFO: 172.20.0.1:53264 - "POST /node/69b926ee0ec88e58bad0e271 HTTP/1.0" 202 Accepted 2026-03-17 10:04:28,720 - lava_callback - INFO - Starting async job submit for node 69b926ee0ec88e58bad0e271 2026-03-17 10:04:28,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:04:28,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b926ee0ec88e58bad0e271 HTTP/1.1" 200 None 2026-03-17 10:04:28,764 - lava_callback - DEBUG - Processing node 69b926ee0ec88e58bad0e271: baseline-arm64 2026-03-17 10:04:28,898 - lava_callback - WARNING - Failed to upload log 2026-03-17 10:04:28,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:04:29,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:04:29,169 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b926ee0ec88e58bad0e271/lava-logs.yaml 2026-03-17 10:04:29,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:04:29,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:04:29,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b926ee0ec88e58bad0e271/lava_callback.json.gz 2026-03-17 10:04:29,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:04:29,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b926ee0ec88e58bad0e271 HTTP/1.1" 200 None 2026-03-17 10:04:29,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:04:29,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:04:29,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:04:29,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b926ee0ec88e58bad0e271 HTTP/1.1" 200 None 2026-03-17 10:04:29,531 - lava_callback - INFO - Completed processing callback for node 69b926ee0ec88e58bad0e271 INFO: 172.20.0.1:57266 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:04:42,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:04:42,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54756 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:06:36,990 - lava_callback - INFO - Received callback for node 69b919c90ec88e58bad0de1b INFO: 172.20.0.1:54762 - "POST /node/69b919c90ec88e58bad0de1b HTTP/1.0" 202 Accepted 2026-03-17 10:06:36,996 - lava_callback - INFO - Starting async job submit for node 69b919c90ec88e58bad0de1b 2026-03-17 10:06:37,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:06:37,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919c90ec88e58bad0de1b HTTP/1.1" 200 None 2026-03-17 10:06:37,061 - lava_callback - DEBUG - Processing node 69b919c90ec88e58bad0de1b: baseline-arm64 2026-03-17 10:06:37,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:06:37,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:06:37,503 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919c90ec88e58bad0de1b/log.txt.gz 2026-03-17 10:06:37,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:06:37,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:06:37,936 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919c90ec88e58bad0de1b/lava-logs.yaml 2026-03-17 10:06:37,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:06:38,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:06:38,151 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b919c90ec88e58bad0de1b/lava_callback.json.gz 2026-03-17 10:06:38,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:06:38,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919c90ec88e58bad0de1b HTTP/1.1" 200 None 2026-03-17 10:06:38,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:06:38,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:06:38,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:06:38,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919c90ec88e58bad0de1b HTTP/1.1" 200 None 2026-03-17 10:06:38,264 - lava_callback - INFO - Completed processing callback for node 69b919c90ec88e58bad0de1b 2026-03-17 10:06:42,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:06:42,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33238 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 10:07:16,214 - lava_callback - INFO - Received callback for node 69b927730ec88e58bad0e282 INFO: 172.20.0.1:33252 - "POST /node/69b927730ec88e58bad0e282 HTTP/1.0" 202 Accepted 2026-03-17 10:07:16,221 - lava_callback - INFO - Starting async job submit for node 69b927730ec88e58bad0e282 2026-03-17 10:07:16,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:16,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b927730ec88e58bad0e282 HTTP/1.1" 200 None 2026-03-17 10:07:16,258 - lava_callback - DEBUG - Processing node 69b927730ec88e58bad0e282: baseline-x86 INFO: 172.20.0.1:33260 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:07:16,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:07:16,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:07:16,649 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b927730ec88e58bad0e282/log.txt.gz 2026-03-17 10:07:16,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:07:17,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:07:17,056 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b927730ec88e58bad0e282/lava-logs.yaml 2026-03-17 10:07:17,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:07:17,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:07:17,201 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b927730ec88e58bad0e282/lava_callback.json.gz 2026-03-17 10:07:17,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:17,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b927730ec88e58bad0e282 HTTP/1.1" 200 None 2026-03-17 10:07:17,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:17,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e550ec88e58bad0d108 HTTP/1.1" 200 None 2026-03-17 10:07:17,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:17,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b927730ec88e58bad0e282 HTTP/1.1" 200 None 2026-03-17 10:07:17,284 - lava_callback - INFO - Completed processing callback for node 69b927730ec88e58bad0e282 2026-03-17 10:07:23,717 - lava_callback - INFO - Received callback for node 69b923c40ec88e58bad0e1d1 INFO: 172.20.0.1:33822 - "POST /node/69b923c40ec88e58bad0e1d1 HTTP/1.0" 202 Accepted 2026-03-17 10:07:23,725 - lava_callback - INFO - Starting async job submit for node 69b923c40ec88e58bad0e1d1 2026-03-17 10:07:23,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:23,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b923c40ec88e58bad0e1d1 HTTP/1.1" 200 None 2026-03-17 10:07:23,862 - lava_callback - DEBUG - Processing node 69b923c40ec88e58bad0e1d1: ltp-smoke 2026-03-17 10:07:24,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:07:24,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:07:24,509 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b923c40ec88e58bad0e1d1/log.txt.gz 2026-03-17 10:07:24,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:07:25,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:07:25,085 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b923c40ec88e58bad0e1d1/lava-logs.yaml 2026-03-17 10:07:25,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:07:25,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:07:25,252 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b923c40ec88e58bad0e1d1/lava_callback.json.gz 2026-03-17 10:07:25,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:25,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b923c40ec88e58bad0e1d1 HTTP/1.1" 200 None 2026-03-17 10:07:25,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:25,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e3a0ec88e58bad0d0e3 HTTP/1.1" 200 None 2026-03-17 10:07:25,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:25,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b923c40ec88e58bad0e1d1 HTTP/1.1" 200 None 2026-03-17 10:07:25,554 - lava_callback - INFO - Completed processing callback for node 69b923c40ec88e58bad0e1d1 INFO: 172.20.0.1:33836 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:07:26,775 - lava_callback - INFO - Received callback for node 69b919db0ec88e58bad0de57 INFO: 172.20.0.1:33852 - "POST /node/69b919db0ec88e58bad0de57 HTTP/1.0" 202 Accepted 2026-03-17 10:07:26,782 - lava_callback - INFO - Starting async job submit for node 69b919db0ec88e58bad0de57 2026-03-17 10:07:26,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:26,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919db0ec88e58bad0de57 HTTP/1.1" 200 None 2026-03-17 10:07:26,820 - lava_callback - DEBUG - Processing node 69b919db0ec88e58bad0de57: baseline-nfs-arm64 2026-03-17 10:07:27,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:07:27,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:07:27,355 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919db0ec88e58bad0de57/log.txt.gz 2026-03-17 10:07:27,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:07:27,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:07:27,794 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919db0ec88e58bad0de57/lava-logs.yaml 2026-03-17 10:07:27,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:07:27,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:07:27,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b919db0ec88e58bad0de57/lava_callback.json.gz 2026-03-17 10:07:27,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:28,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919db0ec88e58bad0de57 HTTP/1.1" 200 None 2026-03-17 10:07:28,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:28,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:07:28,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:28,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919db0ec88e58bad0de57 HTTP/1.1" 200 None 2026-03-17 10:07:28,057 - lava_callback - INFO - Completed processing callback for node 69b919db0ec88e58bad0de57 INFO: 172.20.0.1:34390 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:07:42,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:42,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33398 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:07:51,874 - lava_callback - INFO - Received callback for node 69b684f41727ff69d6f275b2 INFO: 172.20.0.1:58022 - "POST /node/69b684f41727ff69d6f275b2 HTTP/1.0" 202 Accepted 2026-03-17 10:07:51,880 - lava_callback - INFO - Starting async job submit for node 69b684f41727ff69d6f275b2 2026-03-17 10:07:51,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:51,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b684f41727ff69d6f275b2 HTTP/1.1" 200 None 2026-03-17 10:07:51,895 - lava_callback - DEBUG - Processing node 69b684f41727ff69d6f275b2: baseline-arm64-baylibre 2026-03-17 10:07:51,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b684f41727ff69d6f275b2 2026-03-17 10:07:51,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:51,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b684f41727ff69d6f275b2 HTTP/1.1" 200 None 2026-03-17 10:07:51,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:51,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-17 10:07:51,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:07:51,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b684f41727ff69d6f275b2 HTTP/1.1" 200 None 2026-03-17 10:07:51,946 - lava_callback - ERROR - Error processing callback for node 69b684f41727ff69d6f275b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49692 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:09:11,790 - lava_callback - INFO - Received callback for node 69b685451727ff69d6f275be INFO: 172.20.0.1:54580 - "POST /node/69b685451727ff69d6f275be HTTP/1.0" 202 Accepted 2026-03-17 10:09:11,796 - lava_callback - INFO - Starting async job submit for node 69b685451727ff69d6f275be 2026-03-17 10:09:11,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:09:11,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b685451727ff69d6f275be HTTP/1.1" 200 None 2026-03-17 10:09:11,813 - lava_callback - DEBUG - Processing node 69b685451727ff69d6f275be: baseline-arm64-baylibre 2026-03-17 10:09:11,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b685451727ff69d6f275be 2026-03-17 10:09:11,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:09:11,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b685451727ff69d6f275be HTTP/1.1" 200 None 2026-03-17 10:09:11,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:09:11,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-17 10:09:11,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:09:11,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b685451727ff69d6f275be HTTP/1.1" 200 None 2026-03-17 10:09:11,878 - lava_callback - ERROR - Error processing callback for node 69b685451727ff69d6f275be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60118 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:09:54,185 - lava_callback - INFO - Received callback for node 69b9249f0ec88e58bad0e1e8 INFO: 172.20.0.1:48554 - "POST /node/69b9249f0ec88e58bad0e1e8 HTTP/1.0" 202 Accepted 2026-03-17 10:09:54,192 - lava_callback - INFO - Starting async job submit for node 69b9249f0ec88e58bad0e1e8 2026-03-17 10:09:54,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:09:54,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9249f0ec88e58bad0e1e8 HTTP/1.1" 200 None 2026-03-17 10:09:54,262 - lava_callback - DEBUG - Processing node 69b9249f0ec88e58bad0e1e8: baseline-arm 2026-03-17 10:09:54,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:09:55,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:09:55,084 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b9249f0ec88e58bad0e1e8/log.txt.gz 2026-03-17 10:09:55,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:09:55,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:09:55,717 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b9249f0ec88e58bad0e1e8/lava-logs.yaml 2026-03-17 10:09:55,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:09:55,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:09:55,946 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b9249f0ec88e58bad0e1e8/lava_callback.json.gz DEBUG: Setup failed for 69b9249f0ec88e58bad0e1e8. Transitting job node result: incomplete -> fail 2026-03-17 10:09:56,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:09:56,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9249f0ec88e58bad0e1e8 HTTP/1.1" 200 None 2026-03-17 10:09:56,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:09:56,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 10:09:56,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:09:56,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9249f0ec88e58bad0e1e8 HTTP/1.1" 200 None 2026-03-17 10:09:56,299 - lava_callback - INFO - Completed processing callback for node 69b9249f0ec88e58bad0e1e8 INFO: 172.20.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43720 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:10:12,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:10:12,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51196 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:10:32,107 - lava_callback - INFO - Received callback for node 69b685961727ff69d6f275c5 INFO: 172.20.0.1:33236 - "POST /node/69b685961727ff69d6f275c5 HTTP/1.0" 202 Accepted 2026-03-17 10:10:32,113 - lava_callback - INFO - Starting async job submit for node 69b685961727ff69d6f275c5 2026-03-17 10:10:32,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:10:32,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b685961727ff69d6f275c5 HTTP/1.1" 200 None 2026-03-17 10:10:32,130 - lava_callback - DEBUG - Processing node 69b685961727ff69d6f275c5: baseline-arm64-baylibre 2026-03-17 10:10:32,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b685961727ff69d6f275c5 2026-03-17 10:10:32,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:10:32,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b685961727ff69d6f275c5 HTTP/1.1" 200 None 2026-03-17 10:10:32,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:10:32,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-17 10:10:32,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:10:32,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b685961727ff69d6f275c5 HTTP/1.1" 200 None 2026-03-17 10:10:32,188 - lava_callback - ERROR - Error processing callback for node 69b685961727ff69d6f275c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52538 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:11:24,877 - lava_callback - INFO - Received callback for node 69b9281d0ec88e58bad0e2c0 INFO: 172.20.0.1:56326 - "POST /node/69b9281d0ec88e58bad0e2c0 HTTP/1.0" 202 Accepted 2026-03-17 10:11:24,883 - lava_callback - INFO - Starting async job submit for node 69b9281d0ec88e58bad0e2c0 2026-03-17 10:11:24,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:11:24,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9281d0ec88e58bad0e2c0 HTTP/1.1" 200 None 2026-03-17 10:11:24,926 - lava_callback - DEBUG - Processing node 69b9281d0ec88e58bad0e2c0: baseline-arm64-broonie 2026-03-17 10:11:25,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:11:25,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:11:25,461 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b9281d0ec88e58bad0e2c0/log.txt.gz 2026-03-17 10:11:25,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:11:25,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:11:25,960 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b9281d0ec88e58bad0e2c0/lava-logs.yaml 2026-03-17 10:11:25,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:11:26,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:11:26,216 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b9281d0ec88e58bad0e2c0/lava_callback.json.gz 2026-03-17 10:11:26,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:11:26,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9281d0ec88e58bad0e2c0 HTTP/1.1" 200 None 2026-03-17 10:11:26,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:11:26,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 10:11:26,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:11:26,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9281d0ec88e58bad0e2c0 HTTP/1.1" 200 None 2026-03-17 10:11:26,382 - lava_callback - INFO - Completed processing callback for node 69b9281d0ec88e58bad0e2c0 INFO: 172.20.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45458 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:11:42,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:11:42,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34924 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:12:37,346 - lava_callback - INFO - Received callback for node 69b685ff1727ff69d6f275d2 INFO: 172.20.0.1:34928 - "POST /node/69b685ff1727ff69d6f275d2 HTTP/1.0" 202 Accepted 2026-03-17 10:12:37,351 - lava_callback - INFO - Starting async job submit for node 69b685ff1727ff69d6f275d2 2026-03-17 10:12:37,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:12:37,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b685ff1727ff69d6f275d2 HTTP/1.1" 200 None 2026-03-17 10:12:37,369 - lava_callback - DEBUG - Processing node 69b685ff1727ff69d6f275d2: baseline-arm64-clabbe 2026-03-17 10:12:37,369 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b685ff1727ff69d6f275d2 2026-03-17 10:12:37,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:12:37,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b685ff1727ff69d6f275d2 HTTP/1.1" 200 None 2026-03-17 10:12:37,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:12:37,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-17 10:12:37,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:12:37,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b685ff1727ff69d6f275d2 HTTP/1.1" 200 None 2026-03-17 10:12:37,438 - lava_callback - ERROR - Error processing callback for node 69b685ff1727ff69d6f275d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48074 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:13:04,001 - lava_callback - INFO - Received callback for node 69b9277d0ec88e58bad0e286 INFO: 172.20.0.1:58432 - "POST /node/69b9277d0ec88e58bad0e286 HTTP/1.0" 202 Accepted 2026-03-17 10:13:04,009 - lava_callback - INFO - Starting async job submit for node 69b9277d0ec88e58bad0e286 2026-03-17 10:13:04,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:13:04,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9277d0ec88e58bad0e286 HTTP/1.1" 200 None 2026-03-17 10:13:04,062 - lava_callback - DEBUG - Processing node 69b9277d0ec88e58bad0e286: baseline-arm64 2026-03-17 10:13:04,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:13:04,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:13:04,642 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b9277d0ec88e58bad0e286/log.txt.gz 2026-03-17 10:13:04,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:13:05,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:13:05,125 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b9277d0ec88e58bad0e286/lava-logs.yaml 2026-03-17 10:13:05,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:13:05,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:13:05,357 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b9277d0ec88e58bad0e286/lava_callback.json.gz DEBUG: Setup failed for 69b9277d0ec88e58bad0e286. Transitting job node result: incomplete -> fail 2026-03-17 10:13:05,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:13:05,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9277d0ec88e58bad0e286 HTTP/1.1" 200 None 2026-03-17 10:13:05,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:13:05,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:13:05,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:13:05,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9277d0ec88e58bad0e286 HTTP/1.1" 200 None 2026-03-17 10:13:05,580 - lava_callback - INFO - Completed processing callback for node 69b9277d0ec88e58bad0e286 INFO: 172.20.0.1:58436 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:13:12,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:13:12,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51472 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:13:37,435 - lava_callback - INFO - Received callback for node 69b6864e1727ff69d6f275d9 INFO: 172.20.0.1:51488 - "POST /node/69b6864e1727ff69d6f275d9 HTTP/1.0" 202 Accepted 2026-03-17 10:13:37,440 - lava_callback - INFO - Starting async job submit for node 69b6864e1727ff69d6f275d9 2026-03-17 10:13:37,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:13:37,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6864e1727ff69d6f275d9 HTTP/1.1" 200 None 2026-03-17 10:13:37,455 - lava_callback - DEBUG - Processing node 69b6864e1727ff69d6f275d9: baseline-arm64-clabbe 2026-03-17 10:13:37,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6864e1727ff69d6f275d9 2026-03-17 10:13:37,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:13:37,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6864e1727ff69d6f275d9 HTTP/1.1" 200 None 2026-03-17 10:13:37,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:13:37,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-17 10:13:37,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:13:37,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6864e1727ff69d6f275d9 HTTP/1.1" 200 None 2026-03-17 10:13:37,508 - lava_callback - ERROR - Error processing callback for node 69b6864e1727ff69d6f275d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36874 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:13:50,569 - lava_callback - INFO - Received callback for node 69b9293c0ec88e58bad0e2f9 INFO: 172.20.0.1:40392 - "POST /node/69b9293c0ec88e58bad0e2f9 HTTP/1.0" 202 Accepted 2026-03-17 10:13:50,575 - lava_callback - INFO - Starting async job submit for node 69b9293c0ec88e58bad0e2f9 2026-03-17 10:13:50,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:13:50,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9293c0ec88e58bad0e2f9 HTTP/1.1" 200 None 2026-03-17 10:13:50,592 - lava_callback - DEBUG - Processing node 69b9293c0ec88e58bad0e2f9: baseline-nfs-arm64 2026-03-17 10:13:50,593 - lava_callback - WARNING - Failed to upload log 2026-03-17 10:13:50,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:13:50,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:13:50,807 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b9293c0ec88e58bad0e2f9/lava-logs.yaml 2026-03-17 10:13:50,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:13:50,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:13:50,990 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b9293c0ec88e58bad0e2f9/lava_callback.json.gz 2026-03-17 10:13:50,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:13:51,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9293c0ec88e58bad0e2f9 HTTP/1.1" 200 None 2026-03-17 10:13:51,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:13:51,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:13:51,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:13:51,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9293c0ec88e58bad0e2f9 HTTP/1.1" 200 None 2026-03-17 10:13:51,055 - lava_callback - INFO - Completed processing callback for node 69b9293c0ec88e58bad0e2f9 INFO: 172.20.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55228 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:14:12,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:14:12,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58446 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:15:17,473 - lava_callback - INFO - Received callback for node 69b6869f1727ff69d6f275e5 INFO: 172.20.0.1:58450 - "POST /node/69b6869f1727ff69d6f275e5 HTTP/1.0" 202 Accepted 2026-03-17 10:15:17,479 - lava_callback - INFO - Starting async job submit for node 69b6869f1727ff69d6f275e5 2026-03-17 10:15:17,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:15:17,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6869f1727ff69d6f275e5 HTTP/1.1" 200 None 2026-03-17 10:15:17,495 - lava_callback - DEBUG - Processing node 69b6869f1727ff69d6f275e5: baseline-arm64-clabbe 2026-03-17 10:15:17,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6869f1727ff69d6f275e5 2026-03-17 10:15:17,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:15:17,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6869f1727ff69d6f275e5 HTTP/1.1" 200 None 2026-03-17 10:15:17,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:15:17,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-17 10:15:17,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:15:17,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6869f1727ff69d6f275e5 HTTP/1.1" 200 None 2026-03-17 10:15:17,553 - lava_callback - ERROR - Error processing callback for node 69b6869f1727ff69d6f275e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56248 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:15:48,409 - lava_callback - INFO - Received callback for node 69b925150ec88e58bad0e1fe INFO: 172.20.0.1:56256 - "POST /node/69b925150ec88e58bad0e1fe HTTP/1.0" 202 Accepted 2026-03-17 10:15:48,417 - lava_callback - INFO - Starting async job submit for node 69b925150ec88e58bad0e1fe 2026-03-17 10:15:48,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:15:48,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b925150ec88e58bad0e1fe HTTP/1.1" 200 None 2026-03-17 10:15:48,490 - lava_callback - DEBUG - Processing node 69b925150ec88e58bad0e1fe: baseline-nfs-arm64 2026-03-17 10:15:49,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:15:49,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:15:49,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b925150ec88e58bad0e1fe/log.txt.gz 2026-03-17 10:15:50,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:15:50,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:15:50,712 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b925150ec88e58bad0e1fe/lava-logs.yaml 2026-03-17 10:15:50,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:15:50,978 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:15:50,980 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b925150ec88e58bad0e1fe/lava_callback.json.gz DEBUG: Setup failed for 69b925150ec88e58bad0e1fe. Transitting job node result: incomplete -> fail 2026-03-17 10:15:51,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:15:51,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b925150ec88e58bad0e1fe HTTP/1.1" 200 None 2026-03-17 10:15:51,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:15:51,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:15:51,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:15:51,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b925150ec88e58bad0e1fe HTTP/1.1" 200 None 2026-03-17 10:15:51,215 - lava_callback - INFO - Completed processing callback for node 69b925150ec88e58bad0e1fe INFO: 172.20.0.1:53280 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:16:03,469 - lava_callback - INFO - Received callback for node 69b925620ec88e58bad0e20e INFO: 172.20.0.1:40034 - "POST /node/69b925620ec88e58bad0e20e HTTP/1.0" 202 Accepted 2026-03-17 10:16:03,517 - lava_callback - INFO - Starting async job submit for node 69b925620ec88e58bad0e20e 2026-03-17 10:16:03,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:16:03,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b925620ec88e58bad0e20e HTTP/1.1" 200 None 2026-03-17 10:16:03,556 - lava_callback - DEBUG - Processing node 69b925620ec88e58bad0e20e: baseline-arm-pengutronix 2026-03-17 10:16:03,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:16:03,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:16:03,779 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b925620ec88e58bad0e20e/log.txt.gz 2026-03-17 10:16:03,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:16:03,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:16:03,993 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b925620ec88e58bad0e20e/lava-logs.yaml 2026-03-17 10:16:03,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:16:04,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:16:04,126 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b925620ec88e58bad0e20e/lava_callback.json.gz DEBUG: Setup failed for 69b925620ec88e58bad0e20e. Transitting job node result: incomplete -> fail 2026-03-17 10:16:04,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:16:04,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b925620ec88e58bad0e20e HTTP/1.1" 200 None 2026-03-17 10:16:04,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:16:04,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 10:16:04,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:16:04,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b925620ec88e58bad0e20e HTTP/1.1" 200 None 2026-03-17 10:16:04,304 - lava_callback - INFO - Completed processing callback for node 69b925620ec88e58bad0e20e INFO: 172.20.0.1:40050 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:16:12,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:16:12,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53156 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:16:37,556 - lava_callback - INFO - Received callback for node 69b686ef1727ff69d6f275f0 INFO: 172.20.0.1:53170 - "POST /node/69b686ef1727ff69d6f275f0 HTTP/1.0" 202 Accepted 2026-03-17 10:16:37,562 - lava_callback - INFO - Starting async job submit for node 69b686ef1727ff69d6f275f0 2026-03-17 10:16:37,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:16:37,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b686ef1727ff69d6f275f0 HTTP/1.1" 200 None 2026-03-17 10:16:37,585 - lava_callback - DEBUG - Processing node 69b686ef1727ff69d6f275f0: baseline-arm64-clabbe 2026-03-17 10:16:37,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b686ef1727ff69d6f275f0 2026-03-17 10:16:37,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:16:37,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b686ef1727ff69d6f275f0 HTTP/1.1" 200 None 2026-03-17 10:16:37,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:16:37,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-17 10:16:37,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:16:37,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b686ef1727ff69d6f275f0 HTTP/1.1" 200 None 2026-03-17 10:16:37,648 - lava_callback - ERROR - Error processing callback for node 69b686ef1727ff69d6f275f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46764 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:17:04,188 - lava_callback - INFO - Received callback for node 69b929cb0ec88e58bad0e30f INFO: 172.20.0.1:36484 - "POST /node/69b929cb0ec88e58bad0e30f HTTP/1.0" 202 Accepted 2026-03-17 10:17:04,195 - lava_callback - INFO - Starting async job submit for node 69b929cb0ec88e58bad0e30f 2026-03-17 10:17:04,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:17:04,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b929cb0ec88e58bad0e30f HTTP/1.1" 200 None 2026-03-17 10:17:04,242 - lava_callback - DEBUG - Processing node 69b929cb0ec88e58bad0e30f: baseline-arm64 2026-03-17 10:17:04,375 - lava_callback - WARNING - Failed to upload log 2026-03-17 10:17:04,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:17:04,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:17:04,708 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b929cb0ec88e58bad0e30f/lava-logs.yaml 2026-03-17 10:17:04,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:17:04,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:17:04,845 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b929cb0ec88e58bad0e30f/lava_callback.json.gz 2026-03-17 10:17:04,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:17:04,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b929cb0ec88e58bad0e30f HTTP/1.1" 200 None 2026-03-17 10:17:04,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:17:04,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:17:04,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:17:04,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b929cb0ec88e58bad0e30f HTTP/1.1" 200 None 2026-03-17 10:17:05,002 - lava_callback - INFO - Completed processing callback for node 69b929cb0ec88e58bad0e30f INFO: 172.20.0.1:36496 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:17:12,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:17:12,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36516 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:17:57,560 - lava_callback - INFO - Received callback for node 69b6873f1727ff69d6f275f7 INFO: 172.20.0.1:36532 - "POST /node/69b6873f1727ff69d6f275f7 HTTP/1.0" 202 Accepted 2026-03-17 10:17:57,566 - lava_callback - INFO - Starting async job submit for node 69b6873f1727ff69d6f275f7 2026-03-17 10:17:57,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:17:57,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6873f1727ff69d6f275f7 HTTP/1.1" 200 None 2026-03-17 10:17:57,583 - lava_callback - DEBUG - Processing node 69b6873f1727ff69d6f275f7: baseline-arm64-clabbe 2026-03-17 10:17:57,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6873f1727ff69d6f275f7 2026-03-17 10:17:57,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:17:57,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6873f1727ff69d6f275f7 HTTP/1.1" 200 None 2026-03-17 10:17:57,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:17:57,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-17 10:17:57,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:17:57,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6873f1727ff69d6f275f7 HTTP/1.1" 200 None 2026-03-17 10:17:57,635 - lava_callback - ERROR - Error processing callback for node 69b6873f1727ff69d6f275f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40598 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:18:57,605 - lava_callback - INFO - Received callback for node 69b6878f1727ff69d6f27603 INFO: 172.20.0.1:40606 - "POST /node/69b6878f1727ff69d6f27603 HTTP/1.0" 202 Accepted 2026-03-17 10:18:57,610 - lava_callback - INFO - Starting async job submit for node 69b6878f1727ff69d6f27603 2026-03-17 10:18:57,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:18:57,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6878f1727ff69d6f27603 HTTP/1.1" 200 None 2026-03-17 10:18:57,627 - lava_callback - DEBUG - Processing node 69b6878f1727ff69d6f27603: baseline-arm64-clabbe 2026-03-17 10:18:57,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6878f1727ff69d6f27603 2026-03-17 10:18:57,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:18:57,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6878f1727ff69d6f27603 HTTP/1.1" 200 None 2026-03-17 10:18:57,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:18:57,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-17 10:18:57,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:18:57,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6878f1727ff69d6f27603 HTTP/1.1" 200 None 2026-03-17 10:18:57,692 - lava_callback - ERROR - Error processing callback for node 69b6878f1727ff69d6f27603: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60370 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:22:50,593 - lava_callback - INFO - Received callback for node 69b928f30ec88e58bad0e2ea INFO: 172.20.0.1:47914 - "POST /node/69b928f30ec88e58bad0e2ea HTTP/1.0" 202 Accepted 2026-03-17 10:22:50,600 - lava_callback - INFO - Starting async job submit for node 69b928f30ec88e58bad0e2ea 2026-03-17 10:22:50,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:22:50,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b928f30ec88e58bad0e2ea HTTP/1.1" 200 None 2026-03-17 10:22:50,641 - lava_callback - DEBUG - Processing node 69b928f30ec88e58bad0e2ea: baseline-nfs-arm64 2026-03-17 10:22:51,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:22:51,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:22:51,354 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b928f30ec88e58bad0e2ea/log.txt.gz 2026-03-17 10:22:51,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:22:51,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:22:51,901 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b928f30ec88e58bad0e2ea/lava-logs.yaml 2026-03-17 10:22:51,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:22:52,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:22:52,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b928f30ec88e58bad0e2ea/lava_callback.json.gz 2026-03-17 10:22:52,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:22:52,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b928f30ec88e58bad0e2ea HTTP/1.1" 200 None 2026-03-17 10:22:52,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:22:52,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:22:52,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:22:52,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b928f30ec88e58bad0e2ea HTTP/1.1" 200 None 2026-03-17 10:22:52,302 - lava_callback - INFO - Completed processing callback for node 69b928f30ec88e58bad0e2ea INFO: 172.20.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60052 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:23:12,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:23:12,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46794 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:25:09,332 - lava_callback - INFO - Received callback for node 69b92a160ec88e58bad0e326 INFO: 172.20.0.1:46802 - "POST /node/69b92a160ec88e58bad0e326 HTTP/1.0" 202 Accepted 2026-03-17 10:25:09,339 - lava_callback - INFO - Starting async job submit for node 69b92a160ec88e58bad0e326 2026-03-17 10:25:09,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:25:09,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92a160ec88e58bad0e326 HTTP/1.1" 200 None 2026-03-17 10:25:09,384 - lava_callback - DEBUG - Processing node 69b92a160ec88e58bad0e326: baseline-arm64 2026-03-17 10:25:09,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:25:09,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:25:09,738 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b92a160ec88e58bad0e326/log.txt.gz 2026-03-17 10:25:09,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:25:10,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:25:10,060 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b92a160ec88e58bad0e326/lava-logs.yaml 2026-03-17 10:25:10,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:25:10,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:25:10,261 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b92a160ec88e58bad0e326/lava_callback.json.gz 2026-03-17 10:25:10,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:25:10,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92a160ec88e58bad0e326 HTTP/1.1" 200 None 2026-03-17 10:25:10,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:25:10,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:25:10,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:25:10,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92a160ec88e58bad0e326 HTTP/1.1" 200 None 2026-03-17 10:25:10,407 - lava_callback - INFO - Completed processing callback for node 69b92a160ec88e58bad0e326 2026-03-17 10:25:12,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:25:12,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47296 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:30:18,076 - lava_callback - INFO - Received callback for node 69b92bba0ec88e58bad0e365 INFO: 172.20.0.1:47308 - "POST /node/69b92bba0ec88e58bad0e365 HTTP/1.0" 202 Accepted 2026-03-17 10:30:18,084 - lava_callback - INFO - Starting async job submit for node 69b92bba0ec88e58bad0e365 2026-03-17 10:30:18,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:30:18,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92bba0ec88e58bad0e365 HTTP/1.1" 200 None 2026-03-17 10:30:18,136 - lava_callback - DEBUG - Processing node 69b92bba0ec88e58bad0e365: baseline-arm64 2026-03-17 10:30:18,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:30:18,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:30:18,742 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b92bba0ec88e58bad0e365/log.txt.gz 2026-03-17 10:30:18,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:30:19,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:30:19,238 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b92bba0ec88e58bad0e365/lava-logs.yaml 2026-03-17 10:30:19,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:30:19,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:30:19,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b92bba0ec88e58bad0e365/lava_callback.json.gz DEBUG: Setup failed for 69b92bba0ec88e58bad0e365. Transitting job node result: incomplete -> fail 2026-03-17 10:30:19,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:30:19,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92bba0ec88e58bad0e365 HTTP/1.1" 200 None 2026-03-17 10:30:19,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:30:19,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:30:19,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:30:19,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92bba0ec88e58bad0e365 HTTP/1.1" 200 None 2026-03-17 10:30:19,706 - lava_callback - INFO - Completed processing callback for node 69b92bba0ec88e58bad0e365 INFO: 172.20.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50998 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:30:42,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:30:42,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60970 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:36:04,805 - lava_callback - INFO - Received callback for node 69b92a5f0ec88e58bad0e331 INFO: 172.20.0.1:54006 - "POST /node/69b92a5f0ec88e58bad0e331 HTTP/1.0" 202 Accepted 2026-03-17 10:36:04,812 - lava_callback - INFO - Starting async job submit for node 69b92a5f0ec88e58bad0e331 2026-03-17 10:36:04,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:36:04,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92a5f0ec88e58bad0e331 HTTP/1.1" 200 None 2026-03-17 10:36:04,884 - lava_callback - DEBUG - Processing node 69b92a5f0ec88e58bad0e331: ltp-smoke 2026-03-17 10:36:05,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:36:05,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:36:05,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b92a5f0ec88e58bad0e331/log.txt.gz 2026-03-17 10:36:05,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:36:06,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:36:06,134 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b92a5f0ec88e58bad0e331/lava-logs.yaml 2026-03-17 10:36:06,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:36:06,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:36:06,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b92a5f0ec88e58bad0e331/lava_callback.json.gz 2026-03-17 10:36:06,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:54008 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:36:06,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92a5f0ec88e58bad0e331 HTTP/1.1" 200 None 2026-03-17 10:36:06,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:36:06,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e3a0ec88e58bad0d0e3 HTTP/1.1" 200 None 2026-03-17 10:36:06,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:36:06,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92a5f0ec88e58bad0e331 HTTP/1.1" 200 None 2026-03-17 10:36:06,683 - lava_callback - INFO - Completed processing callback for node 69b92a5f0ec88e58bad0e331 2026-03-17 10:36:12,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:36:12,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51970 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:36:17,243 - lava_callback - INFO - Received callback for node 69b929820ec88e58bad0e306 INFO: 172.20.0.1:51974 - "POST /node/69b929820ec88e58bad0e306 HTTP/1.0" 202 Accepted 2026-03-17 10:36:17,249 - lava_callback - INFO - Starting async job submit for node 69b929820ec88e58bad0e306 2026-03-17 10:36:17,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:36:17,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b929820ec88e58bad0e306 HTTP/1.1" 200 None 2026-03-17 10:36:17,358 - lava_callback - DEBUG - Processing node 69b929820ec88e58bad0e306: baseline-arm64 2026-03-17 10:36:17,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:36:17,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:36:18,000 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b929820ec88e58bad0e306/log.txt.gz 2026-03-17 10:36:18,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:36:18,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:36:18,483 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b929820ec88e58bad0e306/lava-logs.yaml 2026-03-17 10:36:18,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:36:18,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:36:18,714 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b929820ec88e58bad0e306/lava_callback.json.gz 2026-03-17 10:36:18,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:36:18,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b929820ec88e58bad0e306 HTTP/1.1" 200 None 2026-03-17 10:36:18,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:36:18,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:36:18,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:36:18,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b929820ec88e58bad0e306 HTTP/1.1" 200 None 2026-03-17 10:36:18,852 - lava_callback - INFO - Completed processing callback for node 69b929820ec88e58bad0e306 INFO: 172.20.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33542 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:36:42,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:36:42,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51524 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:38:18,999 - lava_callback - INFO - Received callback for node 69b92af70ec88e58bad0e347 INFO: 172.20.0.1:51538 - "POST /node/69b92af70ec88e58bad0e347 HTTP/1.0" 202 Accepted 2026-03-17 10:38:19,006 - lava_callback - INFO - Starting async job submit for node 69b92af70ec88e58bad0e347 2026-03-17 10:38:19,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:38:19,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92af70ec88e58bad0e347 HTTP/1.1" 200 None 2026-03-17 10:38:19,075 - lava_callback - DEBUG - Processing node 69b92af70ec88e58bad0e347: baseline-arm 2026-03-17 10:38:19,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:38:19,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:38:19,868 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b92af70ec88e58bad0e347/log.txt.gz 2026-03-17 10:38:20,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:38:20,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:38:20,571 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b92af70ec88e58bad0e347/lava-logs.yaml 2026-03-17 10:38:20,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:38:20,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:38:20,818 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b92af70ec88e58bad0e347/lava_callback.json.gz DEBUG: Setup failed for 69b92af70ec88e58bad0e347. Transitting job node result: incomplete -> fail 2026-03-17 10:38:20,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:38:20,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92af70ec88e58bad0e347 HTTP/1.1" 200 None 2026-03-17 10:38:20,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:38:20,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 10:38:20,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:38:20,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92af70ec88e58bad0e347 HTTP/1.1" 200 None 2026-03-17 10:38:21,078 - lava_callback - INFO - Completed processing callback for node 69b92af70ec88e58bad0e347 INFO: 172.20.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59576 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:38:42,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:38:42,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47786 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:47:46,990 - lava_callback - INFO - Received callback for node 69b92ca10ec88e58bad0e37e INFO: 172.20.0.1:47796 - "POST /node/69b92ca10ec88e58bad0e37e HTTP/1.0" 202 Accepted 2026-03-17 10:47:46,998 - lava_callback - INFO - Starting async job submit for node 69b92ca10ec88e58bad0e37e 2026-03-17 10:47:47,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:47:47,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92ca10ec88e58bad0e37e HTTP/1.1" 200 None 2026-03-17 10:47:47,060 - lava_callback - DEBUG - Processing node 69b92ca10ec88e58bad0e37e: baseline-nfs-arm64 2026-03-17 10:47:48,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:47:48,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:47:48,292 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b92ca10ec88e58bad0e37e/log.txt.gz 2026-03-17 10:47:48,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:47:49,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:47:49,164 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b92ca10ec88e58bad0e37e/lava-logs.yaml 2026-03-17 10:47:49,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:47:49,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:47:49,444 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b92ca10ec88e58bad0e37e/lava_callback.json.gz DEBUG: Setup failed for 69b92ca10ec88e58bad0e37e. Transitting job node result: incomplete -> fail 2026-03-17 10:47:49,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:47:49,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92ca10ec88e58bad0e37e HTTP/1.1" 200 None 2026-03-17 10:47:49,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:47:49,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:47:49,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:47:49,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92ca10ec88e58bad0e37e HTTP/1.1" 200 None 2026-03-17 10:47:49,720 - lava_callback - INFO - Completed processing callback for node 69b92ca10ec88e58bad0e37e INFO: 172.20.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54834 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:48:12,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:48:12,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48332 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:52:45,067 - lava_callback - INFO - Received callback for node 69b92df20ec88e58bad0e3af INFO: 172.20.0.1:52994 - "POST /node/69b92df20ec88e58bad0e3af HTTP/1.0" 202 Accepted 2026-03-17 10:52:45,073 - lava_callback - INFO - Starting async job submit for node 69b92df20ec88e58bad0e3af 2026-03-17 10:52:45,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:52:45,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92df20ec88e58bad0e3af HTTP/1.1" 200 None 2026-03-17 10:52:45,131 - lava_callback - DEBUG - Processing node 69b92df20ec88e58bad0e3af: baseline-nfs-arm64 INFO: 172.20.0.1:53010 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:52:45,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:52:45,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:52:45,874 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b92df20ec88e58bad0e3af/log.txt.gz 2026-03-17 10:52:46,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:52:46,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:52:46,431 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b92df20ec88e58bad0e3af/lava-logs.yaml 2026-03-17 10:52:46,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:53018 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:52:46,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:52:46,714 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b92df20ec88e58bad0e3af/lava_callback.json.gz 2026-03-17 10:52:46,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:52:46,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92df20ec88e58bad0e3af HTTP/1.1" 200 None 2026-03-17 10:52:46,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:52:46,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:52:46,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:52:46,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92df20ec88e58bad0e3af HTTP/1.1" 200 None 2026-03-17 10:52:46,866 - lava_callback - INFO - Completed processing callback for node 69b92df20ec88e58bad0e3af INFO: 172.20.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59724 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:53:12,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:53:12,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35692 - "GET / HTTP/1.0" 200 OK 2026-03-17 10:58:38,046 - lava_callback - INFO - Received callback for node 69b92ea80ec88e58bad0e3c0 INFO: 172.20.0.1:35704 - "POST /node/69b92ea80ec88e58bad0e3c0 HTTP/1.0" 202 Accepted 2026-03-17 10:58:38,053 - lava_callback - INFO - Starting async job submit for node 69b92ea80ec88e58bad0e3c0 2026-03-17 10:58:38,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:58:38,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92ea80ec88e58bad0e3c0 HTTP/1.1" 200 None 2026-03-17 10:58:38,166 - lava_callback - DEBUG - Processing node 69b92ea80ec88e58bad0e3c0: baseline-arm64 2026-03-17 10:58:38,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:58:38,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:58:38,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b92ea80ec88e58bad0e3c0/log.txt.gz 2026-03-17 10:58:39,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:58:39,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:58:39,473 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b92ea80ec88e58bad0e3c0/lava-logs.yaml 2026-03-17 10:58:39,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 10:58:39,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 10:58:39,699 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b92ea80ec88e58bad0e3c0/lava_callback.json.gz 2026-03-17 10:58:39,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:58:39,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92ea80ec88e58bad0e3c0 HTTP/1.1" 200 None 2026-03-17 10:58:39,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:58:39,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 10:58:39,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:58:39,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92ea80ec88e58bad0e3c0 HTTP/1.1" 200 None 2026-03-17 10:58:39,849 - lava_callback - INFO - Completed processing callback for node 69b92ea80ec88e58bad0e3c0 2026-03-17 10:58:42,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 10:58:42,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58292 - "GET / HTTP/1.0" 200 OK 2026-03-17 11:08:47,846 - lava_callback - INFO - Received callback for node 69b9318f0ec88e58bad0e489 INFO: 172.20.0.1:58294 - "POST /node/69b9318f0ec88e58bad0e489 HTTP/1.0" 202 Accepted 2026-03-17 11:08:47,854 - lava_callback - INFO - Starting async job submit for node 69b9318f0ec88e58bad0e489 2026-03-17 11:08:47,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 11:08:47,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9318f0ec88e58bad0e489 HTTP/1.1" 200 None 2026-03-17 11:08:47,913 - lava_callback - DEBUG - Processing node 69b9318f0ec88e58bad0e489: baseline-nfs-arm64 2026-03-17 11:08:48,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 11:08:49,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 11:08:49,197 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b9318f0ec88e58bad0e489/log.txt.gz 2026-03-17 11:08:49,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 11:08:50,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 11:08:50,064 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b9318f0ec88e58bad0e489/lava-logs.yaml 2026-03-17 11:08:50,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 11:08:50,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 11:08:50,388 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b9318f0ec88e58bad0e489/lava_callback.json.gz DEBUG: Setup failed for 69b9318f0ec88e58bad0e489. Transitting job node result: incomplete -> fail 2026-03-17 11:08:50,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 11:08:50,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9318f0ec88e58bad0e489 HTTP/1.1" 200 None 2026-03-17 11:08:50,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 11:08:50,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-17 11:08:50,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 11:08:50,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9318f0ec88e58bad0e489 HTTP/1.1" 200 None 2026-03-17 11:08:50,643 - lava_callback - INFO - Completed processing callback for node 69b9318f0ec88e58bad0e489 INFO: 172.20.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44456 - "GET / HTTP/1.0" 200 OK 2026-03-17 11:09:12,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 11:09:12,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56972 - "GET / HTTP/1.0" 200 OK 2026-03-17 11:33:26,340 - lava_callback - INFO - Received callback for node 69b92cee0ec88e58bad0e387 INFO: 172.20.0.1:52294 - "POST /node/69b92cee0ec88e58bad0e387 HTTP/1.0" 202 Accepted 2026-03-17 11:33:26,389 - lava_callback - INFO - Starting async job submit for node 69b92cee0ec88e58bad0e387 2026-03-17 11:33:26,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 11:33:26,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92cee0ec88e58bad0e387 HTTP/1.1" 200 None 2026-03-17 11:33:26,447 - lava_callback - DEBUG - Processing node 69b92cee0ec88e58bad0e387: baseline-arm-pengutronix INFO: 172.20.0.1:52300 - "GET / HTTP/1.0" 200 OK 2026-03-17 11:33:26,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 11:33:26,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 11:33:26,757 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b92cee0ec88e58bad0e387/log.txt.gz 2026-03-17 11:33:26,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 11:33:27,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 11:33:27,080 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b92cee0ec88e58bad0e387/lava-logs.yaml 2026-03-17 11:33:27,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 11:33:27,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 11:33:27,276 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b92cee0ec88e58bad0e387/lava_callback.json.gz DEBUG: Setup failed for 69b92cee0ec88e58bad0e387. Transitting job node result: incomplete -> fail 2026-03-17 11:33:27,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 11:33:27,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92cee0ec88e58bad0e387 HTTP/1.1" 200 None 2026-03-17 11:33:27,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 11:33:27,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-17 11:33:27,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 11:33:27,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92cee0ec88e58bad0e387 HTTP/1.1" 200 None 2026-03-17 11:33:27,508 - lava_callback - INFO - Completed processing callback for node 69b92cee0ec88e58bad0e387 INFO: 172.20.0.1:44896 - "GET / HTTP/1.0" 200 OK 2026-03-17 11:33:42,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 11:33:42,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57614 - "GET / HTTP/1.0" 200 OK 2026-03-17 12:52:01,060 - lava_callback - INFO - Received callback for node 69b6ab611727ff69d6f27699 INFO: 172.20.0.1:52104 - "POST /node/69b6ab611727ff69d6f27699 HTTP/1.0" 202 Accepted 2026-03-17 12:52:01,066 - lava_callback - INFO - Starting async job submit for node 69b6ab611727ff69d6f27699 2026-03-17 12:52:01,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:52:01,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ab611727ff69d6f27699 HTTP/1.1" 200 None 2026-03-17 12:52:01,152 - lava_callback - DEBUG - Processing node 69b6ab611727ff69d6f27699: baseline-arm-baylibre 2026-03-17 12:52:01,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ab611727ff69d6f27699 2026-03-17 12:52:01,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:52:01,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ab611727ff69d6f27699 HTTP/1.1" 200 None 2026-03-17 12:52:01,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:52:01,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 12:52:01,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:52:01,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ab611727ff69d6f27699 HTTP/1.1" 200 None 2026-03-17 12:52:01,222 - lava_callback - ERROR - Error processing callback for node 69b6ab611727ff69d6f27699: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53150 - "GET / HTTP/1.0" 200 OK 2026-03-17 12:53:04,325 - lava_callback - INFO - Received callback for node 69b6aba11727ff69d6f276a9 INFO: 172.20.0.1:33648 - "POST /node/69b6aba11727ff69d6f276a9 HTTP/1.0" 202 Accepted 2026-03-17 12:53:04,330 - lava_callback - INFO - Starting async job submit for node 69b6aba11727ff69d6f276a9 2026-03-17 12:53:04,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:53:04,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6aba11727ff69d6f276a9 HTTP/1.1" 200 None 2026-03-17 12:53:04,347 - lava_callback - DEBUG - Processing node 69b6aba11727ff69d6f276a9: baseline-arm-clabbe 2026-03-17 12:53:04,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6aba11727ff69d6f276a9 2026-03-17 12:53:04,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:53:04,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6aba11727ff69d6f276a9 HTTP/1.1" 200 None 2026-03-17 12:53:04,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:53:04,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 12:53:04,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:53:04,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6aba11727ff69d6f276a9 HTTP/1.1" 200 None 2026-03-17 12:53:04,429 - lava_callback - ERROR - Error processing callback for node 69b6aba11727ff69d6f276a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36768 - "GET / HTTP/1.0" 200 OK 2026-03-17 12:53:41,179 - lava_callback - INFO - Received callback for node 69b6abc61727ff69d6f276b6 INFO: 172.20.0.1:59962 - "POST /node/69b6abc61727ff69d6f276b6 HTTP/1.0" 202 Accepted 2026-03-17 12:53:41,185 - lava_callback - INFO - Starting async job submit for node 69b6abc61727ff69d6f276b6 2026-03-17 12:53:41,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:53:41,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6abc61727ff69d6f276b6 HTTP/1.1" 200 None 2026-03-17 12:53:41,201 - lava_callback - DEBUG - Processing node 69b6abc61727ff69d6f276b6: baseline-arm-baylibre 2026-03-17 12:53:41,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6abc61727ff69d6f276b6 2026-03-17 12:53:41,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:53:41,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6abc61727ff69d6f276b6 HTTP/1.1" 200 None 2026-03-17 12:53:41,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:53:41,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-17 12:53:41,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:53:41,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6abc61727ff69d6f276b6 HTTP/1.1" 200 None 2026-03-17 12:53:41,323 - lava_callback - ERROR - Error processing callback for node 69b6abc61727ff69d6f276b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58174 - "GET / HTTP/1.0" 200 OK 2026-03-17 12:54:24,365 - lava_callback - INFO - Received callback for node 69b6abef1727ff69d6f276c2 INFO: 172.20.0.1:57550 - "POST /node/69b6abef1727ff69d6f276c2 HTTP/1.0" 202 Accepted 2026-03-17 12:54:24,370 - lava_callback - INFO - Starting async job submit for node 69b6abef1727ff69d6f276c2 2026-03-17 12:54:24,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:54:24,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6abef1727ff69d6f276c2 HTTP/1.1" 200 None 2026-03-17 12:54:24,386 - lava_callback - DEBUG - Processing node 69b6abef1727ff69d6f276c2: baseline-arm-clabbe 2026-03-17 12:54:24,387 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6abef1727ff69d6f276c2 2026-03-17 12:54:24,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:54:24,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6abef1727ff69d6f276c2 HTTP/1.1" 200 None 2026-03-17 12:54:24,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:54:24,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 12:54:24,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:54:24,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6abef1727ff69d6f276c2 HTTP/1.1" 200 None 2026-03-17 12:54:24,445 - lava_callback - ERROR - Error processing callback for node 69b6abef1727ff69d6f276c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47800 - "GET / HTTP/1.0" 200 OK 2026-03-17 12:54:41,012 - lava_callback - INFO - Received callback for node 69b6ac0e1727ff69d6f276cc INFO: 172.20.0.1:57408 - "POST /node/69b6ac0e1727ff69d6f276cc HTTP/1.0" 202 Accepted 2026-03-17 12:54:41,018 - lava_callback - INFO - Starting async job submit for node 69b6ac0e1727ff69d6f276cc 2026-03-17 12:54:41,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:54:41,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ac0e1727ff69d6f276cc HTTP/1.1" 200 None 2026-03-17 12:54:41,036 - lava_callback - DEBUG - Processing node 69b6ac0e1727ff69d6f276cc: baseline-arm-baylibre 2026-03-17 12:54:41,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ac0e1727ff69d6f276cc 2026-03-17 12:54:41,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:54:41,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ac0e1727ff69d6f276cc HTTP/1.1" 200 None 2026-03-17 12:54:41,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:54:41,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-17 12:54:41,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:54:41,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ac0e1727ff69d6f276cc HTTP/1.1" 200 None 2026-03-17 12:54:41,126 - lava_callback - ERROR - Error processing callback for node 69b6ac0e1727ff69d6f276cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58558 - "GET / HTTP/1.0" 200 OK 2026-03-17 12:55:24,409 - lava_callback - INFO - Received callback for node 69b6ac371727ff69d6f276dc INFO: 172.20.0.1:33592 - "POST /node/69b6ac371727ff69d6f276dc HTTP/1.0" 202 Accepted 2026-03-17 12:55:24,415 - lava_callback - INFO - Starting async job submit for node 69b6ac371727ff69d6f276dc 2026-03-17 12:55:24,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:55:24,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ac371727ff69d6f276dc HTTP/1.1" 200 None 2026-03-17 12:55:24,435 - lava_callback - DEBUG - Processing node 69b6ac371727ff69d6f276dc: baseline-arm-clabbe 2026-03-17 12:55:24,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ac371727ff69d6f276dc 2026-03-17 12:55:24,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:55:24,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ac371727ff69d6f276dc HTTP/1.1" 200 None 2026-03-17 12:55:24,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:55:24,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 12:55:24,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:55:24,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ac371727ff69d6f276dc HTTP/1.1" 200 None 2026-03-17 12:55:24,492 - lava_callback - ERROR - Error processing callback for node 69b6ac371727ff69d6f276dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49880 - "GET / HTTP/1.0" 200 OK 2026-03-17 12:56:04,425 - lava_callback - INFO - Received callback for node 69b6ac5a1727ff69d6f276eb INFO: 172.20.0.1:60080 - "POST /node/69b6ac5a1727ff69d6f276eb HTTP/1.0" 202 Accepted 2026-03-17 12:56:04,431 - lava_callback - INFO - Starting async job submit for node 69b6ac5a1727ff69d6f276eb 2026-03-17 12:56:04,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:56:04,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ac5a1727ff69d6f276eb HTTP/1.1" 200 None 2026-03-17 12:56:04,510 - lava_callback - DEBUG - Processing node 69b6ac5a1727ff69d6f276eb: baseline-arm-clabbe 2026-03-17 12:56:04,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ac5a1727ff69d6f276eb 2026-03-17 12:56:04,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:56:04,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ac5a1727ff69d6f276eb HTTP/1.1" 200 None 2026-03-17 12:56:04,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:56:04,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 12:56:04,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:56:04,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ac5a1727ff69d6f276eb HTTP/1.1" 200 None 2026-03-17 12:56:04,573 - lava_callback - ERROR - Error processing callback for node 69b6ac5a1727ff69d6f276eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55832 - "GET / HTTP/1.0" 200 OK 2026-03-17 12:56:44,461 - lava_callback - INFO - Received callback for node 69b6ac7f1727ff69d6f276f8 INFO: 172.20.0.1:42772 - "POST /node/69b6ac7f1727ff69d6f276f8 HTTP/1.0" 202 Accepted 2026-03-17 12:56:44,466 - lava_callback - INFO - Starting async job submit for node 69b6ac7f1727ff69d6f276f8 2026-03-17 12:56:44,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:56:44,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ac7f1727ff69d6f276f8 HTTP/1.1" 200 None 2026-03-17 12:56:44,492 - lava_callback - DEBUG - Processing node 69b6ac7f1727ff69d6f276f8: baseline-arm-clabbe 2026-03-17 12:56:44,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ac7f1727ff69d6f276f8 2026-03-17 12:56:44,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:56:44,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ac7f1727ff69d6f276f8 HTTP/1.1" 200 None 2026-03-17 12:56:44,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:56:44,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 12:56:44,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:56:44,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ac7f1727ff69d6f276f8 HTTP/1.1" 200 None 2026-03-17 12:56:44,547 - lava_callback - ERROR - Error processing callback for node 69b6ac7f1727ff69d6f276f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48766 - "GET / HTTP/1.0" 200 OK 2026-03-17 12:57:21,776 - lava_callback - INFO - Received callback for node 69b6ac9e1727ff69d6f27705 INFO: 172.20.0.1:45322 - "POST /node/69b6ac9e1727ff69d6f27705 HTTP/1.0" 202 Accepted 2026-03-17 12:57:21,781 - lava_callback - INFO - Starting async job submit for node 69b6ac9e1727ff69d6f27705 2026-03-17 12:57:21,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:57:21,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ac9e1727ff69d6f27705 HTTP/1.1" 200 None 2026-03-17 12:57:21,797 - lava_callback - DEBUG - Processing node 69b6ac9e1727ff69d6f27705: baseline-arm-baylibre 2026-03-17 12:57:21,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ac9e1727ff69d6f27705 2026-03-17 12:57:21,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:57:21,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ac9e1727ff69d6f27705 HTTP/1.1" 200 None 2026-03-17 12:57:21,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:57:21,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 12:57:21,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:57:21,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ac9e1727ff69d6f27705 HTTP/1.1" 200 None 2026-03-17 12:57:21,849 - lava_callback - ERROR - Error processing callback for node 69b6ac9e1727ff69d6f27705: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35382 - "GET / HTTP/1.0" 200 OK 2026-03-17 12:57:41,178 - lava_callback - INFO - Received callback for node 69b6acc31727ff69d6f27711 INFO: 172.20.0.1:33778 - "POST /node/69b6acc31727ff69d6f27711 HTTP/1.0" 202 Accepted 2026-03-17 12:57:41,197 - lava_callback - INFO - Starting async job submit for node 69b6acc31727ff69d6f27711 2026-03-17 12:57:41,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:57:41,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6acc31727ff69d6f27711 HTTP/1.1" 200 None 2026-03-17 12:57:41,257 - lava_callback - DEBUG - Processing node 69b6acc31727ff69d6f27711: baseline-arm-baylibre 2026-03-17 12:57:41,257 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6acc31727ff69d6f27711 2026-03-17 12:57:41,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:57:41,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6acc31727ff69d6f27711 HTTP/1.1" 200 None 2026-03-17 12:57:41,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:57:41,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-17 12:57:41,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:57:41,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6acc31727ff69d6f27711 HTTP/1.1" 200 None 2026-03-17 12:57:41,348 - lava_callback - ERROR - Error processing callback for node 69b6acc31727ff69d6f27711: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56412 - "GET / HTTP/1.0" 200 OK 2026-03-17 12:58:21,209 - lava_callback - INFO - Received callback for node 69b6ace71727ff69d6f27722 INFO: 172.20.0.1:41744 - "POST /node/69b6ace71727ff69d6f27722 HTTP/1.0" 202 Accepted 2026-03-17 12:58:21,215 - lava_callback - INFO - Starting async job submit for node 69b6ace71727ff69d6f27722 2026-03-17 12:58:21,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:58:21,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ace71727ff69d6f27722 HTTP/1.1" 200 None 2026-03-17 12:58:21,241 - lava_callback - DEBUG - Processing node 69b6ace71727ff69d6f27722: baseline-arm-baylibre 2026-03-17 12:58:21,241 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ace71727ff69d6f27722 2026-03-17 12:58:21,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:58:21,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ace71727ff69d6f27722 HTTP/1.1" 200 None 2026-03-17 12:58:21,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:58:21,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-17 12:58:21,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:58:21,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ace71727ff69d6f27722 HTTP/1.1" 200 None 2026-03-17 12:58:21,310 - lava_callback - ERROR - Error processing callback for node 69b6ace71727ff69d6f27722: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51540 - "GET / HTTP/1.0" 200 OK 2026-03-17 12:59:04,563 - lava_callback - INFO - Received callback for node 69b6ad0d1727ff69d6f2772f INFO: 172.20.0.1:47448 - "POST /node/69b6ad0d1727ff69d6f2772f HTTP/1.0" 202 Accepted 2026-03-17 12:59:04,569 - lava_callback - INFO - Starting async job submit for node 69b6ad0d1727ff69d6f2772f 2026-03-17 12:59:04,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:59:04,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ad0d1727ff69d6f2772f HTTP/1.1" 200 None 2026-03-17 12:59:04,661 - lava_callback - DEBUG - Processing node 69b6ad0d1727ff69d6f2772f: baseline-arm-clabbe 2026-03-17 12:59:04,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ad0d1727ff69d6f2772f 2026-03-17 12:59:04,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:59:04,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ad0d1727ff69d6f2772f HTTP/1.1" 200 None 2026-03-17 12:59:04,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:59:04,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 12:59:04,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:59:04,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ad0d1727ff69d6f2772f HTTP/1.1" 200 None 2026-03-17 12:59:04,723 - lava_callback - ERROR - Error processing callback for node 69b6ad0d1727ff69d6f2772f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33462 - "GET / HTTP/1.0" 200 OK 2026-03-17 12:59:41,306 - lava_callback - INFO - Received callback for node 69b6ad2b1727ff69d6f2773a INFO: 172.20.0.1:53158 - "POST /node/69b6ad2b1727ff69d6f2773a HTTP/1.0" 202 Accepted 2026-03-17 12:59:41,311 - lava_callback - INFO - Starting async job submit for node 69b6ad2b1727ff69d6f2773a 2026-03-17 12:59:41,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:59:41,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ad2b1727ff69d6f2773a HTTP/1.1" 200 None 2026-03-17 12:59:41,327 - lava_callback - DEBUG - Processing node 69b6ad2b1727ff69d6f2773a: baseline-arm-baylibre 2026-03-17 12:59:41,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ad2b1727ff69d6f2773a 2026-03-17 12:59:41,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:59:41,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ad2b1727ff69d6f2773a HTTP/1.1" 200 None 2026-03-17 12:59:41,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:59:41,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 12:59:41,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 12:59:41,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ad2b1727ff69d6f2773a HTTP/1.1" 200 None 2026-03-17 12:59:41,386 - lava_callback - ERROR - Error processing callback for node 69b6ad2b1727ff69d6f2773a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59330 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:00:24,524 - lava_callback - INFO - Received callback for node 69b6ad531727ff69d6f27745 INFO: 172.20.0.1:37888 - "POST /node/69b6ad531727ff69d6f27745 HTTP/1.0" 202 Accepted 2026-03-17 13:00:24,530 - lava_callback - INFO - Starting async job submit for node 69b6ad531727ff69d6f27745 2026-03-17 13:00:24,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:00:24,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ad531727ff69d6f27745 HTTP/1.1" 200 None 2026-03-17 13:00:24,545 - lava_callback - DEBUG - Processing node 69b6ad531727ff69d6f27745: baseline-arm-clabbe 2026-03-17 13:00:24,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ad531727ff69d6f27745 2026-03-17 13:00:24,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:00:24,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ad531727ff69d6f27745 HTTP/1.1" 200 None 2026-03-17 13:00:24,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:00:24,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-17 13:00:24,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:00:24,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ad531727ff69d6f27745 HTTP/1.1" 200 None 2026-03-17 13:00:24,608 - lava_callback - ERROR - Error processing callback for node 69b6ad531727ff69d6f27745: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41278 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:00:44,599 - lava_callback - INFO - Received callback for node 69b6ad771727ff69d6f27750 INFO: 172.20.0.1:51360 - "POST /node/69b6ad771727ff69d6f27750 HTTP/1.0" 202 Accepted 2026-03-17 13:00:44,604 - lava_callback - INFO - Starting async job submit for node 69b6ad771727ff69d6f27750 2026-03-17 13:00:44,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:00:44,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ad771727ff69d6f27750 HTTP/1.1" 200 None 2026-03-17 13:00:44,624 - lava_callback - DEBUG - Processing node 69b6ad771727ff69d6f27750: baseline-arm-clabbe 2026-03-17 13:00:44,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ad771727ff69d6f27750 2026-03-17 13:00:44,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:00:44,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ad771727ff69d6f27750 HTTP/1.1" 200 None 2026-03-17 13:00:44,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:00:44,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 13:00:44,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:00:44,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ad771727ff69d6f27750 HTTP/1.1" 200 None 2026-03-17 13:00:44,689 - lava_callback - ERROR - Error processing callback for node 69b6ad771727ff69d6f27750: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46274 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:01:24,637 - lava_callback - INFO - Received callback for node 69b6ad9c1727ff69d6f2775a INFO: 172.20.0.1:38012 - "POST /node/69b6ad9c1727ff69d6f2775a HTTP/1.0" 202 Accepted 2026-03-17 13:01:24,642 - lava_callback - INFO - Starting async job submit for node 69b6ad9c1727ff69d6f2775a 2026-03-17 13:01:24,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:01:24,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ad9c1727ff69d6f2775a HTTP/1.1" 200 None 2026-03-17 13:01:24,658 - lava_callback - DEBUG - Processing node 69b6ad9c1727ff69d6f2775a: baseline-arm-clabbe 2026-03-17 13:01:24,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ad9c1727ff69d6f2775a 2026-03-17 13:01:24,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:01:24,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ad9c1727ff69d6f2775a HTTP/1.1" 200 None 2026-03-17 13:01:24,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:01:24,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 13:01:24,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:01:24,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ad9c1727ff69d6f2775a HTTP/1.1" 200 None 2026-03-17 13:01:24,714 - lava_callback - ERROR - Error processing callback for node 69b6ad9c1727ff69d6f2775a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40286 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:02:01,419 - lava_callback - INFO - Received callback for node 69b6adbe1727ff69d6f27764 INFO: 172.20.0.1:59272 - "POST /node/69b6adbe1727ff69d6f27764 HTTP/1.0" 202 Accepted 2026-03-17 13:02:01,425 - lava_callback - INFO - Starting async job submit for node 69b6adbe1727ff69d6f27764 2026-03-17 13:02:01,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:02:01,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6adbe1727ff69d6f27764 HTTP/1.1" 200 None 2026-03-17 13:02:01,449 - lava_callback - DEBUG - Processing node 69b6adbe1727ff69d6f27764: baseline-arm-baylibre 2026-03-17 13:02:01,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6adbe1727ff69d6f27764 2026-03-17 13:02:01,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:02:01,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6adbe1727ff69d6f27764 HTTP/1.1" 200 None 2026-03-17 13:02:01,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:02:01,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-17 13:02:01,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:02:01,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6adbe1727ff69d6f27764 HTTP/1.1" 200 None 2026-03-17 13:02:01,504 - lava_callback - ERROR - Error processing callback for node 69b6adbe1727ff69d6f27764: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39052 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:02:44,715 - lava_callback - INFO - Received callback for node 69b6ade31727ff69d6f2776f INFO: 172.20.0.1:39080 - "POST /node/69b6ade31727ff69d6f2776f HTTP/1.0" 202 Accepted 2026-03-17 13:02:44,721 - lava_callback - INFO - Starting async job submit for node 69b6ade31727ff69d6f2776f 2026-03-17 13:02:44,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:02:44,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ade31727ff69d6f2776f HTTP/1.1" 200 None 2026-03-17 13:02:44,737 - lava_callback - DEBUG - Processing node 69b6ade31727ff69d6f2776f: baseline-arm-clabbe 2026-03-17 13:02:44,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ade31727ff69d6f2776f 2026-03-17 13:02:44,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:02:44,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ade31727ff69d6f2776f HTTP/1.1" 200 None 2026-03-17 13:02:44,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:02:44,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 13:02:44,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:02:44,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ade31727ff69d6f2776f HTTP/1.1" 200 None 2026-03-17 13:02:44,808 - lava_callback - ERROR - Error processing callback for node 69b6ade31727ff69d6f2776f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56594 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:03:24,811 - lava_callback - INFO - Received callback for node 69b6ae071727ff69d6f2777a INFO: 172.20.0.1:36286 - "POST /node/69b6ae071727ff69d6f2777a HTTP/1.0" 202 Accepted 2026-03-17 13:03:24,816 - lava_callback - INFO - Starting async job submit for node 69b6ae071727ff69d6f2777a 2026-03-17 13:03:24,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:03:24,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ae071727ff69d6f2777a HTTP/1.1" 200 None 2026-03-17 13:03:24,832 - lava_callback - DEBUG - Processing node 69b6ae071727ff69d6f2777a: baseline-arm-clabbe 2026-03-17 13:03:24,832 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ae071727ff69d6f2777a 2026-03-17 13:03:24,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:03:24,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ae071727ff69d6f2777a HTTP/1.1" 200 None 2026-03-17 13:03:24,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:03:24,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 13:03:24,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:03:24,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ae071727ff69d6f2777a HTTP/1.1" 200 None 2026-03-17 13:03:24,984 - lava_callback - ERROR - Error processing callback for node 69b6ae071727ff69d6f2777a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59916 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:03:44,752 - lava_callback - INFO - Received callback for node 69b6ae2a1727ff69d6f27785 INFO: 172.20.0.1:59148 - "POST /node/69b6ae2a1727ff69d6f27785 HTTP/1.0" 202 Accepted 2026-03-17 13:03:44,758 - lava_callback - INFO - Starting async job submit for node 69b6ae2a1727ff69d6f27785 2026-03-17 13:03:44,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:03:44,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ae2a1727ff69d6f27785 HTTP/1.1" 200 None 2026-03-17 13:03:44,775 - lava_callback - DEBUG - Processing node 69b6ae2a1727ff69d6f27785: baseline-arm-clabbe 2026-03-17 13:03:44,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ae2a1727ff69d6f27785 2026-03-17 13:03:44,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:03:44,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ae2a1727ff69d6f27785 HTTP/1.1" 200 None 2026-03-17 13:03:44,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:03:44,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 13:03:44,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:03:44,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ae2a1727ff69d6f27785 HTTP/1.1" 200 None 2026-03-17 13:03:44,836 - lava_callback - ERROR - Error processing callback for node 69b6ae2a1727ff69d6f27785: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58138 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:04:24,751 - lava_callback - INFO - Received callback for node 69b6ae4f1727ff69d6f27792 INFO: 172.20.0.1:44070 - "POST /node/69b6ae4f1727ff69d6f27792 HTTP/1.0" 202 Accepted 2026-03-17 13:04:24,757 - lava_callback - INFO - Starting async job submit for node 69b6ae4f1727ff69d6f27792 2026-03-17 13:04:24,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:04:24,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ae4f1727ff69d6f27792 HTTP/1.1" 200 None 2026-03-17 13:04:24,839 - lava_callback - DEBUG - Processing node 69b6ae4f1727ff69d6f27792: baseline-arm-clabbe 2026-03-17 13:04:24,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ae4f1727ff69d6f27792 2026-03-17 13:04:24,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:04:24,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ae4f1727ff69d6f27792 HTTP/1.1" 200 None 2026-03-17 13:04:24,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:04:24,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-17 13:04:24,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:04:24,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ae4f1727ff69d6f27792 HTTP/1.1" 200 None 2026-03-17 13:04:24,899 - lava_callback - ERROR - Error processing callback for node 69b6ae4f1727ff69d6f27792: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51046 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:05:04,846 - lava_callback - INFO - Received callback for node 69b6ae731727ff69d6f2779b INFO: 172.20.0.1:33456 - "POST /node/69b6ae731727ff69d6f2779b HTTP/1.0" 202 Accepted 2026-03-17 13:05:04,852 - lava_callback - INFO - Starting async job submit for node 69b6ae731727ff69d6f2779b 2026-03-17 13:05:04,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:05:04,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ae731727ff69d6f2779b HTTP/1.1" 200 None 2026-03-17 13:05:04,868 - lava_callback - DEBUG - Processing node 69b6ae731727ff69d6f2779b: baseline-arm-clabbe 2026-03-17 13:05:04,869 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ae731727ff69d6f2779b 2026-03-17 13:05:04,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:05:04,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ae731727ff69d6f2779b HTTP/1.1" 200 None 2026-03-17 13:05:04,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:05:04,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-17 13:05:04,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:05:04,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ae731727ff69d6f2779b HTTP/1.1" 200 None 2026-03-17 13:05:04,998 - lava_callback - ERROR - Error processing callback for node 69b6ae731727ff69d6f2779b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46904 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:05:44,780 - lava_callback - INFO - Received callback for node 69b6ae971727ff69d6f277a6 INFO: 172.20.0.1:51352 - "POST /node/69b6ae971727ff69d6f277a6 HTTP/1.0" 202 Accepted 2026-03-17 13:05:44,786 - lava_callback - INFO - Starting async job submit for node 69b6ae971727ff69d6f277a6 2026-03-17 13:05:44,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:05:44,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ae971727ff69d6f277a6 HTTP/1.1" 200 None 2026-03-17 13:05:44,802 - lava_callback - DEBUG - Processing node 69b6ae971727ff69d6f277a6: baseline-arm-clabbe 2026-03-17 13:05:44,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ae971727ff69d6f277a6 2026-03-17 13:05:44,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:05:44,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ae971727ff69d6f277a6 HTTP/1.1" 200 None 2026-03-17 13:05:44,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:05:44,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 13:05:44,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:05:44,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ae971727ff69d6f277a6 HTTP/1.1" 200 None 2026-03-17 13:05:44,857 - lava_callback - ERROR - Error processing callback for node 69b6ae971727ff69d6f277a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56144 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:06:24,851 - lava_callback - INFO - Received callback for node 69b6aebc1727ff69d6f277af INFO: 172.20.0.1:37666 - "POST /node/69b6aebc1727ff69d6f277af HTTP/1.0" 202 Accepted 2026-03-17 13:06:24,856 - lava_callback - INFO - Starting async job submit for node 69b6aebc1727ff69d6f277af 2026-03-17 13:06:24,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:06:24,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6aebc1727ff69d6f277af HTTP/1.1" 200 None 2026-03-17 13:06:24,873 - lava_callback - DEBUG - Processing node 69b6aebc1727ff69d6f277af: baseline-arm-clabbe 2026-03-17 13:06:24,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6aebc1727ff69d6f277af 2026-03-17 13:06:24,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:06:24,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6aebc1727ff69d6f277af HTTP/1.1" 200 None 2026-03-17 13:06:24,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:06:24,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-17 13:06:24,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:06:24,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6aebc1727ff69d6f277af HTTP/1.1" 200 None 2026-03-17 13:06:24,951 - lava_callback - ERROR - Error processing callback for node 69b6aebc1727ff69d6f277af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33636 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:06:44,811 - lava_callback - INFO - Received callback for node 69b6aee01727ff69d6f277ba INFO: 172.20.0.1:34130 - "POST /node/69b6aee01727ff69d6f277ba HTTP/1.0" 202 Accepted 2026-03-17 13:06:44,817 - lava_callback - INFO - Starting async job submit for node 69b6aee01727ff69d6f277ba 2026-03-17 13:06:44,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:06:44,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6aee01727ff69d6f277ba HTTP/1.1" 200 None 2026-03-17 13:06:44,834 - lava_callback - DEBUG - Processing node 69b6aee01727ff69d6f277ba: baseline-arm-clabbe 2026-03-17 13:06:44,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6aee01727ff69d6f277ba 2026-03-17 13:06:44,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:06:44,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6aee01727ff69d6f277ba HTTP/1.1" 200 None 2026-03-17 13:06:44,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:06:44,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-17 13:06:44,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:06:44,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6aee01727ff69d6f277ba HTTP/1.1" 200 None 2026-03-17 13:06:44,887 - lava_callback - ERROR - Error processing callback for node 69b6aee01727ff69d6f277ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59996 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:07:24,914 - lava_callback - INFO - Received callback for node 69b6af041727ff69d6f277c2 INFO: 172.20.0.1:46710 - "POST /node/69b6af041727ff69d6f277c2 HTTP/1.0" 202 Accepted 2026-03-17 13:07:24,920 - lava_callback - INFO - Starting async job submit for node 69b6af041727ff69d6f277c2 2026-03-17 13:07:24,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:07:24,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6af041727ff69d6f277c2 HTTP/1.1" 200 None 2026-03-17 13:07:24,936 - lava_callback - DEBUG - Processing node 69b6af041727ff69d6f277c2: baseline-arm-clabbe 2026-03-17 13:07:24,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6af041727ff69d6f277c2 2026-03-17 13:07:24,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:07:24,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6af041727ff69d6f277c2 HTTP/1.1" 200 None 2026-03-17 13:07:24,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:07:25,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 13:07:25,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:07:25,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6af041727ff69d6f277c2 HTTP/1.1" 200 None 2026-03-17 13:07:25,071 - lava_callback - ERROR - Error processing callback for node 69b6af041727ff69d6f277c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47288 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:08:04,888 - lava_callback - INFO - Received callback for node 69b6af271727ff69d6f277cb INFO: 172.20.0.1:49532 - "POST /node/69b6af271727ff69d6f277cb HTTP/1.0" 202 Accepted 2026-03-17 13:08:04,893 - lava_callback - INFO - Starting async job submit for node 69b6af271727ff69d6f277cb 2026-03-17 13:08:04,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:08:04,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6af271727ff69d6f277cb HTTP/1.1" 200 None 2026-03-17 13:08:04,913 - lava_callback - DEBUG - Processing node 69b6af271727ff69d6f277cb: baseline-arm-clabbe 2026-03-17 13:08:04,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6af271727ff69d6f277cb 2026-03-17 13:08:04,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:08:04,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6af271727ff69d6f277cb HTTP/1.1" 200 None 2026-03-17 13:08:04,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:08:04,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 13:08:04,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:08:04,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6af271727ff69d6f277cb HTTP/1.1" 200 None 2026-03-17 13:08:04,980 - lava_callback - ERROR - Error processing callback for node 69b6af271727ff69d6f277cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53954 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:08:44,964 - lava_callback - INFO - Received callback for node 69b6af4c1727ff69d6f277d5 INFO: 172.20.0.1:58300 - "POST /node/69b6af4c1727ff69d6f277d5 HTTP/1.0" 202 Accepted 2026-03-17 13:08:44,969 - lava_callback - INFO - Starting async job submit for node 69b6af4c1727ff69d6f277d5 2026-03-17 13:08:44,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:08:44,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6af4c1727ff69d6f277d5 HTTP/1.1" 200 None 2026-03-17 13:08:44,997 - lava_callback - DEBUG - Processing node 69b6af4c1727ff69d6f277d5: baseline-arm-clabbe 2026-03-17 13:08:44,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6af4c1727ff69d6f277d5 2026-03-17 13:08:44,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:08:45,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6af4c1727ff69d6f277d5 HTTP/1.1" 200 None 2026-03-17 13:08:45,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:08:45,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 13:08:45,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:08:45,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6af4c1727ff69d6f277d5 HTTP/1.1" 200 None 2026-03-17 13:08:45,070 - lava_callback - ERROR - Error processing callback for node 69b6af4c1727ff69d6f277d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44530 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:11:01,905 - lava_callback - INFO - Received callback for node 69b6afe11727ff69d6f277e2 INFO: 172.20.0.1:38946 - "POST /node/69b6afe11727ff69d6f277e2 HTTP/1.0" 202 Accepted 2026-03-17 13:11:01,911 - lava_callback - INFO - Starting async job submit for node 69b6afe11727ff69d6f277e2 2026-03-17 13:11:01,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:11:01,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6afe11727ff69d6f277e2 HTTP/1.1" 200 None 2026-03-17 13:11:01,932 - lava_callback - DEBUG - Processing node 69b6afe11727ff69d6f277e2: baseline-arm64-baylibre 2026-03-17 13:11:01,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6afe11727ff69d6f277e2 2026-03-17 13:11:01,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:11:01,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6afe11727ff69d6f277e2 HTTP/1.1" 200 None 2026-03-17 13:11:01,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:11:01,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:11:01,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:11:02,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6afe11727ff69d6f277e2 HTTP/1.1" 200 None 2026-03-17 13:11:02,051 - lava_callback - ERROR - Error processing callback for node 69b6afe11727ff69d6f277e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34162 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:13:02,414 - lava_callback - INFO - Received callback for node 69b6b05a1727ff69d6f277ed INFO: 172.20.0.1:56326 - "POST /node/69b6b05a1727ff69d6f277ed HTTP/1.0" 202 Accepted 2026-03-17 13:13:02,420 - lava_callback - INFO - Starting async job submit for node 69b6b05a1727ff69d6f277ed 2026-03-17 13:13:02,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:13:02,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b05a1727ff69d6f277ed HTTP/1.1" 200 None 2026-03-17 13:13:02,438 - lava_callback - DEBUG - Processing node 69b6b05a1727ff69d6f277ed: baseline-arm64-baylibre 2026-03-17 13:13:02,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b05a1727ff69d6f277ed 2026-03-17 13:13:02,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:13:02,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b05a1727ff69d6f277ed HTTP/1.1" 200 None 2026-03-17 13:13:02,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:13:02,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:13:02,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:13:02,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b05a1727ff69d6f277ed HTTP/1.1" 200 None 2026-03-17 13:13:02,505 - lava_callback - ERROR - Error processing callback for node 69b6b05a1727ff69d6f277ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45186 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:14:22,176 - lava_callback - INFO - Received callback for node 69b6b0a41727ff69d6f277fe INFO: 172.20.0.1:35196 - "POST /node/69b6b0a41727ff69d6f277fe HTTP/1.0" 202 Accepted 2026-03-17 13:14:22,182 - lava_callback - INFO - Starting async job submit for node 69b6b0a41727ff69d6f277fe 2026-03-17 13:14:22,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:14:22,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b0a41727ff69d6f277fe HTTP/1.1" 200 None 2026-03-17 13:14:22,208 - lava_callback - DEBUG - Processing node 69b6b0a41727ff69d6f277fe: baseline-arm64-baylibre 2026-03-17 13:14:22,209 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b0a41727ff69d6f277fe 2026-03-17 13:14:22,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:14:22,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b0a41727ff69d6f277fe HTTP/1.1" 200 None 2026-03-17 13:14:22,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:14:22,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:14:22,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:14:22,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b0a41727ff69d6f277fe HTTP/1.1" 200 None 2026-03-17 13:14:22,331 - lava_callback - ERROR - Error processing callback for node 69b6b0a41727ff69d6f277fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41484 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:18:25,371 - lava_callback - INFO - Received callback for node 69b6b18d1727ff69d6f2780a INFO: 172.20.0.1:60820 - "POST /node/69b6b18d1727ff69d6f2780a HTTP/1.0" 202 Accepted 2026-03-17 13:18:25,377 - lava_callback - INFO - Starting async job submit for node 69b6b18d1727ff69d6f2780a 2026-03-17 13:18:25,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:18:25,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b18d1727ff69d6f2780a HTTP/1.1" 200 None 2026-03-17 13:18:25,393 - lava_callback - DEBUG - Processing node 69b6b18d1727ff69d6f2780a: baseline-arm64-clabbe 2026-03-17 13:18:25,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b18d1727ff69d6f2780a 2026-03-17 13:18:25,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:18:25,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b18d1727ff69d6f2780a HTTP/1.1" 200 None 2026-03-17 13:18:25,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:18:25,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:18:25,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:18:25,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b18d1727ff69d6f2780a HTTP/1.1" 200 None 2026-03-17 13:18:25,445 - lava_callback - ERROR - Error processing callback for node 69b6b18d1727ff69d6f2780a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37606 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:19:25,435 - lava_callback - INFO - Received callback for node 69b6b1d81727ff69d6f2781a INFO: 172.20.0.1:41556 - "POST /node/69b6b1d81727ff69d6f2781a HTTP/1.0" 202 Accepted 2026-03-17 13:19:25,441 - lava_callback - INFO - Starting async job submit for node 69b6b1d81727ff69d6f2781a 2026-03-17 13:19:25,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:19:25,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b1d81727ff69d6f2781a HTTP/1.1" 200 None 2026-03-17 13:19:25,457 - lava_callback - DEBUG - Processing node 69b6b1d81727ff69d6f2781a: baseline-arm64-clabbe 2026-03-17 13:19:25,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b1d81727ff69d6f2781a 2026-03-17 13:19:25,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:19:25,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b1d81727ff69d6f2781a HTTP/1.1" 200 None 2026-03-17 13:19:25,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:19:25,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:19:25,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:19:25,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b1d81727ff69d6f2781a HTTP/1.1" 200 None 2026-03-17 13:19:25,762 - lava_callback - ERROR - Error processing callback for node 69b6b1d81727ff69d6f2781a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38998 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:20:45,431 - lava_callback - INFO - Received callback for node 69b6b2241727ff69d6f27823 INFO: 172.20.0.1:33892 - "POST /node/69b6b2241727ff69d6f27823 HTTP/1.0" 202 Accepted 2026-03-17 13:20:45,437 - lava_callback - INFO - Starting async job submit for node 69b6b2241727ff69d6f27823 2026-03-17 13:20:45,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:20:45,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b2241727ff69d6f27823 HTTP/1.1" 200 None 2026-03-17 13:20:45,455 - lava_callback - DEBUG - Processing node 69b6b2241727ff69d6f27823: baseline-arm64-clabbe 2026-03-17 13:20:45,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b2241727ff69d6f27823 2026-03-17 13:20:45,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:20:45,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b2241727ff69d6f27823 HTTP/1.1" 200 None 2026-03-17 13:20:45,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:20:45,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:20:45,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:20:45,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b2241727ff69d6f27823 HTTP/1.1" 200 None 2026-03-17 13:20:45,515 - lava_callback - ERROR - Error processing callback for node 69b6b2241727ff69d6f27823: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42562 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:22:05,506 - lava_callback - INFO - Received callback for node 69b6b2701727ff69d6f27830 INFO: 172.20.0.1:48346 - "POST /node/69b6b2701727ff69d6f27830 HTTP/1.0" 202 Accepted 2026-03-17 13:22:05,511 - lava_callback - INFO - Starting async job submit for node 69b6b2701727ff69d6f27830 2026-03-17 13:22:05,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:22:05,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b2701727ff69d6f27830 HTTP/1.1" 200 None 2026-03-17 13:22:05,544 - lava_callback - DEBUG - Processing node 69b6b2701727ff69d6f27830: baseline-arm64-clabbe 2026-03-17 13:22:05,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b2701727ff69d6f27830 2026-03-17 13:22:05,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:22:05,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b2701727ff69d6f27830 HTTP/1.1" 200 None 2026-03-17 13:22:05,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:22:05,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:22:05,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:22:05,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b2701727ff69d6f27830 HTTP/1.1" 200 None 2026-03-17 13:22:05,602 - lava_callback - ERROR - Error processing callback for node 69b6b2701727ff69d6f27830: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55744 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:23:25,566 - lava_callback - INFO - Received callback for node 69b6b2bb1727ff69d6f2783a INFO: 172.20.0.1:45264 - "POST /node/69b6b2bb1727ff69d6f2783a HTTP/1.0" 202 Accepted 2026-03-17 13:23:25,572 - lava_callback - INFO - Starting async job submit for node 69b6b2bb1727ff69d6f2783a 2026-03-17 13:23:25,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:23:25,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b2bb1727ff69d6f2783a HTTP/1.1" 200 None 2026-03-17 13:23:25,588 - lava_callback - DEBUG - Processing node 69b6b2bb1727ff69d6f2783a: baseline-arm64-clabbe 2026-03-17 13:23:25,588 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b2bb1727ff69d6f2783a 2026-03-17 13:23:25,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:23:25,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b2bb1727ff69d6f2783a HTTP/1.1" 200 None 2026-03-17 13:23:25,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:23:25,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:23:25,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:23:25,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b2bb1727ff69d6f2783a HTTP/1.1" 200 None 2026-03-17 13:23:25,644 - lava_callback - ERROR - Error processing callback for node 69b6b2bb1727ff69d6f2783a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40350 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:24:25,599 - lava_callback - INFO - Received callback for node 69b6b3071727ff69d6f27849 INFO: 172.20.0.1:56122 - "POST /node/69b6b3071727ff69d6f27849 HTTP/1.0" 202 Accepted 2026-03-17 13:24:25,605 - lava_callback - INFO - Starting async job submit for node 69b6b3071727ff69d6f27849 2026-03-17 13:24:25,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:24:25,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b3071727ff69d6f27849 HTTP/1.1" 200 None 2026-03-17 13:24:25,621 - lava_callback - DEBUG - Processing node 69b6b3071727ff69d6f27849: baseline-arm64-clabbe 2026-03-17 13:24:25,621 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b3071727ff69d6f27849 2026-03-17 13:24:25,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:24:25,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b3071727ff69d6f27849 HTTP/1.1" 200 None 2026-03-17 13:24:25,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:24:25,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:24:25,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:24:25,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b3071727ff69d6f27849 HTTP/1.1" 200 None 2026-03-17 13:24:25,676 - lava_callback - ERROR - Error processing callback for node 69b6b3071727ff69d6f27849: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42528 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:25:42,786 - lava_callback - INFO - Received callback for node 69b6b34c1727ff69d6f27853 INFO: 172.20.0.1:43090 - "POST /node/69b6b34c1727ff69d6f27853 HTTP/1.0" 202 Accepted 2026-03-17 13:25:42,791 - lava_callback - INFO - Starting async job submit for node 69b6b34c1727ff69d6f27853 2026-03-17 13:25:42,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:25:42,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b34c1727ff69d6f27853 HTTP/1.1" 200 None 2026-03-17 13:25:42,809 - lava_callback - DEBUG - Processing node 69b6b34c1727ff69d6f27853: baseline-arm64-baylibre 2026-03-17 13:25:42,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b34c1727ff69d6f27853 2026-03-17 13:25:42,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:25:42,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b34c1727ff69d6f27853 HTTP/1.1" 200 None 2026-03-17 13:25:42,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:25:42,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:25:42,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:25:42,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b34c1727ff69d6f27853 HTTP/1.1" 200 None 2026-03-17 13:25:42,889 - lava_callback - ERROR - Error processing callback for node 69b6b34c1727ff69d6f27853: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37914 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:27:02,832 - lava_callback - INFO - Received callback for node 69b6b3931727ff69d6f27860 INFO: 172.20.0.1:47486 - "POST /node/69b6b3931727ff69d6f27860 HTTP/1.0" 202 Accepted 2026-03-17 13:27:02,837 - lava_callback - INFO - Starting async job submit for node 69b6b3931727ff69d6f27860 2026-03-17 13:27:02,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:27:02,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b3931727ff69d6f27860 HTTP/1.1" 200 None 2026-03-17 13:27:02,854 - lava_callback - DEBUG - Processing node 69b6b3931727ff69d6f27860: baseline-arm64-baylibre 2026-03-17 13:27:02,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b3931727ff69d6f27860 2026-03-17 13:27:02,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:27:02,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b3931727ff69d6f27860 HTTP/1.1" 200 None 2026-03-17 13:27:02,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:27:02,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-17 13:27:02,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:27:02,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b3931727ff69d6f27860 HTTP/1.1" 200 None 2026-03-17 13:27:02,974 - lava_callback - ERROR - Error processing callback for node 69b6b3931727ff69d6f27860: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35830 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:28:02,836 - lava_callback - INFO - Received callback for node 69b6b3df1727ff69d6f2786a INFO: 172.20.0.1:46744 - "POST /node/69b6b3df1727ff69d6f2786a HTTP/1.0" 202 Accepted 2026-03-17 13:28:02,842 - lava_callback - INFO - Starting async job submit for node 69b6b3df1727ff69d6f2786a 2026-03-17 13:28:02,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:28:02,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b3df1727ff69d6f2786a HTTP/1.1" 200 None 2026-03-17 13:28:02,860 - lava_callback - DEBUG - Processing node 69b6b3df1727ff69d6f2786a: baseline-arm64-baylibre 2026-03-17 13:28:02,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b3df1727ff69d6f2786a 2026-03-17 13:28:02,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:28:02,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b3df1727ff69d6f2786a HTTP/1.1" 200 None 2026-03-17 13:28:02,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:28:02,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:28:02,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:28:02,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b3df1727ff69d6f2786a HTTP/1.1" 200 None 2026-03-17 13:28:02,929 - lava_callback - ERROR - Error processing callback for node 69b6b3df1727ff69d6f2786a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39236 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:29:22,947 - lava_callback - INFO - Received callback for node 69b6b4281727ff69d6f27879 INFO: 172.20.0.1:60294 - "POST /node/69b6b4281727ff69d6f27879 HTTP/1.0" 202 Accepted 2026-03-17 13:29:22,953 - lava_callback - INFO - Starting async job submit for node 69b6b4281727ff69d6f27879 2026-03-17 13:29:22,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:29:22,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b4281727ff69d6f27879 HTTP/1.1" 200 None 2026-03-17 13:29:22,975 - lava_callback - DEBUG - Processing node 69b6b4281727ff69d6f27879: baseline-arm64-baylibre 2026-03-17 13:29:22,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b4281727ff69d6f27879 2026-03-17 13:29:22,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:29:22,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b4281727ff69d6f27879 HTTP/1.1" 200 None 2026-03-17 13:29:22,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:29:23,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:29:23,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:29:23,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b4281727ff69d6f27879 HTTP/1.1" 200 None 2026-03-17 13:29:23,026 - lava_callback - ERROR - Error processing callback for node 69b6b4281727ff69d6f27879: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47778 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:30:42,987 - lava_callback - INFO - Received callback for node 69b6b4701727ff69d6f27883 INFO: 172.20.0.1:44418 - "POST /node/69b6b4701727ff69d6f27883 HTTP/1.0" 202 Accepted 2026-03-17 13:30:42,992 - lava_callback - INFO - Starting async job submit for node 69b6b4701727ff69d6f27883 2026-03-17 13:30:42,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:30:43,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b4701727ff69d6f27883 HTTP/1.1" 200 None 2026-03-17 13:30:43,009 - lava_callback - DEBUG - Processing node 69b6b4701727ff69d6f27883: baseline-arm64-baylibre 2026-03-17 13:30:43,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b4701727ff69d6f27883 2026-03-17 13:30:43,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:30:43,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b4701727ff69d6f27883 HTTP/1.1" 200 None 2026-03-17 13:30:43,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:30:43,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-17 13:30:43,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:30:43,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b4701727ff69d6f27883 HTTP/1.1" 200 None 2026-03-17 13:30:43,070 - lava_callback - ERROR - Error processing callback for node 69b6b4701727ff69d6f27883: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40786 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:32:03,085 - lava_callback - INFO - Received callback for node 69b6b4c01727ff69d6f27892 INFO: 172.20.0.1:40606 - "POST /node/69b6b4c01727ff69d6f27892 HTTP/1.0" 202 Accepted 2026-03-17 13:32:03,091 - lava_callback - INFO - Starting async job submit for node 69b6b4c01727ff69d6f27892 2026-03-17 13:32:03,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:32:03,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b4c01727ff69d6f27892 HTTP/1.1" 200 None 2026-03-17 13:32:03,107 - lava_callback - DEBUG - Processing node 69b6b4c01727ff69d6f27892: baseline-arm64-baylibre 2026-03-17 13:32:03,107 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b4c01727ff69d6f27892 2026-03-17 13:32:03,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:32:03,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b4c01727ff69d6f27892 HTTP/1.1" 200 None 2026-03-17 13:32:03,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:32:03,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:32:03,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:32:03,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b4c01727ff69d6f27892 HTTP/1.1" 200 None 2026-03-17 13:32:03,183 - lava_callback - ERROR - Error processing callback for node 69b6b4c01727ff69d6f27892: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38920 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:33:03,105 - lava_callback - INFO - Received callback for node 69b6b50b1727ff69d6f2789a INFO: 172.20.0.1:49540 - "POST /node/69b6b50b1727ff69d6f2789a HTTP/1.0" 202 Accepted 2026-03-17 13:33:03,111 - lava_callback - INFO - Starting async job submit for node 69b6b50b1727ff69d6f2789a 2026-03-17 13:33:03,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:33:03,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b50b1727ff69d6f2789a HTTP/1.1" 200 None 2026-03-17 13:33:03,127 - lava_callback - DEBUG - Processing node 69b6b50b1727ff69d6f2789a: baseline-arm64-baylibre 2026-03-17 13:33:03,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b50b1727ff69d6f2789a 2026-03-17 13:33:03,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:33:03,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b50b1727ff69d6f2789a HTTP/1.1" 200 None 2026-03-17 13:33:03,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:33:03,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:33:03,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:33:03,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b50b1727ff69d6f2789a HTTP/1.1" 200 None 2026-03-17 13:33:03,190 - lava_callback - ERROR - Error processing callback for node 69b6b50b1727ff69d6f2789a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43640 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:34:23,189 - lava_callback - INFO - Received callback for node 69b6b5521727ff69d6f278a6 INFO: 172.20.0.1:43808 - "POST /node/69b6b5521727ff69d6f278a6 HTTP/1.0" 202 Accepted 2026-03-17 13:34:23,194 - lava_callback - INFO - Starting async job submit for node 69b6b5521727ff69d6f278a6 2026-03-17 13:34:23,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:34:23,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b5521727ff69d6f278a6 HTTP/1.1" 200 None 2026-03-17 13:34:23,210 - lava_callback - DEBUG - Processing node 69b6b5521727ff69d6f278a6: baseline-arm64-baylibre 2026-03-17 13:34:23,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b5521727ff69d6f278a6 2026-03-17 13:34:23,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:34:23,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b5521727ff69d6f278a6 HTTP/1.1" 200 None 2026-03-17 13:34:23,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:34:23,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-17 13:34:23,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:34:23,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b5521727ff69d6f278a6 HTTP/1.1" 200 None 2026-03-17 13:34:23,269 - lava_callback - ERROR - Error processing callback for node 69b6b5521727ff69d6f278a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37196 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:35:43,285 - lava_callback - INFO - Received callback for node 69b6b59c1727ff69d6f278b2 INFO: 172.20.0.1:44926 - "POST /node/69b6b59c1727ff69d6f278b2 HTTP/1.0" 202 Accepted 2026-03-17 13:35:43,290 - lava_callback - INFO - Starting async job submit for node 69b6b59c1727ff69d6f278b2 2026-03-17 13:35:43,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:35:43,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b59c1727ff69d6f278b2 HTTP/1.1" 200 None 2026-03-17 13:35:43,307 - lava_callback - DEBUG - Processing node 69b6b59c1727ff69d6f278b2: baseline-arm64-baylibre 2026-03-17 13:35:43,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b59c1727ff69d6f278b2 2026-03-17 13:35:43,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:35:43,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b59c1727ff69d6f278b2 HTTP/1.1" 200 None 2026-03-17 13:35:43,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:35:43,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-17 13:35:43,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:35:43,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b59c1727ff69d6f278b2 HTTP/1.1" 200 None 2026-03-17 13:35:43,372 - lava_callback - ERROR - Error processing callback for node 69b6b59c1727ff69d6f278b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51454 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:36:43,304 - lava_callback - INFO - Received callback for node 69b6b5e71727ff69d6f278bd INFO: 172.20.0.1:34492 - "POST /node/69b6b5e71727ff69d6f278bd HTTP/1.0" 202 Accepted 2026-03-17 13:36:43,310 - lava_callback - INFO - Starting async job submit for node 69b6b5e71727ff69d6f278bd 2026-03-17 13:36:43,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:36:43,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b5e71727ff69d6f278bd HTTP/1.1" 200 None 2026-03-17 13:36:43,326 - lava_callback - DEBUG - Processing node 69b6b5e71727ff69d6f278bd: baseline-arm64-baylibre 2026-03-17 13:36:43,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b5e71727ff69d6f278bd 2026-03-17 13:36:43,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:36:43,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b5e71727ff69d6f278bd HTTP/1.1" 200 None 2026-03-17 13:36:43,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:36:43,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:36:43,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:36:43,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b5e71727ff69d6f278bd HTTP/1.1" 200 None 2026-03-17 13:36:43,384 - lava_callback - ERROR - Error processing callback for node 69b6b5e71727ff69d6f278bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54996 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:38:06,299 - lava_callback - INFO - Received callback for node 69b6b6371727ff69d6f278cc INFO: 172.20.0.1:60206 - "POST /node/69b6b6371727ff69d6f278cc HTTP/1.0" 202 Accepted 2026-03-17 13:38:06,305 - lava_callback - INFO - Starting async job submit for node 69b6b6371727ff69d6f278cc 2026-03-17 13:38:06,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:38:06,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b6371727ff69d6f278cc HTTP/1.1" 200 None 2026-03-17 13:38:06,355 - lava_callback - DEBUG - Processing node 69b6b6371727ff69d6f278cc: baseline-arm64-clabbe 2026-03-17 13:38:06,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b6371727ff69d6f278cc 2026-03-17 13:38:06,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:38:06,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b6371727ff69d6f278cc HTTP/1.1" 200 None 2026-03-17 13:38:06,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:38:06,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:38:06,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:38:06,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b6371727ff69d6f278cc HTTP/1.1" 200 None 2026-03-17 13:38:06,422 - lava_callback - ERROR - Error processing callback for node 69b6b6371727ff69d6f278cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46290 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:39:23,454 - lava_callback - INFO - Received callback for node 69b6b67b1727ff69d6f278d6 INFO: 172.20.0.1:55476 - "POST /node/69b6b67b1727ff69d6f278d6 HTTP/1.0" 202 Accepted 2026-03-17 13:39:23,459 - lava_callback - INFO - Starting async job submit for node 69b6b67b1727ff69d6f278d6 2026-03-17 13:39:23,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:39:23,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b67b1727ff69d6f278d6 HTTP/1.1" 200 None 2026-03-17 13:39:23,503 - lava_callback - DEBUG - Processing node 69b6b67b1727ff69d6f278d6: baseline-arm64-baylibre 2026-03-17 13:39:23,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b67b1727ff69d6f278d6 2026-03-17 13:39:23,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:39:23,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b67b1727ff69d6f278d6 HTTP/1.1" 200 None 2026-03-17 13:39:23,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:39:23,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-17 13:39:23,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:39:23,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b67b1727ff69d6f278d6 HTTP/1.1" 200 None 2026-03-17 13:39:23,578 - lava_callback - ERROR - Error processing callback for node 69b6b67b1727ff69d6f278d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57678 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:40:46,350 - lava_callback - INFO - Received callback for node 69b6b6cb1727ff69d6f278e6 INFO: 172.20.0.1:49668 - "POST /node/69b6b6cb1727ff69d6f278e6 HTTP/1.0" 202 Accepted 2026-03-17 13:40:46,355 - lava_callback - INFO - Starting async job submit for node 69b6b6cb1727ff69d6f278e6 2026-03-17 13:40:46,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:40:46,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b6cb1727ff69d6f278e6 HTTP/1.1" 200 None 2026-03-17 13:40:46,385 - lava_callback - DEBUG - Processing node 69b6b6cb1727ff69d6f278e6: baseline-arm64-clabbe 2026-03-17 13:40:46,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b6cb1727ff69d6f278e6 2026-03-17 13:40:46,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:40:46,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b6cb1727ff69d6f278e6 HTTP/1.1" 200 None 2026-03-17 13:40:46,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:40:46,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:40:46,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:40:46,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b6cb1727ff69d6f278e6 HTTP/1.1" 200 None 2026-03-17 13:40:46,445 - lava_callback - ERROR - Error processing callback for node 69b6b6cb1727ff69d6f278e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47426 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:41:43,643 - lava_callback - INFO - Received callback for node 69b6b7101727ff69d6f278f0 INFO: 172.20.0.1:35330 - "POST /node/69b6b7101727ff69d6f278f0 HTTP/1.0" 202 Accepted 2026-03-17 13:41:43,648 - lava_callback - INFO - Starting async job submit for node 69b6b7101727ff69d6f278f0 2026-03-17 13:41:43,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:41:43,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b7101727ff69d6f278f0 HTTP/1.1" 200 None 2026-03-17 13:41:43,664 - lava_callback - DEBUG - Processing node 69b6b7101727ff69d6f278f0: baseline-arm64-baylibre 2026-03-17 13:41:43,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b7101727ff69d6f278f0 2026-03-17 13:41:43,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:41:43,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b7101727ff69d6f278f0 HTTP/1.1" 200 None 2026-03-17 13:41:43,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:41:43,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-17 13:41:43,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:41:43,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b7101727ff69d6f278f0 HTTP/1.1" 200 None 2026-03-17 13:41:43,757 - lava_callback - ERROR - Error processing callback for node 69b6b7101727ff69d6f278f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35996 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:43:06,447 - lava_callback - INFO - Received callback for node 69b6b7601727ff69d6f27900 INFO: 172.20.0.1:51232 - "POST /node/69b6b7601727ff69d6f27900 HTTP/1.0" 202 Accepted 2026-03-17 13:43:06,453 - lava_callback - INFO - Starting async job submit for node 69b6b7601727ff69d6f27900 2026-03-17 13:43:06,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:43:06,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b7601727ff69d6f27900 HTTP/1.1" 200 None 2026-03-17 13:43:06,469 - lava_callback - DEBUG - Processing node 69b6b7601727ff69d6f27900: baseline-arm64-clabbe 2026-03-17 13:43:06,469 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b7601727ff69d6f27900 2026-03-17 13:43:06,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:43:06,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b7601727ff69d6f27900 HTTP/1.1" 200 None 2026-03-17 13:43:06,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:43:06,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:43:06,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:43:06,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b7601727ff69d6f27900 HTTP/1.1" 200 None 2026-03-17 13:43:06,524 - lava_callback - ERROR - Error processing callback for node 69b6b7601727ff69d6f27900: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54002 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:44:26,471 - lava_callback - INFO - Received callback for node 69b6b7ac1727ff69d6f2790e INFO: 172.20.0.1:46298 - "POST /node/69b6b7ac1727ff69d6f2790e HTTP/1.0" 202 Accepted 2026-03-17 13:44:26,476 - lava_callback - INFO - Starting async job submit for node 69b6b7ac1727ff69d6f2790e 2026-03-17 13:44:26,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:44:26,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b7ac1727ff69d6f2790e HTTP/1.1" 200 None 2026-03-17 13:44:26,492 - lava_callback - DEBUG - Processing node 69b6b7ac1727ff69d6f2790e: baseline-arm64-clabbe 2026-03-17 13:44:26,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b7ac1727ff69d6f2790e 2026-03-17 13:44:26,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:44:26,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b7ac1727ff69d6f2790e HTTP/1.1" 200 None 2026-03-17 13:44:26,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:44:26,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None INFO: 172.20.0.1:46304 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:44:26,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:44:26,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b7ac1727ff69d6f2790e HTTP/1.1" 200 None 2026-03-17 13:44:26,561 - lava_callback - ERROR - Error processing callback for node 69b6b7ac1727ff69d6f2790e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43032 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:45:46,533 - lava_callback - INFO - Received callback for node 69b6b7f61727ff69d6f27919 INFO: 172.20.0.1:43038 - "POST /node/69b6b7f61727ff69d6f27919 HTTP/1.0" 202 Accepted 2026-03-17 13:45:46,538 - lava_callback - INFO - Starting async job submit for node 69b6b7f61727ff69d6f27919 2026-03-17 13:45:46,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:45:46,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b7f61727ff69d6f27919 HTTP/1.1" 200 None 2026-03-17 13:45:46,560 - lava_callback - DEBUG - Processing node 69b6b7f61727ff69d6f27919: baseline-arm64-clabbe 2026-03-17 13:45:46,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b7f61727ff69d6f27919 2026-03-17 13:45:46,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:45:46,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b7f61727ff69d6f27919 HTTP/1.1" 200 None 2026-03-17 13:45:46,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:45:46,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-17 13:45:46,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:45:46,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b7f61727ff69d6f27919 HTTP/1.1" 200 None 2026-03-17 13:45:46,612 - lava_callback - ERROR - Error processing callback for node 69b6b7f61727ff69d6f27919: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53490 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:46:46,581 - lava_callback - INFO - Received callback for node 69b6b8401727ff69d6f27921 INFO: 172.20.0.1:53496 - "POST /node/69b6b8401727ff69d6f27921 HTTP/1.0" 202 Accepted 2026-03-17 13:46:46,587 - lava_callback - INFO - Starting async job submit for node 69b6b8401727ff69d6f27921 2026-03-17 13:46:46,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:46:46,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b8401727ff69d6f27921 HTTP/1.1" 200 None 2026-03-17 13:46:46,603 - lava_callback - DEBUG - Processing node 69b6b8401727ff69d6f27921: baseline-arm64-clabbe 2026-03-17 13:46:46,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b8401727ff69d6f27921 2026-03-17 13:46:46,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:46:46,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b8401727ff69d6f27921 HTTP/1.1" 200 None 2026-03-17 13:46:46,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:46:46,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:46:46,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:46:46,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b8401727ff69d6f27921 HTTP/1.1" 200 None 2026-03-17 13:46:46,671 - lava_callback - ERROR - Error processing callback for node 69b6b8401727ff69d6f27921: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49594 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:48:06,661 - lava_callback - INFO - Received callback for node 69b6b88a1727ff69d6f2792f INFO: 172.20.0.1:49600 - "POST /node/69b6b88a1727ff69d6f2792f HTTP/1.0" 202 Accepted 2026-03-17 13:48:06,667 - lava_callback - INFO - Starting async job submit for node 69b6b88a1727ff69d6f2792f 2026-03-17 13:48:06,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:48:06,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b88a1727ff69d6f2792f HTTP/1.1" 200 None 2026-03-17 13:48:06,686 - lava_callback - DEBUG - Processing node 69b6b88a1727ff69d6f2792f: baseline-arm64-clabbe 2026-03-17 13:48:06,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b88a1727ff69d6f2792f 2026-03-17 13:48:06,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:48:06,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b88a1727ff69d6f2792f HTTP/1.1" 200 None 2026-03-17 13:48:06,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:48:06,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:48:06,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:48:06,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b88a1727ff69d6f2792f HTTP/1.1" 200 None 2026-03-17 13:48:06,737 - lava_callback - ERROR - Error processing callback for node 69b6b88a1727ff69d6f2792f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51548 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:49:26,713 - lava_callback - INFO - Received callback for node 69b6b8d41727ff69d6f2793a INFO: 172.20.0.1:51564 - "POST /node/69b6b8d41727ff69d6f2793a HTTP/1.0" 202 Accepted 2026-03-17 13:49:26,718 - lava_callback - INFO - Starting async job submit for node 69b6b8d41727ff69d6f2793a 2026-03-17 13:49:26,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:49:26,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b8d41727ff69d6f2793a HTTP/1.1" 200 None 2026-03-17 13:49:26,754 - lava_callback - DEBUG - Processing node 69b6b8d41727ff69d6f2793a: baseline-arm64-clabbe 2026-03-17 13:49:26,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b8d41727ff69d6f2793a 2026-03-17 13:49:26,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:49:26,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b8d41727ff69d6f2793a HTTP/1.1" 200 None 2026-03-17 13:49:26,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:49:26,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:49:26,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:49:26,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b8d41727ff69d6f2793a HTTP/1.1" 200 None 2026-03-17 13:49:26,822 - lava_callback - ERROR - Error processing callback for node 69b6b8d41727ff69d6f2793a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48640 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:50:26,784 - lava_callback - INFO - Received callback for node 69b6b91e1727ff69d6f27949 INFO: 172.20.0.1:48650 - "POST /node/69b6b91e1727ff69d6f27949 HTTP/1.0" 202 Accepted 2026-03-17 13:50:26,790 - lava_callback - INFO - Starting async job submit for node 69b6b91e1727ff69d6f27949 2026-03-17 13:50:26,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:50:26,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b91e1727ff69d6f27949 HTTP/1.1" 200 None 2026-03-17 13:50:26,806 - lava_callback - DEBUG - Processing node 69b6b91e1727ff69d6f27949: baseline-arm64-clabbe 2026-03-17 13:50:26,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b91e1727ff69d6f27949 2026-03-17 13:50:26,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:50:26,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b91e1727ff69d6f27949 HTTP/1.1" 200 None 2026-03-17 13:50:26,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:50:26,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-17 13:50:26,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:50:26,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b91e1727ff69d6f27949 HTTP/1.1" 200 None 2026-03-17 13:50:26,927 - lava_callback - ERROR - Error processing callback for node 69b6b91e1727ff69d6f27949: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49946 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:51:46,845 - lava_callback - INFO - Received callback for node 69b6b9691727ff69d6f27952 INFO: 172.20.0.1:49948 - "POST /node/69b6b9691727ff69d6f27952 HTTP/1.0" 202 Accepted 2026-03-17 13:51:46,850 - lava_callback - INFO - Starting async job submit for node 69b6b9691727ff69d6f27952 2026-03-17 13:51:46,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:51:46,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b9691727ff69d6f27952 HTTP/1.1" 200 None 2026-03-17 13:51:46,874 - lava_callback - DEBUG - Processing node 69b6b9691727ff69d6f27952: baseline-arm64-clabbe 2026-03-17 13:51:46,874 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b9691727ff69d6f27952 2026-03-17 13:51:46,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:51:46,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b9691727ff69d6f27952 HTTP/1.1" 200 None 2026-03-17 13:51:46,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:51:46,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:51:46,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:51:46,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b9691727ff69d6f27952 HTTP/1.1" 200 None 2026-03-17 13:51:46,929 - lava_callback - ERROR - Error processing callback for node 69b6b9691727ff69d6f27952: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46584 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:53:06,919 - lava_callback - INFO - Received callback for node 69b6b9b31727ff69d6f27961 INFO: 172.20.0.1:46586 - "POST /node/69b6b9b31727ff69d6f27961 HTTP/1.0" 202 Accepted 2026-03-17 13:53:06,924 - lava_callback - INFO - Starting async job submit for node 69b6b9b31727ff69d6f27961 2026-03-17 13:53:06,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:53:06,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b9b31727ff69d6f27961 HTTP/1.1" 200 None 2026-03-17 13:53:06,946 - lava_callback - DEBUG - Processing node 69b6b9b31727ff69d6f27961: baseline-arm64-clabbe 2026-03-17 13:53:06,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b9b31727ff69d6f27961 2026-03-17 13:53:06,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:53:06,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b9b31727ff69d6f27961 HTTP/1.1" 200 None 2026-03-17 13:53:06,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:53:06,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-17 13:53:06,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:53:07,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b9b31727ff69d6f27961 HTTP/1.1" 200 None 2026-03-17 13:53:07,016 - lava_callback - ERROR - Error processing callback for node 69b6b9b31727ff69d6f27961: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43814 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:54:26,976 - lava_callback - INFO - Received callback for node 69b6b9fe1727ff69d6f2796a INFO: 172.20.0.1:43818 - "POST /node/69b6b9fe1727ff69d6f2796a HTTP/1.0" 202 Accepted 2026-03-17 13:54:26,982 - lava_callback - INFO - Starting async job submit for node 69b6b9fe1727ff69d6f2796a 2026-03-17 13:54:26,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:54:27,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b9fe1727ff69d6f2796a HTTP/1.1" 200 None 2026-03-17 13:54:27,015 - lava_callback - DEBUG - Processing node 69b6b9fe1727ff69d6f2796a: baseline-arm64-clabbe 2026-03-17 13:54:27,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6b9fe1727ff69d6f2796a 2026-03-17 13:54:27,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:54:27,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6b9fe1727ff69d6f2796a HTTP/1.1" 200 None 2026-03-17 13:54:27,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:54:27,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:54:27,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:54:27,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6b9fe1727ff69d6f2796a HTTP/1.1" 200 None 2026-03-17 13:54:27,084 - lava_callback - ERROR - Error processing callback for node 69b6b9fe1727ff69d6f2796a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32940 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:55:26,968 - lava_callback - INFO - Received callback for node 69b6ba481727ff69d6f27978 INFO: 172.20.0.1:32952 - "POST /node/69b6ba481727ff69d6f27978 HTTP/1.0" 202 Accepted 2026-03-17 13:55:26,973 - lava_callback - INFO - Starting async job submit for node 69b6ba481727ff69d6f27978 2026-03-17 13:55:26,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:55:27,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ba481727ff69d6f27978 HTTP/1.1" 200 None 2026-03-17 13:55:27,013 - lava_callback - DEBUG - Processing node 69b6ba481727ff69d6f27978: baseline-arm64-clabbe 2026-03-17 13:55:27,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ba481727ff69d6f27978 2026-03-17 13:55:27,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:55:27,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ba481727ff69d6f27978 HTTP/1.1" 200 None 2026-03-17 13:55:27,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:55:27,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-17 13:55:27,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:55:27,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ba481727ff69d6f27978 HTTP/1.1" 200 None 2026-03-17 13:55:27,099 - lava_callback - ERROR - Error processing callback for node 69b6ba481727ff69d6f27978: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43968 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:56:47,018 - lava_callback - INFO - Received callback for node 69b6ba931727ff69d6f27980 INFO: 172.20.0.1:43972 - "POST /node/69b6ba931727ff69d6f27980 HTTP/1.0" 202 Accepted 2026-03-17 13:56:47,023 - lava_callback - INFO - Starting async job submit for node 69b6ba931727ff69d6f27980 2026-03-17 13:56:47,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:56:47,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ba931727ff69d6f27980 HTTP/1.1" 200 None 2026-03-17 13:56:47,050 - lava_callback - DEBUG - Processing node 69b6ba931727ff69d6f27980: baseline-arm64-clabbe 2026-03-17 13:56:47,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ba931727ff69d6f27980 2026-03-17 13:56:47,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:56:47,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ba931727ff69d6f27980 HTTP/1.1" 200 None 2026-03-17 13:56:47,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:56:47,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:56:47,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:56:47,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ba931727ff69d6f27980 HTTP/1.1" 200 None 2026-03-17 13:56:47,166 - lava_callback - ERROR - Error processing callback for node 69b6ba931727ff69d6f27980: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46900 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:58:07,045 - lava_callback - INFO - Received callback for node 69b6badd1727ff69d6f2798e INFO: 172.20.0.1:46910 - "POST /node/69b6badd1727ff69d6f2798e HTTP/1.0" 202 Accepted 2026-03-17 13:58:07,051 - lava_callback - INFO - Starting async job submit for node 69b6badd1727ff69d6f2798e 2026-03-17 13:58:07,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:58:07,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6badd1727ff69d6f2798e HTTP/1.1" 200 None 2026-03-17 13:58:07,105 - lava_callback - DEBUG - Processing node 69b6badd1727ff69d6f2798e: baseline-arm64-clabbe 2026-03-17 13:58:07,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6badd1727ff69d6f2798e 2026-03-17 13:58:07,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:58:07,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6badd1727ff69d6f2798e HTTP/1.1" 200 None 2026-03-17 13:58:07,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:58:07,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 13:58:07,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:58:07,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6badd1727ff69d6f2798e HTTP/1.1" 200 None 2026-03-17 13:58:07,171 - lava_callback - ERROR - Error processing callback for node 69b6badd1727ff69d6f2798e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46956 - "GET / HTTP/1.0" 200 OK 2026-03-17 13:59:27,076 - lava_callback - INFO - Received callback for node 69b6bb291727ff69d6f27995 INFO: 172.20.0.1:46962 - "POST /node/69b6bb291727ff69d6f27995 HTTP/1.0" 202 Accepted 2026-03-17 13:59:27,081 - lava_callback - INFO - Starting async job submit for node 69b6bb291727ff69d6f27995 2026-03-17 13:59:27,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:59:27,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6bb291727ff69d6f27995 HTTP/1.1" 200 None 2026-03-17 13:59:27,123 - lava_callback - DEBUG - Processing node 69b6bb291727ff69d6f27995: baseline-arm64-clabbe 2026-03-17 13:59:27,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6bb291727ff69d6f27995 2026-03-17 13:59:27,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:59:27,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6bb291727ff69d6f27995 HTTP/1.1" 200 None 2026-03-17 13:59:27,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:59:27,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-17 13:59:27,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 13:59:27,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6bb291727ff69d6f27995 HTTP/1.1" 200 None 2026-03-17 13:59:27,205 - lava_callback - ERROR - Error processing callback for node 69b6bb291727ff69d6f27995: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33630 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:00:27,107 - lava_callback - INFO - Received callback for node 69b6bb741727ff69d6f279a4 INFO: 172.20.0.1:33640 - "POST /node/69b6bb741727ff69d6f279a4 HTTP/1.0" 202 Accepted 2026-03-17 14:00:27,112 - lava_callback - INFO - Starting async job submit for node 69b6bb741727ff69d6f279a4 2026-03-17 14:00:27,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:00:27,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6bb741727ff69d6f279a4 HTTP/1.1" 200 None 2026-03-17 14:00:27,128 - lava_callback - DEBUG - Processing node 69b6bb741727ff69d6f279a4: baseline-arm64-clabbe 2026-03-17 14:00:27,129 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6bb741727ff69d6f279a4 2026-03-17 14:00:27,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:00:27,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6bb741727ff69d6f279a4 HTTP/1.1" 200 None 2026-03-17 14:00:27,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:00:27,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-17 14:00:27,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:00:27,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6bb741727ff69d6f279a4 HTTP/1.1" 200 None 2026-03-17 14:00:27,213 - lava_callback - ERROR - Error processing callback for node 69b6bb741727ff69d6f279a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46662 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:01:47,202 - lava_callback - INFO - Received callback for node 69b6bbc01727ff69d6f279ac INFO: 172.20.0.1:46678 - "POST /node/69b6bbc01727ff69d6f279ac HTTP/1.0" 202 Accepted 2026-03-17 14:01:47,208 - lava_callback - INFO - Starting async job submit for node 69b6bbc01727ff69d6f279ac 2026-03-17 14:01:47,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:01:47,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6bbc01727ff69d6f279ac HTTP/1.1" 200 None 2026-03-17 14:01:47,230 - lava_callback - DEBUG - Processing node 69b6bbc01727ff69d6f279ac: baseline-arm64-clabbe 2026-03-17 14:01:47,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6bbc01727ff69d6f279ac 2026-03-17 14:01:47,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:01:47,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6bbc01727ff69d6f279ac HTTP/1.1" 200 None 2026-03-17 14:01:47,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:01:47,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 14:01:47,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:01:47,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6bbc01727ff69d6f279ac HTTP/1.1" 200 None 2026-03-17 14:01:47,288 - lava_callback - ERROR - Error processing callback for node 69b6bbc01727ff69d6f279ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53006 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:38:06,889 - lava_callback - INFO - Received callback for node 69b6c4411727ff69d6f279c2 INFO: 172.20.0.1:53022 - "POST /node/69b6c4411727ff69d6f279c2 HTTP/1.0" 202 Accepted 2026-03-17 14:38:06,895 - lava_callback - INFO - Starting async job submit for node 69b6c4411727ff69d6f279c2 2026-03-17 14:38:06,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:38:06,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c4411727ff69d6f279c2 HTTP/1.1" 200 None 2026-03-17 14:38:06,911 - lava_callback - DEBUG - Processing node 69b6c4411727ff69d6f279c2: baseline-arm-baylibre 2026-03-17 14:38:06,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c4411727ff69d6f279c2 2026-03-17 14:38:06,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:38:06,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c4411727ff69d6f279c2 HTTP/1.1" 200 None 2026-03-17 14:38:06,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:38:06,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:38:06,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:38:06,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c4411727ff69d6f279c2 HTTP/1.1" 200 None 2026-03-17 14:38:06,988 - lava_callback - ERROR - Error processing callback for node 69b6c4411727ff69d6f279c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59472 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:39:06,688 - lava_callback - INFO - Received callback for node 69b6c47c1727ff69d6f279d2 INFO: 172.20.0.1:59488 - "POST /node/69b6c47c1727ff69d6f279d2 HTTP/1.0" 202 Accepted 2026-03-17 14:39:06,694 - lava_callback - INFO - Starting async job submit for node 69b6c47c1727ff69d6f279d2 2026-03-17 14:39:06,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:39:06,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c47c1727ff69d6f279d2 HTTP/1.1" 200 None 2026-03-17 14:39:06,716 - lava_callback - DEBUG - Processing node 69b6c47c1727ff69d6f279d2: baseline-arm-baylibre 2026-03-17 14:39:06,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c47c1727ff69d6f279d2 2026-03-17 14:39:06,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:39:06,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c47c1727ff69d6f279d2 HTTP/1.1" 200 None 2026-03-17 14:39:06,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:39:06,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:39:06,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:39:06,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c47c1727ff69d6f279d2 HTTP/1.1" 200 None 2026-03-17 14:39:06,779 - lava_callback - ERROR - Error processing callback for node 69b6c47c1727ff69d6f279d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52084 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:39:46,772 - lava_callback - INFO - Received callback for node 69b6c4a01727ff69d6f279dd INFO: 172.20.0.1:52100 - "POST /node/69b6c4a01727ff69d6f279dd HTTP/1.0" 202 Accepted 2026-03-17 14:39:46,778 - lava_callback - INFO - Starting async job submit for node 69b6c4a01727ff69d6f279dd 2026-03-17 14:39:46,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:39:46,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c4a01727ff69d6f279dd HTTP/1.1" 200 None 2026-03-17 14:39:46,801 - lava_callback - DEBUG - Processing node 69b6c4a01727ff69d6f279dd: baseline-arm-baylibre 2026-03-17 14:39:46,801 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c4a01727ff69d6f279dd 2026-03-17 14:39:46,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:39:46,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c4a01727ff69d6f279dd HTTP/1.1" 200 None 2026-03-17 14:39:46,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:39:46,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:39:46,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:39:46,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c4a01727ff69d6f279dd HTTP/1.1" 200 None 2026-03-17 14:39:46,867 - lava_callback - ERROR - Error processing callback for node 69b6c4a01727ff69d6f279dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55314 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:40:26,765 - lava_callback - INFO - Received callback for node 69b6c4c51727ff69d6f279ec INFO: 172.20.0.1:55320 - "POST /node/69b6c4c51727ff69d6f279ec HTTP/1.0" 202 Accepted 2026-03-17 14:40:26,770 - lava_callback - INFO - Starting async job submit for node 69b6c4c51727ff69d6f279ec 2026-03-17 14:40:26,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:40:26,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c4c51727ff69d6f279ec HTTP/1.1" 200 None 2026-03-17 14:40:26,787 - lava_callback - DEBUG - Processing node 69b6c4c51727ff69d6f279ec: baseline-arm-baylibre 2026-03-17 14:40:26,787 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c4c51727ff69d6f279ec 2026-03-17 14:40:26,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:40:26,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c4c51727ff69d6f279ec HTTP/1.1" 200 None 2026-03-17 14:40:26,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:40:26,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:40:26,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:40:26,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c4c51727ff69d6f279ec HTTP/1.1" 200 None 2026-03-17 14:40:26,837 - lava_callback - ERROR - Error processing callback for node 69b6c4c51727ff69d6f279ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59906 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:40:46,779 - lava_callback - INFO - Received callback for node 69b6c4e81727ff69d6f279f8 INFO: 172.20.0.1:59916 - "POST /node/69b6c4e81727ff69d6f279f8 HTTP/1.0" 202 Accepted 2026-03-17 14:40:46,785 - lava_callback - INFO - Starting async job submit for node 69b6c4e81727ff69d6f279f8 2026-03-17 14:40:46,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:40:46,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c4e81727ff69d6f279f8 HTTP/1.1" 200 None 2026-03-17 14:40:46,808 - lava_callback - DEBUG - Processing node 69b6c4e81727ff69d6f279f8: baseline-arm-baylibre 2026-03-17 14:40:46,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c4e81727ff69d6f279f8 2026-03-17 14:40:46,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:40:46,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c4e81727ff69d6f279f8 HTTP/1.1" 200 None 2026-03-17 14:40:46,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:40:46,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:40:46,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:40:46,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c4e81727ff69d6f279f8 HTTP/1.1" 200 None 2026-03-17 14:40:46,862 - lava_callback - ERROR - Error processing callback for node 69b6c4e81727ff69d6f279f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59052 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:41:26,933 - lava_callback - INFO - Received callback for node 69b6c50d1727ff69d6f27a07 INFO: 172.20.0.1:59058 - "POST /node/69b6c50d1727ff69d6f27a07 HTTP/1.0" 202 Accepted 2026-03-17 14:41:26,939 - lava_callback - INFO - Starting async job submit for node 69b6c50d1727ff69d6f27a07 2026-03-17 14:41:26,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:41:26,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c50d1727ff69d6f27a07 HTTP/1.1" 200 None 2026-03-17 14:41:26,954 - lava_callback - DEBUG - Processing node 69b6c50d1727ff69d6f27a07: baseline-arm-baylibre 2026-03-17 14:41:26,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c50d1727ff69d6f27a07 2026-03-17 14:41:26,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:41:26,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c50d1727ff69d6f27a07 HTTP/1.1" 200 None 2026-03-17 14:41:26,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:41:26,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:41:26,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:41:27,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c50d1727ff69d6f27a07 HTTP/1.1" 200 None 2026-03-17 14:41:27,032 - lava_callback - ERROR - Error processing callback for node 69b6c50d1727ff69d6f27a07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41832 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:42:09,021 - lava_callback - INFO - Received callback for node 69b6c5321727ff69d6f27a16 INFO: 172.20.0.1:41838 - "POST /node/69b6c5321727ff69d6f27a16 HTTP/1.0" 202 Accepted 2026-03-17 14:42:09,027 - lava_callback - INFO - Starting async job submit for node 69b6c5321727ff69d6f27a16 2026-03-17 14:42:09,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:42:09,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c5321727ff69d6f27a16 HTTP/1.1" 200 None 2026-03-17 14:42:09,043 - lava_callback - DEBUG - Processing node 69b6c5321727ff69d6f27a16: baseline-arm-clabbe 2026-03-17 14:42:09,043 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c5321727ff69d6f27a16 2026-03-17 14:42:09,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:42:09,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c5321727ff69d6f27a16 HTTP/1.1" 200 None 2026-03-17 14:42:09,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:42:09,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:42:09,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:42:09,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c5321727ff69d6f27a16 HTTP/1.1" 200 None 2026-03-17 14:42:09,100 - lava_callback - ERROR - Error processing callback for node 69b6c5321727ff69d6f27a16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39598 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:42:46,952 - lava_callback - INFO - Received callback for node 69b6c5531727ff69d6f27a21 INFO: 172.20.0.1:39614 - "POST /node/69b6c5531727ff69d6f27a21 HTTP/1.0" 202 Accepted 2026-03-17 14:42:46,957 - lava_callback - INFO - Starting async job submit for node 69b6c5531727ff69d6f27a21 2026-03-17 14:42:46,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:42:46,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c5531727ff69d6f27a21 HTTP/1.1" 200 None 2026-03-17 14:42:46,974 - lava_callback - DEBUG - Processing node 69b6c5531727ff69d6f27a21: baseline-arm-baylibre 2026-03-17 14:42:46,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c5531727ff69d6f27a21 2026-03-17 14:42:46,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:42:46,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c5531727ff69d6f27a21 HTTP/1.1" 200 None 2026-03-17 14:42:46,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:42:47,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:42:47,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:42:47,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c5531727ff69d6f27a21 HTTP/1.1" 200 None 2026-03-17 14:42:47,028 - lava_callback - ERROR - Error processing callback for node 69b6c5531727ff69d6f27a21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45694 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:43:06,920 - lava_callback - INFO - Received callback for node 69b6c5781727ff69d6f27a2e INFO: 172.20.0.1:45698 - "POST /node/69b6c5781727ff69d6f27a2e HTTP/1.0" 202 Accepted 2026-03-17 14:43:06,926 - lava_callback - INFO - Starting async job submit for node 69b6c5781727ff69d6f27a2e 2026-03-17 14:43:06,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:43:06,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c5781727ff69d6f27a2e HTTP/1.1" 200 None 2026-03-17 14:43:06,942 - lava_callback - DEBUG - Processing node 69b6c5781727ff69d6f27a2e: baseline-arm-baylibre 2026-03-17 14:43:06,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c5781727ff69d6f27a2e 2026-03-17 14:43:06,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:43:06,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c5781727ff69d6f27a2e HTTP/1.1" 200 None 2026-03-17 14:43:06,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:43:06,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:43:06,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:43:06,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c5781727ff69d6f27a2e HTTP/1.1" 200 None 2026-03-17 14:43:06,992 - lava_callback - ERROR - Error processing callback for node 69b6c5781727ff69d6f27a2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48200 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:43:47,012 - lava_callback - INFO - Received callback for node 69b6c59b1727ff69d6f27a3b INFO: 172.20.0.1:48206 - "POST /node/69b6c59b1727ff69d6f27a3b HTTP/1.0" 202 Accepted 2026-03-17 14:43:47,019 - lava_callback - INFO - Starting async job submit for node 69b6c59b1727ff69d6f27a3b 2026-03-17 14:43:47,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:43:47,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c59b1727ff69d6f27a3b HTTP/1.1" 200 None 2026-03-17 14:43:47,037 - lava_callback - DEBUG - Processing node 69b6c59b1727ff69d6f27a3b: baseline-arm-baylibre 2026-03-17 14:43:47,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c59b1727ff69d6f27a3b 2026-03-17 14:43:47,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:43:47,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c59b1727ff69d6f27a3b HTTP/1.1" 200 None 2026-03-17 14:43:47,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:43:47,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:43:47,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:43:47,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c59b1727ff69d6f27a3b HTTP/1.1" 200 None 2026-03-17 14:43:47,091 - lava_callback - ERROR - Error processing callback for node 69b6c59b1727ff69d6f27a3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59358 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:44:27,017 - lava_callback - INFO - Received callback for node 69b6c5be1727ff69d6f27a48 INFO: 172.20.0.1:59362 - "POST /node/69b6c5be1727ff69d6f27a48 HTTP/1.0" 202 Accepted 2026-03-17 14:44:27,023 - lava_callback - INFO - Starting async job submit for node 69b6c5be1727ff69d6f27a48 2026-03-17 14:44:27,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:44:27,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c5be1727ff69d6f27a48 HTTP/1.1" 200 None 2026-03-17 14:44:27,038 - lava_callback - DEBUG - Processing node 69b6c5be1727ff69d6f27a48: baseline-arm-baylibre 2026-03-17 14:44:27,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c5be1727ff69d6f27a48 2026-03-17 14:44:27,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:44:27,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c5be1727ff69d6f27a48 HTTP/1.1" 200 None 2026-03-17 14:44:27,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:44:27,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:44:27,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:44:27,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c5be1727ff69d6f27a48 HTTP/1.1" 200 None 2026-03-17 14:44:27,121 - lava_callback - ERROR - Error processing callback for node 69b6c5be1727ff69d6f27a48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41338 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:45:09,032 - lava_callback - INFO - Received callback for node 69b6c5e41727ff69d6f27a53 INFO: 172.20.0.1:41348 - "POST /node/69b6c5e41727ff69d6f27a53 HTTP/1.0" 202 Accepted 2026-03-17 14:45:09,037 - lava_callback - INFO - Starting async job submit for node 69b6c5e41727ff69d6f27a53 2026-03-17 14:45:09,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:45:09,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c5e41727ff69d6f27a53 HTTP/1.1" 200 None 2026-03-17 14:45:09,075 - lava_callback - DEBUG - Processing node 69b6c5e41727ff69d6f27a53: baseline-arm-clabbe 2026-03-17 14:45:09,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c5e41727ff69d6f27a53 2026-03-17 14:45:09,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:45:09,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c5e41727ff69d6f27a53 HTTP/1.1" 200 None 2026-03-17 14:45:09,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:45:09,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:45:09,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:45:09,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c5e41727ff69d6f27a53 HTTP/1.1" 200 None 2026-03-17 14:45:09,132 - lava_callback - ERROR - Error processing callback for node 69b6c5e41727ff69d6f27a53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56918 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:45:49,095 - lava_callback - INFO - Received callback for node 69b6c6081727ff69d6f27a5f INFO: 172.20.0.1:56928 - "POST /node/69b6c6081727ff69d6f27a5f HTTP/1.0" 202 Accepted 2026-03-17 14:45:49,101 - lava_callback - INFO - Starting async job submit for node 69b6c6081727ff69d6f27a5f 2026-03-17 14:45:49,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:45:49,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c6081727ff69d6f27a5f HTTP/1.1" 200 None 2026-03-17 14:45:49,118 - lava_callback - DEBUG - Processing node 69b6c6081727ff69d6f27a5f: baseline-arm-clabbe 2026-03-17 14:45:49,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c6081727ff69d6f27a5f 2026-03-17 14:45:49,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:45:49,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c6081727ff69d6f27a5f HTTP/1.1" 200 None 2026-03-17 14:45:49,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:45:49,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:45:49,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:45:49,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c6081727ff69d6f27a5f HTTP/1.1" 200 None 2026-03-17 14:45:49,184 - lava_callback - ERROR - Error processing callback for node 69b6c6081727ff69d6f27a5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36474 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:46:09,196 - lava_callback - INFO - Received callback for node 69b6c62c1727ff69d6f27a6a INFO: 172.20.0.1:36486 - "POST /node/69b6c62c1727ff69d6f27a6a HTTP/1.0" 202 Accepted 2026-03-17 14:46:09,201 - lava_callback - INFO - Starting async job submit for node 69b6c62c1727ff69d6f27a6a 2026-03-17 14:46:09,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:46:09,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c62c1727ff69d6f27a6a HTTP/1.1" 200 None 2026-03-17 14:46:09,218 - lava_callback - DEBUG - Processing node 69b6c62c1727ff69d6f27a6a: baseline-arm-clabbe 2026-03-17 14:46:09,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c62c1727ff69d6f27a6a 2026-03-17 14:46:09,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:46:09,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c62c1727ff69d6f27a6a HTTP/1.1" 200 None 2026-03-17 14:46:09,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:46:09,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:46:09,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:46:09,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c62c1727ff69d6f27a6a HTTP/1.1" 200 None 2026-03-17 14:46:09,316 - lava_callback - ERROR - Error processing callback for node 69b6c62c1727ff69d6f27a6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45860 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:46:49,126 - lava_callback - INFO - Received callback for node 69b6c64f1727ff69d6f27a76 INFO: 172.20.0.1:45862 - "POST /node/69b6c64f1727ff69d6f27a76 HTTP/1.0" 202 Accepted 2026-03-17 14:46:49,132 - lava_callback - INFO - Starting async job submit for node 69b6c64f1727ff69d6f27a76 2026-03-17 14:46:49,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:46:49,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c64f1727ff69d6f27a76 HTTP/1.1" 200 None 2026-03-17 14:46:49,150 - lava_callback - DEBUG - Processing node 69b6c64f1727ff69d6f27a76: baseline-arm-clabbe 2026-03-17 14:46:49,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c64f1727ff69d6f27a76 2026-03-17 14:46:49,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:46:49,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c64f1727ff69d6f27a76 HTTP/1.1" 200 None 2026-03-17 14:46:49,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:46:49,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:46:49,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:46:49,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c64f1727ff69d6f27a76 HTTP/1.1" 200 None 2026-03-17 14:46:49,203 - lava_callback - ERROR - Error processing callback for node 69b6c64f1727ff69d6f27a76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34750 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:47:29,179 - lava_callback - INFO - Received callback for node 69b6c6731727ff69d6f27a86 INFO: 172.20.0.1:34752 - "POST /node/69b6c6731727ff69d6f27a86 HTTP/1.0" 202 Accepted 2026-03-17 14:47:29,185 - lava_callback - INFO - Starting async job submit for node 69b6c6731727ff69d6f27a86 2026-03-17 14:47:29,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:47:29,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c6731727ff69d6f27a86 HTTP/1.1" 200 None 2026-03-17 14:47:29,200 - lava_callback - DEBUG - Processing node 69b6c6731727ff69d6f27a86: baseline-arm-clabbe 2026-03-17 14:47:29,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c6731727ff69d6f27a86 2026-03-17 14:47:29,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:47:29,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c6731727ff69d6f27a86 HTTP/1.1" 200 None 2026-03-17 14:47:29,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:47:29,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:47:29,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:47:29,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c6731727ff69d6f27a86 HTTP/1.1" 200 None 2026-03-17 14:47:29,256 - lava_callback - ERROR - Error processing callback for node 69b6c6731727ff69d6f27a86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33506 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:48:09,149 - lava_callback - INFO - Received callback for node 69b6c6971727ff69d6f27a93 INFO: 172.20.0.1:33510 - "POST /node/69b6c6971727ff69d6f27a93 HTTP/1.0" 202 Accepted 2026-03-17 14:48:09,155 - lava_callback - INFO - Starting async job submit for node 69b6c6971727ff69d6f27a93 2026-03-17 14:48:09,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:48:09,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c6971727ff69d6f27a93 HTTP/1.1" 200 None 2026-03-17 14:48:09,171 - lava_callback - DEBUG - Processing node 69b6c6971727ff69d6f27a93: baseline-arm-clabbe 2026-03-17 14:48:09,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c6971727ff69d6f27a93 2026-03-17 14:48:09,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:48:09,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c6971727ff69d6f27a93 HTTP/1.1" 200 None 2026-03-17 14:48:09,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:48:09,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:48:09,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:48:09,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c6971727ff69d6f27a93 HTTP/1.1" 200 None 2026-03-17 14:48:09,236 - lava_callback - ERROR - Error processing callback for node 69b6c6971727ff69d6f27a93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49664 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:48:49,211 - lava_callback - INFO - Received callback for node 69b6c6bb1727ff69d6f27aa0 INFO: 172.20.0.1:49666 - "POST /node/69b6c6bb1727ff69d6f27aa0 HTTP/1.0" 202 Accepted 2026-03-17 14:48:49,216 - lava_callback - INFO - Starting async job submit for node 69b6c6bb1727ff69d6f27aa0 2026-03-17 14:48:49,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:48:49,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c6bb1727ff69d6f27aa0 HTTP/1.1" 200 None 2026-03-17 14:48:49,233 - lava_callback - DEBUG - Processing node 69b6c6bb1727ff69d6f27aa0: baseline-arm-clabbe 2026-03-17 14:48:49,233 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c6bb1727ff69d6f27aa0 2026-03-17 14:48:49,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:48:49,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c6bb1727ff69d6f27aa0 HTTP/1.1" 200 None 2026-03-17 14:48:49,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:48:49,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:48:49,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:48:49,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c6bb1727ff69d6f27aa0 HTTP/1.1" 200 None 2026-03-17 14:48:49,312 - lava_callback - ERROR - Error processing callback for node 69b6c6bb1727ff69d6f27aa0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38626 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:49:09,188 - lava_callback - INFO - Received callback for node 69b6c6df1727ff69d6f27aab INFO: 172.20.0.1:38634 - "POST /node/69b6c6df1727ff69d6f27aab HTTP/1.0" 202 Accepted 2026-03-17 14:49:09,193 - lava_callback - INFO - Starting async job submit for node 69b6c6df1727ff69d6f27aab 2026-03-17 14:49:09,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:49:09,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c6df1727ff69d6f27aab HTTP/1.1" 200 None 2026-03-17 14:49:09,209 - lava_callback - DEBUG - Processing node 69b6c6df1727ff69d6f27aab: baseline-arm-clabbe 2026-03-17 14:49:09,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c6df1727ff69d6f27aab 2026-03-17 14:49:09,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:49:09,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c6df1727ff69d6f27aab HTTP/1.1" 200 None 2026-03-17 14:49:09,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:49:09,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:49:09,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:49:09,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c6df1727ff69d6f27aab HTTP/1.1" 200 None 2026-03-17 14:49:09,263 - lava_callback - ERROR - Error processing callback for node 69b6c6df1727ff69d6f27aab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44712 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:49:49,231 - lava_callback - INFO - Received callback for node 69b6c7031727ff69d6f27ab6 INFO: 172.20.0.1:44718 - "POST /node/69b6c7031727ff69d6f27ab6 HTTP/1.0" 202 Accepted 2026-03-17 14:49:49,236 - lava_callback - INFO - Starting async job submit for node 69b6c7031727ff69d6f27ab6 2026-03-17 14:49:49,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:49:49,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7031727ff69d6f27ab6 HTTP/1.1" 200 None 2026-03-17 14:49:49,266 - lava_callback - DEBUG - Processing node 69b6c7031727ff69d6f27ab6: baseline-arm-clabbe 2026-03-17 14:49:49,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c7031727ff69d6f27ab6 2026-03-17 14:49:49,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:49:49,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7031727ff69d6f27ab6 HTTP/1.1" 200 None 2026-03-17 14:49:49,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:49:49,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:49:49,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:49:49,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c7031727ff69d6f27ab6 HTTP/1.1" 200 None 2026-03-17 14:49:49,326 - lava_callback - ERROR - Error processing callback for node 69b6c7031727ff69d6f27ab6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39676 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:50:29,223 - lava_callback - INFO - Received callback for node 69b6c7281727ff69d6f27ac3 INFO: 172.20.0.1:39688 - "POST /node/69b6c7281727ff69d6f27ac3 HTTP/1.0" 202 Accepted 2026-03-17 14:50:29,228 - lava_callback - INFO - Starting async job submit for node 69b6c7281727ff69d6f27ac3 2026-03-17 14:50:29,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:50:29,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7281727ff69d6f27ac3 HTTP/1.1" 200 None 2026-03-17 14:50:29,249 - lava_callback - DEBUG - Processing node 69b6c7281727ff69d6f27ac3: baseline-arm-clabbe 2026-03-17 14:50:29,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c7281727ff69d6f27ac3 2026-03-17 14:50:29,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:50:29,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7281727ff69d6f27ac3 HTTP/1.1" 200 None 2026-03-17 14:50:29,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:50:29,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:50:29,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:50:29,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c7281727ff69d6f27ac3 HTTP/1.1" 200 None 2026-03-17 14:50:29,302 - lava_callback - ERROR - Error processing callback for node 69b6c7281727ff69d6f27ac3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58686 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:51:09,276 - lava_callback - INFO - Received callback for node 69b6c74c1727ff69d6f27acc INFO: 172.20.0.1:58700 - "POST /node/69b6c74c1727ff69d6f27acc HTTP/1.0" 202 Accepted 2026-03-17 14:51:09,282 - lava_callback - INFO - Starting async job submit for node 69b6c74c1727ff69d6f27acc 2026-03-17 14:51:09,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:51:09,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c74c1727ff69d6f27acc HTTP/1.1" 200 None 2026-03-17 14:51:09,297 - lava_callback - DEBUG - Processing node 69b6c74c1727ff69d6f27acc: baseline-arm-clabbe 2026-03-17 14:51:09,297 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c74c1727ff69d6f27acc 2026-03-17 14:51:09,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:51:09,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c74c1727ff69d6f27acc HTTP/1.1" 200 None 2026-03-17 14:51:09,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:51:09,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-17 14:51:09,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:51:09,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c74c1727ff69d6f27acc HTTP/1.1" 200 None 2026-03-17 14:51:09,353 - lava_callback - ERROR - Error processing callback for node 69b6c74c1727ff69d6f27acc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40382 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:51:49,278 - lava_callback - INFO - Received callback for node 69b6c7701727ff69d6f27ad7 INFO: 172.20.0.1:40394 - "POST /node/69b6c7701727ff69d6f27ad7 HTTP/1.0" 202 Accepted 2026-03-17 14:51:49,283 - lava_callback - INFO - Starting async job submit for node 69b6c7701727ff69d6f27ad7 2026-03-17 14:51:49,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:51:49,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7701727ff69d6f27ad7 HTTP/1.1" 200 None 2026-03-17 14:51:49,306 - lava_callback - DEBUG - Processing node 69b6c7701727ff69d6f27ad7: baseline-arm-clabbe 2026-03-17 14:51:49,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c7701727ff69d6f27ad7 2026-03-17 14:51:49,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:51:49,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7701727ff69d6f27ad7 HTTP/1.1" 200 None 2026-03-17 14:51:49,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:51:49,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:51:49,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:51:49,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c7701727ff69d6f27ad7 HTTP/1.1" 200 None 2026-03-17 14:51:49,372 - lava_callback - ERROR - Error processing callback for node 69b6c7701727ff69d6f27ad7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58206 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:52:09,310 - lava_callback - INFO - Received callback for node 69b6c7941727ff69d6f27ae4 INFO: 172.20.0.1:58222 - "POST /node/69b6c7941727ff69d6f27ae4 HTTP/1.0" 202 Accepted 2026-03-17 14:52:09,315 - lava_callback - INFO - Starting async job submit for node 69b6c7941727ff69d6f27ae4 2026-03-17 14:52:09,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:52:09,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7941727ff69d6f27ae4 HTTP/1.1" 200 None 2026-03-17 14:52:09,331 - lava_callback - DEBUG - Processing node 69b6c7941727ff69d6f27ae4: baseline-arm-clabbe 2026-03-17 14:52:09,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c7941727ff69d6f27ae4 2026-03-17 14:52:09,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:52:09,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7941727ff69d6f27ae4 HTTP/1.1" 200 None 2026-03-17 14:52:09,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:52:09,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:52:09,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:52:09,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c7941727ff69d6f27ae4 HTTP/1.1" 200 None 2026-03-17 14:52:09,389 - lava_callback - ERROR - Error processing callback for node 69b6c7941727ff69d6f27ae4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34230 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:52:49,314 - lava_callback - INFO - Received callback for node 69b6c7b71727ff69d6f27aee INFO: 172.20.0.1:34242 - "POST /node/69b6c7b71727ff69d6f27aee HTTP/1.0" 202 Accepted 2026-03-17 14:52:49,320 - lava_callback - INFO - Starting async job submit for node 69b6c7b71727ff69d6f27aee 2026-03-17 14:52:49,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:52:49,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7b71727ff69d6f27aee HTTP/1.1" 200 None 2026-03-17 14:52:49,336 - lava_callback - DEBUG - Processing node 69b6c7b71727ff69d6f27aee: baseline-arm-clabbe 2026-03-17 14:52:49,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c7b71727ff69d6f27aee 2026-03-17 14:52:49,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:52:49,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7b71727ff69d6f27aee HTTP/1.1" 200 None 2026-03-17 14:52:49,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:52:49,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:52:49,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:52:49,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c7b71727ff69d6f27aee HTTP/1.1" 200 None 2026-03-17 14:52:49,397 - lava_callback - ERROR - Error processing callback for node 69b6c7b71727ff69d6f27aee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39892 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:53:29,420 - lava_callback - INFO - Received callback for node 69b6c7dc1727ff69d6f27afc INFO: 172.20.0.1:39902 - "POST /node/69b6c7dc1727ff69d6f27afc HTTP/1.0" 202 Accepted 2026-03-17 14:53:29,426 - lava_callback - INFO - Starting async job submit for node 69b6c7dc1727ff69d6f27afc 2026-03-17 14:53:29,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:53:29,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7dc1727ff69d6f27afc HTTP/1.1" 200 None 2026-03-17 14:53:29,442 - lava_callback - DEBUG - Processing node 69b6c7dc1727ff69d6f27afc: baseline-arm-clabbe 2026-03-17 14:53:29,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c7dc1727ff69d6f27afc 2026-03-17 14:53:29,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:53:29,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7dc1727ff69d6f27afc HTTP/1.1" 200 None 2026-03-17 14:53:29,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:53:29,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:53:29,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:53:29,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c7dc1727ff69d6f27afc HTTP/1.1" 200 None 2026-03-17 14:53:29,519 - lava_callback - ERROR - Error processing callback for node 69b6c7dc1727ff69d6f27afc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52478 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:54:09,353 - lava_callback - INFO - Received callback for node 69b6c7ff1727ff69d6f27b03 INFO: 172.20.0.1:52494 - "POST /node/69b6c7ff1727ff69d6f27b03 HTTP/1.0" 202 Accepted 2026-03-17 14:54:09,359 - lava_callback - INFO - Starting async job submit for node 69b6c7ff1727ff69d6f27b03 2026-03-17 14:54:09,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:54:09,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7ff1727ff69d6f27b03 HTTP/1.1" 200 None 2026-03-17 14:54:09,375 - lava_callback - DEBUG - Processing node 69b6c7ff1727ff69d6f27b03: baseline-arm-clabbe 2026-03-17 14:54:09,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c7ff1727ff69d6f27b03 2026-03-17 14:54:09,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:54:09,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c7ff1727ff69d6f27b03 HTTP/1.1" 200 None 2026-03-17 14:54:09,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:54:09,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:54:09,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:54:09,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c7ff1727ff69d6f27b03 HTTP/1.1" 200 None 2026-03-17 14:54:09,434 - lava_callback - ERROR - Error processing callback for node 69b6c7ff1727ff69d6f27b03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60134 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:54:49,429 - lava_callback - INFO - Received callback for node 69b6c8231727ff69d6f27b0c INFO: 172.20.0.1:60140 - "POST /node/69b6c8231727ff69d6f27b0c HTTP/1.0" 202 Accepted 2026-03-17 14:54:49,435 - lava_callback - INFO - Starting async job submit for node 69b6c8231727ff69d6f27b0c 2026-03-17 14:54:49,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:54:49,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c8231727ff69d6f27b0c HTTP/1.1" 200 None 2026-03-17 14:54:49,451 - lava_callback - DEBUG - Processing node 69b6c8231727ff69d6f27b0c: baseline-arm-clabbe 2026-03-17 14:54:49,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c8231727ff69d6f27b0c 2026-03-17 14:54:49,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:54:49,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c8231727ff69d6f27b0c HTTP/1.1" 200 None 2026-03-17 14:54:49,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:54:49,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:54:49,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:54:49,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c8231727ff69d6f27b0c HTTP/1.1" 200 None 2026-03-17 14:54:49,524 - lava_callback - ERROR - Error processing callback for node 69b6c8231727ff69d6f27b0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55642 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:55:09,289 - lava_callback - INFO - Received callback for node 69b6c8471727ff69d6f27b17 INFO: 172.20.0.1:55650 - "POST /node/69b6c8471727ff69d6f27b17 HTTP/1.0" 202 Accepted 2026-03-17 14:55:09,295 - lava_callback - INFO - Starting async job submit for node 69b6c8471727ff69d6f27b17 2026-03-17 14:55:09,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:55:09,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c8471727ff69d6f27b17 HTTP/1.1" 200 None 2026-03-17 14:55:09,312 - lava_callback - DEBUG - Processing node 69b6c8471727ff69d6f27b17: baseline-arm-clabbe 2026-03-17 14:55:09,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c8471727ff69d6f27b17 2026-03-17 14:55:09,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:55:09,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c8471727ff69d6f27b17 HTTP/1.1" 200 None 2026-03-17 14:55:09,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:55:09,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:55:09,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:55:09,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c8471727ff69d6f27b17 HTTP/1.1" 200 None 2026-03-17 14:55:09,385 - lava_callback - ERROR - Error processing callback for node 69b6c8471727ff69d6f27b17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58386 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:55:49,432 - lava_callback - INFO - Received callback for node 69b6c86b1727ff69d6f27b21 INFO: 172.20.0.1:58390 - "POST /node/69b6c86b1727ff69d6f27b21 HTTP/1.0" 202 Accepted 2026-03-17 14:55:49,438 - lava_callback - INFO - Starting async job submit for node 69b6c86b1727ff69d6f27b21 2026-03-17 14:55:49,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:55:49,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c86b1727ff69d6f27b21 HTTP/1.1" 200 None 2026-03-17 14:55:49,453 - lava_callback - DEBUG - Processing node 69b6c86b1727ff69d6f27b21: baseline-arm-clabbe 2026-03-17 14:55:49,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c86b1727ff69d6f27b21 2026-03-17 14:55:49,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:55:49,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c86b1727ff69d6f27b21 HTTP/1.1" 200 None 2026-03-17 14:55:49,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:55:49,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:55:49,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:55:49,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c86b1727ff69d6f27b21 HTTP/1.1" 200 None 2026-03-17 14:55:49,520 - lava_callback - ERROR - Error processing callback for node 69b6c86b1727ff69d6f27b21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36684 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:56:29,428 - lava_callback - INFO - Received callback for node 69b6c88f1727ff69d6f27b2f INFO: 172.20.0.1:36690 - "POST /node/69b6c88f1727ff69d6f27b2f HTTP/1.0" 202 Accepted 2026-03-17 14:56:29,434 - lava_callback - INFO - Starting async job submit for node 69b6c88f1727ff69d6f27b2f 2026-03-17 14:56:29,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:56:29,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c88f1727ff69d6f27b2f HTTP/1.1" 200 None 2026-03-17 14:56:29,449 - lava_callback - DEBUG - Processing node 69b6c88f1727ff69d6f27b2f: baseline-arm-clabbe 2026-03-17 14:56:29,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c88f1727ff69d6f27b2f 2026-03-17 14:56:29,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:56:29,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c88f1727ff69d6f27b2f HTTP/1.1" 200 None 2026-03-17 14:56:29,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:56:29,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:56:29,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:56:29,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c88f1727ff69d6f27b2f HTTP/1.1" 200 None 2026-03-17 14:56:29,517 - lava_callback - ERROR - Error processing callback for node 69b6c88f1727ff69d6f27b2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47400 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:57:09,507 - lava_callback - INFO - Received callback for node 69b6c8b31727ff69d6f27b38 INFO: 172.20.0.1:47412 - "POST /node/69b6c8b31727ff69d6f27b38 HTTP/1.0" 202 Accepted 2026-03-17 14:57:09,512 - lava_callback - INFO - Starting async job submit for node 69b6c8b31727ff69d6f27b38 2026-03-17 14:57:09,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:57:09,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c8b31727ff69d6f27b38 HTTP/1.1" 200 None 2026-03-17 14:57:09,528 - lava_callback - DEBUG - Processing node 69b6c8b31727ff69d6f27b38: baseline-arm-clabbe 2026-03-17 14:57:09,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c8b31727ff69d6f27b38 2026-03-17 14:57:09,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:57:09,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c8b31727ff69d6f27b38 HTTP/1.1" 200 None 2026-03-17 14:57:09,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:57:09,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:57:09,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:57:09,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c8b31727ff69d6f27b38 HTTP/1.1" 200 None 2026-03-17 14:57:09,583 - lava_callback - ERROR - Error processing callback for node 69b6c8b31727ff69d6f27b38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48498 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:57:49,463 - lava_callback - INFO - Received callback for node 69b6c8d71727ff69d6f27b42 INFO: 172.20.0.1:48510 - "POST /node/69b6c8d71727ff69d6f27b42 HTTP/1.0" 202 Accepted 2026-03-17 14:57:49,469 - lava_callback - INFO - Starting async job submit for node 69b6c8d71727ff69d6f27b42 2026-03-17 14:57:49,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:57:49,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c8d71727ff69d6f27b42 HTTP/1.1" 200 None 2026-03-17 14:57:49,487 - lava_callback - DEBUG - Processing node 69b6c8d71727ff69d6f27b42: baseline-arm-clabbe 2026-03-17 14:57:49,488 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c8d71727ff69d6f27b42 2026-03-17 14:57:49,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:57:49,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c8d71727ff69d6f27b42 HTTP/1.1" 200 None 2026-03-17 14:57:49,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:57:49,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:57:49,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:57:49,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c8d71727ff69d6f27b42 HTTP/1.1" 200 None 2026-03-17 14:57:49,541 - lava_callback - ERROR - Error processing callback for node 69b6c8d71727ff69d6f27b42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59168 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:58:09,506 - lava_callback - INFO - Received callback for node 69b6c8fb1727ff69d6f27b4d INFO: 172.20.0.1:59184 - "POST /node/69b6c8fb1727ff69d6f27b4d HTTP/1.0" 202 Accepted 2026-03-17 14:58:09,512 - lava_callback - INFO - Starting async job submit for node 69b6c8fb1727ff69d6f27b4d 2026-03-17 14:58:09,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:58:09,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c8fb1727ff69d6f27b4d HTTP/1.1" 200 None 2026-03-17 14:58:09,528 - lava_callback - DEBUG - Processing node 69b6c8fb1727ff69d6f27b4d: baseline-arm-clabbe 2026-03-17 14:58:09,528 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c8fb1727ff69d6f27b4d 2026-03-17 14:58:09,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:58:09,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c8fb1727ff69d6f27b4d HTTP/1.1" 200 None 2026-03-17 14:58:09,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:58:09,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 14:58:09,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:58:09,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c8fb1727ff69d6f27b4d HTTP/1.1" 200 None 2026-03-17 14:58:09,596 - lava_callback - ERROR - Error processing callback for node 69b6c8fb1727ff69d6f27b4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35754 - "GET / HTTP/1.0" 200 OK 2026-03-17 14:58:47,763 - lava_callback - INFO - Received callback for node 69b6c9241727ff69d6f27b5c INFO: 172.20.0.1:35756 - "POST /node/69b6c9241727ff69d6f27b5c HTTP/1.0" 202 Accepted 2026-03-17 14:58:47,769 - lava_callback - INFO - Starting async job submit for node 69b6c9241727ff69d6f27b5c 2026-03-17 14:58:47,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:58:47,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c9241727ff69d6f27b5c HTTP/1.1" 200 None 2026-03-17 14:58:47,786 - lava_callback - DEBUG - Processing node 69b6c9241727ff69d6f27b5c: baseline-arm64-baylibre 2026-03-17 14:58:47,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c9241727ff69d6f27b5c 2026-03-17 14:58:47,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:58:47,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c9241727ff69d6f27b5c HTTP/1.1" 200 None 2026-03-17 14:58:47,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:58:47,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 14:58:47,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 14:58:47,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c9241727ff69d6f27b5c HTTP/1.1" 200 None 2026-03-17 14:58:47,863 - lava_callback - ERROR - Error processing callback for node 69b6c9241727ff69d6f27b5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37568 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:00:07,797 - lava_callback - INFO - Received callback for node 69b6c96d1727ff69d6f27b65 INFO: 172.20.0.1:37574 - "POST /node/69b6c96d1727ff69d6f27b65 HTTP/1.0" 202 Accepted 2026-03-17 15:00:07,802 - lava_callback - INFO - Starting async job submit for node 69b6c96d1727ff69d6f27b65 2026-03-17 15:00:07,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:00:07,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c96d1727ff69d6f27b65 HTTP/1.1" 200 None 2026-03-17 15:00:07,818 - lava_callback - DEBUG - Processing node 69b6c96d1727ff69d6f27b65: baseline-arm64-baylibre 2026-03-17 15:00:07,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c96d1727ff69d6f27b65 2026-03-17 15:00:07,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:00:07,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c96d1727ff69d6f27b65 HTTP/1.1" 200 None 2026-03-17 15:00:07,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:00:07,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:00:07,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:00:07,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c96d1727ff69d6f27b65 HTTP/1.1" 200 None 2026-03-17 15:00:07,880 - lava_callback - ERROR - Error processing callback for node 69b6c96d1727ff69d6f27b65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60516 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:01:27,915 - lava_callback - INFO - Received callback for node 69b6c9b71727ff69d6f27b72 INFO: 172.20.0.1:60522 - "POST /node/69b6c9b71727ff69d6f27b72 HTTP/1.0" 202 Accepted 2026-03-17 15:01:27,920 - lava_callback - INFO - Starting async job submit for node 69b6c9b71727ff69d6f27b72 2026-03-17 15:01:27,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:01:27,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c9b71727ff69d6f27b72 HTTP/1.1" 200 None 2026-03-17 15:01:27,937 - lava_callback - DEBUG - Processing node 69b6c9b71727ff69d6f27b72: baseline-arm64-baylibre 2026-03-17 15:01:27,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6c9b71727ff69d6f27b72 2026-03-17 15:01:27,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:01:27,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6c9b71727ff69d6f27b72 HTTP/1.1" 200 None 2026-03-17 15:01:27,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:01:27,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:01:27,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:01:27,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6c9b71727ff69d6f27b72 HTTP/1.1" 200 None 2026-03-17 15:01:27,990 - lava_callback - ERROR - Error processing callback for node 69b6c9b71727ff69d6f27b72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35090 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:02:47,966 - lava_callback - INFO - Received callback for node 69b6ca021727ff69d6f27b81 INFO: 172.20.0.1:35098 - "POST /node/69b6ca021727ff69d6f27b81 HTTP/1.0" 202 Accepted 2026-03-17 15:02:47,972 - lava_callback - INFO - Starting async job submit for node 69b6ca021727ff69d6f27b81 2026-03-17 15:02:47,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:02:48,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ca021727ff69d6f27b81 HTTP/1.1" 200 None 2026-03-17 15:02:48,010 - lava_callback - DEBUG - Processing node 69b6ca021727ff69d6f27b81: baseline-arm64-baylibre 2026-03-17 15:02:48,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ca021727ff69d6f27b81 2026-03-17 15:02:48,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:02:48,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ca021727ff69d6f27b81 HTTP/1.1" 200 None 2026-03-17 15:02:48,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:02:48,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:02:48,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:02:48,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ca021727ff69d6f27b81 HTTP/1.1" 200 None 2026-03-17 15:02:48,079 - lava_callback - ERROR - Error processing callback for node 69b6ca021727ff69d6f27b81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43626 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:03:47,999 - lava_callback - INFO - Received callback for node 69b6ca4d1727ff69d6f27b8c INFO: 172.20.0.1:43630 - "POST /node/69b6ca4d1727ff69d6f27b8c HTTP/1.0" 202 Accepted 2026-03-17 15:03:48,005 - lava_callback - INFO - Starting async job submit for node 69b6ca4d1727ff69d6f27b8c 2026-03-17 15:03:48,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:03:48,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ca4d1727ff69d6f27b8c HTTP/1.1" 200 None 2026-03-17 15:03:48,021 - lava_callback - DEBUG - Processing node 69b6ca4d1727ff69d6f27b8c: baseline-arm64-baylibre 2026-03-17 15:03:48,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ca4d1727ff69d6f27b8c 2026-03-17 15:03:48,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:03:48,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ca4d1727ff69d6f27b8c HTTP/1.1" 200 None 2026-03-17 15:03:48,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:03:48,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:03:48,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:03:48,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ca4d1727ff69d6f27b8c HTTP/1.1" 200 None 2026-03-17 15:03:48,079 - lava_callback - ERROR - Error processing callback for node 69b6ca4d1727ff69d6f27b8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46880 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:05:08,142 - lava_callback - INFO - Received callback for node 69b6ca971727ff69d6f27b9b INFO: 172.20.0.1:46894 - "POST /node/69b6ca971727ff69d6f27b9b HTTP/1.0" 202 Accepted 2026-03-17 15:05:08,148 - lava_callback - INFO - Starting async job submit for node 69b6ca971727ff69d6f27b9b 2026-03-17 15:05:08,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:05:08,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ca971727ff69d6f27b9b HTTP/1.1" 200 None 2026-03-17 15:05:08,164 - lava_callback - DEBUG - Processing node 69b6ca971727ff69d6f27b9b: baseline-arm64-baylibre 2026-03-17 15:05:08,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ca971727ff69d6f27b9b 2026-03-17 15:05:08,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:05:08,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ca971727ff69d6f27b9b HTTP/1.1" 200 None 2026-03-17 15:05:08,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:05:08,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:05:08,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:05:08,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ca971727ff69d6f27b9b HTTP/1.1" 200 None 2026-03-17 15:05:08,220 - lava_callback - ERROR - Error processing callback for node 69b6ca971727ff69d6f27b9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42792 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:06:08,134 - lava_callback - INFO - Received callback for node 69b6cade1727ff69d6f27ba5 INFO: 172.20.0.1:42794 - "POST /node/69b6cade1727ff69d6f27ba5 HTTP/1.0" 202 Accepted 2026-03-17 15:06:08,140 - lava_callback - INFO - Starting async job submit for node 69b6cade1727ff69d6f27ba5 2026-03-17 15:06:08,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:06:08,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cade1727ff69d6f27ba5 HTTP/1.1" 200 None 2026-03-17 15:06:08,157 - lava_callback - DEBUG - Processing node 69b6cade1727ff69d6f27ba5: baseline-arm64-baylibre 2026-03-17 15:06:08,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cade1727ff69d6f27ba5 2026-03-17 15:06:08,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:06:08,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cade1727ff69d6f27ba5 HTTP/1.1" 200 None 2026-03-17 15:06:08,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:06:08,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:06:08,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:06:08,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cade1727ff69d6f27ba5 HTTP/1.1" 200 None 2026-03-17 15:06:08,232 - lava_callback - ERROR - Error processing callback for node 69b6cade1727ff69d6f27ba5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60054 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:07:28,195 - lava_callback - INFO - Received callback for node 69b6cb281727ff69d6f27bb5 INFO: 172.20.0.1:60058 - "POST /node/69b6cb281727ff69d6f27bb5 HTTP/1.0" 202 Accepted 2026-03-17 15:07:28,201 - lava_callback - INFO - Starting async job submit for node 69b6cb281727ff69d6f27bb5 2026-03-17 15:07:28,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:07:28,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cb281727ff69d6f27bb5 HTTP/1.1" 200 None 2026-03-17 15:07:28,218 - lava_callback - DEBUG - Processing node 69b6cb281727ff69d6f27bb5: baseline-arm64-baylibre 2026-03-17 15:07:28,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cb281727ff69d6f27bb5 2026-03-17 15:07:28,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:07:28,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cb281727ff69d6f27bb5 HTTP/1.1" 200 None 2026-03-17 15:07:28,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:07:28,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:07:28,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:07:28,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cb281727ff69d6f27bb5 HTTP/1.1" 200 None 2026-03-17 15:07:28,270 - lava_callback - ERROR - Error processing callback for node 69b6cb281727ff69d6f27bb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51486 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:08:50,296 - lava_callback - INFO - Received callback for node 69b6cb7a1727ff69d6f27bbe INFO: 172.20.0.1:40218 - "POST /node/69b6cb7a1727ff69d6f27bbe HTTP/1.0" 202 Accepted 2026-03-17 15:08:50,302 - lava_callback - INFO - Starting async job submit for node 69b6cb7a1727ff69d6f27bbe 2026-03-17 15:08:50,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:08:50,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cb7a1727ff69d6f27bbe HTTP/1.1" 200 None 2026-03-17 15:08:50,318 - lava_callback - DEBUG - Processing node 69b6cb7a1727ff69d6f27bbe: baseline-arm64-clabbe 2026-03-17 15:08:50,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cb7a1727ff69d6f27bbe 2026-03-17 15:08:50,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:08:50,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cb7a1727ff69d6f27bbe HTTP/1.1" 200 None 2026-03-17 15:08:50,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:08:50,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:08:50,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:08:50,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cb7a1727ff69d6f27bbe HTTP/1.1" 200 None 2026-03-17 15:08:50,379 - lava_callback - ERROR - Error processing callback for node 69b6cb7a1727ff69d6f27bbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50686 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:10:08,408 - lava_callback - INFO - Received callback for node 69b6cbbd1727ff69d6f27bc9 INFO: 172.20.0.1:50694 - "POST /node/69b6cbbd1727ff69d6f27bc9 HTTP/1.0" 202 Accepted 2026-03-17 15:10:08,414 - lava_callback - INFO - Starting async job submit for node 69b6cbbd1727ff69d6f27bc9 2026-03-17 15:10:08,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:10:08,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cbbd1727ff69d6f27bc9 HTTP/1.1" 200 None 2026-03-17 15:10:08,430 - lava_callback - DEBUG - Processing node 69b6cbbd1727ff69d6f27bc9: baseline-arm64-baylibre 2026-03-17 15:10:08,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cbbd1727ff69d6f27bc9 2026-03-17 15:10:08,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:10:08,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cbbd1727ff69d6f27bc9 HTTP/1.1" 200 None 2026-03-17 15:10:08,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:10:08,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:10:08,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:10:08,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cbbd1727ff69d6f27bc9 HTTP/1.1" 200 None 2026-03-17 15:10:08,525 - lava_callback - ERROR - Error processing callback for node 69b6cbbd1727ff69d6f27bc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57058 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:11:50,169 - lava_callback - INFO - Received callback for node 69b6cc2e1727ff69d6f27bd4 INFO: 172.20.0.1:34048 - "POST /node/69b6cc2e1727ff69d6f27bd4 HTTP/1.0" 202 Accepted 2026-03-17 15:11:50,174 - lava_callback - INFO - Starting async job submit for node 69b6cc2e1727ff69d6f27bd4 2026-03-17 15:11:50,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:11:50,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cc2e1727ff69d6f27bd4 HTTP/1.1" 200 None 2026-03-17 15:11:50,210 - lava_callback - DEBUG - Processing node 69b6cc2e1727ff69d6f27bd4: baseline-arm64-clabbe 2026-03-17 15:11:50,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cc2e1727ff69d6f27bd4 2026-03-17 15:11:50,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:11:50,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cc2e1727ff69d6f27bd4 HTTP/1.1" 200 None 2026-03-17 15:11:50,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:11:50,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:11:50,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:11:50,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cc2e1727ff69d6f27bd4 HTTP/1.1" 200 None 2026-03-17 15:11:50,279 - lava_callback - ERROR - Error processing callback for node 69b6cc2e1727ff69d6f27bd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48558 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:13:10,208 - lava_callback - INFO - Received callback for node 69b6cc791727ff69d6f27be2 INFO: 172.20.0.1:36596 - "POST /node/69b6cc791727ff69d6f27be2 HTTP/1.0" 202 Accepted 2026-03-17 15:13:10,214 - lava_callback - INFO - Starting async job submit for node 69b6cc791727ff69d6f27be2 2026-03-17 15:13:10,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:13:10,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cc791727ff69d6f27be2 HTTP/1.1" 200 None 2026-03-17 15:13:10,230 - lava_callback - DEBUG - Processing node 69b6cc791727ff69d6f27be2: baseline-arm64-clabbe 2026-03-17 15:13:10,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cc791727ff69d6f27be2 2026-03-17 15:13:10,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:13:10,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cc791727ff69d6f27be2 HTTP/1.1" 200 None 2026-03-17 15:13:10,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:13:10,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:13:10,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:13:10,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cc791727ff69d6f27be2 HTTP/1.1" 200 None 2026-03-17 15:13:10,294 - lava_callback - ERROR - Error processing callback for node 69b6cc791727ff69d6f27be2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35220 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:14:08,708 - lava_callback - INFO - Received callback for node 69b6ccbc1727ff69d6f27bed INFO: 172.20.0.1:35230 - "POST /node/69b6ccbc1727ff69d6f27bed HTTP/1.0" 202 Accepted 2026-03-17 15:14:08,713 - lava_callback - INFO - Starting async job submit for node 69b6ccbc1727ff69d6f27bed 2026-03-17 15:14:08,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:14:08,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ccbc1727ff69d6f27bed HTTP/1.1" 200 None 2026-03-17 15:14:08,730 - lava_callback - DEBUG - Processing node 69b6ccbc1727ff69d6f27bed: baseline-arm64-baylibre 2026-03-17 15:14:08,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ccbc1727ff69d6f27bed 2026-03-17 15:14:08,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:14:08,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ccbc1727ff69d6f27bed HTTP/1.1" 200 None 2026-03-17 15:14:08,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:14:08,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:14:08,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:14:08,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ccbc1727ff69d6f27bed HTTP/1.1" 200 None 2026-03-17 15:14:08,790 - lava_callback - ERROR - Error processing callback for node 69b6ccbc1727ff69d6f27bed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39460 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:15:30,383 - lava_callback - INFO - Received callback for node 69b6cd0d1727ff69d6f27bfc INFO: 172.20.0.1:48566 - "POST /node/69b6cd0d1727ff69d6f27bfc HTTP/1.0" 202 Accepted 2026-03-17 15:15:30,388 - lava_callback - INFO - Starting async job submit for node 69b6cd0d1727ff69d6f27bfc 2026-03-17 15:15:30,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:15:30,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cd0d1727ff69d6f27bfc HTTP/1.1" 200 None 2026-03-17 15:15:30,404 - lava_callback - DEBUG - Processing node 69b6cd0d1727ff69d6f27bfc: baseline-arm64-clabbe 2026-03-17 15:15:30,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cd0d1727ff69d6f27bfc 2026-03-17 15:15:30,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:15:30,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cd0d1727ff69d6f27bfc HTTP/1.1" 200 None 2026-03-17 15:15:30,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:15:30,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:15:30,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:15:30,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cd0d1727ff69d6f27bfc HTTP/1.1" 200 None 2026-03-17 15:15:30,473 - lava_callback - ERROR - Error processing callback for node 69b6cd0d1727ff69d6f27bfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42366 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:16:30,383 - lava_callback - INFO - Received callback for node 69b6cd4a1727ff69d6f27c04 INFO: 172.20.0.1:56192 - "POST /node/69b6cd4a1727ff69d6f27c04 HTTP/1.0" 202 Accepted 2026-03-17 15:16:30,388 - lava_callback - INFO - Starting async job submit for node 69b6cd4a1727ff69d6f27c04 2026-03-17 15:16:30,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:16:30,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cd4a1727ff69d6f27c04 HTTP/1.1" 200 None 2026-03-17 15:16:30,413 - lava_callback - DEBUG - Processing node 69b6cd4a1727ff69d6f27c04: baseline-arm-clabbe 2026-03-17 15:16:30,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cd4a1727ff69d6f27c04 2026-03-17 15:16:30,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:16:30,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cd4a1727ff69d6f27c04 HTTP/1.1" 200 None 2026-03-17 15:16:30,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:16:30,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-17 15:16:30,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:16:30,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cd4a1727ff69d6f27c04 HTTP/1.1" 200 None 2026-03-17 15:16:30,471 - lava_callback - ERROR - Error processing callback for node 69b6cd4a1727ff69d6f27c04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45708 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:17:30,628 - lava_callback - INFO - Received callback for node 69b6cd7c1727ff69d6f27c14 INFO: 172.20.0.1:42164 - "POST /node/69b6cd7c1727ff69d6f27c14 HTTP/1.0" 202 Accepted 2026-03-17 15:17:30,634 - lava_callback - INFO - Starting async job submit for node 69b6cd7c1727ff69d6f27c14 2026-03-17 15:17:30,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:17:30,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cd7c1727ff69d6f27c14 HTTP/1.1" 200 None 2026-03-17 15:17:30,649 - lava_callback - DEBUG - Processing node 69b6cd7c1727ff69d6f27c14: baseline-arm64-clabbe 2026-03-17 15:17:30,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cd7c1727ff69d6f27c14 2026-03-17 15:17:30,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:17:30,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cd7c1727ff69d6f27c14 HTTP/1.1" 200 None 2026-03-17 15:17:30,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:17:30,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:17:30,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:17:30,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cd7c1727ff69d6f27c14 HTTP/1.1" 200 None 2026-03-17 15:17:30,705 - lava_callback - ERROR - Error processing callback for node 69b6cd7c1727ff69d6f27c14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60850 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:18:28,889 - lava_callback - INFO - Received callback for node 69b6cdc01727ff69d6f27c1c INFO: 172.20.0.1:60866 - "POST /node/69b6cdc01727ff69d6f27c1c HTTP/1.0" 202 Accepted 2026-03-17 15:18:28,894 - lava_callback - INFO - Starting async job submit for node 69b6cdc01727ff69d6f27c1c 2026-03-17 15:18:28,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:18:28,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cdc01727ff69d6f27c1c HTTP/1.1" 200 None 2026-03-17 15:18:28,910 - lava_callback - DEBUG - Processing node 69b6cdc01727ff69d6f27c1c: baseline-arm64-baylibre 2026-03-17 15:18:28,910 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cdc01727ff69d6f27c1c 2026-03-17 15:18:28,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:18:28,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cdc01727ff69d6f27c1c HTTP/1.1" 200 None 2026-03-17 15:18:28,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:18:28,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:18:28,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:18:28,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cdc01727ff69d6f27c1c HTTP/1.1" 200 None 2026-03-17 15:18:28,993 - lava_callback - ERROR - Error processing callback for node 69b6cdc01727ff69d6f27c1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48340 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:19:48,956 - lava_callback - INFO - Received callback for node 69b6ce0a1727ff69d6f27c25 INFO: 172.20.0.1:48354 - "POST /node/69b6ce0a1727ff69d6f27c25 HTTP/1.0" 202 Accepted 2026-03-17 15:19:48,962 - lava_callback - INFO - Starting async job submit for node 69b6ce0a1727ff69d6f27c25 2026-03-17 15:19:48,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:19:48,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ce0a1727ff69d6f27c25 HTTP/1.1" 200 None 2026-03-17 15:19:48,997 - lava_callback - DEBUG - Processing node 69b6ce0a1727ff69d6f27c25: baseline-arm64-baylibre 2026-03-17 15:19:48,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ce0a1727ff69d6f27c25 2026-03-17 15:19:48,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:19:49,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ce0a1727ff69d6f27c25 HTTP/1.1" 200 None 2026-03-17 15:19:49,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:19:49,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:19:49,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:19:49,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ce0a1727ff69d6f27c25 HTTP/1.1" 200 None 2026-03-17 15:19:49,065 - lava_callback - ERROR - Error processing callback for node 69b6ce0a1727ff69d6f27c25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39100 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:21:10,621 - lava_callback - INFO - Received callback for node 69b6ce591727ff69d6f27c34 INFO: 172.20.0.1:43038 - "POST /node/69b6ce591727ff69d6f27c34 HTTP/1.0" 202 Accepted 2026-03-17 15:21:10,627 - lava_callback - INFO - Starting async job submit for node 69b6ce591727ff69d6f27c34 2026-03-17 15:21:10,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:21:10,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ce591727ff69d6f27c34 HTTP/1.1" 200 None 2026-03-17 15:21:10,643 - lava_callback - DEBUG - Processing node 69b6ce591727ff69d6f27c34: baseline-arm64-clabbe 2026-03-17 15:21:10,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6ce591727ff69d6f27c34 2026-03-17 15:21:10,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:21:10,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6ce591727ff69d6f27c34 HTTP/1.1" 200 None 2026-03-17 15:21:10,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:21:10,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:21:10,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:21:10,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6ce591727ff69d6f27c34 HTTP/1.1" 200 None 2026-03-17 15:21:10,716 - lava_callback - ERROR - Error processing callback for node 69b6ce591727ff69d6f27c34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50098 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:22:30,670 - lava_callback - INFO - Received callback for node 69b6cea51727ff69d6f27c3c INFO: 172.20.0.1:58324 - "POST /node/69b6cea51727ff69d6f27c3c HTTP/1.0" 202 Accepted 2026-03-17 15:22:30,675 - lava_callback - INFO - Starting async job submit for node 69b6cea51727ff69d6f27c3c 2026-03-17 15:22:30,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:22:30,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cea51727ff69d6f27c3c HTTP/1.1" 200 None 2026-03-17 15:22:30,692 - lava_callback - DEBUG - Processing node 69b6cea51727ff69d6f27c3c: baseline-arm64-clabbe 2026-03-17 15:22:30,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cea51727ff69d6f27c3c 2026-03-17 15:22:30,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:22:30,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cea51727ff69d6f27c3c HTTP/1.1" 200 None 2026-03-17 15:22:30,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:22:30,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:22:30,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:22:30,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cea51727ff69d6f27c3c HTTP/1.1" 200 None 2026-03-17 15:22:30,759 - lava_callback - ERROR - Error processing callback for node 69b6cea51727ff69d6f27c3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35568 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:23:50,714 - lava_callback - INFO - Received callback for node 69b6cef01727ff69d6f27c48 INFO: 172.20.0.1:44214 - "POST /node/69b6cef01727ff69d6f27c48 HTTP/1.0" 202 Accepted 2026-03-17 15:23:50,719 - lava_callback - INFO - Starting async job submit for node 69b6cef01727ff69d6f27c48 2026-03-17 15:23:50,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:23:50,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cef01727ff69d6f27c48 HTTP/1.1" 200 None 2026-03-17 15:23:50,734 - lava_callback - DEBUG - Processing node 69b6cef01727ff69d6f27c48: baseline-arm64-clabbe 2026-03-17 15:23:50,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cef01727ff69d6f27c48 2026-03-17 15:23:50,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:23:50,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cef01727ff69d6f27c48 HTTP/1.1" 200 None 2026-03-17 15:23:50,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:23:50,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:23:50,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:23:50,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cef01727ff69d6f27c48 HTTP/1.1" 200 None 2026-03-17 15:23:50,790 - lava_callback - ERROR - Error processing callback for node 69b6cef01727ff69d6f27c48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43318 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:24:50,755 - lava_callback - INFO - Received callback for node 69b6cf3f1727ff69d6f27c53 INFO: 172.20.0.1:59064 - "POST /node/69b6cf3f1727ff69d6f27c53 HTTP/1.0" 202 Accepted 2026-03-17 15:24:50,760 - lava_callback - INFO - Starting async job submit for node 69b6cf3f1727ff69d6f27c53 2026-03-17 15:24:50,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:24:50,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cf3f1727ff69d6f27c53 HTTP/1.1" 200 None 2026-03-17 15:24:50,781 - lava_callback - DEBUG - Processing node 69b6cf3f1727ff69d6f27c53: baseline-arm64-clabbe 2026-03-17 15:24:50,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cf3f1727ff69d6f27c53 2026-03-17 15:24:50,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:24:50,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cf3f1727ff69d6f27c53 HTTP/1.1" 200 None 2026-03-17 15:24:50,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:24:50,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:24:50,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:24:50,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cf3f1727ff69d6f27c53 HTTP/1.1" 200 None 2026-03-17 15:24:50,841 - lava_callback - ERROR - Error processing callback for node 69b6cf3f1727ff69d6f27c53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36124 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:26:10,844 - lava_callback - INFO - Received callback for node 69b6cf891727ff69d6f27c5b INFO: 172.20.0.1:46148 - "POST /node/69b6cf891727ff69d6f27c5b HTTP/1.0" 202 Accepted 2026-03-17 15:26:10,849 - lava_callback - INFO - Starting async job submit for node 69b6cf891727ff69d6f27c5b 2026-03-17 15:26:10,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:26:10,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cf891727ff69d6f27c5b HTTP/1.1" 200 None 2026-03-17 15:26:10,870 - lava_callback - DEBUG - Processing node 69b6cf891727ff69d6f27c5b: baseline-arm64-clabbe 2026-03-17 15:26:10,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cf891727ff69d6f27c5b 2026-03-17 15:26:10,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:26:10,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cf891727ff69d6f27c5b HTTP/1.1" 200 None 2026-03-17 15:26:10,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:26:10,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:26:10,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:26:10,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cf891727ff69d6f27c5b HTTP/1.1" 200 None 2026-03-17 15:26:10,931 - lava_callback - ERROR - Error processing callback for node 69b6cf891727ff69d6f27c5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46862 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:27:30,856 - lava_callback - INFO - Received callback for node 69b6cfd31727ff69d6f27c67 INFO: 172.20.0.1:57978 - "POST /node/69b6cfd31727ff69d6f27c67 HTTP/1.0" 202 Accepted 2026-03-17 15:27:30,861 - lava_callback - INFO - Starting async job submit for node 69b6cfd31727ff69d6f27c67 2026-03-17 15:27:30,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:27:30,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cfd31727ff69d6f27c67 HTTP/1.1" 200 None 2026-03-17 15:27:30,877 - lava_callback - DEBUG - Processing node 69b6cfd31727ff69d6f27c67: baseline-arm64-clabbe 2026-03-17 15:27:30,878 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6cfd31727ff69d6f27c67 2026-03-17 15:27:30,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:27:30,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6cfd31727ff69d6f27c67 HTTP/1.1" 200 None 2026-03-17 15:27:30,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:27:30,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:27:30,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:27:30,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6cfd31727ff69d6f27c67 HTTP/1.1" 200 None 2026-03-17 15:27:30,960 - lava_callback - ERROR - Error processing callback for node 69b6cfd31727ff69d6f27c67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43992 - "GET / HTTP/1.0" 200 OK 2026-03-17 15:28:50,927 - lava_callback - INFO - Received callback for node 69b6d01d1727ff69d6f27c70 INFO: 172.20.0.1:57152 - "POST /node/69b6d01d1727ff69d6f27c70 HTTP/1.0" 202 Accepted 2026-03-17 15:28:50,935 - lava_callback - INFO - Starting async job submit for node 69b6d01d1727ff69d6f27c70 2026-03-17 15:28:50,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:28:50,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6d01d1727ff69d6f27c70 HTTP/1.1" 200 None 2026-03-17 15:28:50,953 - lava_callback - DEBUG - Processing node 69b6d01d1727ff69d6f27c70: baseline-arm64-clabbe 2026-03-17 15:28:50,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6d01d1727ff69d6f27c70 2026-03-17 15:28:50,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:28:50,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6d01d1727ff69d6f27c70 HTTP/1.1" 200 None 2026-03-17 15:28:50,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:28:50,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-17 15:28:50,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 15:28:51,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6d01d1727ff69d6f27c70 HTTP/1.1" 200 None 2026-03-17 15:28:51,042 - lava_callback - ERROR - Error processing callback for node 69b6d01d1727ff69d6f27c70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]