INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:36:08,616 - lava_callback - INFO - Received callback for node 69fda065e98225c4a2046af8 2026-05-08 08:36:08,623 - lava_callback - INFO - Starting async job submit for node 69fda065e98225c4a2046af8 INFO: 172.21.0.1:38100 - "POST /node/69fda065e98225c4a2046af8 HTTP/1.0" 202 Accepted 2026-05-08 08:36:08,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:08,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda065e98225c4a2046af8 HTTP/1.1" 200 None 2026-05-08 08:36:08,667 - lava_callback - DEBUG - Processing node 69fda065e98225c4a2046af8: baseline-x86 2026-05-08 08:36:08,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:36:08,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:08,952 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fda065e98225c4a2046af8/log.txt.gz 2026-05-08 08:36:09,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:36:09,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:09,207 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fda065e98225c4a2046af8/lava-logs.yaml 2026-05-08 08:36:09,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:36:09,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:09,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fda065e98225c4a2046af8/lava_callback.json.gz 2026-05-08 08:36:09,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:09,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda065e98225c4a2046af8 HTTP/1.1" 200 None 2026-05-08 08:36:09,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:09,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9cbde98225c4a20469e0 HTTP/1.1" 200 None 2026-05-08 08:36:09,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:09,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda065e98225c4a2046af8 HTTP/1.1" 200 None 2026-05-08 08:36:09,508 - lava_callback - INFO - Completed processing callback for node 69fda065e98225c4a2046af8 2026-05-08 08:36:14,926 - lava_callback - INFO - Received callback for node 69fda071e98225c4a2046b27 INFO: 172.21.0.1:39358 - "POST /node/69fda071e98225c4a2046b27 HTTP/1.0" 202 Accepted 2026-05-08 08:36:14,932 - lava_callback - INFO - Starting async job submit for node 69fda071e98225c4a2046b27 2026-05-08 08:36:14,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:14,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda071e98225c4a2046b27 HTTP/1.1" 200 None 2026-05-08 08:36:14,957 - lava_callback - DEBUG - Processing node 69fda071e98225c4a2046b27: baseline-arm 2026-05-08 08:36:14,963 - lava_callback - WARNING - Failed to upload log 2026-05-08 08:36:14,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:36:15,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:15,085 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fda071e98225c4a2046b27/lava-logs.yaml 2026-05-08 08:36:15,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39374 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 08:36:15,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:15,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fda071e98225c4a2046b27/lava_callback.json.gz 2026-05-08 08:36:15,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:15,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda071e98225c4a2046b27 HTTP/1.1" 200 None 2026-05-08 08:36:15,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:15,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:36:15,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:15,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda071e98225c4a2046b27 HTTP/1.1" 200 None 2026-05-08 08:36:15,260 - lava_callback - INFO - Completed processing callback for node 69fda071e98225c4a2046b27 INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:36:28,135 - lava_callback - INFO - Received callback for node 69fda067e98225c4a2046b03 INFO: 172.21.0.1:47272 - "POST /node/69fda067e98225c4a2046b03 HTTP/1.0" 202 Accepted 2026-05-08 08:36:28,146 - lava_callback - INFO - Starting async job submit for node 69fda067e98225c4a2046b03 2026-05-08 08:36:28,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:28,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda067e98225c4a2046b03 HTTP/1.1" 200 None 2026-05-08 08:36:28,289 - lava_callback - DEBUG - Processing node 69fda067e98225c4a2046b03: baseline-x86 2026-05-08 08:36:28,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:36:28,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:28,629 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fda067e98225c4a2046b03/log.txt.gz 2026-05-08 08:36:28,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:36:28,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:28,912 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fda067e98225c4a2046b03/lava-logs.yaml 2026-05-08 08:36:28,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:36:29,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:29,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fda067e98225c4a2046b03/lava_callback.json.gz 2026-05-08 08:36:29,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:29,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda067e98225c4a2046b03 HTTP/1.1" 200 None 2026-05-08 08:36:29,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:29,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9cbde98225c4a20469e0 HTTP/1.1" 200 None 2026-05-08 08:36:29,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:29,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda067e98225c4a2046b03 HTTP/1.1" 200 None 2026-05-08 08:36:29,172 - lava_callback - INFO - Completed processing callback for node 69fda067e98225c4a2046b03 INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:36:39,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:39,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56376 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:36:45,813 - lava_callback - INFO - Received callback for node 69fafd915ce316b79a7142a0 INFO: 172.21.0.1:56384 - "POST /node/69fafd915ce316b79a7142a0 HTTP/1.0" 202 Accepted 2026-05-08 08:36:45,819 - lava_callback - INFO - Starting async job submit for node 69fafd915ce316b79a7142a0 2026-05-08 08:36:45,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:45,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafd915ce316b79a7142a0 HTTP/1.1" 200 None 2026-05-08 08:36:45,836 - lava_callback - DEBUG - Processing node 69fafd915ce316b79a7142a0: baseline-arm-baylibre 2026-05-08 08:36:45,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafd915ce316b79a7142a0 2026-05-08 08:36:45,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:45,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafd915ce316b79a7142a0 HTTP/1.1" 200 None 2026-05-08 08:36:45,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:45,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 08:36:45,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:45,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafd915ce316b79a7142a0 HTTP/1.1" 200 None 2026-05-08 08:36:45,902 - lava_callback - ERROR - Error processing callback for node 69fafd915ce316b79a7142a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56386 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:36:50,314 - lava_callback - INFO - Received callback for node 69fda072e98225c4a2046b2c INFO: 172.21.0.1:34724 - "POST /node/69fda072e98225c4a2046b2c HTTP/1.0" 202 Accepted 2026-05-08 08:36:50,366 - lava_callback - INFO - Starting async job submit for node 69fda072e98225c4a2046b2c 2026-05-08 08:36:50,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:50,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda072e98225c4a2046b2c HTTP/1.1" 200 None 2026-05-08 08:36:50,412 - lava_callback - DEBUG - Processing node 69fda072e98225c4a2046b2c: baseline-arm 2026-05-08 08:36:50,516 - lava_callback - INFO - Received callback for node 69fda075e98225c4a2046b35 2026-05-08 08:36:50,554 - lava_callback - INFO - Starting async job submit for node 69fda075e98225c4a2046b35 INFO: 172.21.0.1:34726 - "POST /node/69fda075e98225c4a2046b35 HTTP/1.0" 202 Accepted 2026-05-08 08:36:50,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:50,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:36:50,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda075e98225c4a2046b35 HTTP/1.1" 200 None 2026-05-08 08:36:50,624 - lava_callback - DEBUG - Processing node 69fda075e98225c4a2046b35: baseline-arm 2026-05-08 08:36:50,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:50,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fda072e98225c4a2046b2c/log.txt.gz 2026-05-08 08:36:50,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:36:50,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:36:50,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:50,997 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fda075e98225c4a2046b35/log.txt.gz 2026-05-08 08:36:51,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:51,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fda072e98225c4a2046b2c/lava-logs.yaml 2026-05-08 08:36:51,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:36:51,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:36:51,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:51,175 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fda072e98225c4a2046b2c/lava_callback.json.gz 2026-05-08 08:36:51,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:51,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:51,215 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fda075e98225c4a2046b35/lava-logs.yaml 2026-05-08 08:36:51,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:36:51,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda072e98225c4a2046b2c HTTP/1.1" 200 None 2026-05-08 08:36:51,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:51,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:36:51,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:51,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda072e98225c4a2046b2c HTTP/1.1" 200 None 2026-05-08 08:36:51,275 - lava_callback - INFO - Completed processing callback for node 69fda072e98225c4a2046b2c 2026-05-08 08:36:51,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:36:51,327 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fda075e98225c4a2046b35/lava_callback.json.gz 2026-05-08 08:36:51,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:51,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda075e98225c4a2046b35 HTTP/1.1" 200 None 2026-05-08 08:36:51,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:51,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:36:51,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:36:51,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda075e98225c4a2046b35 HTTP/1.1" 200 None 2026-05-08 08:36:51,484 - lava_callback - INFO - Completed processing callback for node 69fda075e98225c4a2046b35 INFO: 172.21.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49282 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:37:09,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:09,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51586 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:37:18,136 - lava_callback - INFO - Received callback for node 69fda065e98225c4a2046afb INFO: 172.21.0.1:51600 - "POST /node/69fda065e98225c4a2046afb HTTP/1.0" 202 Accepted 2026-05-08 08:37:18,142 - lava_callback - INFO - Starting async job submit for node 69fda065e98225c4a2046afb 2026-05-08 08:37:18,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:18,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda065e98225c4a2046afb HTTP/1.1" 200 None 2026-05-08 08:37:18,177 - lava_callback - DEBUG - Processing node 69fda065e98225c4a2046afb: baseline-x86 2026-05-08 08:37:18,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:18,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:18,569 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fda065e98225c4a2046afb/log.txt.gz 2026-05-08 08:37:18,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:18,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:18,894 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fda065e98225c4a2046afb/lava-logs.yaml 2026-05-08 08:37:18,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:18,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:19,000 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fda065e98225c4a2046afb/lava_callback.json.gz 2026-05-08 08:37:19,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:19,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda065e98225c4a2046afb HTTP/1.1" 200 None 2026-05-08 08:37:19,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:19,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9cbde98225c4a20469e0 HTTP/1.1" 200 None 2026-05-08 08:37:19,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:19,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda065e98225c4a2046afb HTTP/1.1" 200 None 2026-05-08 08:37:19,096 - lava_callback - INFO - Completed processing callback for node 69fda065e98225c4a2046afb 2026-05-08 08:37:19,277 - lava_callback - INFO - Received callback for node 69fda066e98225c4a2046afe INFO: 172.21.0.1:51614 - "POST /node/69fda066e98225c4a2046afe HTTP/1.0" 202 Accepted 2026-05-08 08:37:19,285 - lava_callback - INFO - Starting async job submit for node 69fda066e98225c4a2046afe 2026-05-08 08:37:19,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:19,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda066e98225c4a2046afe HTTP/1.1" 200 None 2026-05-08 08:37:19,362 - lava_callback - DEBUG - Processing node 69fda066e98225c4a2046afe: baseline-x86 2026-05-08 08:37:19,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:19,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:19,737 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fda066e98225c4a2046afe/log.txt.gz 2026-05-08 08:37:19,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:20,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:20,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fda066e98225c4a2046afe/lava-logs.yaml 2026-05-08 08:37:20,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:20,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:20,186 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fda066e98225c4a2046afe/lava_callback.json.gz 2026-05-08 08:37:20,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:20,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda066e98225c4a2046afe HTTP/1.1" 200 None 2026-05-08 08:37:20,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:20,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9cbde98225c4a20469e0 HTTP/1.1" 200 None 2026-05-08 08:37:20,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:20,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda066e98225c4a2046afe HTTP/1.1" 200 None 2026-05-08 08:37:20,263 - lava_callback - INFO - Completed processing callback for node 69fda066e98225c4a2046afe 2026-05-08 08:37:25,512 - lava_callback - INFO - Received callback for node 69fafdb85ce316b79a7142b7 INFO: 172.21.0.1:58802 - "POST /node/69fafdb85ce316b79a7142b7 HTTP/1.0" 202 Accepted 2026-05-08 08:37:25,519 - lava_callback - INFO - Starting async job submit for node 69fafdb85ce316b79a7142b7 2026-05-08 08:37:25,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:25,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafdb85ce316b79a7142b7 HTTP/1.1" 200 None 2026-05-08 08:37:25,534 - lava_callback - DEBUG - Processing node 69fafdb85ce316b79a7142b7: baseline-arm-baylibre 2026-05-08 08:37:25,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafdb85ce316b79a7142b7 2026-05-08 08:37:25,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:25,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafdb85ce316b79a7142b7 HTTP/1.1" 200 None 2026-05-08 08:37:25,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:25,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 08:37:25,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:25,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafdb85ce316b79a7142b7 HTTP/1.1" 200 None 2026-05-08 08:37:25,596 - lava_callback - ERROR - Error processing callback for node 69fafdb85ce316b79a7142b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44110 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:37:39,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:39,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 08:37:42,130 - lava_callback - INFO - Received callback for node 69fda097e98225c4a2046bb6 INFO: 172.21.0.1:43486 - "POST /node/69fda097e98225c4a2046bb6 HTTP/1.0" 202 Accepted 2026-05-08 08:37:42,181 - lava_callback - INFO - Starting async job submit for node 69fda097e98225c4a2046bb6 2026-05-08 08:37:42,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:42,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda097e98225c4a2046bb6 HTTP/1.1" 200 None 2026-05-08 08:37:42,217 - lava_callback - DEBUG - Processing node 69fda097e98225c4a2046bb6: baseline-arm-pengutronix 2026-05-08 08:37:42,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:42,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:42,410 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fda097e98225c4a2046bb6/log.txt.gz 2026-05-08 08:37:42,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:42,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:42,601 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fda097e98225c4a2046bb6/lava-logs.yaml 2026-05-08 08:37:42,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:42,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:42,690 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fda097e98225c4a2046bb6/lava_callback.json.gz 2026-05-08 08:37:42,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:42,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda097e98225c4a2046bb6 HTTP/1.1" 200 None 2026-05-08 08:37:42,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:42,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:37:42,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:42,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda097e98225c4a2046bb6 HTTP/1.1" 200 None 2026-05-08 08:37:42,764 - lava_callback - INFO - Completed processing callback for node 69fda097e98225c4a2046bb6 INFO: 172.21.0.1:43500 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:37:43,295 - lava_callback - INFO - Received callback for node 69fda071e98225c4a2046b24 INFO: 172.21.0.1:43510 - "POST /node/69fda071e98225c4a2046b24 HTTP/1.0" 202 Accepted 2026-05-08 08:37:43,301 - lava_callback - INFO - Starting async job submit for node 69fda071e98225c4a2046b24 2026-05-08 08:37:43,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:43,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda071e98225c4a2046b24 HTTP/1.1" 200 None 2026-05-08 08:37:43,338 - lava_callback - DEBUG - Processing node 69fda071e98225c4a2046b24: baseline-arm 2026-05-08 08:37:43,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:43,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:43,630 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fda071e98225c4a2046b24/log.txt.gz 2026-05-08 08:37:43,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:43,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:43,898 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fda071e98225c4a2046b24/lava-logs.yaml 2026-05-08 08:37:43,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:44,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:44,013 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fda071e98225c4a2046b24/lava_callback.json.gz 2026-05-08 08:37:44,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:44,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda071e98225c4a2046b24 HTTP/1.1" 200 None 2026-05-08 08:37:44,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:44,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:37:44,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:44,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda071e98225c4a2046b24 HTTP/1.1" 200 None 2026-05-08 08:37:44,084 - lava_callback - INFO - Completed processing callback for node 69fda071e98225c4a2046b24 2026-05-08 08:37:45,563 - lava_callback - INFO - Received callback for node 69fda093e98225c4a2046bad INFO: 172.21.0.1:43526 - "POST /node/69fda093e98225c4a2046bad HTTP/1.0" 202 Accepted 2026-05-08 08:37:45,569 - lava_callback - INFO - Starting async job submit for node 69fda093e98225c4a2046bad 2026-05-08 08:37:45,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:45,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda093e98225c4a2046bad HTTP/1.1" 200 None 2026-05-08 08:37:45,603 - lava_callback - DEBUG - Processing node 69fda093e98225c4a2046bad: baseline-arm-pengutronix 2026-05-08 08:37:45,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:45,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:45,819 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fda093e98225c4a2046bad/log.txt.gz 2026-05-08 08:37:45,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:46,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:46,031 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fda093e98225c4a2046bad/lava-logs.yaml 2026-05-08 08:37:46,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:46,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:46,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fda093e98225c4a2046bad/lava_callback.json.gz 2026-05-08 08:37:46,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:46,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda093e98225c4a2046bad HTTP/1.1" 200 None 2026-05-08 08:37:46,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:46,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:37:46,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:46,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda093e98225c4a2046bad HTTP/1.1" 200 None 2026-05-08 08:37:46,233 - lava_callback - INFO - Completed processing callback for node 69fda093e98225c4a2046bad INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:37:46,777 - lava_callback - INFO - Received callback for node 69fda094e98225c4a2046bb0 INFO: 172.21.0.1:43532 - "POST /node/69fda094e98225c4a2046bb0 HTTP/1.0" 202 Accepted 2026-05-08 08:37:46,784 - lava_callback - INFO - Starting async job submit for node 69fda094e98225c4a2046bb0 2026-05-08 08:37:46,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:46,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda094e98225c4a2046bb0 HTTP/1.1" 200 None 2026-05-08 08:37:46,823 - lava_callback - DEBUG - Processing node 69fda094e98225c4a2046bb0: baseline-arm-pengutronix 2026-05-08 08:37:47,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:47,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:47,081 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fda094e98225c4a2046bb0/log.txt.gz 2026-05-08 08:37:47,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:47,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:47,313 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fda094e98225c4a2046bb0/lava-logs.yaml 2026-05-08 08:37:47,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:37:47,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:37:47,420 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fda094e98225c4a2046bb0/lava_callback.json.gz 2026-05-08 08:37:47,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:47,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda094e98225c4a2046bb0 HTTP/1.1" 200 None 2026-05-08 08:37:47,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:47,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:37:47,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:37:47,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda094e98225c4a2046bb0 HTTP/1.1" 200 None 2026-05-08 08:37:47,490 - lava_callback - INFO - Completed processing callback for node 69fda094e98225c4a2046bb0 INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:38:05,807 - lava_callback - INFO - Received callback for node 69fafdde5ce316b79a7142e3 INFO: 172.21.0.1:54344 - "POST /node/69fafdde5ce316b79a7142e3 HTTP/1.0" 202 Accepted 2026-05-08 08:38:05,813 - lava_callback - INFO - Starting async job submit for node 69fafdde5ce316b79a7142e3 2026-05-08 08:38:05,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:05,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafdde5ce316b79a7142e3 HTTP/1.1" 200 None 2026-05-08 08:38:05,830 - lava_callback - DEBUG - Processing node 69fafdde5ce316b79a7142e3: baseline-arm-baylibre 2026-05-08 08:38:05,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafdde5ce316b79a7142e3 2026-05-08 08:38:05,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:05,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafdde5ce316b79a7142e3 HTTP/1.1" 200 None 2026-05-08 08:38:05,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:05,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 08:38:05,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:05,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafdde5ce316b79a7142e3 HTTP/1.1" 200 None 2026-05-08 08:38:05,874 - lava_callback - ERROR - Error processing callback for node 69fafdde5ce316b79a7142e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54348 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:38:08,109 - lava_callback - INFO - Received callback for node 69fda07ee98225c4a2046b47 INFO: 172.21.0.1:54362 - "POST /node/69fda07ee98225c4a2046b47 HTTP/1.0" 202 Accepted 2026-05-08 08:38:08,115 - lava_callback - INFO - Starting async job submit for node 69fda07ee98225c4a2046b47 2026-05-08 08:38:08,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:08,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda07ee98225c4a2046b47 HTTP/1.1" 200 None 2026-05-08 08:38:08,151 - lava_callback - DEBUG - Processing node 69fda07ee98225c4a2046b47: baseline-arm-broonie 2026-05-08 08:38:08,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:08,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:08,467 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fda07ee98225c4a2046b47/log.txt.gz 2026-05-08 08:38:08,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:08,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:08,759 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fda07ee98225c4a2046b47/lava-logs.yaml 2026-05-08 08:38:08,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:09,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:09,027 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fda07ee98225c4a2046b47/lava_callback.json.gz 2026-05-08 08:38:09,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:09,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda07ee98225c4a2046b47 HTTP/1.1" 200 None 2026-05-08 08:38:09,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:09,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:38:09,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:09,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda07ee98225c4a2046b47 HTTP/1.1" 200 None 2026-05-08 08:38:09,104 - lava_callback - INFO - Completed processing callback for node 69fda07ee98225c4a2046b47 2026-05-08 08:38:09,301 - lava_callback - INFO - Received callback for node 69fda08de98225c4a2046b9f INFO: 172.21.0.1:54374 - "POST /node/69fda08de98225c4a2046b9f HTTP/1.0" 202 Accepted 2026-05-08 08:38:09,311 - lava_callback - INFO - Starting async job submit for node 69fda08de98225c4a2046b9f 2026-05-08 08:38:09,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:09,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda08de98225c4a2046b9f HTTP/1.1" 200 None 2026-05-08 08:38:09,351 - lava_callback - DEBUG - Processing node 69fda08de98225c4a2046b9f: baseline-arm-kontron 2026-05-08 08:38:09,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:09,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:09,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-08 08:38:09,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:09,615 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fda08de98225c4a2046b9f/log.txt.gz 2026-05-08 08:38:09,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:09,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:09,872 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fda08de98225c4a2046b9f/lava-logs.yaml 2026-05-08 08:38:09,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:09,915 - lava_callback - INFO - Received callback for node 69fda080e98225c4a2046b4c INFO: 172.21.0.1:46660 - "POST /node/69fda080e98225c4a2046b4c HTTP/1.0" 202 Accepted 2026-05-08 08:38:09,921 - lava_callback - INFO - Starting async job submit for node 69fda080e98225c4a2046b4c 2026-05-08 08:38:09,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:09,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda080e98225c4a2046b4c HTTP/1.1" 200 None 2026-05-08 08:38:09,969 - lava_callback - DEBUG - Processing node 69fda080e98225c4a2046b4c: baseline-arm-broonie 2026-05-08 08:38:10,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:10,053 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fda08de98225c4a2046b9f/lava_callback.json.gz 2026-05-08 08:38:10,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:10,232 - lava_callback - INFO - Received callback for node 69fda081e98225c4a2046b4f 2026-05-08 08:38:10,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda08de98225c4a2046b9f HTTP/1.1" 200 None 2026-05-08 08:38:10,265 - lava_callback - INFO - Starting async job submit for node 69fda081e98225c4a2046b4f INFO: 172.21.0.1:46672 - "POST /node/69fda081e98225c4a2046b4f HTTP/1.0" 202 Accepted 2026-05-08 08:38:10,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:10,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:10,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:10,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:38:10,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda081e98225c4a2046b4f HTTP/1.1" 200 None 2026-05-08 08:38:10,312 - lava_callback - DEBUG - Processing node 69fda081e98225c4a2046b4f: baseline-arm-broonie 2026-05-08 08:38:10,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:10,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:10,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda08de98225c4a2046b9f HTTP/1.1" 200 None 2026-05-08 08:38:10,436 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fda080e98225c4a2046b4c/log.txt.gz 2026-05-08 08:38:10,454 - lava_callback - INFO - Completed processing callback for node 69fda08de98225c4a2046b9f 2026-05-08 08:38:10,640 - lava_callback - INFO - Received callback for node 69fda08fe98225c4a2046ba2 INFO: 172.21.0.1:46684 - "POST /node/69fda08fe98225c4a2046ba2 HTTP/1.0" 202 Accepted 2026-05-08 08:38:10,663 - lava_callback - INFO - Starting async job submit for node 69fda08fe98225c4a2046ba2 2026-05-08 08:38:10,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:10,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:10,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:10,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda08fe98225c4a2046ba2 HTTP/1.1" 200 None 2026-05-08 08:38:10,839 - lava_callback - DEBUG - Processing node 69fda08fe98225c4a2046ba2: baseline-arm-kontron 2026-05-08 08:38:10,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:10,977 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fda081e98225c4a2046b4f/log.txt.gz 2026-05-08 08:38:11,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:11,148 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fda080e98225c4a2046b4c/lava-logs.yaml 2026-05-08 08:38:11,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:11,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:11,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:11,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:11,287 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fda08fe98225c4a2046ba2/log.txt.gz 2026-05-08 08:38:11,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:11,367 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fda080e98225c4a2046b4c/lava_callback.json.gz 2026-05-08 08:38:11,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:11,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:11,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fda081e98225c4a2046b4f/lava-logs.yaml 2026-05-08 08:38:11,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:11,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:11,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda080e98225c4a2046b4c HTTP/1.1" 200 None 2026-05-08 08:38:11,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:11,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:38:11,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:11,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda080e98225c4a2046b4c HTTP/1.1" 200 None 2026-05-08 08:38:11,501 - lava_callback - INFO - Completed processing callback for node 69fda080e98225c4a2046b4c 2026-05-08 08:38:11,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:11,569 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fda081e98225c4a2046b4f/lava_callback.json.gz 2026-05-08 08:38:11,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:11,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:11,598 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fda08fe98225c4a2046ba2/lava-logs.yaml 2026-05-08 08:38:11,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:11,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda081e98225c4a2046b4f HTTP/1.1" 200 None 2026-05-08 08:38:11,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:11,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:38:11,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:11,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda081e98225c4a2046b4f HTTP/1.1" 200 None 2026-05-08 08:38:11,667 - lava_callback - INFO - Completed processing callback for node 69fda081e98225c4a2046b4f 2026-05-08 08:38:11,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:11,735 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fda08fe98225c4a2046ba2/lava_callback.json.gz 2026-05-08 08:38:11,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:11,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda08fe98225c4a2046ba2 HTTP/1.1" 200 None 2026-05-08 08:38:11,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:11,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:38:11,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:11,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda08fe98225c4a2046ba2 HTTP/1.1" 200 None 2026-05-08 08:38:11,852 - lava_callback - INFO - Completed processing callback for node 69fda08fe98225c4a2046ba2 INFO: 172.21.0.1:46692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41206 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:38:26,714 - lava_callback - INFO - Received callback for node 69fda085e98225c4a2046b5e INFO: 172.21.0.1:41222 - "POST /node/69fda085e98225c4a2046b5e HTTP/1.0" 202 Accepted 2026-05-08 08:38:26,720 - lava_callback - INFO - Starting async job submit for node 69fda085e98225c4a2046b5e 2026-05-08 08:38:26,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:26,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda085e98225c4a2046b5e HTTP/1.1" 200 None 2026-05-08 08:38:26,761 - lava_callback - DEBUG - Processing node 69fda085e98225c4a2046b5e: baseline-arm-clabbe 2026-05-08 08:38:26,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:27,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:27,062 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fda085e98225c4a2046b5e/log.txt.gz 2026-05-08 08:38:27,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:27,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:27,332 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fda085e98225c4a2046b5e/lava-logs.yaml 2026-05-08 08:38:27,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:27,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:27,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fda085e98225c4a2046b5e/lava_callback.json.gz 2026-05-08 08:38:27,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:27,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda085e98225c4a2046b5e HTTP/1.1" 200 None 2026-05-08 08:38:27,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:27,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:38:27,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:27,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda085e98225c4a2046b5e HTTP/1.1" 200 None 2026-05-08 08:38:27,508 - lava_callback - INFO - Completed processing callback for node 69fda085e98225c4a2046b5e INFO: 172.21.0.1:38692 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:38:37,615 - lava_callback - INFO - Received callback for node 69fda100e98225c4a2046c8f INFO: 172.21.0.1:38708 - "POST /node/69fda100e98225c4a2046c8f HTTP/1.0" 202 Accepted 2026-05-08 08:38:37,622 - lava_callback - INFO - Starting async job submit for node 69fda100e98225c4a2046c8f 2026-05-08 08:38:37,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:37,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda100e98225c4a2046c8f HTTP/1.1" 200 None 2026-05-08 08:38:37,646 - lava_callback - DEBUG - Processing node 69fda100e98225c4a2046c8f: baseline-arm 2026-05-08 08:38:37,651 - lava_callback - WARNING - Failed to upload log 2026-05-08 08:38:37,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:37,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:37,732 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fda100e98225c4a2046c8f/lava-logs.yaml 2026-05-08 08:38:37,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:37,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:37,810 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fda100e98225c4a2046c8f/lava_callback.json.gz 2026-05-08 08:38:37,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:37,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda100e98225c4a2046c8f HTTP/1.1" 200 None 2026-05-08 08:38:37,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:37,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:38:37,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:37,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda100e98225c4a2046c8f HTTP/1.1" 200 None 2026-05-08 08:38:37,863 - lava_callback - INFO - Completed processing callback for node 69fda100e98225c4a2046c8f 2026-05-08 08:38:39,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:39,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:48982 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:38:45,580 - lava_callback - INFO - Received callback for node 69fafe025ce316b79a7142f9 INFO: 172.21.0.1:48990 - "POST /node/69fafe025ce316b79a7142f9 HTTP/1.0" 202 Accepted 2026-05-08 08:38:45,586 - lava_callback - INFO - Starting async job submit for node 69fafe025ce316b79a7142f9 2026-05-08 08:38:45,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:45,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe025ce316b79a7142f9 HTTP/1.1" 200 None 2026-05-08 08:38:45,609 - lava_callback - DEBUG - Processing node 69fafe025ce316b79a7142f9: baseline-arm-baylibre 2026-05-08 08:38:45,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafe025ce316b79a7142f9 2026-05-08 08:38:45,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:45,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe025ce316b79a7142f9 HTTP/1.1" 200 None 2026-05-08 08:38:45,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:45,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 08:38:45,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:45,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafe025ce316b79a7142f9 HTTP/1.1" 200 None 2026-05-08 08:38:45,654 - lava_callback - ERROR - Error processing callback for node 69fafe025ce316b79a7142f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49004 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:38:47,728 - lava_callback - INFO - Received callback for node 69fda086e98225c4a2046b62 INFO: 172.21.0.1:49016 - "POST /node/69fda086e98225c4a2046b62 HTTP/1.0" 202 Accepted 2026-05-08 08:38:47,734 - lava_callback - INFO - Starting async job submit for node 69fda086e98225c4a2046b62 2026-05-08 08:38:47,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:47,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda086e98225c4a2046b62 HTTP/1.1" 200 None 2026-05-08 08:38:47,780 - lava_callback - DEBUG - Processing node 69fda086e98225c4a2046b62: baseline-arm-clabbe 2026-05-08 08:38:47,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:48,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:48,126 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fda086e98225c4a2046b62/log.txt.gz 2026-05-08 08:38:48,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:48,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:48,414 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fda086e98225c4a2046b62/lava-logs.yaml 2026-05-08 08:38:48,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:38:48,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:38:48,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fda086e98225c4a2046b62/lava_callback.json.gz 2026-05-08 08:38:48,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:48,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda086e98225c4a2046b62 HTTP/1.1" 200 None 2026-05-08 08:38:48,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:48,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:38:48,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:38:48,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda086e98225c4a2046b62 HTTP/1.1" 200 None 2026-05-08 08:38:48,756 - lava_callback - INFO - Completed processing callback for node 69fda086e98225c4a2046b62 INFO: 172.21.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:39:09,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:39:09,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:39:25,648 - lava_callback - INFO - Received callback for node 69fafe285ce316b79a714311 INFO: 172.21.0.1:35162 - "POST /node/69fafe285ce316b79a714311 HTTP/1.0" 202 Accepted 2026-05-08 08:39:25,654 - lava_callback - INFO - Starting async job submit for node 69fafe285ce316b79a714311 2026-05-08 08:39:25,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:39:25,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe285ce316b79a714311 HTTP/1.1" 200 None 2026-05-08 08:39:25,670 - lava_callback - DEBUG - Processing node 69fafe285ce316b79a714311: baseline-arm-baylibre 2026-05-08 08:39:25,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafe285ce316b79a714311 2026-05-08 08:39:25,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:39:25,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe285ce316b79a714311 HTTP/1.1" 200 None 2026-05-08 08:39:25,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:39:25,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 08:39:25,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:39:25,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafe285ce316b79a714311 HTTP/1.1" 200 None 2026-05-08 08:39:25,730 - lava_callback - ERROR - Error processing callback for node 69fafe285ce316b79a714311: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36470 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:39:45,639 - lava_callback - INFO - Received callback for node 69fafe4d5ce316b79a714328 INFO: 172.21.0.1:36478 - "POST /node/69fafe4d5ce316b79a714328 HTTP/1.0" 202 Accepted 2026-05-08 08:39:45,645 - lava_callback - INFO - Starting async job submit for node 69fafe4d5ce316b79a714328 2026-05-08 08:39:45,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:39:45,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe4d5ce316b79a714328 HTTP/1.1" 200 None 2026-05-08 08:39:45,663 - lava_callback - DEBUG - Processing node 69fafe4d5ce316b79a714328: baseline-arm-baylibre 2026-05-08 08:39:45,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafe4d5ce316b79a714328 2026-05-08 08:39:45,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:39:45,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe4d5ce316b79a714328 HTTP/1.1" 200 None 2026-05-08 08:39:45,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:39:45,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 08:39:45,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:39:45,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafe4d5ce316b79a714328 HTTP/1.1" 200 None 2026-05-08 08:39:45,745 - lava_callback - ERROR - Error processing callback for node 69fafe4d5ce316b79a714328: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 08:40:15,215 - lava_callback - INFO - Received callback for node 69fda08be98225c4a2046b71 INFO: 172.21.0.1:59142 - "POST /node/69fda08be98225c4a2046b71 HTTP/1.0" 202 Accepted 2026-05-08 08:40:15,221 - lava_callback - INFO - Starting async job submit for node 69fda08be98225c4a2046b71 2026-05-08 08:40:15,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:15,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda08be98225c4a2046b71 HTTP/1.1" 200 None 2026-05-08 08:40:15,261 - lava_callback - DEBUG - Processing node 69fda08be98225c4a2046b71: baseline-arm-clabbe 2026-05-08 08:40:15,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:40:15,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:40:15,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fda08be98225c4a2046b71/log.txt.gz 2026-05-08 08:40:15,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:40:15,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:40:15,926 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fda08be98225c4a2046b71/lava-logs.yaml 2026-05-08 08:40:15,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:40:16,026 - lava_callback - INFO - Received callback for node 69fafe655ce316b79a714380 INFO: 172.21.0.1:59150 - "POST /node/69fafe655ce316b79a714380 HTTP/1.0" 202 Accepted 2026-05-08 08:40:16,033 - lava_callback - INFO - Starting async job submit for node 69fafe655ce316b79a714380 2026-05-08 08:40:16,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:40:16,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:16,036 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fda08be98225c4a2046b71/lava_callback.json.gz 2026-05-08 08:40:16,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:16,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda08be98225c4a2046b71 HTTP/1.1" 200 None 2026-05-08 08:40:16,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe655ce316b79a714380 HTTP/1.1" 200 None 2026-05-08 08:40:16,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:16,076 - lava_callback - DEBUG - Processing node 69fafe655ce316b79a714380: baseline-arm-clabbe 2026-05-08 08:40:16,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafe655ce316b79a714380 2026-05-08 08:40:16,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:16,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:40:16,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:16,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe655ce316b79a714380 HTTP/1.1" 200 None 2026-05-08 08:40:16,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:16,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-08 08:40:16,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:16,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda08be98225c4a2046b71 HTTP/1.1" 200 None 2026-05-08 08:40:16,114 - lava_callback - INFO - Completed processing callback for node 69fda08be98225c4a2046b71 2026-05-08 08:40:16,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafe655ce316b79a714380 HTTP/1.1" 200 None 2026-05-08 08:40:16,186 - lava_callback - ERROR - Error processing callback for node 69fafe655ce316b79a714380: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59156 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:40:16,671 - lava_callback - INFO - Received callback for node 69fafe6a5ce316b79a71438f INFO: 172.21.0.1:59170 - "POST /node/69fafe6a5ce316b79a71438f HTTP/1.0" 202 Accepted 2026-05-08 08:40:16,677 - lava_callback - INFO - Starting async job submit for node 69fafe6a5ce316b79a71438f 2026-05-08 08:40:16,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:16,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe6a5ce316b79a71438f HTTP/1.1" 200 None 2026-05-08 08:40:16,695 - lava_callback - DEBUG - Processing node 69fafe6a5ce316b79a71438f: baseline-arm-clabbe 2026-05-08 08:40:16,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafe6a5ce316b79a71438f 2026-05-08 08:40:16,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:16,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe6a5ce316b79a71438f HTTP/1.1" 200 None 2026-05-08 08:40:16,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:16,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-08 08:40:16,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:16,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafe6a5ce316b79a71438f HTTP/1.1" 200 None 2026-05-08 08:40:16,744 - lava_callback - ERROR - Error processing callback for node 69fafe6a5ce316b79a71438f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 08:40:17,350 - lava_callback - INFO - Received callback for node 69fafe6b5ce316b79a714392 INFO: 172.21.0.1:59178 - "POST /node/69fafe6b5ce316b79a714392 HTTP/1.0" 202 Accepted 2026-05-08 08:40:17,355 - lava_callback - INFO - Starting async job submit for node 69fafe6b5ce316b79a714392 2026-05-08 08:40:17,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:17,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe6b5ce316b79a714392 HTTP/1.1" 200 None 2026-05-08 08:40:17,377 - lava_callback - DEBUG - Processing node 69fafe6b5ce316b79a714392: baseline-arm-clabbe 2026-05-08 08:40:17,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafe6b5ce316b79a714392 2026-05-08 08:40:17,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:17,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe6b5ce316b79a714392 HTTP/1.1" 200 None 2026-05-08 08:40:17,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:17,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-08 08:40:17,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:17,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafe6b5ce316b79a714392 HTTP/1.1" 200 None 2026-05-08 08:40:17,424 - lava_callback - ERROR - Error processing callback for node 69fafe6b5ce316b79a714392: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 08:40:18,035 - lava_callback - INFO - Received callback for node 69fafe6b5ce316b79a714395 INFO: 172.21.0.1:59194 - "POST /node/69fafe6b5ce316b79a714395 HTTP/1.0" 202 Accepted 2026-05-08 08:40:18,041 - lava_callback - INFO - Starting async job submit for node 69fafe6b5ce316b79a714395 2026-05-08 08:40:18,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:18,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe6b5ce316b79a714395 HTTP/1.1" 200 None 2026-05-08 08:40:18,062 - lava_callback - DEBUG - Processing node 69fafe6b5ce316b79a714395: baseline-arm-clabbe 2026-05-08 08:40:18,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafe6b5ce316b79a714395 2026-05-08 08:40:18,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:18,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe6b5ce316b79a714395 HTTP/1.1" 200 None 2026-05-08 08:40:18,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:18,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-08 08:40:18,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:18,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafe6b5ce316b79a714395 HTTP/1.1" 200 None 2026-05-08 08:40:18,120 - lava_callback - ERROR - Error processing callback for node 69fafe6b5ce316b79a714395: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 08:40:18,711 - lava_callback - INFO - Received callback for node 69fafe6c5ce316b79a714398 INFO: 172.21.0.1:59202 - "POST /node/69fafe6c5ce316b79a714398 HTTP/1.0" 202 Accepted 2026-05-08 08:40:18,717 - lava_callback - INFO - Starting async job submit for node 69fafe6c5ce316b79a714398 2026-05-08 08:40:18,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:18,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe6c5ce316b79a714398 HTTP/1.1" 200 None 2026-05-08 08:40:18,732 - lava_callback - DEBUG - Processing node 69fafe6c5ce316b79a714398: baseline-arm-clabbe 2026-05-08 08:40:18,732 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafe6c5ce316b79a714398 2026-05-08 08:40:18,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:18,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe6c5ce316b79a714398 HTTP/1.1" 200 None 2026-05-08 08:40:18,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:18,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-08 08:40:18,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:18,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafe6c5ce316b79a714398 HTTP/1.1" 200 None 2026-05-08 08:40:18,783 - lava_callback - ERROR - Error processing callback for node 69fafe6c5ce316b79a714398: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 08:40:19,389 - lava_callback - INFO - Received callback for node 69fafe6e5ce316b79a71439e INFO: 172.21.0.1:59210 - "POST /node/69fafe6e5ce316b79a71439e HTTP/1.0" 202 Accepted 2026-05-08 08:40:19,395 - lava_callback - INFO - Starting async job submit for node 69fafe6e5ce316b79a71439e 2026-05-08 08:40:19,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:19,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe6e5ce316b79a71439e HTTP/1.1" 200 None 2026-05-08 08:40:19,411 - lava_callback - DEBUG - Processing node 69fafe6e5ce316b79a71439e: baseline-arm-clabbe 2026-05-08 08:40:19,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafe6e5ce316b79a71439e 2026-05-08 08:40:19,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:19,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe6e5ce316b79a71439e HTTP/1.1" 200 None 2026-05-08 08:40:19,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:19,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf9825ce316b79a713c62 HTTP/1.1" 200 None 2026-05-08 08:40:19,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:19,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafe6e5ce316b79a71439e HTTP/1.1" 200 None 2026-05-08 08:40:19,456 - lava_callback - ERROR - Error processing callback for node 69fafe6e5ce316b79a71439e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45990 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:40:35,946 - lava_callback - INFO - Received callback for node 69fafe735ce316b79a7143b1 INFO: 172.21.0.1:56552 - "POST /node/69fafe735ce316b79a7143b1 HTTP/1.0" 202 Accepted 2026-05-08 08:40:35,951 - lava_callback - INFO - Starting async job submit for node 69fafe735ce316b79a7143b1 2026-05-08 08:40:35,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:35,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe735ce316b79a7143b1 HTTP/1.1" 200 None 2026-05-08 08:40:35,975 - lava_callback - DEBUG - Processing node 69fafe735ce316b79a7143b1: baseline-arm-clabbe 2026-05-08 08:40:35,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafe735ce316b79a7143b1 2026-05-08 08:40:35,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:35,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe735ce316b79a7143b1 HTTP/1.1" 200 None 2026-05-08 08:40:35,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:36,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 08:40:36,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:36,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafe735ce316b79a7143b1 HTTP/1.1" 200 None 2026-05-08 08:40:36,027 - lava_callback - ERROR - Error processing callback for node 69fafe735ce316b79a7143b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:40:39,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:40:39,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42708 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 08:41:15,955 - lava_callback - INFO - Received callback for node 69fafe9a5ce316b79a71441c INFO: 172.21.0.1:42718 - "POST /node/69fafe9a5ce316b79a71441c HTTP/1.0" 202 Accepted 2026-05-08 08:41:15,961 - lava_callback - INFO - Starting async job submit for node 69fafe9a5ce316b79a71441c 2026-05-08 08:41:15,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:41:15,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe9a5ce316b79a71441c HTTP/1.1" 200 None 2026-05-08 08:41:15,981 - lava_callback - DEBUG - Processing node 69fafe9a5ce316b79a71441c: baseline-arm-clabbe 2026-05-08 08:41:15,981 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafe9a5ce316b79a71441c 2026-05-08 08:41:15,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:41:15,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafe9a5ce316b79a71441c HTTP/1.1" 200 None 2026-05-08 08:41:15,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:41:16,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 08:41:16,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:41:16,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafe9a5ce316b79a71441c HTTP/1.1" 200 None 2026-05-08 08:41:16,027 - lava_callback - ERROR - Error processing callback for node 69fafe9a5ce316b79a71441c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:41:33,811 - lava_callback - INFO - Received callback for node 69fda0bee98225c4a2046c0d INFO: 172.21.0.1:60922 - "POST /node/69fda0bee98225c4a2046c0d HTTP/1.0" 202 Accepted 2026-05-08 08:41:33,819 - lava_callback - INFO - Starting async job submit for node 69fda0bee98225c4a2046c0d 2026-05-08 08:41:33,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:41:33,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0bee98225c4a2046c0d HTTP/1.1" 200 None 2026-05-08 08:41:33,868 - lava_callback - DEBUG - Processing node 69fda0bee98225c4a2046c0d: ltp-syscalls 2026-05-08 08:41:34,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:41:34,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:41:34,744 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fda0bee98225c4a2046c0d/log.txt.gz 2026-05-08 08:41:35,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:41:35,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:41:35,365 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fda0bee98225c4a2046c0d/lava-logs.yaml 2026-05-08 08:41:35,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:41:35,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:41:35,575 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fda0bee98225c4a2046c0d/lava_callback.json.gz 2026-05-08 08:41:35,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:41:35,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0bee98225c4a2046c0d HTTP/1.1" 200 None 2026-05-08 08:41:35,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:41:35,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:41:35,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:41:35,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0bee98225c4a2046c0d HTTP/1.1" 200 None 2026-05-08 08:41:35,667 - lava_callback - INFO - Completed processing callback for node 69fda0bee98225c4a2046c0d INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:41:39,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:41:39,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35426 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:41:55,992 - lava_callback - INFO - Received callback for node 69fafec25ce316b79a71445b INFO: 172.21.0.1:51414 - "POST /node/69fafec25ce316b79a71445b HTTP/1.0" 202 Accepted 2026-05-08 08:41:56,003 - lava_callback - INFO - Starting async job submit for node 69fafec25ce316b79a71445b 2026-05-08 08:41:56,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:41:56,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafec25ce316b79a71445b HTTP/1.1" 200 None 2026-05-08 08:41:56,058 - lava_callback - DEBUG - Processing node 69fafec25ce316b79a71445b: baseline-arm-clabbe 2026-05-08 08:41:56,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafec25ce316b79a71445b 2026-05-08 08:41:56,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:41:56,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafec25ce316b79a71445b HTTP/1.1" 200 None 2026-05-08 08:41:56,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:41:56,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 08:41:56,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:41:56,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafec25ce316b79a71445b HTTP/1.1" 200 None 2026-05-08 08:41:56,168 - lava_callback - ERROR - Error processing callback for node 69fafec25ce316b79a71445b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:42:36,019 - lava_callback - INFO - Received callback for node 69fafee85ce316b79a714492 INFO: 172.21.0.1:38466 - "POST /node/69fafee85ce316b79a714492 HTTP/1.0" 202 Accepted 2026-05-08 08:42:36,025 - lava_callback - INFO - Starting async job submit for node 69fafee85ce316b79a714492 2026-05-08 08:42:36,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:42:36,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafee85ce316b79a714492 HTTP/1.1" 200 None 2026-05-08 08:42:36,047 - lava_callback - DEBUG - Processing node 69fafee85ce316b79a714492: baseline-arm-clabbe 2026-05-08 08:42:36,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fafee85ce316b79a714492 2026-05-08 08:42:36,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:42:36,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fafee85ce316b79a714492 HTTP/1.1" 200 None 2026-05-08 08:42:36,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:42:36,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 08:42:36,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:42:36,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fafee85ce316b79a714492 HTTP/1.1" 200 None 2026-05-08 08:42:36,096 - lava_callback - ERROR - Error processing callback for node 69fafee85ce316b79a714492: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 08:43:16,017 - lava_callback - INFO - Received callback for node 69faff0f5ce316b79a7144bc INFO: 172.21.0.1:60942 - "POST /node/69faff0f5ce316b79a7144bc HTTP/1.0" 202 Accepted 2026-05-08 08:43:16,023 - lava_callback - INFO - Starting async job submit for node 69faff0f5ce316b79a7144bc 2026-05-08 08:43:16,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:43:16,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faff0f5ce316b79a7144bc HTTP/1.1" 200 None 2026-05-08 08:43:16,040 - lava_callback - DEBUG - Processing node 69faff0f5ce316b79a7144bc: baseline-arm-clabbe 2026-05-08 08:43:16,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faff0f5ce316b79a7144bc 2026-05-08 08:43:16,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:43:16,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faff0f5ce316b79a7144bc HTTP/1.1" 200 None 2026-05-08 08:43:16,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:43:16,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 08:43:16,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:43:16,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faff0f5ce316b79a7144bc HTTP/1.1" 200 None 2026-05-08 08:43:16,092 - lava_callback - ERROR - Error processing callback for node 69faff0f5ce316b79a7144bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:43:56,101 - lava_callback - INFO - Received callback for node 69faff375ce316b79a7144de INFO: 172.21.0.1:57984 - "POST /node/69faff375ce316b79a7144de HTTP/1.0" 202 Accepted 2026-05-08 08:43:56,108 - lava_callback - INFO - Starting async job submit for node 69faff375ce316b79a7144de 2026-05-08 08:43:56,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:43:56,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faff375ce316b79a7144de HTTP/1.1" 200 None 2026-05-08 08:43:56,130 - lava_callback - DEBUG - Processing node 69faff375ce316b79a7144de: baseline-arm-clabbe 2026-05-08 08:43:56,131 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69faff375ce316b79a7144de 2026-05-08 08:43:56,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:43:56,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faff375ce316b79a7144de HTTP/1.1" 200 None 2026-05-08 08:43:56,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:43:56,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f855f6a8609de22f0a4565 HTTP/1.1" 200 None 2026-05-08 08:43:56,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:43:56,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69faff375ce316b79a7144de HTTP/1.1" 200 None 2026-05-08 08:43:56,186 - lava_callback - ERROR - Error processing callback for node 69faff375ce316b79a7144de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51544 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:45:30,333 - lava_callback - INFO - Received callback for node 69fda27ae98225c4a2046d52 INFO: 172.21.0.1:49440 - "POST /node/69fda27ae98225c4a2046d52 HTTP/1.0" 202 Accepted 2026-05-08 08:45:30,344 - lava_callback - INFO - Starting async job submit for node 69fda27ae98225c4a2046d52 2026-05-08 08:45:30,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:30,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda27ae98225c4a2046d52 HTTP/1.1" 200 None 2026-05-08 08:45:30,432 - lava_callback - DEBUG - Processing node 69fda27ae98225c4a2046d52: baseline-arm64 2026-05-08 08:45:30,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:45:30,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:45:30,962 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27ae98225c4a2046d52/log.txt.gz 2026-05-08 08:45:31,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:45:31,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:45:31,398 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27ae98225c4a2046d52/lava-logs.yaml 2026-05-08 08:45:31,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:45:31,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:45:31,661 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27ae98225c4a2046d52/lava_callback.json.gz 2026-05-08 08:45:31,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:31,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda27ae98225c4a2046d52 HTTP/1.1" 200 None 2026-05-08 08:45:31,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:31,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:45:31,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:31,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda27ae98225c4a2046d52 HTTP/1.1" 200 None 2026-05-08 08:45:31,859 - lava_callback - INFO - Completed processing callback for node 69fda27ae98225c4a2046d52 INFO: 172.21.0.1:49448 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:45:39,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:39,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34014 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:45:44,668 - lava_callback - INFO - Received callback for node 69fda285e98225c4a2046d73 INFO: 172.21.0.1:34028 - "POST /node/69fda285e98225c4a2046d73 HTTP/1.0" 202 Accepted 2026-05-08 08:45:44,679 - lava_callback - INFO - Starting async job submit for node 69fda285e98225c4a2046d73 2026-05-08 08:45:44,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:44,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda285e98225c4a2046d73 HTTP/1.1" 200 None 2026-05-08 08:45:44,737 - lava_callback - DEBUG - Processing node 69fda285e98225c4a2046d73: baseline-arm64 2026-05-08 08:45:45,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:45:45,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:45:45,291 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda285e98225c4a2046d73/log.txt.gz 2026-05-08 08:45:45,435 - lava_callback - INFO - Received callback for node 69fda294e98225c4a2046db7 INFO: 172.21.0.1:34040 - "POST /node/69fda294e98225c4a2046db7 HTTP/1.0" 202 Accepted 2026-05-08 08:45:45,447 - lava_callback - INFO - Starting async job submit for node 69fda294e98225c4a2046db7 2026-05-08 08:45:45,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:45,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:45:45,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda294e98225c4a2046db7 HTTP/1.1" 200 None 2026-05-08 08:45:45,513 - lava_callback - DEBUG - Processing node 69fda294e98225c4a2046db7: baseline-nfs-arm64 2026-05-08 08:45:45,516 - lava_callback - WARNING - Failed to upload log 2026-05-08 08:45:45,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:45:45,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:45:45,711 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda294e98225c4a2046db7/lava-logs.yaml 2026-05-08 08:45:45,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:45:45,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:45:45,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda285e98225c4a2046d73/lava-logs.yaml 2026-05-08 08:45:45,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:45:46,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:45:46,039 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda294e98225c4a2046db7/lava_callback.json.gz 2026-05-08 08:45:46,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:46,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda294e98225c4a2046db7 HTTP/1.1" 200 None 2026-05-08 08:45:46,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:46,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:45:46,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:46,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda294e98225c4a2046db7 HTTP/1.1" 200 None 2026-05-08 08:45:46,150 - lava_callback - INFO - Completed processing callback for node 69fda294e98225c4a2046db7 2026-05-08 08:45:46,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:45:46,278 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda285e98225c4a2046d73/lava_callback.json.gz 2026-05-08 08:45:46,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:46,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda285e98225c4a2046d73 HTTP/1.1" 200 None 2026-05-08 08:45:46,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:46,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:45:46,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:46,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda285e98225c4a2046d73 HTTP/1.1" 200 None 2026-05-08 08:45:46,448 - lava_callback - INFO - Completed processing callback for node 69fda285e98225c4a2046d73 INFO: 172.21.0.1:34056 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:45:54,136 - lava_callback - INFO - Received callback for node 69fda282e98225c4a2046d6a INFO: 172.21.0.1:50498 - "POST /node/69fda282e98225c4a2046d6a HTTP/1.0" 202 Accepted 2026-05-08 08:45:54,143 - lava_callback - INFO - Starting async job submit for node 69fda282e98225c4a2046d6a 2026-05-08 08:45:54,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:54,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda282e98225c4a2046d6a HTTP/1.1" 200 None 2026-05-08 08:45:54,182 - lava_callback - DEBUG - Processing node 69fda282e98225c4a2046d6a: baseline-arm64 2026-05-08 08:45:54,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:45:54,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:45:54,654 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda282e98225c4a2046d6a/log.txt.gz 2026-05-08 08:45:54,782 - lava_callback - INFO - Received callback for node 69fda27de98225c4a2046d5e INFO: 172.21.0.1:50502 - "POST /node/69fda27de98225c4a2046d5e HTTP/1.0" 202 Accepted 2026-05-08 08:45:54,807 - lava_callback - INFO - Starting async job submit for node 69fda27de98225c4a2046d5e 2026-05-08 08:45:54,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:54,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:45:54,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda27de98225c4a2046d5e HTTP/1.1" 200 None 2026-05-08 08:45:54,960 - lava_callback - DEBUG - Processing node 69fda27de98225c4a2046d5e: baseline-arm64 2026-05-08 08:45:55,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:45:55,131 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda282e98225c4a2046d6a/lava-logs.yaml 2026-05-08 08:45:55,132 - lava_callback - WARNING - Failed to upload log 2026-05-08 08:45:55,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:45:55,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:45:55,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:45:55,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda282e98225c4a2046d6a/lava_callback.json.gz 2026-05-08 08:45:55,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:45:55,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:55,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27de98225c4a2046d5e/lava-logs.yaml 2026-05-08 08:45:55,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:45:55,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda282e98225c4a2046d6a HTTP/1.1" 200 None 2026-05-08 08:45:55,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:55,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:45:55,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:55,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda282e98225c4a2046d6a HTTP/1.1" 200 None 2026-05-08 08:45:55,392 - lava_callback - INFO - Completed processing callback for node 69fda282e98225c4a2046d6a 2026-05-08 08:45:55,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:45:55,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27de98225c4a2046d5e/lava_callback.json.gz 2026-05-08 08:45:55,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:55,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda27de98225c4a2046d5e HTTP/1.1" 200 None 2026-05-08 08:45:55,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:55,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:45:55,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:45:55,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda27de98225c4a2046d5e HTTP/1.1" 200 None 2026-05-08 08:45:55,618 - lava_callback - INFO - Completed processing callback for node 69fda27de98225c4a2046d5e INFO: 172.21.0.1:50514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48494 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:46:09,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:09,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 08:46:13,303 - lava_callback - INFO - Received callback for node 69fda27be98225c4a2046d55 INFO: 172.21.0.1:41792 - "POST /node/69fda27be98225c4a2046d55 HTTP/1.0" 202 Accepted 2026-05-08 08:46:13,309 - lava_callback - INFO - Starting async job submit for node 69fda27be98225c4a2046d55 2026-05-08 08:46:13,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:13,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda27be98225c4a2046d55 HTTP/1.1" 200 None 2026-05-08 08:46:13,351 - lava_callback - DEBUG - Processing node 69fda27be98225c4a2046d55: baseline-arm64 2026-05-08 08:46:13,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:13,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:13,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27be98225c4a2046d55/log.txt.gz 2026-05-08 08:46:13,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:13,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:13,963 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27be98225c4a2046d55/lava-logs.yaml 2026-05-08 08:46:13,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:14,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:14,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27be98225c4a2046d55/lava_callback.json.gz 2026-05-08 08:46:14,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:14,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda27be98225c4a2046d55 HTTP/1.1" 200 None 2026-05-08 08:46:14,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:14,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:46:14,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:14,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda27be98225c4a2046d55 HTTP/1.1" 200 None 2026-05-08 08:46:14,168 - lava_callback - INFO - Completed processing callback for node 69fda27be98225c4a2046d55 2026-05-08 08:46:14,267 - lava_callback - INFO - Received callback for node 69fda27be98225c4a2046d58 INFO: 172.21.0.1:41800 - "POST /node/69fda27be98225c4a2046d58 HTTP/1.0" 202 Accepted 2026-05-08 08:46:14,274 - lava_callback - INFO - Starting async job submit for node 69fda27be98225c4a2046d58 2026-05-08 08:46:14,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:14,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda27be98225c4a2046d58 HTTP/1.1" 200 None 2026-05-08 08:46:14,332 - lava_callback - DEBUG - Processing node 69fda27be98225c4a2046d58: baseline-arm64 2026-05-08 08:46:14,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:14,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:14,780 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27be98225c4a2046d58/log.txt.gz 2026-05-08 08:46:14,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:15,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:15,147 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27be98225c4a2046d58/lava-logs.yaml 2026-05-08 08:46:15,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:41808 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 08:46:15,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:15,265 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27be98225c4a2046d58/lava_callback.json.gz 2026-05-08 08:46:15,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:15,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda27be98225c4a2046d58 HTTP/1.1" 200 None 2026-05-08 08:46:15,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:15,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:46:15,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:15,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda27be98225c4a2046d58 HTTP/1.1" 200 None 2026-05-08 08:46:15,343 - lava_callback - INFO - Completed processing callback for node 69fda27be98225c4a2046d58 INFO: 172.21.0.1:41820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41832 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:46:25,655 - lava_callback - INFO - Received callback for node 69fda28ae98225c4a2046d9b INFO: 172.21.0.1:50332 - "POST /node/69fda28ae98225c4a2046d9b HTTP/1.0" 202 Accepted 2026-05-08 08:46:25,662 - lava_callback - INFO - Starting async job submit for node 69fda28ae98225c4a2046d9b 2026-05-08 08:46:25,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:25,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda28ae98225c4a2046d9b HTTP/1.1" 200 None 2026-05-08 08:46:25,710 - lava_callback - DEBUG - Processing node 69fda28ae98225c4a2046d9b: baseline-arm64 2026-05-08 08:46:26,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:26,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:26,146 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda28ae98225c4a2046d9b/log.txt.gz 2026-05-08 08:46:26,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:26,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:26,516 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda28ae98225c4a2046d9b/lava-logs.yaml INFO: 172.21.0.1:50340 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:46:26,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:26,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:26,654 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda28ae98225c4a2046d9b/lava_callback.json.gz 2026-05-08 08:46:26,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:26,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda28ae98225c4a2046d9b HTTP/1.1" 200 None 2026-05-08 08:46:26,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:26,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:46:26,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:26,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda28ae98225c4a2046d9b HTTP/1.1" 200 None 2026-05-08 08:46:26,770 - lava_callback - INFO - Completed processing callback for node 69fda28ae98225c4a2046d9b 2026-05-08 08:46:32,051 - lava_callback - INFO - Received callback for node 69fda293e98225c4a2046db4 INFO: 172.21.0.1:33740 - "POST /node/69fda293e98225c4a2046db4 HTTP/1.0" 202 Accepted 2026-05-08 08:46:32,058 - lava_callback - INFO - Starting async job submit for node 69fda293e98225c4a2046db4 2026-05-08 08:46:32,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:32,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda293e98225c4a2046db4 HTTP/1.1" 200 None 2026-05-08 08:46:32,114 - lava_callback - DEBUG - Processing node 69fda293e98225c4a2046db4: baseline-nfs-arm64 2026-05-08 08:46:32,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:32,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:32,832 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda293e98225c4a2046db4/log.txt.gz 2026-05-08 08:46:33,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:33,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:33,284 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda293e98225c4a2046db4/lava-logs.yaml 2026-05-08 08:46:33,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33746 - "GET /favicon.ico HTTP/1.0" 404 Not Found 2026-05-08 08:46:33,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:33,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda293e98225c4a2046db4/lava_callback.json.gz 2026-05-08 08:46:33,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:33,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda293e98225c4a2046db4 HTTP/1.1" 200 None 2026-05-08 08:46:33,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:33,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:46:33,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:33,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda293e98225c4a2046db4 HTTP/1.1" 200 None 2026-05-08 08:46:33,490 - lava_callback - INFO - Completed processing callback for node 69fda293e98225c4a2046db4 INFO: 172.21.0.1:33760 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:46:39,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:39,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:46:43,574 - lava_callback - INFO - Received callback for node 69fda298e98225c4a2046dc0 INFO: 172.21.0.1:36742 - "POST /node/69fda298e98225c4a2046dc0 HTTP/1.0" 202 Accepted 2026-05-08 08:46:43,581 - lava_callback - INFO - Starting async job submit for node 69fda298e98225c4a2046dc0 2026-05-08 08:46:43,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:43,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda298e98225c4a2046dc0 HTTP/1.1" 200 None 2026-05-08 08:46:43,625 - lava_callback - DEBUG - Processing node 69fda298e98225c4a2046dc0: baseline-nfs-arm64 2026-05-08 08:46:44,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:44,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:44,162 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda298e98225c4a2046dc0/log.txt.gz 2026-05-08 08:46:44,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:44,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:44,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda298e98225c4a2046dc0/lava-logs.yaml 2026-05-08 08:46:44,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:44,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:44,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda298e98225c4a2046dc0/lava_callback.json.gz 2026-05-08 08:46:44,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:44,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda298e98225c4a2046dc0 HTTP/1.1" 200 None 2026-05-08 08:46:44,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:44,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:46:44,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:44,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda298e98225c4a2046dc0 HTTP/1.1" 200 None 2026-05-08 08:46:44,733 - lava_callback - INFO - Completed processing callback for node 69fda298e98225c4a2046dc0 INFO: 172.21.0.1:36754 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:46:47,537 - lava_callback - INFO - Received callback for node 69fda299e98225c4a2046dc7 INFO: 172.21.0.1:36766 - "POST /node/69fda299e98225c4a2046dc7 HTTP/1.0" 202 Accepted 2026-05-08 08:46:47,544 - lava_callback - INFO - Starting async job submit for node 69fda299e98225c4a2046dc7 2026-05-08 08:46:47,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:47,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda299e98225c4a2046dc7 HTTP/1.1" 200 None 2026-05-08 08:46:47,608 - lava_callback - DEBUG - Processing node 69fda299e98225c4a2046dc7: baseline-nfs-arm64 2026-05-08 08:46:47,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:48,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:48,115 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda299e98225c4a2046dc7/log.txt.gz 2026-05-08 08:46:48,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:48,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:48,583 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda299e98225c4a2046dc7/lava-logs.yaml 2026-05-08 08:46:48,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:48,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:48,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda299e98225c4a2046dc7/lava_callback.json.gz 2026-05-08 08:46:48,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:48,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda299e98225c4a2046dc7 HTTP/1.1" 200 None 2026-05-08 08:46:48,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:48,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:46:48,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:48,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda299e98225c4a2046dc7 HTTP/1.1" 200 None 2026-05-08 08:46:48,804 - lava_callback - INFO - Completed processing callback for node 69fda299e98225c4a2046dc7 2026-05-08 08:46:49,321 - lava_callback - INFO - Received callback for node 69fda284e98225c4a2046d70 INFO: 172.21.0.1:36770 - "POST /node/69fda284e98225c4a2046d70 HTTP/1.0" 202 Accepted 2026-05-08 08:46:49,327 - lava_callback - INFO - Starting async job submit for node 69fda284e98225c4a2046d70 2026-05-08 08:46:49,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:49,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda284e98225c4a2046d70 HTTP/1.1" 200 None 2026-05-08 08:46:49,365 - lava_callback - DEBUG - Processing node 69fda284e98225c4a2046d70: baseline-arm64 2026-05-08 08:46:49,587 - lava_callback - INFO - Received callback for node 69fda2c0e98225c4a2046e48 INFO: 172.21.0.1:36782 - "POST /node/69fda2c0e98225c4a2046e48 HTTP/1.0" 202 Accepted 2026-05-08 08:46:49,615 - lava_callback - INFO - Starting async job submit for node 69fda2c0e98225c4a2046e48 2026-05-08 08:46:49,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:49,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2c0e98225c4a2046e48 HTTP/1.1" 200 None 2026-05-08 08:46:49,795 - lava_callback - DEBUG - Processing node 69fda2c0e98225c4a2046e48: baseline-arm64-kontron 2026-05-08 08:46:49,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:50,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:50,087 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda284e98225c4a2046d70/log.txt.gz 2026-05-08 08:46:50,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:50,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:50,343 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fda2c0e98225c4a2046e48/log.txt.gz 2026-05-08 08:46:50,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:50,413 - lava_callback - INFO - Received callback for node 69fda27fe98225c4a2046d61 INFO: 172.21.0.1:57338 - "POST /node/69fda27fe98225c4a2046d61 HTTP/1.0" 202 Accepted 2026-05-08 08:46:50,432 - lava_callback - INFO - Starting async job submit for node 69fda27fe98225c4a2046d61 2026-05-08 08:46:50,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:50,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:50,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda27fe98225c4a2046d61 HTTP/1.1" 200 None 2026-05-08 08:46:50,609 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda284e98225c4a2046d70/lava-logs.yaml 2026-05-08 08:46:50,615 - lava_callback - DEBUG - Processing node 69fda27fe98225c4a2046d61: baseline-arm64 2026-05-08 08:46:50,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:50,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:50,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:50,837 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda284e98225c4a2046d70/lava_callback.json.gz 2026-05-08 08:46:50,852 - lava_callback - WARNING - Failed to upload log 2026-05-08 08:46:50,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:50,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:50,906 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fda2c0e98225c4a2046e48/lava-logs.yaml 2026-05-08 08:46:50,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda284e98225c4a2046d70 HTTP/1.1" 200 None 2026-05-08 08:46:50,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:50,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:50,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:51,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:46:51,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:51,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda284e98225c4a2046d70 HTTP/1.1" 200 None 2026-05-08 08:46:51,055 - lava_callback - INFO - Completed processing callback for node 69fda284e98225c4a2046d70 2026-05-08 08:46:51,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:51,134 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fda2c0e98225c4a2046e48/lava_callback.json.gz 2026-05-08 08:46:51,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:51,166 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27fe98225c4a2046d61/lava-logs.yaml 2026-05-08 08:46:51,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:51,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:51,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2c0e98225c4a2046e48 HTTP/1.1" 200 None 2026-05-08 08:46:51,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:51,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:46:51,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:51,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2c0e98225c4a2046e48 HTTP/1.1" 200 None 2026-05-08 08:46:51,267 - lava_callback - INFO - Completed processing callback for node 69fda2c0e98225c4a2046e48 2026-05-08 08:46:51,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:51,331 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27fe98225c4a2046d61/lava_callback.json.gz 2026-05-08 08:46:51,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:51,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda27fe98225c4a2046d61 HTTP/1.1" 200 None 2026-05-08 08:46:51,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:51,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:46:51,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:51,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda27fe98225c4a2046d61 HTTP/1.1" 200 None 2026-05-08 08:46:51,529 - lava_callback - INFO - Completed processing callback for node 69fda27fe98225c4a2046d61 2026-05-08 08:46:53,972 - lava_callback - INFO - Received callback for node 69fda2c5e98225c4a2046e5b INFO: 172.21.0.1:57342 - "POST /node/69fda2c5e98225c4a2046e5b HTTP/1.0" 202 Accepted 2026-05-08 08:46:53,978 - lava_callback - INFO - Starting async job submit for node 69fda2c5e98225c4a2046e5b 2026-05-08 08:46:54,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:54,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2c5e98225c4a2046e5b HTTP/1.1" 200 None 2026-05-08 08:46:54,022 - lava_callback - DEBUG - Processing node 69fda2c5e98225c4a2046e5b: baseline-arm64-foundriesio 2026-05-08 08:46:54,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:54,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:54,398 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fda2c5e98225c4a2046e5b/log.txt.gz 2026-05-08 08:46:54,423 - lava_callback - INFO - Received callback for node 69fda28fe98225c4a2046da7 INFO: 172.21.0.1:57356 - "POST /node/69fda28fe98225c4a2046da7 HTTP/1.0" 202 Accepted 2026-05-08 08:46:54,446 - lava_callback - INFO - Starting async job submit for node 69fda28fe98225c4a2046da7 2026-05-08 08:46:54,452 - lava_callback - INFO - Received callback for node 69fda2c5e98225c4a2046e5e INFO: 172.21.0.1:57364 - "POST /node/69fda2c5e98225c4a2046e5e HTTP/1.0" 202 Accepted 2026-05-08 08:46:54,488 - lava_callback - INFO - Starting async job submit for node 69fda2c5e98225c4a2046e5e 2026-05-08 08:46:54,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:54,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:54,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2c5e98225c4a2046e5e HTTP/1.1" 200 None 2026-05-08 08:46:54,633 - lava_callback - DEBUG - Processing node 69fda2c5e98225c4a2046e5e: baseline-arm64-foundriesio 2026-05-08 08:46:54,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:54,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda28fe98225c4a2046da7 HTTP/1.1" 200 None 2026-05-08 08:46:54,733 - lava_callback - DEBUG - Processing node 69fda28fe98225c4a2046da7: baseline-nfs-arm64 2026-05-08 08:46:55,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:55,287 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fda2c5e98225c4a2046e5b/lava-logs.yaml 2026-05-08 08:46:55,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:55,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:55,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:55,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:55,650 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda28fe98225c4a2046da7/log.txt.gz 2026-05-08 08:46:55,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:55,696 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fda2c5e98225c4a2046e5e/log.txt.gz 2026-05-08 08:46:55,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:55,762 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fda2c5e98225c4a2046e5b/lava_callback.json.gz 2026-05-08 08:46:55,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:55,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2c5e98225c4a2046e5b HTTP/1.1" 200 None 2026-05-08 08:46:55,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:56,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:46:56,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:56,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:56,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:56,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2c5e98225c4a2046e5b HTTP/1.1" 200 None 2026-05-08 08:46:56,376 - lava_callback - INFO - Completed processing callback for node 69fda2c5e98225c4a2046e5b INFO: 172.21.0.1:57376 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:46:56,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:56,605 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda28fe98225c4a2046da7/lava-logs.yaml 2026-05-08 08:46:56,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:56,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:56,646 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fda2c5e98225c4a2046e5e/lava-logs.yaml 2026-05-08 08:46:56,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:56,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:56,755 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda28fe98225c4a2046da7/lava_callback.json.gz 2026-05-08 08:46:56,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:56,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda28fe98225c4a2046da7 HTTP/1.1" 200 None 2026-05-08 08:46:56,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:56,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:56,818 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fda2c5e98225c4a2046e5e/lava_callback.json.gz 2026-05-08 08:46:56,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:56,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:46:56,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2c5e98225c4a2046e5e HTTP/1.1" 200 None 2026-05-08 08:46:56,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:56,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:56,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:46:56,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:56,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda28fe98225c4a2046da7 HTTP/1.1" 200 None 2026-05-08 08:46:56,913 - lava_callback - INFO - Completed processing callback for node 69fda28fe98225c4a2046da7 2026-05-08 08:46:56,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2c5e98225c4a2046e5e HTTP/1.1" 200 None 2026-05-08 08:46:56,975 - lava_callback - INFO - Completed processing callback for node 69fda2c5e98225c4a2046e5e 2026-05-08 08:46:57,608 - lava_callback - INFO - Received callback for node 69fda286e98225c4a2046d76 INFO: 172.21.0.1:57380 - "POST /node/69fda286e98225c4a2046d76 HTTP/1.0" 202 Accepted 2026-05-08 08:46:57,615 - lava_callback - INFO - Starting async job submit for node 69fda286e98225c4a2046d76 2026-05-08 08:46:57,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:57,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda286e98225c4a2046d76 HTTP/1.1" 200 None 2026-05-08 08:46:57,652 - lava_callback - DEBUG - Processing node 69fda286e98225c4a2046d76: baseline-arm64 2026-05-08 08:46:57,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:57,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:57,948 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda286e98225c4a2046d76/log.txt.gz 2026-05-08 08:46:58,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:58,104 - lava_callback - INFO - Received callback for node 69fda2e2e98225c4a2046e93 INFO: 172.21.0.1:57382 - "POST /node/69fda2e2e98225c4a2046e93 HTTP/1.0" 202 Accepted 2026-05-08 08:46:58,110 - lava_callback - INFO - Starting async job submit for node 69fda2e2e98225c4a2046e93 2026-05-08 08:46:58,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:58,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2e2e98225c4a2046e93 HTTP/1.1" 200 None 2026-05-08 08:46:58,128 - lava_callback - DEBUG - Processing node 69fda2e2e98225c4a2046e93: baseline-arm 2026-05-08 08:46:58,134 - lava_callback - WARNING - Failed to upload log 2026-05-08 08:46:58,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:58,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:58,219 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda286e98225c4a2046d76/lava-logs.yaml 2026-05-08 08:46:58,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:58,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:58,228 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fda2e2e98225c4a2046e93/lava-logs.yaml 2026-05-08 08:46:58,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:58,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:58,320 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fda2e2e98225c4a2046e93/lava_callback.json.gz 2026-05-08 08:46:58,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:58,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2e2e98225c4a2046e93 HTTP/1.1" 200 None 2026-05-08 08:46:58,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:58,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:58,355 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda286e98225c4a2046d76/lava_callback.json.gz 2026-05-08 08:46:58,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:46:58,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:58,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:58,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda286e98225c4a2046d76 HTTP/1.1" 200 None 2026-05-08 08:46:58,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:58,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2e2e98225c4a2046e93 HTTP/1.1" 200 None 2026-05-08 08:46:58,413 - lava_callback - INFO - Completed processing callback for node 69fda2e2e98225c4a2046e93 2026-05-08 08:46:58,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:46:58,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:58,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda286e98225c4a2046d76 HTTP/1.1" 200 None 2026-05-08 08:46:58,512 - lava_callback - INFO - Completed processing callback for node 69fda286e98225c4a2046d76 2026-05-08 08:46:59,520 - lava_callback - INFO - Received callback for node 69fda2c1e98225c4a2046e4b INFO: 172.21.0.1:57394 - "POST /node/69fda2c1e98225c4a2046e4b HTTP/1.0" 202 Accepted 2026-05-08 08:46:59,527 - lava_callback - INFO - Starting async job submit for node 69fda2c1e98225c4a2046e4b 2026-05-08 08:46:59,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:46:59,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2c1e98225c4a2046e4b HTTP/1.1" 200 None 2026-05-08 08:46:59,566 - lava_callback - DEBUG - Processing node 69fda2c1e98225c4a2046e4b: baseline-arm64-pengutronix 2026-05-08 08:46:59,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:46:59,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:46:59,903 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fda2c1e98225c4a2046e4b/log.txt.gz 2026-05-08 08:47:00,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:00,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:00,153 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fda2c1e98225c4a2046e4b/lava-logs.yaml 2026-05-08 08:47:00,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:00,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:00,259 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fda2c1e98225c4a2046e4b/lava_callback.json.gz 2026-05-08 08:47:00,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:00,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2c1e98225c4a2046e4b HTTP/1.1" 200 None 2026-05-08 08:47:00,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:00,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:47:00,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:00,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2c1e98225c4a2046e4b HTTP/1.1" 200 None 2026-05-08 08:47:00,338 - lava_callback - INFO - Completed processing callback for node 69fda2c1e98225c4a2046e4b 2026-05-08 08:47:00,647 - lava_callback - INFO - Received callback for node 69fda281e98225c4a2046d67 INFO: 172.21.0.1:53458 - "POST /node/69fda281e98225c4a2046d67 HTTP/1.0" 202 Accepted 2026-05-08 08:47:00,654 - lava_callback - INFO - Starting async job submit for node 69fda281e98225c4a2046d67 2026-05-08 08:47:00,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:00,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda281e98225c4a2046d67 HTTP/1.1" 200 None 2026-05-08 08:47:00,692 - lava_callback - DEBUG - Processing node 69fda281e98225c4a2046d67: baseline-arm64 2026-05-08 08:47:00,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:01,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:01,080 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda281e98225c4a2046d67/log.txt.gz 2026-05-08 08:47:01,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:01,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:01,404 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda281e98225c4a2046d67/lava-logs.yaml 2026-05-08 08:47:01,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:01,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:01,553 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda281e98225c4a2046d67/lava_callback.json.gz 2026-05-08 08:47:01,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:01,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda281e98225c4a2046d67 HTTP/1.1" 200 None 2026-05-08 08:47:01,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:01,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:47:01,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:01,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda281e98225c4a2046d67 HTTP/1.1" 200 None 2026-05-08 08:47:01,656 - lava_callback - INFO - Completed processing callback for node 69fda281e98225c4a2046d67 INFO: 172.21.0.1:53460 - "GET /.well-known/security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:47:08,249 - lava_callback - INFO - Received callback for node 69fda288e98225c4a2046d7c INFO: 172.21.0.1:53470 - "POST /node/69fda288e98225c4a2046d7c HTTP/1.0" 202 Accepted 2026-05-08 08:47:08,260 - lava_callback - INFO - Starting async job submit for node 69fda288e98225c4a2046d7c 2026-05-08 08:47:08,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:08,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda288e98225c4a2046d7c HTTP/1.1" 200 None 2026-05-08 08:47:08,330 - lava_callback - DEBUG - Processing node 69fda288e98225c4a2046d7c: baseline-arm64 2026-05-08 08:47:08,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:08,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:08,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda288e98225c4a2046d7c/log.txt.gz 2026-05-08 08:47:09,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:09,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:09,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda288e98225c4a2046d7c/lava-logs.yaml 2026-05-08 08:47:09,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:09,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:09,696 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda288e98225c4a2046d7c/lava_callback.json.gz 2026-05-08 08:47:09,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:09,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda288e98225c4a2046d7c HTTP/1.1" 200 None 2026-05-08 08:47:09,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:09,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:09,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:47:09,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:09,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-08 08:47:09,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda288e98225c4a2046d7c HTTP/1.1" 200 None 2026-05-08 08:47:09,841 - lava_callback - INFO - Completed processing callback for node 69fda288e98225c4a2046d7c 2026-05-08 08:47:10,784 - lava_callback - INFO - Received callback for node 69fda2c2e98225c4a2046e4f INFO: 172.21.0.1:56066 - "POST /node/69fda2c2e98225c4a2046e4f HTTP/1.0" 202 Accepted 2026-05-08 08:47:10,793 - lava_callback - INFO - Starting async job submit for node 69fda2c2e98225c4a2046e4f 2026-05-08 08:47:10,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:10,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2c2e98225c4a2046e4f HTTP/1.1" 200 None 2026-05-08 08:47:10,852 - lava_callback - DEBUG - Processing node 69fda2c2e98225c4a2046e4f: baseline-arm64-pengutronix 2026-05-08 08:47:11,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:11,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:11,382 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fda2c2e98225c4a2046e4f/log.txt.gz 2026-05-08 08:47:11,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:11,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:11,865 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fda2c2e98225c4a2046e4f/lava-logs.yaml 2026-05-08 08:47:11,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:12,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:12,123 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fda2c2e98225c4a2046e4f/lava_callback.json.gz 2026-05-08 08:47:12,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:12,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2c2e98225c4a2046e4f HTTP/1.1" 200 None 2026-05-08 08:47:12,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:12,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:47:12,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:12,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2c2e98225c4a2046e4f HTTP/1.1" 200 None 2026-05-08 08:47:12,317 - lava_callback - INFO - Completed processing callback for node 69fda2c2e98225c4a2046e4f INFO: 172.21.0.1:56082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56088 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:47:16,635 - lava_callback - INFO - Received callback for node 69fda2c4e98225c4a2046e58 INFO: 172.21.0.1:56098 - "POST /node/69fda2c4e98225c4a2046e58 HTTP/1.0" 202 Accepted 2026-05-08 08:47:16,646 - lava_callback - INFO - Starting async job submit for node 69fda2c4e98225c4a2046e58 2026-05-08 08:47:16,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:16,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2c4e98225c4a2046e58 HTTP/1.1" 200 None 2026-05-08 08:47:16,715 - lava_callback - DEBUG - Processing node 69fda2c4e98225c4a2046e58: baseline-arm64-pengutronix 2026-05-08 08:47:17,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:17,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:17,289 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fda2c4e98225c4a2046e58/log.txt.gz 2026-05-08 08:47:17,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:17,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:17,682 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fda2c4e98225c4a2046e58/lava-logs.yaml 2026-05-08 08:47:17,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:17,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:17,816 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fda2c4e98225c4a2046e58/lava_callback.json.gz 2026-05-08 08:47:17,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:17,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2c4e98225c4a2046e58 HTTP/1.1" 200 None 2026-05-08 08:47:17,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:17,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:47:17,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:17,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2c4e98225c4a2046e58 HTTP/1.1" 200 None 2026-05-08 08:47:17,968 - lava_callback - INFO - Completed processing callback for node 69fda2c4e98225c4a2046e58 2026-05-08 08:47:21,877 - lava_callback - INFO - Received callback for node 69fda295e98225c4a2046dba INFO: 172.21.0.1:53088 - "POST /node/69fda295e98225c4a2046dba HTTP/1.0" 202 Accepted 2026-05-08 08:47:21,893 - lava_callback - INFO - Starting async job submit for node 69fda295e98225c4a2046dba 2026-05-08 08:47:21,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:21,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda295e98225c4a2046dba HTTP/1.1" 200 None 2026-05-08 08:47:21,986 - lava_callback - DEBUG - Processing node 69fda295e98225c4a2046dba: baseline-nfs-arm64 2026-05-08 08:47:22,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:22,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:22,756 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda295e98225c4a2046dba/log.txt.gz 2026-05-08 08:47:23,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:23,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:23,436 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda295e98225c4a2046dba/lava-logs.yaml 2026-05-08 08:47:23,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:23,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:23,661 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda295e98225c4a2046dba/lava_callback.json.gz 2026-05-08 08:47:23,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:23,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda295e98225c4a2046dba HTTP/1.1" 200 None 2026-05-08 08:47:23,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:23,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:47:23,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:23,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda295e98225c4a2046dba HTTP/1.1" 200 None 2026-05-08 08:47:23,872 - lava_callback - INFO - Completed processing callback for node 69fda295e98225c4a2046dba INFO: 172.21.0.1:53094 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:47:27,063 - lava_callback - INFO - Received callback for node 69fda06ee98225c4a2046b18 INFO: 172.21.0.1:53110 - "POST /node/69fda06ee98225c4a2046b18 HTTP/1.0" 202 Accepted 2026-05-08 08:47:27,072 - lava_callback - INFO - Starting async job submit for node 69fda06ee98225c4a2046b18 2026-05-08 08:47:27,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:27,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda06ee98225c4a2046b18 HTTP/1.1" 200 None 2026-05-08 08:47:27,153 - lava_callback - DEBUG - Processing node 69fda06ee98225c4a2046b18: baseline-arm 2026-05-08 08:47:27,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:27,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:27,708 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fda06ee98225c4a2046b18/log.txt.gz 2026-05-08 08:47:27,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:28,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:28,109 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fda06ee98225c4a2046b18/lava-logs.yaml 2026-05-08 08:47:28,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:28,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:28,345 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fda06ee98225c4a2046b18/lava_callback.json.gz 2026-05-08 08:47:28,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:28,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda06ee98225c4a2046b18 HTTP/1.1" 200 None 2026-05-08 08:47:28,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:28,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c90e98225c4a20469a4 HTTP/1.1" 200 None 2026-05-08 08:47:28,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:28,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda06ee98225c4a2046b18 HTTP/1.1" 200 None 2026-05-08 08:47:28,493 - lava_callback - INFO - Completed processing callback for node 69fda06ee98225c4a2046b18 INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:47:39,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:39,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60010 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:47:50,369 - lava_callback - INFO - Received callback for node 69fda2bbe98225c4a2046e3c INFO: 172.21.0.1:37316 - "POST /node/69fda2bbe98225c4a2046e3c HTTP/1.0" 202 Accepted 2026-05-08 08:47:50,376 - lava_callback - INFO - Starting async job submit for node 69fda2bbe98225c4a2046e3c 2026-05-08 08:47:50,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:50,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2bbe98225c4a2046e3c HTTP/1.1" 200 None 2026-05-08 08:47:50,415 - lava_callback - DEBUG - Processing node 69fda2bbe98225c4a2046e3c: baseline-arm64-clabbe 2026-05-08 08:47:50,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:50,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:50,789 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fda2bbe98225c4a2046e3c/log.txt.gz 2026-05-08 08:47:50,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:51,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:51,088 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fda2bbe98225c4a2046e3c/lava-logs.yaml 2026-05-08 08:47:51,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:47:51,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:47:51,192 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fda2bbe98225c4a2046e3c/lava_callback.json.gz 2026-05-08 08:47:51,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:51,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2bbe98225c4a2046e3c HTTP/1.1" 200 None 2026-05-08 08:47:51,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:51,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:47:51,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:47:51,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2bbe98225c4a2046e3c HTTP/1.1" 200 None 2026-05-08 08:47:51,277 - lava_callback - INFO - Completed processing callback for node 69fda2bbe98225c4a2046e3c INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55518 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:48:09,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:48:09,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43184 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:48:55,587 - lava_callback - INFO - Received callback for node 69fda280e98225c4a2046d64 INFO: 172.21.0.1:39734 - "POST /node/69fda280e98225c4a2046d64 HTTP/1.0" 202 Accepted 2026-05-08 08:48:55,594 - lava_callback - INFO - Starting async job submit for node 69fda280e98225c4a2046d64 2026-05-08 08:48:55,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:48:55,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda280e98225c4a2046d64 HTTP/1.1" 200 None 2026-05-08 08:48:55,666 - lava_callback - DEBUG - Processing node 69fda280e98225c4a2046d64: baseline-arm64 2026-05-08 08:48:56,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:48:56,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:48:56,132 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda280e98225c4a2046d64/log.txt.gz 2026-05-08 08:48:56,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:48:56,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:48:56,512 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda280e98225c4a2046d64/lava-logs.yaml 2026-05-08 08:48:56,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:48:56,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:48:56,610 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda280e98225c4a2046d64/lava_callback.json.gz 2026-05-08 08:48:56,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:48:56,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda280e98225c4a2046d64 HTTP/1.1" 200 None 2026-05-08 08:48:56,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:48:56,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:48:56,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:48:56,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda280e98225c4a2046d64 HTTP/1.1" 200 None 2026-05-08 08:48:56,688 - lava_callback - INFO - Completed processing callback for node 69fda280e98225c4a2046d64 INFO: 172.21.0.1:34292 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:49:09,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:49:09,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 08:49:13,438 - lava_callback - INFO - Received callback for node 69fda28ee98225c4a2046da4 INFO: 172.21.0.1:60214 - "POST /node/69fda28ee98225c4a2046da4 HTTP/1.0" 202 Accepted 2026-05-08 08:49:13,445 - lava_callback - INFO - Starting async job submit for node 69fda28ee98225c4a2046da4 2026-05-08 08:49:13,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:49:13,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda28ee98225c4a2046da4 HTTP/1.1" 200 None 2026-05-08 08:49:13,479 - lava_callback - DEBUG - Processing node 69fda28ee98225c4a2046da4: baseline-nfs-arm64 2026-05-08 08:49:13,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:49:13,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:49:13,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda28ee98225c4a2046da4/log.txt.gz 2026-05-08 08:49:14,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:49:14,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:49:14,366 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda28ee98225c4a2046da4/lava-logs.yaml 2026-05-08 08:49:14,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:49:14,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:49:14,575 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda28ee98225c4a2046da4/lava_callback.json.gz 2026-05-08 08:49:14,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:49:14,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda28ee98225c4a2046da4 HTTP/1.1" 200 None 2026-05-08 08:49:14,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:49:14,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:49:14,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:49:14,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda28ee98225c4a2046da4 HTTP/1.1" 200 None 2026-05-08 08:49:14,652 - lava_callback - INFO - Completed processing callback for node 69fda28ee98225c4a2046da4 INFO: 172.21.0.1:60216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36168 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:49:39,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:49:39,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56938 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:51:26,358 - lava_callback - INFO - Received callback for node 69fb010a5ce316b79a7145d9 INFO: 172.21.0.1:56480 - "POST /node/69fb010a5ce316b79a7145d9 HTTP/1.0" 202 Accepted 2026-05-08 08:51:26,363 - lava_callback - INFO - Starting async job submit for node 69fb010a5ce316b79a7145d9 2026-05-08 08:51:26,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:51:26,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb010a5ce316b79a7145d9 HTTP/1.1" 200 None 2026-05-08 08:51:26,383 - lava_callback - DEBUG - Processing node 69fb010a5ce316b79a7145d9: baseline-arm-baylibre 2026-05-08 08:51:26,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb010a5ce316b79a7145d9 2026-05-08 08:51:26,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:51:26,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb010a5ce316b79a7145d9 HTTP/1.1" 200 None 2026-05-08 08:51:26,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:51:26,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-08 08:51:26,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:51:26,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb010a5ce316b79a7145d9 HTTP/1.1" 200 None 2026-05-08 08:51:26,428 - lava_callback - ERROR - Error processing callback for node 69fb010a5ce316b79a7145d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56496 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:51:27,055 - lava_callback - INFO - Received callback for node 69fda074e98225c4a2046b32 INFO: 172.21.0.1:56500 - "POST /node/69fda074e98225c4a2046b32 HTTP/1.0" 202 Accepted 2026-05-08 08:51:27,062 - lava_callback - INFO - Starting async job submit for node 69fda074e98225c4a2046b32 2026-05-08 08:51:27,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:51:27,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda074e98225c4a2046b32 HTTP/1.1" 200 None 2026-05-08 08:51:27,118 - lava_callback - DEBUG - Processing node 69fda074e98225c4a2046b32: baseline-arm 2026-05-08 08:51:27,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:51:27,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:51:27,511 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fda074e98225c4a2046b32/log.txt.gz 2026-05-08 08:51:27,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:51:27,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:51:27,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fda074e98225c4a2046b32/lava-logs.yaml 2026-05-08 08:51:27,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:51:27,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:51:27,912 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fda074e98225c4a2046b32/lava_callback.json.gz 2026-05-08 08:51:27,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:51:27,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda074e98225c4a2046b32 HTTP/1.1" 200 None 2026-05-08 08:51:27,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:51:27,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:51:27,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:51:27,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda074e98225c4a2046b32 HTTP/1.1" 200 None 2026-05-08 08:51:27,991 - lava_callback - INFO - Completed processing callback for node 69fda074e98225c4a2046b32 INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:51:39,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:51:39,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:52:06,324 - lava_callback - INFO - Received callback for node 69fb012f5ce316b79a7145eb INFO: 172.21.0.1:38542 - "POST /node/69fb012f5ce316b79a7145eb HTTP/1.0" 202 Accepted 2026-05-08 08:52:06,333 - lava_callback - INFO - Starting async job submit for node 69fb012f5ce316b79a7145eb 2026-05-08 08:52:06,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:52:06,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb012f5ce316b79a7145eb HTTP/1.1" 200 None 2026-05-08 08:52:06,359 - lava_callback - DEBUG - Processing node 69fb012f5ce316b79a7145eb: baseline-arm-baylibre 2026-05-08 08:52:06,360 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb012f5ce316b79a7145eb 2026-05-08 08:52:06,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:52:06,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb012f5ce316b79a7145eb HTTP/1.1" 200 None 2026-05-08 08:52:06,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:52:06,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-08 08:52:06,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:52:06,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb012f5ce316b79a7145eb HTTP/1.1" 200 None 2026-05-08 08:52:06,448 - lava_callback - ERROR - Error processing callback for node 69fb012f5ce316b79a7145eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:52:46,398 - lava_callback - INFO - Received callback for node 69fb01545ce316b79a7145fc INFO: 172.21.0.1:46020 - "POST /node/69fb01545ce316b79a7145fc HTTP/1.0" 202 Accepted 2026-05-08 08:52:46,403 - lava_callback - INFO - Starting async job submit for node 69fb01545ce316b79a7145fc 2026-05-08 08:52:46,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:52:46,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb01545ce316b79a7145fc HTTP/1.1" 200 None 2026-05-08 08:52:46,422 - lava_callback - DEBUG - Processing node 69fb01545ce316b79a7145fc: baseline-arm-baylibre 2026-05-08 08:52:46,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb01545ce316b79a7145fc 2026-05-08 08:52:46,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:52:46,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb01545ce316b79a7145fc HTTP/1.1" 200 None 2026-05-08 08:52:46,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:52:46,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-08 08:52:46,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:52:46,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb01545ce316b79a7145fc HTTP/1.1" 200 None 2026-05-08 08:52:46,473 - lava_callback - ERROR - Error processing callback for node 69fb01545ce316b79a7145fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35986 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:53:24,062 - lava_callback - INFO - Received callback for node 69fda0b2e98225c4a2046beb INFO: 172.21.0.1:56158 - "POST /node/69fda0b2e98225c4a2046beb HTTP/1.0" 202 Accepted 2026-05-08 08:53:24,070 - lava_callback - INFO - Starting async job submit for node 69fda0b2e98225c4a2046beb 2026-05-08 08:53:24,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:53:24,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0b2e98225c4a2046beb HTTP/1.1" 200 None 2026-05-08 08:53:24,109 - lava_callback - DEBUG - Processing node 69fda0b2e98225c4a2046beb: ltp-dio 2026-05-08 08:53:24,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:53:24,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:53:24,597 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69fda0b2e98225c4a2046beb/log.txt.gz 2026-05-08 08:53:24,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:53:24,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:53:24,967 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69fda0b2e98225c4a2046beb/lava-logs.yaml 2026-05-08 08:53:24,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:53:25,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:53:25,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69fda0b2e98225c4a2046beb/lava_callback.json.gz 2026-05-08 08:53:25,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:53:25,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0b2e98225c4a2046beb HTTP/1.1" 200 None 2026-05-08 08:53:25,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:53:25,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:53:25,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:53:25,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0b2e98225c4a2046beb HTTP/1.1" 200 None 2026-05-08 08:53:25,163 - lava_callback - INFO - Completed processing callback for node 69fda0b2e98225c4a2046beb INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:53:32,247 - lava_callback - INFO - Received callback for node 69fda073e98225c4a2046b2f INFO: 172.21.0.1:47810 - "POST /node/69fda073e98225c4a2046b2f HTTP/1.0" 202 Accepted 2026-05-08 08:53:32,258 - lava_callback - INFO - Starting async job submit for node 69fda073e98225c4a2046b2f 2026-05-08 08:53:32,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:53:32,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda073e98225c4a2046b2f HTTP/1.1" 200 None 2026-05-08 08:53:32,342 - lava_callback - DEBUG - Processing node 69fda073e98225c4a2046b2f: baseline-arm 2026-05-08 08:53:32,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:53:33,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:53:33,098 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fda073e98225c4a2046b2f/log.txt.gz 2026-05-08 08:53:33,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:53:33,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:53:33,639 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fda073e98225c4a2046b2f/lava-logs.yaml 2026-05-08 08:53:33,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:53:33,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:53:33,767 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fda073e98225c4a2046b2f/lava_callback.json.gz DEBUG: Setup failed for 69fda073e98225c4a2046b2f. Transitting job node result: incomplete -> fail 2026-05-08 08:53:33,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:53:33,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda073e98225c4a2046b2f HTTP/1.1" 200 None 2026-05-08 08:53:33,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:53:33,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:53:33,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:53:33,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda073e98225c4a2046b2f HTTP/1.1" 200 None 2026-05-08 08:53:34,118 - lava_callback - INFO - Completed processing callback for node 69fda073e98225c4a2046b2f INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:53:39,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:53:39,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41888 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:54:26,504 - lava_callback - INFO - Received callback for node 69fb01bb5ce316b79a71461f INFO: 172.21.0.1:59064 - "POST /node/69fb01bb5ce316b79a71461f HTTP/1.0" 202 Accepted 2026-05-08 08:54:26,509 - lava_callback - INFO - Starting async job submit for node 69fb01bb5ce316b79a71461f 2026-05-08 08:54:26,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:54:26,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb01bb5ce316b79a71461f HTTP/1.1" 200 None 2026-05-08 08:54:26,525 - lava_callback - DEBUG - Processing node 69fb01bb5ce316b79a71461f: baseline-arm-baylibre 2026-05-08 08:54:26,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb01bb5ce316b79a71461f 2026-05-08 08:54:26,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:54:26,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb01bb5ce316b79a71461f HTTP/1.1" 200 None 2026-05-08 08:54:26,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:54:26,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-08 08:54:26,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:54:26,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb01bb5ce316b79a71461f HTTP/1.1" 200 None 2026-05-08 08:54:26,583 - lava_callback - ERROR - Error processing callback for node 69fb01bb5ce316b79a71461f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55242 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:55:06,500 - lava_callback - INFO - Received callback for node 69fb01e25ce316b79a714630 INFO: 172.21.0.1:42122 - "POST /node/69fb01e25ce316b79a714630 HTTP/1.0" 202 Accepted 2026-05-08 08:55:06,507 - lava_callback - INFO - Starting async job submit for node 69fb01e25ce316b79a714630 2026-05-08 08:55:06,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:42138 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:55:06,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb01e25ce316b79a714630 HTTP/1.1" 200 None 2026-05-08 08:55:06,524 - lava_callback - DEBUG - Processing node 69fb01e25ce316b79a714630: baseline-arm-baylibre 2026-05-08 08:55:06,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb01e25ce316b79a714630 2026-05-08 08:55:06,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:55:06,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb01e25ce316b79a714630 HTTP/1.1" 200 None 2026-05-08 08:55:06,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:55:06,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-08 08:55:06,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:55:06,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb01e25ce316b79a714630 HTTP/1.1" 200 None 2026-05-08 08:55:06,605 - lava_callback - ERROR - Error processing callback for node 69fb01e25ce316b79a714630: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:56:08,239 - lava_callback - INFO - Received callback for node 69fda096e98225c4a2046bb3 INFO: 172.21.0.1:41070 - "POST /node/69fda096e98225c4a2046bb3 HTTP/1.0" 202 Accepted 2026-05-08 08:56:08,285 - lava_callback - INFO - Starting async job submit for node 69fda096e98225c4a2046bb3 2026-05-08 08:56:08,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:08,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda096e98225c4a2046bb3 HTTP/1.1" 200 None 2026-05-08 08:56:08,326 - lava_callback - DEBUG - Processing node 69fda096e98225c4a2046bb3: baseline-arm-pengutronix 2026-05-08 08:56:08,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:56:08,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:56:08,568 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fda096e98225c4a2046bb3/log.txt.gz 2026-05-08 08:56:08,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:56:09,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:56:09,044 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fda096e98225c4a2046bb3/lava-logs.yaml 2026-05-08 08:56:09,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:56:09,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:56:09,163 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fda096e98225c4a2046bb3/lava_callback.json.gz DEBUG: Setup failed for 69fda096e98225c4a2046bb3. Transitting job node result: incomplete -> fail 2026-05-08 08:56:09,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:09,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda096e98225c4a2046bb3 HTTP/1.1" 200 None 2026-05-08 08:56:09,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:09,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 08:56:09,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:09,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda096e98225c4a2046bb3 HTTP/1.1" 200 None 2026-05-08 08:56:09,335 - lava_callback - INFO - Completed processing callback for node 69fda096e98225c4a2046bb3 2026-05-08 08:56:09,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:09,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:56:26,588 - lava_callback - INFO - Received callback for node 69fb022f5ce316b79a714653 INFO: 172.21.0.1:37668 - "POST /node/69fb022f5ce316b79a714653 HTTP/1.0" 202 Accepted 2026-05-08 08:56:26,595 - lava_callback - INFO - Starting async job submit for node 69fb022f5ce316b79a714653 2026-05-08 08:56:26,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:26,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb022f5ce316b79a714653 HTTP/1.1" 200 None 2026-05-08 08:56:26,610 - lava_callback - DEBUG - Processing node 69fb022f5ce316b79a714653: baseline-arm-baylibre 2026-05-08 08:56:26,611 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb022f5ce316b79a714653 2026-05-08 08:56:26,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:26,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb022f5ce316b79a714653 HTTP/1.1" 200 None 2026-05-08 08:56:26,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:26,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-08 08:56:26,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:26,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb022f5ce316b79a714653 HTTP/1.1" 200 None 2026-05-08 08:56:26,658 - lava_callback - ERROR - Error processing callback for node 69fb022f5ce316b79a714653: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45160 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:56:38,185 - lava_callback - INFO - Received callback for node 69fda28be98225c4a2046d9e INFO: 172.21.0.1:45174 - "POST /node/69fda28be98225c4a2046d9e HTTP/1.0" 202 Accepted 2026-05-08 08:56:38,193 - lava_callback - INFO - Starting async job submit for node 69fda28be98225c4a2046d9e 2026-05-08 08:56:38,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:38,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda28be98225c4a2046d9e HTTP/1.1" 200 None 2026-05-08 08:56:38,244 - lava_callback - DEBUG - Processing node 69fda28be98225c4a2046d9e: baseline-arm64 2026-05-08 08:56:38,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:56:38,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:56:38,690 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda28be98225c4a2046d9e/log.txt.gz 2026-05-08 08:56:38,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:56:39,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:56:39,043 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda28be98225c4a2046d9e/lava-logs.yaml 2026-05-08 08:56:39,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:56:39,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:56:39,185 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda28be98225c4a2046d9e/lava_callback.json.gz DEBUG: Setup failed for 69fda28be98225c4a2046d9e. Transitting job node result: incomplete -> fail 2026-05-08 08:56:39,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:39,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda28be98225c4a2046d9e HTTP/1.1" 200 None 2026-05-08 08:56:39,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:39,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:56:39,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:39,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda28be98225c4a2046d9e HTTP/1.1" 200 None 2026-05-08 08:56:39,411 - lava_callback - INFO - Completed processing callback for node 69fda28be98225c4a2046d9e 2026-05-08 08:56:39,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:56:39,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50274 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:50284 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:57:38,627 - lava_callback - INFO - Received callback for node 69fda283e98225c4a2046d6d INFO: 172.21.0.1:50292 - "POST /node/69fda283e98225c4a2046d6d HTTP/1.0" 202 Accepted 2026-05-08 08:57:38,633 - lava_callback - INFO - Starting async job submit for node 69fda283e98225c4a2046d6d 2026-05-08 08:57:38,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:57:38,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda283e98225c4a2046d6d HTTP/1.1" 200 None 2026-05-08 08:57:38,670 - lava_callback - DEBUG - Processing node 69fda283e98225c4a2046d6d: baseline-arm64 2026-05-08 08:57:38,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:57:39,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:57:39,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda283e98225c4a2046d6d/log.txt.gz 2026-05-08 08:57:39,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:57:39,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:57:39,613 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda283e98225c4a2046d6d/lava-logs.yaml 2026-05-08 08:57:39,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:57:39,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:57:39,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda283e98225c4a2046d6d/lava_callback.json.gz 2026-05-08 08:57:39,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:57:39,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda283e98225c4a2046d6d HTTP/1.1" 200 None 2026-05-08 08:57:39,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:57:39,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:57:39,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:57:39,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda283e98225c4a2046d6d HTTP/1.1" 200 None 2026-05-08 08:57:39,897 - lava_callback - INFO - Completed processing callback for node 69fda283e98225c4a2046d6d 2026-05-08 08:57:39,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:57:39,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:57:46,703 - lava_callback - INFO - Received callback for node 69fb027a5ce316b79a714680 INFO: 172.21.0.1:48222 - "POST /node/69fb027a5ce316b79a714680 HTTP/1.0" 202 Accepted 2026-05-08 08:57:46,708 - lava_callback - INFO - Starting async job submit for node 69fb027a5ce316b79a714680 2026-05-08 08:57:46,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:57:46,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb027a5ce316b79a714680 HTTP/1.1" 200 None 2026-05-08 08:57:46,723 - lava_callback - DEBUG - Processing node 69fb027a5ce316b79a714680: baseline-arm-baylibre 2026-05-08 08:57:46,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb027a5ce316b79a714680 2026-05-08 08:57:46,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:57:46,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb027a5ce316b79a714680 HTTP/1.1" 200 None 2026-05-08 08:57:46,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:57:46,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-08 08:57:46,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:57:46,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb027a5ce316b79a714680 HTTP/1.1" 200 None 2026-05-08 08:57:46,770 - lava_callback - ERROR - Error processing callback for node 69fb027a5ce316b79a714680: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48232 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:56334 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:58:04,456 - lava_callback - INFO - Received callback for node 69fda292e98225c4a2046dad INFO: 172.21.0.1:47924 - "POST /node/69fda292e98225c4a2046dad HTTP/1.0" 202 Accepted 2026-05-08 08:58:04,463 - lava_callback - INFO - Starting async job submit for node 69fda292e98225c4a2046dad 2026-05-08 08:58:04,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:58:04,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda292e98225c4a2046dad HTTP/1.1" 200 None 2026-05-08 08:58:04,507 - lava_callback - DEBUG - Processing node 69fda292e98225c4a2046dad: baseline-nfs-arm64 2026-05-08 08:58:04,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:58:05,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:58:05,062 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda292e98225c4a2046dad/log.txt.gz 2026-05-08 08:58:05,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:58:05,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:58:05,652 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda292e98225c4a2046dad/lava-logs.yaml 2026-05-08 08:58:05,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 08:58:05,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 08:58:05,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda292e98225c4a2046dad/lava_callback.json.gz 2026-05-08 08:58:05,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:58:05,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda292e98225c4a2046dad HTTP/1.1" 200 None 2026-05-08 08:58:05,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:58:05,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 08:58:05,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:58:05,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda292e98225c4a2046dad HTTP/1.1" 200 None 2026-05-08 08:58:05,854 - lava_callback - INFO - Completed processing callback for node 69fda292e98225c4a2046dad INFO: 172.21.0.1:47936 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:58:09,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:58:10,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK 2026-05-08 08:59:36,854 - lava_callback - INFO - Received callback for node 69fb02e85ce316b79a7146b1 INFO: 172.21.0.1:51268 - "POST /node/69fb02e85ce316b79a7146b1 HTTP/1.0" 202 Accepted 2026-05-08 08:59:36,860 - lava_callback - INFO - Starting async job submit for node 69fb02e85ce316b79a7146b1 2026-05-08 08:59:36,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:59:36,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb02e85ce316b79a7146b1 HTTP/1.1" 200 None 2026-05-08 08:59:36,874 - lava_callback - DEBUG - Processing node 69fb02e85ce316b79a7146b1: baseline-arm-clabbe 2026-05-08 08:59:36,874 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb02e85ce316b79a7146b1 2026-05-08 08:59:36,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:59:36,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb02e85ce316b79a7146b1 HTTP/1.1" 200 None 2026-05-08 08:59:36,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:59:36,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-08 08:59:36,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 08:59:36,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb02e85ce316b79a7146b1 HTTP/1.1" 200 None 2026-05-08 08:59:36,935 - lava_callback - ERROR - Error processing callback for node 69fb02e85ce316b79a7146b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55218 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:00:56,853 - lava_callback - INFO - Received callback for node 69fb03355ce316b79a7146d7 INFO: 172.21.0.1:55234 - "POST /node/69fb03355ce316b79a7146d7 HTTP/1.0" 202 Accepted 2026-05-08 09:00:56,859 - lava_callback - INFO - Starting async job submit for node 69fb03355ce316b79a7146d7 2026-05-08 09:00:56,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:00:56,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb03355ce316b79a7146d7 HTTP/1.1" 200 None 2026-05-08 09:00:56,876 - lava_callback - DEBUG - Processing node 69fb03355ce316b79a7146d7: baseline-arm-clabbe 2026-05-08 09:00:56,876 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb03355ce316b79a7146d7 2026-05-08 09:00:56,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:00:56,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb03355ce316b79a7146d7 HTTP/1.1" 200 None 2026-05-08 09:00:56,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:00:56,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-08 09:00:56,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:00:56,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb03355ce316b79a7146d7 HTTP/1.1" 200 None 2026-05-08 09:00:56,937 - lava_callback - ERROR - Error processing callback for node 69fb03355ce316b79a7146d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41838 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:01:56,946 - lava_callback - INFO - Received callback for node 69fb037f5ce316b79a7146ef INFO: 172.21.0.1:41846 - "POST /node/69fb037f5ce316b79a7146ef HTTP/1.0" 202 Accepted 2026-05-08 09:01:56,954 - lava_callback - INFO - Starting async job submit for node 69fb037f5ce316b79a7146ef 2026-05-08 09:01:56,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:01:56,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb037f5ce316b79a7146ef HTTP/1.1" 200 None 2026-05-08 09:01:56,989 - lava_callback - DEBUG - Processing node 69fb037f5ce316b79a7146ef: baseline-arm-clabbe 2026-05-08 09:01:56,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb037f5ce316b79a7146ef 2026-05-08 09:01:56,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:01:57,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb037f5ce316b79a7146ef HTTP/1.1" 200 None 2026-05-08 09:01:57,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:01:57,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-08 09:01:57,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:01:57,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb037f5ce316b79a7146ef HTTP/1.1" 200 None 2026-05-08 09:01:57,052 - lava_callback - ERROR - Error processing callback for node 69fb037f5ce316b79a7146ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34624 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:03:07,062 - lava_callback - INFO - Received callback for node 69fb03c45ce316b79a714708 INFO: 172.21.0.1:34626 - "POST /node/69fb03c45ce316b79a714708 HTTP/1.0" 202 Accepted 2026-05-08 09:03:07,069 - lava_callback - INFO - Starting async job submit for node 69fb03c45ce316b79a714708 2026-05-08 09:03:07,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:03:07,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb03c45ce316b79a714708 HTTP/1.1" 200 None 2026-05-08 09:03:07,084 - lava_callback - DEBUG - Processing node 69fb03c45ce316b79a714708: baseline-arm-baylibre 2026-05-08 09:03:07,084 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb03c45ce316b79a714708 2026-05-08 09:03:07,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:03:07,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb03c45ce316b79a714708 HTTP/1.1" 200 None 2026-05-08 09:03:07,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:03:07,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-08 09:03:07,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:03:07,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb03c45ce316b79a714708 HTTP/1.1" 200 None 2026-05-08 09:03:07,129 - lava_callback - ERROR - Error processing callback for node 69fb03c45ce316b79a714708: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37556 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:03:56,993 - lava_callback - INFO - Received callback for node 69fb03ef5ce316b79a714715 INFO: 172.21.0.1:37558 - "POST /node/69fb03ef5ce316b79a714715 HTTP/1.0" 202 Accepted 2026-05-08 09:03:56,999 - lava_callback - INFO - Starting async job submit for node 69fb03ef5ce316b79a714715 2026-05-08 09:03:57,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:03:57,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb03ef5ce316b79a714715 HTTP/1.1" 200 None 2026-05-08 09:03:57,018 - lava_callback - DEBUG - Processing node 69fb03ef5ce316b79a714715: baseline-arm-clabbe 2026-05-08 09:03:57,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb03ef5ce316b79a714715 2026-05-08 09:03:57,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:03:57,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb03ef5ce316b79a714715 HTTP/1.1" 200 None 2026-05-08 09:03:57,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:03:57,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-08 09:03:57,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:03:57,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb03ef5ce316b79a714715 HTTP/1.1" 200 None 2026-05-08 09:03:57,083 - lava_callback - ERROR - Error processing callback for node 69fb03ef5ce316b79a714715: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:04:37,012 - lava_callback - INFO - Received callback for node 69fb04165ce316b79a714721 INFO: 172.21.0.1:40376 - "POST /node/69fb04165ce316b79a714721 HTTP/1.0" 202 Accepted 2026-05-08 09:04:37,018 - lava_callback - INFO - Starting async job submit for node 69fb04165ce316b79a714721 2026-05-08 09:04:37,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:04:37,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04165ce316b79a714721 HTTP/1.1" 200 None 2026-05-08 09:04:37,038 - lava_callback - DEBUG - Processing node 69fb04165ce316b79a714721: baseline-arm-clabbe 2026-05-08 09:04:37,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb04165ce316b79a714721 2026-05-08 09:04:37,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:04:37,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04165ce316b79a714721 HTTP/1.1" 200 None 2026-05-08 09:04:37,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:04:37,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-08 09:04:37,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:04:37,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb04165ce316b79a714721 HTTP/1.1" 200 None 2026-05-08 09:04:37,114 - lava_callback - ERROR - Error processing callback for node 69fb04165ce316b79a714721: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:05:07,079 - lava_callback - INFO - Received callback for node 69fb043a5ce316b79a714786 INFO: 172.21.0.1:47144 - "POST /node/69fb043a5ce316b79a714786 HTTP/1.0" 202 Accepted 2026-05-08 09:05:07,085 - lava_callback - INFO - Starting async job submit for node 69fb043a5ce316b79a714786 2026-05-08 09:05:07,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:07,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb043a5ce316b79a714786 HTTP/1.1" 200 None 2026-05-08 09:05:07,110 - lava_callback - DEBUG - Processing node 69fb043a5ce316b79a714786: baseline-arm-baylibre 2026-05-08 09:05:07,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb043a5ce316b79a714786 2026-05-08 09:05:07,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:07,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb043a5ce316b79a714786 HTTP/1.1" 200 None 2026-05-08 09:05:07,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:07,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-08 09:05:07,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:07,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb043a5ce316b79a714786 HTTP/1.1" 200 None 2026-05-08 09:05:07,172 - lava_callback - ERROR - Error processing callback for node 69fb043a5ce316b79a714786: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:05:09,713 - lava_callback - INFO - Received callback for node 69fda06fe98225c4a2046b1b INFO: 172.21.0.1:54560 - "POST /node/69fda06fe98225c4a2046b1b HTTP/1.0" 202 Accepted 2026-05-08 09:05:09,725 - lava_callback - INFO - Starting async job submit for node 69fda06fe98225c4a2046b1b 2026-05-08 09:05:09,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:09,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda06fe98225c4a2046b1b HTTP/1.1" 200 None 2026-05-08 09:05:09,872 - lava_callback - DEBUG - Processing node 69fda06fe98225c4a2046b1b: ltp-smoke 2026-05-08 09:05:10,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:05:10,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:05:10,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fda06fe98225c4a2046b1b/log.txt.gz 2026-05-08 09:05:11,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:05:11,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:05:11,238 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fda06fe98225c4a2046b1b/lava-logs.yaml 2026-05-08 09:05:11,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:05:11,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:05:11,409 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fda06fe98225c4a2046b1b/lava_callback.json.gz 2026-05-08 09:05:11,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:11,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda06fe98225c4a2046b1b HTTP/1.1" 200 None 2026-05-08 09:05:11,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:11,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c90e98225c4a20469a4 HTTP/1.1" 200 None 2026-05-08 09:05:11,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:11,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda06fe98225c4a2046b1b HTTP/1.1" 200 None 2026-05-08 09:05:11,775 - lava_callback - INFO - Completed processing callback for node 69fda06fe98225c4a2046b1b INFO: 172.21.0.1:54570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:05:27,122 - lava_callback - INFO - Received callback for node 69fb04465ce316b79a7147d6 INFO: 172.21.0.1:56338 - "POST /node/69fb04465ce316b79a7147d6 HTTP/1.0" 202 Accepted 2026-05-08 09:05:27,127 - lava_callback - INFO - Starting async job submit for node 69fb04465ce316b79a7147d6 2026-05-08 09:05:27,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:27,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04465ce316b79a7147d6 HTTP/1.1" 200 None 2026-05-08 09:05:27,143 - lava_callback - DEBUG - Processing node 69fb04465ce316b79a7147d6: baseline-arm64-baylibre 2026-05-08 09:05:27,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb04465ce316b79a7147d6 2026-05-08 09:05:27,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:27,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04465ce316b79a7147d6 HTTP/1.1" 200 None 2026-05-08 09:05:27,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:27,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 09:05:27,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:27,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb04465ce316b79a7147d6 HTTP/1.1" 200 None 2026-05-08 09:05:27,191 - lava_callback - ERROR - Error processing callback for node 69fb04465ce316b79a7147d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:05:27,832 - lava_callback - INFO - Received callback for node 69fb04475ce316b79a7147d9 INFO: 172.21.0.1:56340 - "POST /node/69fb04475ce316b79a7147d9 HTTP/1.0" 202 Accepted 2026-05-08 09:05:27,840 - lava_callback - INFO - Starting async job submit for node 69fb04475ce316b79a7147d9 2026-05-08 09:05:27,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:27,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04475ce316b79a7147d9 HTTP/1.1" 200 None 2026-05-08 09:05:27,865 - lava_callback - DEBUG - Processing node 69fb04475ce316b79a7147d9: baseline-arm64-baylibre 2026-05-08 09:05:27,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb04475ce316b79a7147d9 2026-05-08 09:05:27,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:27,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04475ce316b79a7147d9 HTTP/1.1" 200 None 2026-05-08 09:05:27,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:27,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 09:05:27,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:27,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb04475ce316b79a7147d9 HTTP/1.1" 200 None 2026-05-08 09:05:27,920 - lava_callback - ERROR - Error processing callback for node 69fb04475ce316b79a7147d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:05:28,515 - lava_callback - INFO - Received callback for node 69fb04485ce316b79a7147dc INFO: 172.21.0.1:56356 - "POST /node/69fb04485ce316b79a7147dc HTTP/1.0" 202 Accepted 2026-05-08 09:05:28,522 - lava_callback - INFO - Starting async job submit for node 69fb04485ce316b79a7147dc 2026-05-08 09:05:28,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:28,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04485ce316b79a7147dc HTTP/1.1" 200 None 2026-05-08 09:05:28,542 - lava_callback - DEBUG - Processing node 69fb04485ce316b79a7147dc: baseline-arm64-baylibre 2026-05-08 09:05:28,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb04485ce316b79a7147dc 2026-05-08 09:05:28,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:28,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04485ce316b79a7147dc HTTP/1.1" 200 None 2026-05-08 09:05:28,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:28,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 09:05:28,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:28,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb04485ce316b79a7147dc HTTP/1.1" 200 None 2026-05-08 09:05:28,602 - lava_callback - ERROR - Error processing callback for node 69fb04485ce316b79a7147dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:05:29,213 - lava_callback - INFO - Received callback for node 69fb044b5ce316b79a7147e3 INFO: 172.21.0.1:56370 - "POST /node/69fb044b5ce316b79a7147e3 HTTP/1.0" 202 Accepted 2026-05-08 09:05:29,219 - lava_callback - INFO - Starting async job submit for node 69fb044b5ce316b79a7147e3 2026-05-08 09:05:29,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:29,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb044b5ce316b79a7147e3 HTTP/1.1" 200 None 2026-05-08 09:05:29,234 - lava_callback - DEBUG - Processing node 69fb044b5ce316b79a7147e3: baseline-arm64-baylibre 2026-05-08 09:05:29,235 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb044b5ce316b79a7147e3 2026-05-08 09:05:29,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:29,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb044b5ce316b79a7147e3 HTTP/1.1" 200 None 2026-05-08 09:05:29,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:29,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 09:05:29,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:29,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb044b5ce316b79a7147e3 HTTP/1.1" 200 None 2026-05-08 09:05:29,282 - lava_callback - ERROR - Error processing callback for node 69fb044b5ce316b79a7147e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:05:29,894 - lava_callback - INFO - Received callback for node 69fb044d5ce316b79a7147e6 INFO: 172.21.0.1:59620 - "POST /node/69fb044d5ce316b79a7147e6 HTTP/1.0" 202 Accepted 2026-05-08 09:05:29,900 - lava_callback - INFO - Starting async job submit for node 69fb044d5ce316b79a7147e6 2026-05-08 09:05:29,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:29,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb044d5ce316b79a7147e6 HTTP/1.1" 200 None 2026-05-08 09:05:29,914 - lava_callback - DEBUG - Processing node 69fb044d5ce316b79a7147e6: baseline-arm64-baylibre 2026-05-08 09:05:29,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb044d5ce316b79a7147e6 2026-05-08 09:05:29,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:29,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb044d5ce316b79a7147e6 HTTP/1.1" 200 None 2026-05-08 09:05:29,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:29,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 09:05:29,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:29,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb044d5ce316b79a7147e6 HTTP/1.1" 200 None 2026-05-08 09:05:29,970 - lava_callback - ERROR - Error processing callback for node 69fb044d5ce316b79a7147e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:05:37,026 - lava_callback - INFO - Received callback for node 69fb045c5ce316b79a71480c INFO: 172.21.0.1:59640 - "POST /node/69fb045c5ce316b79a71480c HTTP/1.0" 202 Accepted 2026-05-08 09:05:37,031 - lava_callback - INFO - Starting async job submit for node 69fb045c5ce316b79a71480c 2026-05-08 09:05:37,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:37,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb045c5ce316b79a71480c HTTP/1.1" 200 None 2026-05-08 09:05:37,050 - lava_callback - DEBUG - Processing node 69fb045c5ce316b79a71480c: baseline-arm64-clabbe 2026-05-08 09:05:37,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb045c5ce316b79a71480c 2026-05-08 09:05:37,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:37,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb045c5ce316b79a71480c HTTP/1.1" 200 None 2026-05-08 09:05:37,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:37,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 09:05:37,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:37,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb045c5ce316b79a71480c HTTP/1.1" 200 None 2026-05-08 09:05:37,107 - lava_callback - ERROR - Error processing callback for node 69fb045c5ce316b79a71480c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:05:37,699 - lava_callback - INFO - Received callback for node 69fb045e5ce316b79a714812 INFO: 172.21.0.1:59650 - "POST /node/69fb045e5ce316b79a714812 HTTP/1.0" 202 Accepted 2026-05-08 09:05:37,705 - lava_callback - INFO - Starting async job submit for node 69fb045e5ce316b79a714812 2026-05-08 09:05:37,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:37,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb045e5ce316b79a714812 HTTP/1.1" 200 None 2026-05-08 09:05:37,725 - lava_callback - DEBUG - Processing node 69fb045e5ce316b79a714812: baseline-arm64-clabbe 2026-05-08 09:05:37,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb045e5ce316b79a714812 2026-05-08 09:05:37,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:37,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb045e5ce316b79a714812 HTTP/1.1" 200 None 2026-05-08 09:05:37,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:37,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 09:05:37,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:37,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb045e5ce316b79a714812 HTTP/1.1" 200 None 2026-05-08 09:05:37,789 - lava_callback - ERROR - Error processing callback for node 69fb045e5ce316b79a714812: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:05:38,355 - lava_callback - INFO - Received callback for node 69fb045f5ce316b79a714815 INFO: 172.21.0.1:59660 - "POST /node/69fb045f5ce316b79a714815 HTTP/1.0" 202 Accepted 2026-05-08 09:05:38,363 - lava_callback - INFO - Starting async job submit for node 69fb045f5ce316b79a714815 2026-05-08 09:05:38,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:38,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb045f5ce316b79a714815 HTTP/1.1" 200 None 2026-05-08 09:05:38,378 - lava_callback - DEBUG - Processing node 69fb045f5ce316b79a714815: baseline-arm64-clabbe 2026-05-08 09:05:38,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb045f5ce316b79a714815 2026-05-08 09:05:38,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:38,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb045f5ce316b79a714815 HTTP/1.1" 200 None 2026-05-08 09:05:38,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:38,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 09:05:38,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:38,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb045f5ce316b79a714815 HTTP/1.1" 200 None 2026-05-08 09:05:38,431 - lava_callback - ERROR - Error processing callback for node 69fb045f5ce316b79a714815: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:05:38,915 - lava_callback - INFO - Received callback for node 69fda291e98225c4a2046daa INFO: 172.21.0.1:59664 - "POST /node/69fda291e98225c4a2046daa HTTP/1.0" 202 Accepted 2026-05-08 09:05:38,923 - lava_callback - INFO - Starting async job submit for node 69fda291e98225c4a2046daa 2026-05-08 09:05:38,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:38,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda291e98225c4a2046daa HTTP/1.1" 200 None 2026-05-08 09:05:38,992 - lava_callback - DEBUG - Processing node 69fda291e98225c4a2046daa: baseline-nfs-arm64 2026-05-08 09:05:40,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:40,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:05:40,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 09:05:40,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:05:40,181 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda291e98225c4a2046daa/log.txt.gz 2026-05-08 09:05:40,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:05:41,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:05:41,118 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda291e98225c4a2046daa/lava-logs.yaml 2026-05-08 09:05:41,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:05:41,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:05:41,314 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda291e98225c4a2046daa/lava_callback.json.gz DEBUG: Setup failed for 69fda291e98225c4a2046daa. Transitting job node result: incomplete -> fail 2026-05-08 09:05:41,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:41,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda291e98225c4a2046daa HTTP/1.1" 200 None 2026-05-08 09:05:41,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:41,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:05:41,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:41,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda291e98225c4a2046daa HTTP/1.1" 200 None 2026-05-08 09:05:41,571 - lava_callback - INFO - Completed processing callback for node 69fda291e98225c4a2046daa INFO: 172.21.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37358 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:05:47,107 - lava_callback - INFO - Received callback for node 69fb04625ce316b79a714843 INFO: 172.21.0.1:37370 - "POST /node/69fb04625ce316b79a714843 HTTP/1.0" 202 Accepted 2026-05-08 09:05:47,112 - lava_callback - INFO - Starting async job submit for node 69fb04625ce316b79a714843 2026-05-08 09:05:47,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:47,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04625ce316b79a714843 HTTP/1.1" 200 None 2026-05-08 09:05:47,127 - lava_callback - DEBUG - Processing node 69fb04625ce316b79a714843: baseline-arm-baylibre 2026-05-08 09:05:47,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb04625ce316b79a714843 2026-05-08 09:05:47,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:47,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04625ce316b79a714843 HTTP/1.1" 200 None 2026-05-08 09:05:47,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:47,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-08 09:05:47,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:47,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb04625ce316b79a714843 HTTP/1.1" 200 None 2026-05-08 09:05:47,174 - lava_callback - ERROR - Error processing callback for node 69fb04625ce316b79a714843: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:05:57,049 - lava_callback - INFO - Received callback for node 69fb04605ce316b79a714838 INFO: 172.21.0.1:53392 - "POST /node/69fb04605ce316b79a714838 HTTP/1.0" 202 Accepted 2026-05-08 09:05:57,054 - lava_callback - INFO - Starting async job submit for node 69fb04605ce316b79a714838 2026-05-08 09:05:57,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:57,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04605ce316b79a714838 HTTP/1.1" 200 None 2026-05-08 09:05:57,070 - lava_callback - DEBUG - Processing node 69fb04605ce316b79a714838: baseline-arm64-clabbe 2026-05-08 09:05:57,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb04605ce316b79a714838 2026-05-08 09:05:57,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:57,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04605ce316b79a714838 HTTP/1.1" 200 None 2026-05-08 09:05:57,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:57,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 09:05:57,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:57,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb04605ce316b79a714838 HTTP/1.1" 200 None 2026-05-08 09:05:57,189 - lava_callback - ERROR - Error processing callback for node 69fb04605ce316b79a714838: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:05:57,726 - lava_callback - INFO - Received callback for node 69fb04625ce316b79a714841 INFO: 172.21.0.1:53400 - "POST /node/69fb04625ce316b79a714841 HTTP/1.0" 202 Accepted 2026-05-08 09:05:57,735 - lava_callback - INFO - Starting async job submit for node 69fb04625ce316b79a714841 2026-05-08 09:05:57,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:57,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04625ce316b79a714841 HTTP/1.1" 200 None 2026-05-08 09:05:57,769 - lava_callback - DEBUG - Processing node 69fb04625ce316b79a714841: baseline-arm64-clabbe 2026-05-08 09:05:57,769 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb04625ce316b79a714841 2026-05-08 09:05:57,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:57,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04625ce316b79a714841 HTTP/1.1" 200 None 2026-05-08 09:05:57,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:57,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 09:05:57,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:57,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb04625ce316b79a714841 HTTP/1.1" 200 None 2026-05-08 09:05:57,836 - lava_callback - ERROR - Error processing callback for node 69fb04625ce316b79a714841: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:05:58,404 - lava_callback - INFO - Received callback for node 69fb04615ce316b79a71483e INFO: 172.21.0.1:53414 - "POST /node/69fb04615ce316b79a71483e HTTP/1.0" 202 Accepted 2026-05-08 09:05:58,410 - lava_callback - INFO - Starting async job submit for node 69fb04615ce316b79a71483e 2026-05-08 09:05:58,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:58,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04615ce316b79a71483e HTTP/1.1" 200 None 2026-05-08 09:05:58,427 - lava_callback - DEBUG - Processing node 69fb04615ce316b79a71483e: baseline-arm64-clabbe 2026-05-08 09:05:58,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb04615ce316b79a71483e 2026-05-08 09:05:58,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:58,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04615ce316b79a71483e HTTP/1.1" 200 None 2026-05-08 09:05:58,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:58,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69faf98f5ce316b79a713c71 HTTP/1.1" 200 None 2026-05-08 09:05:58,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:05:58,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb04615ce316b79a71483e HTTP/1.1" 200 None 2026-05-08 09:05:58,483 - lava_callback - ERROR - Error processing callback for node 69fb04615ce316b79a71483e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:06:09,815 - lava_callback - INFO - Received callback for node 69fda287e98225c4a2046d79 INFO: 172.21.0.1:45910 - "POST /node/69fda287e98225c4a2046d79 HTTP/1.0" 202 Accepted 2026-05-08 09:06:09,825 - lava_callback - INFO - Starting async job submit for node 69fda287e98225c4a2046d79 2026-05-08 09:06:09,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:06:09,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda287e98225c4a2046d79 HTTP/1.1" 200 None 2026-05-08 09:06:09,883 - lava_callback - DEBUG - Processing node 69fda287e98225c4a2046d79: baseline-arm64 2026-05-08 09:06:10,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:06:10,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 09:06:10,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:06:10,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:06:10,613 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda287e98225c4a2046d79/log.txt.gz 2026-05-08 09:06:10,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:06:11,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:06:11,045 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda287e98225c4a2046d79/lava-logs.yaml 2026-05-08 09:06:11,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:06:11,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:06:11,168 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda287e98225c4a2046d79/lava_callback.json.gz 2026-05-08 09:06:11,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:06:11,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda287e98225c4a2046d79 HTTP/1.1" 200 None 2026-05-08 09:06:11,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:06:11,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:06:11,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:06:11,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda287e98225c4a2046d79 HTTP/1.1" 200 None 2026-05-08 09:06:11,286 - lava_callback - INFO - Completed processing callback for node 69fda287e98225c4a2046d79 INFO: 172.21.0.1:45920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59830 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:06:40,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:06:40,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50754 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:06:55,705 - lava_callback - INFO - Received callback for node 69fda7a4e98225c4a2047767 INFO: 172.21.0.1:38874 - "POST /node/69fda7a4e98225c4a2047767 HTTP/1.0" 202 Accepted 2026-05-08 09:06:55,711 - lava_callback - INFO - Starting async job submit for node 69fda7a4e98225c4a2047767 2026-05-08 09:06:55,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:06:55,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda7a4e98225c4a2047767 HTTP/1.1" 200 None 2026-05-08 09:06:55,729 - lava_callback - DEBUG - Processing node 69fda7a4e98225c4a2047767: baseline-nfs-arm64 2026-05-08 09:06:55,730 - lava_callback - WARNING - Failed to upload log 2026-05-08 09:06:55,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:06:55,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:06:55,807 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda7a4e98225c4a2047767/lava-logs.yaml 2026-05-08 09:06:55,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:06:55,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:06:55,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda7a4e98225c4a2047767/lava_callback.json.gz 2026-05-08 09:06:55,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:06:55,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda7a4e98225c4a2047767 HTTP/1.1" 200 None 2026-05-08 09:06:55,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:06:55,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:06:55,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:06:55,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda7a4e98225c4a2047767 HTTP/1.1" 200 None 2026-05-08 09:06:55,937 - lava_callback - INFO - Completed processing callback for node 69fda7a4e98225c4a2047767 INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:07:10,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:07:10,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:08:03,781 - lava_callback - INFO - Received callback for node 69fda296e98225c4a2046dbd INFO: 172.21.0.1:54734 - "POST /node/69fda296e98225c4a2046dbd HTTP/1.0" 202 Accepted 2026-05-08 09:08:03,788 - lava_callback - INFO - Starting async job submit for node 69fda296e98225c4a2046dbd 2026-05-08 09:08:03,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:03,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda296e98225c4a2046dbd HTTP/1.1" 200 None 2026-05-08 09:08:03,829 - lava_callback - DEBUG - Processing node 69fda296e98225c4a2046dbd: baseline-nfs-arm64 2026-05-08 09:08:04,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:08:04,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:08:04,599 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda296e98225c4a2046dbd/log.txt.gz 2026-05-08 09:08:04,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:08:05,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:08:05,074 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda296e98225c4a2046dbd/lava-logs.yaml 2026-05-08 09:08:05,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:08:05,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:08:05,216 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda296e98225c4a2046dbd/lava_callback.json.gz 2026-05-08 09:08:05,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:05,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda296e98225c4a2046dbd HTTP/1.1" 200 None 2026-05-08 09:08:05,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:05,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:08:05,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:05,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda296e98225c4a2046dbd HTTP/1.1" 200 None 2026-05-08 09:08:05,354 - lava_callback - INFO - Completed processing callback for node 69fda296e98225c4a2046dbd INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:08:10,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:10,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 09:08:10,372 - lava_callback - INFO - Received callback for node 69fda07de98225c4a2046b44 INFO: 172.21.0.1:53748 - "POST /node/69fda07de98225c4a2046b44 HTTP/1.0" 202 Accepted 2026-05-08 09:08:10,378 - lava_callback - INFO - Starting async job submit for node 69fda07de98225c4a2046b44 2026-05-08 09:08:10,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:10,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda07de98225c4a2046b44 HTTP/1.1" 200 None 2026-05-08 09:08:10,415 - lava_callback - DEBUG - Processing node 69fda07de98225c4a2046b44: baseline-arm-broonie 2026-05-08 09:08:10,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:08:10,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:08:10,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fda07de98225c4a2046b44/log.txt.gz 2026-05-08 09:08:10,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:08:10,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:08:10,984 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fda07de98225c4a2046b44/lava-logs.yaml 2026-05-08 09:08:10,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:08:11,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:08:11,080 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fda07de98225c4a2046b44/lava_callback.json.gz 2026-05-08 09:08:11,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:11,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda07de98225c4a2046b44 HTTP/1.1" 200 None 2026-05-08 09:08:11,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:11,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:08:11,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:11,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda07de98225c4a2046b44 HTTP/1.1" 200 None 2026-05-08 09:08:11,152 - lava_callback - INFO - Completed processing callback for node 69fda07de98225c4a2046b44 INFO: 172.21.0.1:53756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53762 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:08:17,208 - lava_callback - INFO - Received callback for node 69fb04ef5ce316b79a714940 INFO: 172.21.0.1:53768 - "POST /node/69fb04ef5ce316b79a714940 HTTP/1.0" 202 Accepted 2026-05-08 09:08:17,214 - lava_callback - INFO - Starting async job submit for node 69fb04ef5ce316b79a714940 2026-05-08 09:08:17,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:17,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04ef5ce316b79a714940 HTTP/1.1" 200 None 2026-05-08 09:08:17,232 - lava_callback - DEBUG - Processing node 69fb04ef5ce316b79a714940: baseline-arm-clabbe 2026-05-08 09:08:17,233 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb04ef5ce316b79a714940 2026-05-08 09:08:17,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:17,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb04ef5ce316b79a714940 HTTP/1.1" 200 None 2026-05-08 09:08:17,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:17,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-08 09:08:17,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:17,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb04ef5ce316b79a714940 HTTP/1.1" 200 None 2026-05-08 09:08:17,288 - lava_callback - ERROR - Error processing callback for node 69fb04ef5ce316b79a714940: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:08:40,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:08:40,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49420 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:09:14,468 - lava_callback - INFO - Received callback for node 69fda7f0e98225c4a2047789 INFO: 172.21.0.1:42294 - "POST /node/69fda7f0e98225c4a2047789 HTTP/1.0" 202 Accepted 2026-05-08 09:09:14,475 - lava_callback - INFO - Starting async job submit for node 69fda7f0e98225c4a2047789 2026-05-08 09:09:14,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:09:14,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda7f0e98225c4a2047789 HTTP/1.1" 200 None 2026-05-08 09:09:14,518 - lava_callback - DEBUG - Processing node 69fda7f0e98225c4a2047789: baseline-arm64 2026-05-08 09:09:14,654 - lava_callback - WARNING - Failed to upload log 2026-05-08 09:09:14,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:09:14,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:09:14,869 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda7f0e98225c4a2047789/lava-logs.yaml 2026-05-08 09:09:14,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:09:15,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:09:15,132 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda7f0e98225c4a2047789/lava_callback.json.gz 2026-05-08 09:09:15,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:42298 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 09:09:15,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda7f0e98225c4a2047789 HTTP/1.1" 200 None 2026-05-08 09:09:15,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:09:15,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:09:15,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:09:15,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda7f0e98225c4a2047789 HTTP/1.1" 200 None 2026-05-08 09:09:15,263 - lava_callback - INFO - Completed processing callback for node 69fda7f0e98225c4a2047789 INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59506 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:09:40,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:09:40,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55986 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:09:47,854 - lava_callback - INFO - Received callback for node 69fda2b5e98225c4a2046e25 INFO: 172.21.0.1:56000 - "POST /node/69fda2b5e98225c4a2046e25 HTTP/1.0" 202 Accepted 2026-05-08 09:09:47,860 - lava_callback - INFO - Starting async job submit for node 69fda2b5e98225c4a2046e25 2026-05-08 09:09:47,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:09:47,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2b5e98225c4a2046e25 HTTP/1.1" 200 None 2026-05-08 09:09:47,897 - lava_callback - DEBUG - Processing node 69fda2b5e98225c4a2046e25: baseline-arm64-broonie 2026-05-08 09:09:48,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:09:48,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:09:48,335 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2b5e98225c4a2046e25/log.txt.gz 2026-05-08 09:09:48,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:09:48,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:09:48,815 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2b5e98225c4a2046e25/lava-logs.yaml 2026-05-08 09:09:48,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:09:48,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:09:48,919 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2b5e98225c4a2046e25/lava_callback.json.gz 2026-05-08 09:09:48,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:09:48,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2b5e98225c4a2046e25 HTTP/1.1" 200 None 2026-05-08 09:09:48,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:09:48,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:09:48,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:09:48,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2b5e98225c4a2046e25 HTTP/1.1" 200 None 2026-05-08 09:09:49,000 - lava_callback - INFO - Completed processing callback for node 69fda2b5e98225c4a2046e25 INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57630 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:10:07,387 - lava_callback - INFO - Received callback for node 69fb055d5ce316b79a714996 INFO: 172.21.0.1:57640 - "POST /node/69fb055d5ce316b79a714996 HTTP/1.0" 202 Accepted 2026-05-08 09:10:07,393 - lava_callback - INFO - Starting async job submit for node 69fb055d5ce316b79a714996 2026-05-08 09:10:07,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:07,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb055d5ce316b79a714996 HTTP/1.1" 200 None 2026-05-08 09:10:07,407 - lava_callback - DEBUG - Processing node 69fb055d5ce316b79a714996: baseline-arm-baylibre 2026-05-08 09:10:07,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb055d5ce316b79a714996 2026-05-08 09:10:07,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:07,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb055d5ce316b79a714996 HTTP/1.1" 200 None 2026-05-08 09:10:07,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:07,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-08 09:10:07,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:07,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb055d5ce316b79a714996 HTTP/1.1" 200 None 2026-05-08 09:10:07,483 - lava_callback - ERROR - Error processing callback for node 69fb055d5ce316b79a714996: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:10:10,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:10,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 09:10:10,892 - lava_callback - INFO - Received callback for node 69fda0a9e98225c4a2046bce INFO: 172.21.0.1:58090 - "POST /node/69fda0a9e98225c4a2046bce HTTP/1.0" 202 Accepted 2026-05-08 09:10:10,899 - lava_callback - INFO - Starting async job submit for node 69fda0a9e98225c4a2046bce 2026-05-08 09:10:10,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:10,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0a9e98225c4a2046bce HTTP/1.1" 200 None 2026-05-08 09:10:10,946 - lava_callback - DEBUG - Processing node 69fda0a9e98225c4a2046bce: ltp-cap_bounds 2026-05-08 09:10:11,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:10:11,367 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:10:11,368 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fda0a9e98225c4a2046bce/log.txt.gz 2026-05-08 09:10:11,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:10:11,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:10:11,712 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fda0a9e98225c4a2046bce/lava-logs.yaml 2026-05-08 09:10:11,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:10:11,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:10:11,849 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fda0a9e98225c4a2046bce/lava_callback.json.gz 2026-05-08 09:10:11,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:11,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0a9e98225c4a2046bce HTTP/1.1" 200 None 2026-05-08 09:10:11,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:11,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:10:11,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:11,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0a9e98225c4a2046bce HTTP/1.1" 200 None 2026-05-08 09:10:11,923 - lava_callback - INFO - Completed processing callback for node 69fda0a9e98225c4a2046bce INFO: 172.21.0.1:58106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58134 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:10:27,579 - lava_callback - INFO - Received callback for node 69fda0aae98225c4a2046bde INFO: 172.21.0.1:58138 - "POST /node/69fda0aae98225c4a2046bde HTTP/1.0" 202 Accepted 2026-05-08 09:10:27,586 - lava_callback - INFO - Starting async job submit for node 69fda0aae98225c4a2046bde 2026-05-08 09:10:27,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:27,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0aae98225c4a2046bde HTTP/1.1" 200 None 2026-05-08 09:10:27,625 - lava_callback - DEBUG - Processing node 69fda0aae98225c4a2046bde: ltp-containers 2026-05-08 09:10:28,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:10:28,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:10:28,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69fda0aae98225c4a2046bde/log.txt.gz 2026-05-08 09:10:28,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:10:28,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:10:28,515 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69fda0aae98225c4a2046bde/lava-logs.yaml 2026-05-08 09:10:28,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:10:28,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:10:28,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69fda0aae98225c4a2046bde/lava_callback.json.gz 2026-05-08 09:10:28,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:28,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0aae98225c4a2046bde HTTP/1.1" 200 None 2026-05-08 09:10:28,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:28,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:10:28,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:28,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0aae98225c4a2046bde HTTP/1.1" 200 None 2026-05-08 09:10:28,896 - lava_callback - INFO - Completed processing callback for node 69fda0aae98225c4a2046bde INFO: 172.21.0.1:50608 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:10:37,334 - lava_callback - INFO - Received callback for node 69fb05855ce316b79a7149a4 INFO: 172.21.0.1:50622 - "POST /node/69fb05855ce316b79a7149a4 HTTP/1.0" 202 Accepted 2026-05-08 09:10:37,341 - lava_callback - INFO - Starting async job submit for node 69fb05855ce316b79a7149a4 2026-05-08 09:10:37,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:37,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb05855ce316b79a7149a4 HTTP/1.1" 200 None 2026-05-08 09:10:37,359 - lava_callback - DEBUG - Processing node 69fb05855ce316b79a7149a4: baseline-arm-clabbe 2026-05-08 09:10:37,360 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb05855ce316b79a7149a4 2026-05-08 09:10:37,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:37,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb05855ce316b79a7149a4 HTTP/1.1" 200 None 2026-05-08 09:10:37,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:37,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-08 09:10:37,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:37,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb05855ce316b79a7149a4 HTTP/1.1" 200 None 2026-05-08 09:10:37,415 - lava_callback - ERROR - Error processing callback for node 69fb05855ce316b79a7149a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:10:40,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:40,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33422 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:10:50,628 - lava_callback - INFO - Received callback for node 69fda0ade98225c4a2046be3 INFO: 172.21.0.1:37970 - "POST /node/69fda0ade98225c4a2046be3 HTTP/1.0" 202 Accepted 2026-05-08 09:10:50,634 - lava_callback - INFO - Starting async job submit for node 69fda0ade98225c4a2046be3 2026-05-08 09:10:50,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:50,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0ade98225c4a2046be3 HTTP/1.1" 200 None 2026-05-08 09:10:50,682 - lava_callback - DEBUG - Processing node 69fda0ade98225c4a2046be3: ltp-controllers 2026-05-08 09:10:51,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:10:51,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:10:51,221 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69fda0ade98225c4a2046be3/log.txt.gz 2026-05-08 09:10:51,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:10:51,573 - lava_callback - INFO - Received callback for node 69fda896e98225c4a20477e9 INFO: 172.21.0.1:37976 - "POST /node/69fda896e98225c4a20477e9 HTTP/1.0" 202 Accepted 2026-05-08 09:10:51,579 - lava_callback - INFO - Starting async job submit for node 69fda896e98225c4a20477e9 2026-05-08 09:10:51,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:51,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda896e98225c4a20477e9 HTTP/1.1" 200 None 2026-05-08 09:10:51,595 - lava_callback - DEBUG - Processing node 69fda896e98225c4a20477e9: baseline-arm 2026-05-08 09:10:51,600 - lava_callback - WARNING - Failed to upload log 2026-05-08 09:10:51,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:10:51,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:10:51,732 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fda896e98225c4a20477e9/lava-logs.yaml 2026-05-08 09:10:51,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:10:51,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:10:51,817 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fda896e98225c4a20477e9/lava_callback.json.gz 2026-05-08 09:10:51,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:51,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda896e98225c4a20477e9 HTTP/1.1" 200 None 2026-05-08 09:10:51,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:51,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:10:51,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:51,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:10:51,863 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69fda0ade98225c4a2046be3/lava-logs.yaml 2026-05-08 09:10:51,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:10:51,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda896e98225c4a20477e9 HTTP/1.1" 200 None 2026-05-08 09:10:51,888 - lava_callback - INFO - Completed processing callback for node 69fda896e98225c4a20477e9 2026-05-08 09:10:52,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:10:52,176 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69fda0ade98225c4a2046be3/lava_callback.json.gz 2026-05-08 09:10:52,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:52,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0ade98225c4a2046be3 HTTP/1.1" 200 None 2026-05-08 09:10:52,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:52,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:10:52,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:10:52,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0ade98225c4a2046be3 HTTP/1.1" 200 None 2026-05-08 09:10:52,253 - lava_callback - INFO - Completed processing callback for node 69fda0ade98225c4a2046be3 INFO: 172.21.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47690 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:11:10,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:11:10,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35668 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:11:34,956 - lava_callback - INFO - Received callback for node 69fda845e98225c4a20477b3 INFO: 172.21.0.1:59892 - "POST /node/69fda845e98225c4a20477b3 HTTP/1.0" 202 Accepted 2026-05-08 09:11:34,963 - lava_callback - INFO - Starting async job submit for node 69fda845e98225c4a20477b3 2026-05-08 09:11:34,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:11:35,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda845e98225c4a20477b3 HTTP/1.1" 200 None 2026-05-08 09:11:35,006 - lava_callback - DEBUG - Processing node 69fda845e98225c4a20477b3: baseline-arm64 2026-05-08 09:11:35,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:11:35,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:11:35,233 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda845e98225c4a20477b3/log.txt.gz 2026-05-08 09:11:35,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:11:35,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:11:35,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda845e98225c4a20477b3/lava-logs.yaml 2026-05-08 09:11:35,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:11:35,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:11:35,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda845e98225c4a20477b3/lava_callback.json.gz 2026-05-08 09:11:35,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:11:35,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda845e98225c4a20477b3 HTTP/1.1" 200 None 2026-05-08 09:11:35,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:11:35,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:11:35,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:11:35,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda845e98225c4a20477b3 HTTP/1.1" 200 None 2026-05-08 09:11:35,674 - lava_callback - INFO - Completed processing callback for node 69fda845e98225c4a20477b3 INFO: 172.21.0.1:59894 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:11:40,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:11:40,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51286 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:11:47,686 - lava_callback - INFO - Received callback for node 69fb05d15ce316b79a7149cd INFO: 172.21.0.1:51290 - "POST /node/69fb05d15ce316b79a7149cd HTTP/1.0" 202 Accepted 2026-05-08 09:11:47,692 - lava_callback - INFO - Starting async job submit for node 69fb05d15ce316b79a7149cd 2026-05-08 09:11:47,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:11:47,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb05d15ce316b79a7149cd HTTP/1.1" 200 None 2026-05-08 09:11:47,714 - lava_callback - DEBUG - Processing node 69fb05d15ce316b79a7149cd: baseline-arm-baylibre 2026-05-08 09:11:47,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb05d15ce316b79a7149cd 2026-05-08 09:11:47,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:11:47,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb05d15ce316b79a7149cd HTTP/1.1" 200 None 2026-05-08 09:11:47,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:11:47,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-08 09:11:47,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:11:47,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb05d15ce316b79a7149cd HTTP/1.1" 200 None 2026-05-08 09:11:47,761 - lava_callback - ERROR - Error processing callback for node 69fb05d15ce316b79a7149cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:12:10,948 - lava_callback - INFO - Received callback for node 69fda0b0e98225c4a2046be8 INFO: 172.21.0.1:35422 - "POST /node/69fda0b0e98225c4a2046be8 HTTP/1.0" 202 Accepted 2026-05-08 09:12:10,955 - lava_callback - INFO - Starting async job submit for node 69fda0b0e98225c4a2046be8 2026-05-08 09:12:10,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:12:10,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0b0e98225c4a2046be8 HTTP/1.1" 200 None 2026-05-08 09:12:10,993 - lava_callback - DEBUG - Processing node 69fda0b0e98225c4a2046be8: ltp-cve 2026-05-08 09:12:11,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:12:11,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:12:11,473 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69fda0b0e98225c4a2046be8/log.txt.gz 2026-05-08 09:12:11,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:12:11,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:12:11,869 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69fda0b0e98225c4a2046be8/lava-logs.yaml 2026-05-08 09:12:11,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:12:12,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:12:12,009 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69fda0b0e98225c4a2046be8/lava_callback.json.gz 2026-05-08 09:12:12,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:12:12,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0b0e98225c4a2046be8 HTTP/1.1" 200 None 2026-05-08 09:12:12,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:12:12,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:12:12,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:12:12,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0b0e98225c4a2046be8 HTTP/1.1" 200 None 2026-05-08 09:12:12,085 - lava_callback - INFO - Completed processing callback for node 69fda0b0e98225c4a2046be8 INFO: 172.21.0.1:35436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:12:40,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:12:40,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:13:17,450 - lava_callback - INFO - Received callback for node 69fb061c5ce316b79a714a06 INFO: 172.21.0.1:48428 - "POST /node/69fb061c5ce316b79a714a06 HTTP/1.0" 202 Accepted 2026-05-08 09:13:17,455 - lava_callback - INFO - Starting async job submit for node 69fb061c5ce316b79a714a06 2026-05-08 09:13:17,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:13:17,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb061c5ce316b79a714a06 HTTP/1.1" 200 None 2026-05-08 09:13:17,483 - lava_callback - DEBUG - Processing node 69fb061c5ce316b79a714a06: baseline-arm-clabbe 2026-05-08 09:13:17,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb061c5ce316b79a714a06 2026-05-08 09:13:17,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:13:17,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb061c5ce316b79a714a06 HTTP/1.1" 200 None 2026-05-08 09:13:17,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:13:17,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-08 09:13:17,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:13:17,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb061c5ce316b79a714a06 HTTP/1.1" 200 None 2026-05-08 09:13:17,528 - lava_callback - ERROR - Error processing callback for node 69fb061c5ce316b79a714a06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46418 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:13:57,384 - lava_callback - INFO - Received callback for node 69fb06425ce316b79a714a25 INFO: 172.21.0.1:46432 - "POST /node/69fb06425ce316b79a714a25 HTTP/1.0" 202 Accepted 2026-05-08 09:13:57,390 - lava_callback - INFO - Starting async job submit for node 69fb06425ce316b79a714a25 2026-05-08 09:13:57,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:13:57,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb06425ce316b79a714a25 HTTP/1.1" 200 None 2026-05-08 09:13:57,404 - lava_callback - DEBUG - Processing node 69fb06425ce316b79a714a25: baseline-arm-clabbe 2026-05-08 09:13:57,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb06425ce316b79a714a25 2026-05-08 09:13:57,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:13:57,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb06425ce316b79a714a25 HTTP/1.1" 200 None 2026-05-08 09:13:57,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:13:57,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-08 09:13:57,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:13:57,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb06425ce316b79a714a25 HTTP/1.1" 200 None 2026-05-08 09:13:57,449 - lava_callback - ERROR - Error processing callback for node 69fb06425ce316b79a714a25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56342 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:15:47,702 - lava_callback - INFO - Received callback for node 69fb06bb5ce316b79a714a56 INFO: 172.21.0.1:56350 - "POST /node/69fb06bb5ce316b79a714a56 HTTP/1.0" 202 Accepted 2026-05-08 09:15:47,707 - lava_callback - INFO - Starting async job submit for node 69fb06bb5ce316b79a714a56 2026-05-08 09:15:47,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:15:47,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb06bb5ce316b79a714a56 HTTP/1.1" 200 None 2026-05-08 09:15:47,722 - lava_callback - DEBUG - Processing node 69fb06bb5ce316b79a714a56: baseline-arm64-baylibre 2026-05-08 09:15:47,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb06bb5ce316b79a714a56 2026-05-08 09:15:47,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:15:47,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb06bb5ce316b79a714a56 HTTP/1.1" 200 None 2026-05-08 09:15:47,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:15:47,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-08 09:15:47,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:15:47,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb06bb5ce316b79a714a56 HTTP/1.1" 200 None 2026-05-08 09:15:47,767 - lava_callback - ERROR - Error processing callback for node 69fb06bb5ce316b79a714a56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:17:47,809 - lava_callback - INFO - Received callback for node 69fb072c5ce316b79a714a96 INFO: 172.21.0.1:49930 - "POST /node/69fb072c5ce316b79a714a96 HTTP/1.0" 202 Accepted 2026-05-08 09:17:47,815 - lava_callback - INFO - Starting async job submit for node 69fb072c5ce316b79a714a96 2026-05-08 09:17:47,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:17:47,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb072c5ce316b79a714a96 HTTP/1.1" 200 None 2026-05-08 09:17:47,844 - lava_callback - DEBUG - Processing node 69fb072c5ce316b79a714a96: baseline-arm64-baylibre 2026-05-08 09:17:47,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb072c5ce316b79a714a96 2026-05-08 09:17:47,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:17:47,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb072c5ce316b79a714a96 HTTP/1.1" 200 None 2026-05-08 09:17:47,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:17:47,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-08 09:17:47,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:17:47,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb072c5ce316b79a714a96 HTTP/1.1" 200 None 2026-05-08 09:17:47,902 - lava_callback - ERROR - Error processing callback for node 69fb072c5ce316b79a714a96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:18:29,154 - lava_callback - INFO - Received callback for node 69fda0b3e98225c4a2046bee INFO: 172.21.0.1:38350 - "POST /node/69fda0b3e98225c4a2046bee HTTP/1.0" 202 Accepted 2026-05-08 09:18:29,160 - lava_callback - INFO - Starting async job submit for node 69fda0b3e98225c4a2046bee 2026-05-08 09:18:29,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:29,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0b3e98225c4a2046bee HTTP/1.1" 200 None 2026-05-08 09:18:29,199 - lava_callback - DEBUG - Processing node 69fda0b3e98225c4a2046bee: ltp-fs_bind 2026-05-08 09:18:29,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:18:29,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:18:29,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fda0b3e98225c4a2046bee/log.txt.gz 2026-05-08 09:18:29,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:18:30,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:18:30,091 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fda0b3e98225c4a2046bee/lava-logs.yaml 2026-05-08 09:18:30,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:18:30,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:18:30,252 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fda0b3e98225c4a2046bee/lava_callback.json.gz 2026-05-08 09:18:30,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:30,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0b3e98225c4a2046bee HTTP/1.1" 200 None 2026-05-08 09:18:30,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:30,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:18:30,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:30,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0b3e98225c4a2046bee HTTP/1.1" 200 None 2026-05-08 09:18:30,339 - lava_callback - INFO - Completed processing callback for node 69fda0b3e98225c4a2046bee INFO: 172.21.0.1:34664 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:18:40,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:40,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:18:47,255 - lava_callback - INFO - Received callback for node 69fda2afe98225c4a2046e16 INFO: 172.21.0.1:53548 - "POST /node/69fda2afe98225c4a2046e16 HTTP/1.0" 202 Accepted 2026-05-08 09:18:47,261 - lava_callback - INFO - Starting async job submit for node 69fda2afe98225c4a2046e16 2026-05-08 09:18:47,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:47,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2afe98225c4a2046e16 HTTP/1.1" 200 None 2026-05-08 09:18:47,299 - lava_callback - DEBUG - Processing node 69fda2afe98225c4a2046e16: baseline-arm64-broonie 2026-05-08 09:18:47,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:18:47,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:18:47,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2afe98225c4a2046e16/log.txt.gz 2026-05-08 09:18:47,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:18:48,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:18:48,038 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2afe98225c4a2046e16/lava-logs.yaml 2026-05-08 09:18:48,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:18:48,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:18:48,131 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2afe98225c4a2046e16/lava_callback.json.gz 2026-05-08 09:18:48,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:48,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2afe98225c4a2046e16 HTTP/1.1" 200 None 2026-05-08 09:18:48,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:48,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:18:48,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:48,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2afe98225c4a2046e16 HTTP/1.1" 200 None 2026-05-08 09:18:48,203 - lava_callback - INFO - Completed processing callback for node 69fda2afe98225c4a2046e16 2026-05-08 09:18:51,132 - lava_callback - INFO - Received callback for node 69fda0b7e98225c4a2046bfe INFO: 172.21.0.1:39644 - "POST /node/69fda0b7e98225c4a2046bfe HTTP/1.0" 202 Accepted 2026-05-08 09:18:51,138 - lava_callback - INFO - Starting async job submit for node 69fda0b7e98225c4a2046bfe 2026-05-08 09:18:51,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:51,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0b7e98225c4a2046bfe HTTP/1.1" 200 None 2026-05-08 09:18:51,178 - lava_callback - DEBUG - Processing node 69fda0b7e98225c4a2046bfe: ltp-input 2026-05-08 09:18:51,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:18:51,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:18:51,638 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69fda0b7e98225c4a2046bfe/log.txt.gz 2026-05-08 09:18:51,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:18:52,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:18:52,016 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69fda0b7e98225c4a2046bfe/lava-logs.yaml 2026-05-08 09:18:52,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:18:52,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:18:52,152 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69fda0b7e98225c4a2046bfe/lava_callback.json.gz 2026-05-08 09:18:52,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:52,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0b7e98225c4a2046bfe HTTP/1.1" 200 None 2026-05-08 09:18:52,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:52,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:18:52,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:52,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0b7e98225c4a2046bfe HTTP/1.1" 200 None 2026-05-08 09:18:52,228 - lava_callback - INFO - Completed processing callback for node 69fda0b7e98225c4a2046bfe 2026-05-08 09:18:52,769 - lava_callback - INFO - Received callback for node 69fda0b8e98225c4a2046c01 INFO: 172.21.0.1:39658 - "POST /node/69fda0b8e98225c4a2046c01 HTTP/1.0" 202 Accepted 2026-05-08 09:18:52,775 - lava_callback - INFO - Starting async job submit for node 69fda0b8e98225c4a2046c01 2026-05-08 09:18:52,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:52,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0b8e98225c4a2046c01 HTTP/1.1" 200 None 2026-05-08 09:18:52,815 - lava_callback - DEBUG - Processing node 69fda0b8e98225c4a2046c01: ltp-ipc 2026-05-08 09:18:53,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:18:53,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:18:53,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69fda0b8e98225c4a2046c01/log.txt.gz 2026-05-08 09:18:53,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:18:53,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:18:53,785 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69fda0b8e98225c4a2046c01/lava-logs.yaml 2026-05-08 09:18:53,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:18:53,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:18:53,903 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69fda0b8e98225c4a2046c01/lava_callback.json.gz 2026-05-08 09:18:53,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:53,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0b8e98225c4a2046c01 HTTP/1.1" 200 None 2026-05-08 09:18:53,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:53,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:18:53,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:18:53,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0b8e98225c4a2046c01 HTTP/1.1" 200 None 2026-05-08 09:18:53,979 - lava_callback - INFO - Completed processing callback for node 69fda0b8e98225c4a2046c01 INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43646 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:19:10,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:19:10,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 09:19:11,173 - lava_callback - INFO - Received callback for node 69fda0b5e98225c4a2046bfb INFO: 172.21.0.1:59156 - "POST /node/69fda0b5e98225c4a2046bfb HTTP/1.0" 202 Accepted 2026-05-08 09:19:11,180 - lava_callback - INFO - Starting async job submit for node 69fda0b5e98225c4a2046bfb 2026-05-08 09:19:11,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:19:11,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0b5e98225c4a2046bfb HTTP/1.1" 200 None 2026-05-08 09:19:11,240 - lava_callback - DEBUG - Processing node 69fda0b5e98225c4a2046bfb: ltp-fsx 2026-05-08 09:19:11,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:19:11,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:19:11,878 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69fda0b5e98225c4a2046bfb/log.txt.gz 2026-05-08 09:19:12,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:19:12,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:19:12,266 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69fda0b5e98225c4a2046bfb/lava-logs.yaml 2026-05-08 09:19:12,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:19:12,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:19:12,396 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69fda0b5e98225c4a2046bfb/lava_callback.json.gz 2026-05-08 09:19:12,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:19:12,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0b5e98225c4a2046bfb HTTP/1.1" 200 None 2026-05-08 09:19:12,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:19:12,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:19:12,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:19:12,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0b5e98225c4a2046bfb HTTP/1.1" 200 None 2026-05-08 09:19:12,480 - lava_callback - INFO - Completed processing callback for node 69fda0b5e98225c4a2046bfb INFO: 172.21.0.1:59160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42094 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:19:27,928 - lava_callback - INFO - Received callback for node 69fb079b5ce316b79a714ad3 INFO: 172.21.0.1:42110 - "POST /node/69fb079b5ce316b79a714ad3 HTTP/1.0" 202 Accepted 2026-05-08 09:19:27,934 - lava_callback - INFO - Starting async job submit for node 69fb079b5ce316b79a714ad3 2026-05-08 09:19:27,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:19:27,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb079b5ce316b79a714ad3 HTTP/1.1" 200 None 2026-05-08 09:19:27,949 - lava_callback - DEBUG - Processing node 69fb079b5ce316b79a714ad3: baseline-arm64-baylibre 2026-05-08 09:19:27,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb079b5ce316b79a714ad3 2026-05-08 09:19:27,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:19:27,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb079b5ce316b79a714ad3 HTTP/1.1" 200 None 2026-05-08 09:19:27,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:19:27,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-08 09:19:27,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:19:27,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb079b5ce316b79a714ad3 HTTP/1.1" 200 None 2026-05-08 09:19:27,999 - lava_callback - ERROR - Error processing callback for node 69fb079b5ce316b79a714ad3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37894 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:19:40,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:19:40,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 09:20:15,886 - lava_callback - INFO - Received callback for node 69fda2b2e98225c4a2046e1c INFO: 172.21.0.1:48894 - "POST /node/69fda2b2e98225c4a2046e1c HTTP/1.0" 202 Accepted 2026-05-08 09:20:15,892 - lava_callback - INFO - Starting async job submit for node 69fda2b2e98225c4a2046e1c 2026-05-08 09:20:15,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:20:15,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2b2e98225c4a2046e1c HTTP/1.1" 200 None 2026-05-08 09:20:15,973 - lava_callback - DEBUG - Processing node 69fda2b2e98225c4a2046e1c: baseline-arm64-broonie 2026-05-08 09:20:16,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:20:16,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:20:16,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2b2e98225c4a2046e1c/log.txt.gz INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:20:16,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:20:16,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:20:16,712 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2b2e98225c4a2046e1c/lava-logs.yaml 2026-05-08 09:20:16,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:20:16,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:20:16,832 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2b2e98225c4a2046e1c/lava_callback.json.gz 2026-05-08 09:20:16,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:20:16,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2b2e98225c4a2046e1c HTTP/1.1" 200 None 2026-05-08 09:20:16,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:20:16,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:20:16,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:20:16,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2b2e98225c4a2046e1c HTTP/1.1" 200 None 2026-05-08 09:20:16,917 - lava_callback - INFO - Completed processing callback for node 69fda2b2e98225c4a2046e1c INFO: 172.21.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:20:40,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:20:40,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53970 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:20:47,949 - lava_callback - INFO - Received callback for node 69fb07e75ce316b79a714af6 INFO: 172.21.0.1:53978 - "POST /node/69fb07e75ce316b79a714af6 HTTP/1.0" 202 Accepted 2026-05-08 09:20:47,955 - lava_callback - INFO - Starting async job submit for node 69fb07e75ce316b79a714af6 2026-05-08 09:20:47,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:20:47,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb07e75ce316b79a714af6 HTTP/1.1" 200 None 2026-05-08 09:20:47,978 - lava_callback - DEBUG - Processing node 69fb07e75ce316b79a714af6: baseline-arm64-baylibre 2026-05-08 09:20:47,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb07e75ce316b79a714af6 2026-05-08 09:20:47,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:20:47,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb07e75ce316b79a714af6 HTTP/1.1" 200 None 2026-05-08 09:20:47,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:20:48,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-08 09:20:48,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:20:48,016 - lava_callback - INFO - Received callback for node 69fdaac5e98225c4a20478e1 INFO: 172.21.0.1:53980 - "POST /node/69fdaac5e98225c4a20478e1 HTTP/1.0" 202 Accepted 2026-05-08 09:20:48,022 - lava_callback - INFO - Starting async job submit for node 69fdaac5e98225c4a20478e1 2026-05-08 09:20:48,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:20:48,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb07e75ce316b79a714af6 HTTP/1.1" 200 None 2026-05-08 09:20:48,055 - lava_callback - ERROR - Error processing callback for node 69fb07e75ce316b79a714af6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:20:48,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdaac5e98225c4a20478e1 HTTP/1.1" 200 None 2026-05-08 09:20:48,092 - lava_callback - DEBUG - Processing node 69fdaac5e98225c4a20478e1: baseline-arm64 2026-05-08 09:20:48,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:20:48,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:20:48,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdaac5e98225c4a20478e1/log.txt.gz 2026-05-08 09:20:48,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:20:48,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:20:48,893 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdaac5e98225c4a20478e1/lava-logs.yaml 2026-05-08 09:20:48,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:20:49,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:20:49,184 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdaac5e98225c4a20478e1/lava_callback.json.gz 2026-05-08 09:20:49,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:20:49,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdaac5e98225c4a20478e1 HTTP/1.1" 200 None 2026-05-08 09:20:49,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:20:49,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:20:49,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:20:49,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdaac5e98225c4a20478e1 HTTP/1.1" 200 None 2026-05-08 09:20:49,259 - lava_callback - INFO - Completed processing callback for node 69fdaac5e98225c4a20478e1 INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:21:10,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:21:10,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45224 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:22:29,244 - lava_callback - INFO - Received callback for node 69fda0bae98225c4a2046c04 INFO: 172.21.0.1:45226 - "POST /node/69fda0bae98225c4a2046c04 HTTP/1.0" 202 Accepted 2026-05-08 09:22:29,250 - lava_callback - INFO - Starting async job submit for node 69fda0bae98225c4a2046c04 2026-05-08 09:22:29,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:22:29,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0bae98225c4a2046c04 HTTP/1.1" 200 None 2026-05-08 09:22:29,308 - lava_callback - DEBUG - Processing node 69fda0bae98225c4a2046c04: ltp-pty 2026-05-08 09:22:29,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:22:29,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:22:29,912 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69fda0bae98225c4a2046c04/log.txt.gz 2026-05-08 09:22:30,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:22:30,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:22:30,312 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69fda0bae98225c4a2046c04/lava-logs.yaml 2026-05-08 09:22:30,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:22:30,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:22:30,622 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69fda0bae98225c4a2046c04/lava_callback.json.gz 2026-05-08 09:22:30,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:22:30,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0bae98225c4a2046c04 HTTP/1.1" 200 None 2026-05-08 09:22:30,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:22:30,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:22:30,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:22:30,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0bae98225c4a2046c04 HTTP/1.1" 200 None 2026-05-08 09:22:30,704 - lava_callback - INFO - Completed processing callback for node 69fda0bae98225c4a2046c04 INFO: 172.21.0.1:60636 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:22:40,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:22:40,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:22:51,607 - lava_callback - INFO - Received callback for node 69fda0bbe98225c4a2046c07 INFO: 172.21.0.1:60486 - "POST /node/69fda0bbe98225c4a2046c07 HTTP/1.0" 202 Accepted 2026-05-08 09:22:51,613 - lava_callback - INFO - Starting async job submit for node 69fda0bbe98225c4a2046c07 2026-05-08 09:22:51,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:22:51,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0bbe98225c4a2046c07 HTTP/1.1" 200 None 2026-05-08 09:22:51,653 - lava_callback - DEBUG - Processing node 69fda0bbe98225c4a2046c07: ltp-sched 2026-05-08 09:22:52,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:22:52,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:22:52,216 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69fda0bbe98225c4a2046c07/log.txt.gz 2026-05-08 09:22:52,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:22:52,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:22:52,583 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69fda0bbe98225c4a2046c07/lava-logs.yaml 2026-05-08 09:22:52,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:22:52,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:22:52,702 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69fda0bbe98225c4a2046c07/lava_callback.json.gz 2026-05-08 09:22:52,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:22:52,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0bbe98225c4a2046c07 HTTP/1.1" 200 None 2026-05-08 09:22:52,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:22:52,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:22:52,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:22:52,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0bbe98225c4a2046c07 HTTP/1.1" 200 None 2026-05-08 09:22:52,781 - lava_callback - INFO - Completed processing callback for node 69fda0bbe98225c4a2046c07 INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59016 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:23:10,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:23:10,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 09:23:11,412 - lava_callback - INFO - Received callback for node 69fda0c0e98225c4a2046c14 INFO: 172.21.0.1:43848 - "POST /node/69fda0c0e98225c4a2046c14 HTTP/1.0" 202 Accepted 2026-05-08 09:23:11,419 - lava_callback - INFO - Starting async job submit for node 69fda0c0e98225c4a2046c14 2026-05-08 09:23:11,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:23:11,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0c0e98225c4a2046c14 HTTP/1.1" 200 None 2026-05-08 09:23:11,460 - lava_callback - DEBUG - Processing node 69fda0c0e98225c4a2046c14: ltp-syscalls-ipc 2026-05-08 09:23:11,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:23:11,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:23:11,921 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fda0c0e98225c4a2046c14/log.txt.gz 2026-05-08 09:23:12,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:23:12,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:23:12,313 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fda0c0e98225c4a2046c14/lava-logs.yaml 2026-05-08 09:23:12,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:23:12,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:23:12,642 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fda0c0e98225c4a2046c14/lava_callback.json.gz 2026-05-08 09:23:12,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:23:12,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0c0e98225c4a2046c14 HTTP/1.1" 200 None 2026-05-08 09:23:12,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:23:12,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:23:12,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:23:12,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0c0e98225c4a2046c14 HTTP/1.1" 200 None 2026-05-08 09:23:12,736 - lava_callback - INFO - Completed processing callback for node 69fda0c0e98225c4a2046c14 INFO: 172.21.0.1:43854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54442 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:23:31,320 - lava_callback - INFO - Received callback for node 69fda0bde98225c4a2046c0a INFO: 172.21.0.1:58144 - "POST /node/69fda0bde98225c4a2046c0a HTTP/1.0" 202 Accepted 2026-05-08 09:23:31,326 - lava_callback - INFO - Starting async job submit for node 69fda0bde98225c4a2046c0a 2026-05-08 09:23:31,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:23:31,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0bde98225c4a2046c0a HTTP/1.1" 200 None 2026-05-08 09:23:31,369 - lava_callback - DEBUG - Processing node 69fda0bde98225c4a2046c0a: ltp-smoke 2026-05-08 09:23:31,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:23:32,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:23:32,037 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fda0bde98225c4a2046c0a/log.txt.gz 2026-05-08 09:23:32,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:23:32,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:23:32,385 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fda0bde98225c4a2046c0a/lava-logs.yaml 2026-05-08 09:23:32,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:23:32,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:23:32,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fda0bde98225c4a2046c0a/lava_callback.json.gz 2026-05-08 09:23:32,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:23:32,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0bde98225c4a2046c0a HTTP/1.1" 200 None 2026-05-08 09:23:32,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:23:32,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:23:32,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:23:32,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0bde98225c4a2046c0a HTTP/1.1" 200 None 2026-05-08 09:23:32,606 - lava_callback - INFO - Completed processing callback for node 69fda0bde98225c4a2046c0a INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:23:40,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:23:40,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40630 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:26:27,643 - lava_callback - INFO - Received callback for node 69fda0c1e98225c4a2046c1b INFO: 172.21.0.1:40632 - "POST /node/69fda0c1e98225c4a2046c1b HTTP/1.0" 202 Accepted 2026-05-08 09:26:27,650 - lava_callback - INFO - Starting async job submit for node 69fda0c1e98225c4a2046c1b 2026-05-08 09:26:27,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:26:27,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0c1e98225c4a2046c1b HTTP/1.1" 200 None 2026-05-08 09:26:27,693 - lava_callback - DEBUG - Processing node 69fda0c1e98225c4a2046c1b: ltp-timers 2026-05-08 09:26:28,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:26:28,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:26:28,153 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69fda0c1e98225c4a2046c1b/log.txt.gz 2026-05-08 09:26:28,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:26:28,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:26:28,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69fda0c1e98225c4a2046c1b/lava-logs.yaml 2026-05-08 09:26:28,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:26:28,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:26:28,655 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69fda0c1e98225c4a2046c1b/lava_callback.json.gz 2026-05-08 09:26:28,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:26:28,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0c1e98225c4a2046c1b HTTP/1.1" 200 None 2026-05-08 09:26:28,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:26:28,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:26:28,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:26:28,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0c1e98225c4a2046c1b HTTP/1.1" 200 None 2026-05-08 09:26:28,734 - lava_callback - INFO - Completed processing callback for node 69fda0c1e98225c4a2046c1b INFO: 172.21.0.1:46788 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:26:40,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:26:40,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:26:48,346 - lava_callback - INFO - Received callback for node 69fdaa4fe98225c4a204787d INFO: 172.21.0.1:34760 - "POST /node/69fdaa4fe98225c4a204787d HTTP/1.0" 202 Accepted 2026-05-08 09:26:48,353 - lava_callback - INFO - Starting async job submit for node 69fdaa4fe98225c4a204787d 2026-05-08 09:26:48,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:26:48,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdaa4fe98225c4a204787d HTTP/1.1" 200 None 2026-05-08 09:26:48,410 - lava_callback - DEBUG - Processing node 69fdaa4fe98225c4a204787d: baseline-arm64 2026-05-08 09:26:48,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:26:48,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:26:48,893 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdaa4fe98225c4a204787d/log.txt.gz 2026-05-08 09:26:49,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:26:49,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:26:49,280 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdaa4fe98225c4a204787d/lava-logs.yaml 2026-05-08 09:26:49,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:26:49,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:26:49,587 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdaa4fe98225c4a204787d/lava_callback.json.gz DEBUG: Setup failed for 69fdaa4fe98225c4a204787d. Transitting job node result: incomplete -> fail 2026-05-08 09:26:49,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:26:49,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdaa4fe98225c4a204787d HTTP/1.1" 200 None 2026-05-08 09:26:49,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:26:49,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:26:49,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:26:49,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdaa4fe98225c4a204787d HTTP/1.1" 200 None 2026-05-08 09:26:49,805 - lava_callback - INFO - Completed processing callback for node 69fdaa4fe98225c4a204787d 2026-05-08 09:26:51,183 - lava_callback - INFO - Received callback for node 69fda0c3e98225c4a2046c1e INFO: 172.21.0.1:60642 - "POST /node/69fda0c3e98225c4a2046c1e HTTP/1.0" 202 Accepted 2026-05-08 09:26:51,190 - lava_callback - INFO - Starting async job submit for node 69fda0c3e98225c4a2046c1e 2026-05-08 09:26:51,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:26:51,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0c3e98225c4a2046c1e HTTP/1.1" 200 None 2026-05-08 09:26:51,229 - lava_callback - DEBUG - Processing node 69fda0c3e98225c4a2046c1e: ltp-watchqueue 2026-05-08 09:26:51,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:26:51,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:26:51,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fda0c3e98225c4a2046c1e/log.txt.gz 2026-05-08 09:26:52,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:26:52,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:26:52,213 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fda0c3e98225c4a2046c1e/lava-logs.yaml 2026-05-08 09:26:52,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:26:52,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:26:52,351 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fda0c3e98225c4a2046c1e/lava_callback.json.gz 2026-05-08 09:26:52,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:26:52,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda0c3e98225c4a2046c1e HTTP/1.1" 200 None 2026-05-08 09:26:52,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:26:52,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:26:52,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:26:52,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda0c3e98225c4a2046c1e HTTP/1.1" 200 None 2026-05-08 09:26:52,446 - lava_callback - INFO - Completed processing callback for node 69fda0c3e98225c4a2046c1e INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:27:08,510 - lava_callback - INFO - Received callback for node 69fb095b5ce316b79a714bae INFO: 172.21.0.1:39682 - "POST /node/69fb095b5ce316b79a714bae HTTP/1.0" 202 Accepted 2026-05-08 09:27:08,516 - lava_callback - INFO - Starting async job submit for node 69fb095b5ce316b79a714bae 2026-05-08 09:27:08,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:27:08,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb095b5ce316b79a714bae HTTP/1.1" 200 None 2026-05-08 09:27:08,532 - lava_callback - DEBUG - Processing node 69fb095b5ce316b79a714bae: baseline-arm64-baylibre 2026-05-08 09:27:08,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb095b5ce316b79a714bae 2026-05-08 09:27:08,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:27:08,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb095b5ce316b79a714bae HTTP/1.1" 200 None 2026-05-08 09:27:08,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:27:08,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-08 09:27:08,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:27:08,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb095b5ce316b79a714bae HTTP/1.1" 200 None 2026-05-08 09:27:08,577 - lava_callback - ERROR - Error processing callback for node 69fb095b5ce316b79a714bae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 09:27:10,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:27:10,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56560 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:30:14,777 - lava_callback - INFO - Received callback for node 69fda95ee98225c4a2047839 INFO: 172.21.0.1:55006 - "POST /node/69fda95ee98225c4a2047839 HTTP/1.0" 202 Accepted 2026-05-08 09:30:14,784 - lava_callback - INFO - Starting async job submit for node 69fda95ee98225c4a2047839 2026-05-08 09:30:14,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:30:14,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda95ee98225c4a2047839 HTTP/1.1" 200 None 2026-05-08 09:30:14,854 - lava_callback - DEBUG - Processing node 69fda95ee98225c4a2047839: baseline-arm INFO: 172.21.0.1:55014 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 09:30:15,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:30:15,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:30:15,673 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fda95ee98225c4a2047839/log.txt.gz 2026-05-08 09:30:16,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:30:16,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:30:16,323 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fda95ee98225c4a2047839/lava-logs.yaml 2026-05-08 09:30:16,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:30:16,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:30:16,481 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fda95ee98225c4a2047839/lava_callback.json.gz INFO: 172.21.0.1:55020 - "GET / HTTP/1.0" 200 OK DEBUG: Setup failed for 69fda95ee98225c4a2047839. Transitting job node result: incomplete -> fail 2026-05-08 09:30:16,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:30:16,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda95ee98225c4a2047839 HTTP/1.1" 200 None 2026-05-08 09:30:16,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:30:16,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:30:16,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:30:16,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda95ee98225c4a2047839 HTTP/1.1" 200 None 2026-05-08 09:30:16,761 - lava_callback - INFO - Completed processing callback for node 69fda95ee98225c4a2047839 INFO: 172.21.0.1:58894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:30:40,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:30:40,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:30:48,569 - lava_callback - INFO - Received callback for node 69fb0a3a5ce316b79a714c20 INFO: 172.21.0.1:53490 - "POST /node/69fb0a3a5ce316b79a714c20 HTTP/1.0" 202 Accepted 2026-05-08 09:30:48,578 - lava_callback - INFO - Starting async job submit for node 69fb0a3a5ce316b79a714c20 2026-05-08 09:30:48,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:30:48,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0a3a5ce316b79a714c20 HTTP/1.1" 200 None 2026-05-08 09:30:48,600 - lava_callback - DEBUG - Processing node 69fb0a3a5ce316b79a714c20: baseline-arm64-baylibre 2026-05-08 09:30:48,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb0a3a5ce316b79a714c20 2026-05-08 09:30:48,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:30:48,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0a3a5ce316b79a714c20 HTTP/1.1" 200 None 2026-05-08 09:30:48,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:30:48,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-08 09:30:48,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:30:48,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb0a3a5ce316b79a714c20 HTTP/1.1" 200 None 2026-05-08 09:30:48,661 - lava_callback - ERROR - Error processing callback for node 69fb0a3a5ce316b79a714c20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55990 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:34:38,248 - lava_callback - INFO - Received callback for node 69fb0b1e5ce316b79a714c94 INFO: 172.21.0.1:55994 - "POST /node/69fb0b1e5ce316b79a714c94 HTTP/1.0" 202 Accepted 2026-05-08 09:34:38,254 - lava_callback - INFO - Starting async job submit for node 69fb0b1e5ce316b79a714c94 2026-05-08 09:34:38,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:34:38,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0b1e5ce316b79a714c94 HTTP/1.1" 200 None 2026-05-08 09:34:38,270 - lava_callback - DEBUG - Processing node 69fb0b1e5ce316b79a714c94: baseline-arm64-clabbe 2026-05-08 09:34:38,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb0b1e5ce316b79a714c94 2026-05-08 09:34:38,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:34:38,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0b1e5ce316b79a714c94 HTTP/1.1" 200 None 2026-05-08 09:34:38,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:34:38,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-08 09:34:38,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:34:38,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb0b1e5ce316b79a714c94 HTTP/1.1" 200 None 2026-05-08 09:34:38,323 - lava_callback - ERROR - Error processing callback for node 69fb0b1e5ce316b79a714c94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:35:58,294 - lava_callback - INFO - Received callback for node 69fb0b695ce316b79a714cc2 INFO: 172.21.0.1:44406 - "POST /node/69fb0b695ce316b79a714cc2 HTTP/1.0" 202 Accepted 2026-05-08 09:35:58,299 - lava_callback - INFO - Starting async job submit for node 69fb0b695ce316b79a714cc2 2026-05-08 09:35:58,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:35:58,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0b695ce316b79a714cc2 HTTP/1.1" 200 None 2026-05-08 09:35:58,314 - lava_callback - DEBUG - Processing node 69fb0b695ce316b79a714cc2: baseline-arm64-clabbe 2026-05-08 09:35:58,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb0b695ce316b79a714cc2 2026-05-08 09:35:58,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:35:58,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0b695ce316b79a714cc2 HTTP/1.1" 200 None 2026-05-08 09:35:58,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:35:58,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-08 09:35:58,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:35:58,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb0b695ce316b79a714cc2 HTTP/1.1" 200 None 2026-05-08 09:35:58,360 - lava_callback - ERROR - Error processing callback for node 69fb0b695ce316b79a714cc2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38254 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:38:18,352 - lava_callback - INFO - Received callback for node 69fb0bfe5ce316b79a714d00 INFO: 172.21.0.1:38268 - "POST /node/69fb0bfe5ce316b79a714d00 HTTP/1.0" 202 Accepted 2026-05-08 09:38:18,358 - lava_callback - INFO - Starting async job submit for node 69fb0bfe5ce316b79a714d00 2026-05-08 09:38:18,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:38:18,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0bfe5ce316b79a714d00 HTTP/1.1" 200 None 2026-05-08 09:38:18,376 - lava_callback - DEBUG - Processing node 69fb0bfe5ce316b79a714d00: baseline-arm64-clabbe 2026-05-08 09:38:18,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb0bfe5ce316b79a714d00 2026-05-08 09:38:18,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:38:18,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0bfe5ce316b79a714d00 HTTP/1.1" 200 None 2026-05-08 09:38:18,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:38:18,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-08 09:38:18,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:38:18,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb0bfe5ce316b79a714d00 HTTP/1.1" 200 None 2026-05-08 09:38:18,446 - lava_callback - ERROR - Error processing callback for node 69fb0bfe5ce316b79a714d00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:39:38,359 - lava_callback - INFO - Received callback for node 69fb0c4a5ce316b79a714d2c INFO: 172.21.0.1:58192 - "POST /node/69fb0c4a5ce316b79a714d2c HTTP/1.0" 202 Accepted 2026-05-08 09:39:38,365 - lava_callback - INFO - Starting async job submit for node 69fb0c4a5ce316b79a714d2c 2026-05-08 09:39:38,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:39:38,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0c4a5ce316b79a714d2c HTTP/1.1" 200 None 2026-05-08 09:39:38,388 - lava_callback - DEBUG - Processing node 69fb0c4a5ce316b79a714d2c: baseline-arm64-clabbe 2026-05-08 09:39:38,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb0c4a5ce316b79a714d2c 2026-05-08 09:39:38,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:39:38,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0c4a5ce316b79a714d2c HTTP/1.1" 200 None 2026-05-08 09:39:38,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:39:38,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-08 09:39:38,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:39:38,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb0c4a5ce316b79a714d2c HTTP/1.1" 200 None 2026-05-08 09:39:38,443 - lava_callback - ERROR - Error processing callback for node 69fb0c4a5ce316b79a714d2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:40:01,189 - lava_callback - INFO - Received callback for node 69fda27ce98225c4a2046d5b INFO: 172.21.0.1:52448 - "POST /node/69fda27ce98225c4a2046d5b HTTP/1.0" 202 Accepted 2026-05-08 09:40:01,195 - lava_callback - INFO - Starting async job submit for node 69fda27ce98225c4a2046d5b 2026-05-08 09:40:01,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:40:01,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda27ce98225c4a2046d5b HTTP/1.1" 200 None 2026-05-08 09:40:01,230 - lava_callback - DEBUG - Processing node 69fda27ce98225c4a2046d5b: baseline-arm64 2026-05-08 09:40:01,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:40:01,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:40:01,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27ce98225c4a2046d5b/log.txt.gz 2026-05-08 09:40:01,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:40:01,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:40:01,923 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27ce98225c4a2046d5b/lava-logs.yaml 2026-05-08 09:40:01,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:40:02,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:40:02,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fda27ce98225c4a2046d5b/lava_callback.json.gz 2026-05-08 09:40:02,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:40:02,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda27ce98225c4a2046d5b HTTP/1.1" 200 None 2026-05-08 09:40:02,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:40:02,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:40:02,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:40:02,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda27ce98225c4a2046d5b HTTP/1.1" 200 None 2026-05-08 09:40:02,153 - lava_callback - INFO - Completed processing callback for node 69fda27ce98225c4a2046d5b INFO: 172.21.0.1:52454 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:40:10,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:40:10,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:41:47,021 - lava_callback - INFO - Received callback for node 69fda28ce98225c4a2046da1 INFO: 172.21.0.1:47448 - "POST /node/69fda28ce98225c4a2046da1 HTTP/1.0" 202 Accepted 2026-05-08 09:41:47,027 - lava_callback - INFO - Starting async job submit for node 69fda28ce98225c4a2046da1 2026-05-08 09:41:47,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:41:47,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda28ce98225c4a2046da1 HTTP/1.1" 200 None 2026-05-08 09:41:47,065 - lava_callback - DEBUG - Processing node 69fda28ce98225c4a2046da1: baseline-nfs-arm64 2026-05-08 09:41:47,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:41:47,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:41:47,606 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda28ce98225c4a2046da1/log.txt.gz 2026-05-08 09:41:47,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:41:48,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:41:48,042 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda28ce98225c4a2046da1/lava-logs.yaml 2026-05-08 09:41:48,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:41:48,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:41:48,153 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fda28ce98225c4a2046da1/lava_callback.json.gz 2026-05-08 09:41:48,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:41:48,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda28ce98225c4a2046da1 HTTP/1.1" 200 None 2026-05-08 09:41:48,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:41:48,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:41:48,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:41:48,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda28ce98225c4a2046da1 HTTP/1.1" 200 None 2026-05-08 09:41:48,239 - lava_callback - INFO - Completed processing callback for node 69fda28ce98225c4a2046da1 INFO: 172.21.0.1:46512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53390 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:42:10,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:42:10,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:43:18,520 - lava_callback - INFO - Received callback for node 69fb0d285ce316b79a714da3 INFO: 172.21.0.1:56996 - "POST /node/69fb0d285ce316b79a714da3 HTTP/1.0" 202 Accepted 2026-05-08 09:43:18,526 - lava_callback - INFO - Starting async job submit for node 69fb0d285ce316b79a714da3 2026-05-08 09:43:18,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:43:18,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0d285ce316b79a714da3 HTTP/1.1" 200 None 2026-05-08 09:43:18,552 - lava_callback - DEBUG - Processing node 69fb0d285ce316b79a714da3: baseline-arm64-clabbe 2026-05-08 09:43:18,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb0d285ce316b79a714da3 2026-05-08 09:43:18,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:43:18,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0d285ce316b79a714da3 HTTP/1.1" 200 None 2026-05-08 09:43:18,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:43:18,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-08 09:43:18,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:43:18,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb0d285ce316b79a714da3 HTTP/1.1" 200 None 2026-05-08 09:43:18,626 - lava_callback - ERROR - Error processing callback for node 69fb0d285ce316b79a714da3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38340 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:44:38,535 - lava_callback - INFO - Received callback for node 69fb0d735ce316b79a714dc9 INFO: 172.21.0.1:38346 - "POST /node/69fb0d735ce316b79a714dc9 HTTP/1.0" 202 Accepted 2026-05-08 09:44:38,540 - lava_callback - INFO - Starting async job submit for node 69fb0d735ce316b79a714dc9 2026-05-08 09:44:38,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:44:38,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0d735ce316b79a714dc9 HTTP/1.1" 200 None 2026-05-08 09:44:38,555 - lava_callback - DEBUG - Processing node 69fb0d735ce316b79a714dc9: baseline-arm64-clabbe 2026-05-08 09:44:38,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb0d735ce316b79a714dc9 2026-05-08 09:44:38,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:44:38,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0d735ce316b79a714dc9 HTTP/1.1" 200 None 2026-05-08 09:44:38,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:44:38,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-08 09:44:38,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:44:38,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb0d735ce316b79a714dc9 HTTP/1.1" 200 None 2026-05-08 09:44:38,614 - lava_callback - ERROR - Error processing callback for node 69fb0d735ce316b79a714dc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34822 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:45:38,593 - lava_callback - INFO - Received callback for node 69fb0db15ce316b79a714de9 INFO: 172.21.0.1:34828 - "POST /node/69fb0db15ce316b79a714de9 HTTP/1.0" 202 Accepted 2026-05-08 09:45:38,598 - lava_callback - INFO - Starting async job submit for node 69fb0db15ce316b79a714de9 2026-05-08 09:45:38,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:45:38,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0db15ce316b79a714de9 HTTP/1.1" 200 None 2026-05-08 09:45:38,613 - lava_callback - DEBUG - Processing node 69fb0db15ce316b79a714de9: baseline-arm-clabbe 2026-05-08 09:45:38,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb0db15ce316b79a714de9 2026-05-08 09:45:38,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:45:38,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb0db15ce316b79a714de9 HTTP/1.1" 200 None 2026-05-08 09:45:38,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:45:38,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-08 09:45:38,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:45:38,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb0db15ce316b79a714de9 HTTP/1.1" 200 None 2026-05-08 09:45:38,658 - lava_callback - ERROR - Error processing callback for node 69fb0db15ce316b79a714de9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47310 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:45:48,708 - lava_callback - INFO - Received callback for node 69fdaca4e98225c4a20479bc INFO: 172.21.0.1:47322 - "POST /node/69fdaca4e98225c4a20479bc HTTP/1.0" 202 Accepted 2026-05-08 09:45:48,719 - lava_callback - INFO - Starting async job submit for node 69fdaca4e98225c4a20479bc 2026-05-08 09:45:48,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:45:48,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdaca4e98225c4a20479bc HTTP/1.1" 200 None 2026-05-08 09:45:48,812 - lava_callback - DEBUG - Processing node 69fdaca4e98225c4a20479bc: ltp-smoke 2026-05-08 09:45:49,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:45:49,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:45:49,562 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fdaca4e98225c4a20479bc/log.txt.gz 2026-05-08 09:45:49,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:45:50,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:45:50,117 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fdaca4e98225c4a20479bc/lava-logs.yaml 2026-05-08 09:45:50,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:45:50,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:45:50,281 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fdaca4e98225c4a20479bc/lava_callback.json.gz 2026-05-08 09:45:50,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:45:50,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdaca4e98225c4a20479bc HTTP/1.1" 200 None 2026-05-08 09:45:50,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:45:50,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c90e98225c4a20469a4 HTTP/1.1" 200 None 2026-05-08 09:45:50,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:45:50,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdaca4e98225c4a20479bc HTTP/1.1" 200 None 2026-05-08 09:45:50,587 - lava_callback - INFO - Completed processing callback for node 69fdaca4e98225c4a20479bc INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43034 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:46:10,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:46:10,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47112 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:47:17,378 - lava_callback - INFO - Received callback for node 69fdb11ce98225c4a2047bd7 INFO: 172.21.0.1:47124 - "POST /node/69fdb11ce98225c4a2047bd7 HTTP/1.0" 202 Accepted 2026-05-08 09:47:17,386 - lava_callback - INFO - Starting async job submit for node 69fdb11ce98225c4a2047bd7 2026-05-08 09:47:17,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:47:17,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb11ce98225c4a2047bd7 HTTP/1.1" 200 None 2026-05-08 09:47:17,410 - lava_callback - DEBUG - Processing node 69fdb11ce98225c4a2047bd7: baseline-nfs-arm64 2026-05-08 09:47:17,412 - lava_callback - WARNING - Failed to upload log 2026-05-08 09:47:17,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:47:17,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:47:17,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdb11ce98225c4a2047bd7/lava-logs.yaml 2026-05-08 09:47:17,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:47:17,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:47:17,626 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdb11ce98225c4a2047bd7/lava_callback.json.gz 2026-05-08 09:47:17,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:47:17,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb11ce98225c4a2047bd7 HTTP/1.1" 200 None 2026-05-08 09:47:17,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:47:17,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:47:17,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:47:17,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb11ce98225c4a2047bd7 HTTP/1.1" 200 None 2026-05-08 09:47:17,692 - lava_callback - INFO - Completed processing callback for node 69fdb11ce98225c4a2047bd7 INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51794 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:47:40,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:47:40,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:48:45,663 - lava_callback - INFO - Received callback for node 69fdaa07e98225c4a2047867 INFO: 172.21.0.1:44024 - "POST /node/69fdaa07e98225c4a2047867 HTTP/1.0" 202 Accepted 2026-05-08 09:48:45,714 - lava_callback - INFO - Starting async job submit for node 69fdaa07e98225c4a2047867 2026-05-08 09:48:45,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:48:45,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdaa07e98225c4a2047867 HTTP/1.1" 200 None 2026-05-08 09:48:45,761 - lava_callback - DEBUG - Processing node 69fdaa07e98225c4a2047867: baseline-arm-pengutronix 2026-05-08 09:48:45,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:48:45,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:48:45,997 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fdaa07e98225c4a2047867/log.txt.gz 2026-05-08 09:48:46,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:48:46,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:48:46,196 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fdaa07e98225c4a2047867/lava-logs.yaml 2026-05-08 09:48:46,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:48:46,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:48:46,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fdaa07e98225c4a2047867/lava_callback.json.gz DEBUG: Setup failed for 69fdaa07e98225c4a2047867. Transitting job node result: incomplete -> fail 2026-05-08 09:48:46,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:48:46,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdaa07e98225c4a2047867 HTTP/1.1" 200 None 2026-05-08 09:48:46,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:48:46,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 09:48:46,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:48:46,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdaa07e98225c4a2047867 HTTP/1.1" 200 None INFO: 172.21.0.1:44034 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:48:46,540 - lava_callback - INFO - Completed processing callback for node 69fdaa07e98225c4a2047867 INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:49:10,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:49:10,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:50:36,491 - lava_callback - INFO - Received callback for node 69fdb1b5e98225c4a2047c38 INFO: 172.21.0.1:40638 - "POST /node/69fdb1b5e98225c4a2047c38 HTTP/1.0" 202 Accepted 2026-05-08 09:50:36,502 - lava_callback - INFO - Starting async job submit for node 69fdb1b5e98225c4a2047c38 INFO: 172.21.0.1:40642 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:50:36,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:50:36,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb1b5e98225c4a2047c38 HTTP/1.1" 200 None 2026-05-08 09:50:36,555 - lava_callback - DEBUG - Processing node 69fdb1b5e98225c4a2047c38: baseline-arm64 2026-05-08 09:50:36,745 - lava_callback - WARNING - Failed to upload log 2026-05-08 09:50:36,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:50:37,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:50:37,007 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb1b5e98225c4a2047c38/lava-logs.yaml 2026-05-08 09:50:37,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:50:37,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:50:37,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb1b5e98225c4a2047c38/lava_callback.json.gz 2026-05-08 09:50:37,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:50:37,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb1b5e98225c4a2047c38 HTTP/1.1" 200 None 2026-05-08 09:50:37,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:50:37,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:50:37,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:50:37,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb1b5e98225c4a2047c38 HTTP/1.1" 200 None 2026-05-08 09:50:37,264 - lava_callback - INFO - Completed processing callback for node 69fdb1b5e98225c4a2047c38 2026-05-08 09:50:40,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:50:40,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:52:18,286 - lava_callback - INFO - Received callback for node 69fdb209e98225c4a2047c5a INFO: 172.21.0.1:37046 - "POST /node/69fdb209e98225c4a2047c5a HTTP/1.0" 202 Accepted 2026-05-08 09:52:18,293 - lava_callback - INFO - Starting async job submit for node 69fdb209e98225c4a2047c5a 2026-05-08 09:52:18,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:52:18,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb209e98225c4a2047c5a HTTP/1.1" 200 None 2026-05-08 09:52:18,340 - lava_callback - DEBUG - Processing node 69fdb209e98225c4a2047c5a: baseline-arm64 2026-05-08 09:52:18,544 - lava_callback - WARNING - Failed to upload log 2026-05-08 09:52:18,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:52:18,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:52:18,984 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb209e98225c4a2047c5a/lava-logs.yaml 2026-05-08 09:52:18,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:52:19,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:52:19,261 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb209e98225c4a2047c5a/lava_callback.json.gz 2026-05-08 09:52:19,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:52:19,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb209e98225c4a2047c5a HTTP/1.1" 200 None 2026-05-08 09:52:19,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:52:19,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:52:19,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:52:19,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb209e98225c4a2047c5a HTTP/1.1" 200 None 2026-05-08 09:52:19,408 - lava_callback - INFO - Completed processing callback for node 69fdb209e98225c4a2047c5a INFO: 172.21.0.1:42514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:52:40,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:52:40,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53848 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:56:33,682 - lava_callback - INFO - Received callback for node 69fdb0cde98225c4a2047b9d INFO: 172.21.0.1:55178 - "POST /node/69fdb0cde98225c4a2047b9d HTTP/1.0" 202 Accepted 2026-05-08 09:56:33,689 - lava_callback - INFO - Starting async job submit for node 69fdb0cde98225c4a2047b9d 2026-05-08 09:56:33,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:56:33,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb0cde98225c4a2047b9d HTTP/1.1" 200 None 2026-05-08 09:56:33,739 - lava_callback - DEBUG - Processing node 69fdb0cde98225c4a2047b9d: baseline-arm64 2026-05-08 09:56:34,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:56:34,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:56:34,530 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb0cde98225c4a2047b9d/log.txt.gz 2026-05-08 09:56:34,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:56:34,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:56:34,998 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb0cde98225c4a2047b9d/lava-logs.yaml 2026-05-08 09:56:35,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:56:35,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:56:35,299 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb0cde98225c4a2047b9d/lava_callback.json.gz 2026-05-08 09:56:35,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:56:35,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb0cde98225c4a2047b9d HTTP/1.1" 200 None 2026-05-08 09:56:35,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:56:35,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:56:35,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:56:35,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb0cde98225c4a2047b9d HTTP/1.1" 200 None 2026-05-08 09:56:35,423 - lava_callback - INFO - Completed processing callback for node 69fdb0cde98225c4a2047b9d INFO: 172.21.0.1:55192 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:56:40,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:56:40,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52494 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:58:30,270 - lava_callback - INFO - Received callback for node 69fb10b85ce316b79a714f67 INFO: 172.21.0.1:33146 - "POST /node/69fb10b85ce316b79a714f67 HTTP/1.0" 202 Accepted 2026-05-08 09:58:30,276 - lava_callback - INFO - Starting async job submit for node 69fb10b85ce316b79a714f67 2026-05-08 09:58:30,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:58:30,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb10b85ce316b79a714f67 HTTP/1.1" 200 None 2026-05-08 09:58:30,291 - lava_callback - DEBUG - Processing node 69fb10b85ce316b79a714f67: baseline-arm64-baylibre 2026-05-08 09:58:30,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb10b85ce316b79a714f67 2026-05-08 09:58:30,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:58:30,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb10b85ce316b79a714f67 HTTP/1.1" 200 None 2026-05-08 09:58:30,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:58:30,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-08 09:58:30,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:58:30,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb10b85ce316b79a714f67 HTTP/1.1" 200 None 2026-05-08 09:58:30,342 - lava_callback - ERROR - Error processing callback for node 69fb10b85ce316b79a714f67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44972 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:59:02,135 - lava_callback - INFO - Received callback for node 69fdb16ce98225c4a2047c00 INFO: 172.21.0.1:56020 - "POST /node/69fdb16ce98225c4a2047c00 HTTP/1.0" 202 Accepted 2026-05-08 09:59:02,141 - lava_callback - INFO - Starting async job submit for node 69fdb16ce98225c4a2047c00 2026-05-08 09:59:02,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:59:02,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb16ce98225c4a2047c00 HTTP/1.1" 200 None 2026-05-08 09:59:02,181 - lava_callback - DEBUG - Processing node 69fdb16ce98225c4a2047c00: baseline-nfs-arm64 2026-05-08 09:59:02,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:59:02,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:59:02,893 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdb16ce98225c4a2047c00/log.txt.gz 2026-05-08 09:59:03,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:59:03,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:59:03,401 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdb16ce98225c4a2047c00/lava-logs.yaml 2026-05-08 09:59:03,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 09:59:03,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 09:59:03,540 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdb16ce98225c4a2047c00/lava_callback.json.gz 2026-05-08 09:59:03,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:59:03,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb16ce98225c4a2047c00 HTTP/1.1" 200 None 2026-05-08 09:59:03,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:59:03,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 09:59:03,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:59:03,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb16ce98225c4a2047c00 HTTP/1.1" 200 None 2026-05-08 09:59:03,693 - lava_callback - INFO - Completed processing callback for node 69fdb16ce98225c4a2047c00 INFO: 172.21.0.1:56022 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:59:10,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:59:10,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET / HTTP/1.0" 200 OK 2026-05-08 09:59:50,159 - lava_callback - INFO - Received callback for node 69fb11015ce316b79a714f84 INFO: 172.21.0.1:36648 - "POST /node/69fb11015ce316b79a714f84 HTTP/1.0" 202 Accepted 2026-05-08 09:59:50,165 - lava_callback - INFO - Starting async job submit for node 69fb11015ce316b79a714f84 2026-05-08 09:59:50,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:59:50,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb11015ce316b79a714f84 HTTP/1.1" 200 None 2026-05-08 09:59:50,183 - lava_callback - DEBUG - Processing node 69fb11015ce316b79a714f84: baseline-arm64-baylibre 2026-05-08 09:59:50,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb11015ce316b79a714f84 2026-05-08 09:59:50,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:59:50,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb11015ce316b79a714f84 HTTP/1.1" 200 None 2026-05-08 09:59:50,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:59:50,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-08 09:59:50,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 09:59:50,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb11015ce316b79a714f84 HTTP/1.1" 200 None 2026-05-08 09:59:50,253 - lava_callback - ERROR - Error processing callback for node 69fb11015ce316b79a714f84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35580 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:00:13,377 - lava_callback - INFO - Received callback for node 69fdaf84e98225c4a2047b19 INFO: 172.21.0.1:55760 - "POST /node/69fdaf84e98225c4a2047b19 HTTP/1.0" 202 Accepted 2026-05-08 10:00:13,386 - lava_callback - INFO - Starting async job submit for node 69fdaf84e98225c4a2047b19 2026-05-08 10:00:13,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:00:13,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdaf84e98225c4a2047b19 HTTP/1.1" 200 None 2026-05-08 10:00:13,456 - lava_callback - DEBUG - Processing node 69fdaf84e98225c4a2047b19: baseline-nfs-arm64 2026-05-08 10:00:14,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:00:14,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:00:14,663 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdaf84e98225c4a2047b19/log.txt.gz INFO: 172.21.0.1:55766 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-08 10:00:15,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:00:15,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:00:15,484 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdaf84e98225c4a2047b19/lava-logs.yaml 2026-05-08 10:00:15,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:00:15,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:00:15,686 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdaf84e98225c4a2047b19/lava_callback.json.gz DEBUG: Setup failed for 69fdaf84e98225c4a2047b19. Transitting job node result: incomplete -> fail 2026-05-08 10:00:15,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:00:15,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdaf84e98225c4a2047b19 HTTP/1.1" 200 None 2026-05-08 10:00:15,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:00:15,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:00:15,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:00:15,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdaf84e98225c4a2047b19 HTTP/1.1" 200 None 2026-05-08 10:00:15,958 - lava_callback - INFO - Completed processing callback for node 69fdaf84e98225c4a2047b19 INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44274 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:00:40,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:00:40,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33132 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:02:10,428 - lava_callback - INFO - Received callback for node 69fb11965ce316b79a714fca INFO: 172.21.0.1:44252 - "POST /node/69fb11965ce316b79a714fca HTTP/1.0" 202 Accepted 2026-05-08 10:02:10,435 - lava_callback - INFO - Starting async job submit for node 69fb11965ce316b79a714fca 2026-05-08 10:02:10,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:02:10,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb11965ce316b79a714fca HTTP/1.1" 200 None 2026-05-08 10:02:10,454 - lava_callback - DEBUG - Processing node 69fb11965ce316b79a714fca: baseline-arm64-baylibre 2026-05-08 10:02:10,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb11965ce316b79a714fca 2026-05-08 10:02:10,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:02:10,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb11965ce316b79a714fca HTTP/1.1" 200 None 2026-05-08 10:02:10,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:02:10,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-08 10:02:10,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:02:10,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb11965ce316b79a714fca HTTP/1.1" 200 None 2026-05-08 10:02:10,526 - lava_callback - ERROR - Error processing callback for node 69fb11965ce316b79a714fca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:03:30,361 - lava_callback - INFO - Received callback for node 69fb11e05ce316b79a714ff2 INFO: 172.21.0.1:39428 - "POST /node/69fb11e05ce316b79a714ff2 HTTP/1.0" 202 Accepted 2026-05-08 10:03:30,367 - lava_callback - INFO - Starting async job submit for node 69fb11e05ce316b79a714ff2 2026-05-08 10:03:30,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:03:30,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb11e05ce316b79a714ff2 HTTP/1.1" 200 None 2026-05-08 10:03:30,391 - lava_callback - DEBUG - Processing node 69fb11e05ce316b79a714ff2: baseline-arm64-baylibre 2026-05-08 10:03:30,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb11e05ce316b79a714ff2 2026-05-08 10:03:30,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:03:30,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb11e05ce316b79a714ff2 HTTP/1.1" 200 None 2026-05-08 10:03:30,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:03:30,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-08 10:03:30,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:03:30,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb11e05ce316b79a714ff2 HTTP/1.1" 200 None 2026-05-08 10:03:30,446 - lava_callback - ERROR - Error processing callback for node 69fb11e05ce316b79a714ff2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:04:30,370 - lava_callback - INFO - Received callback for node 69fb122b5ce316b79a71500f INFO: 172.21.0.1:37196 - "POST /node/69fb122b5ce316b79a71500f HTTP/1.0" 202 Accepted 2026-05-08 10:04:30,376 - lava_callback - INFO - Starting async job submit for node 69fb122b5ce316b79a71500f 2026-05-08 10:04:30,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:04:30,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb122b5ce316b79a71500f HTTP/1.1" 200 None 2026-05-08 10:04:30,391 - lava_callback - DEBUG - Processing node 69fb122b5ce316b79a71500f: baseline-arm64-baylibre 2026-05-08 10:04:30,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb122b5ce316b79a71500f 2026-05-08 10:04:30,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:04:30,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb122b5ce316b79a71500f HTTP/1.1" 200 None 2026-05-08 10:04:30,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:04:30,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-08 10:04:30,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:04:30,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb122b5ce316b79a71500f HTTP/1.1" 200 None 2026-05-08 10:04:30,443 - lava_callback - ERROR - Error processing callback for node 69fb122b5ce316b79a71500f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51232 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:05:50,555 - lava_callback - INFO - Received callback for node 69fb12765ce316b79a715032 INFO: 172.21.0.1:47956 - "POST /node/69fb12765ce316b79a715032 HTTP/1.0" 202 Accepted 2026-05-08 10:05:50,562 - lava_callback - INFO - Starting async job submit for node 69fb12765ce316b79a715032 2026-05-08 10:05:50,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:05:50,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb12765ce316b79a715032 HTTP/1.1" 200 None 2026-05-08 10:05:50,577 - lava_callback - DEBUG - Processing node 69fb12765ce316b79a715032: baseline-arm64-baylibre 2026-05-08 10:05:50,577 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb12765ce316b79a715032 2026-05-08 10:05:50,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:05:50,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb12765ce316b79a715032 HTTP/1.1" 200 None 2026-05-08 10:05:50,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:05:50,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-08 10:05:50,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:05:50,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb12765ce316b79a715032 HTTP/1.1" 200 None 2026-05-08 10:05:50,630 - lava_callback - ERROR - Error processing callback for node 69fb12765ce316b79a715032: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:07:19,528 - lava_callback - INFO - Received callback for node 69fb12c55ce316b79a715050 INFO: 172.21.0.1:56652 - "POST /node/69fb12c55ce316b79a715050 HTTP/1.0" 202 Accepted 2026-05-08 10:07:19,535 - lava_callback - INFO - Starting async job submit for node 69fb12c55ce316b79a715050 2026-05-08 10:07:19,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:07:19,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb12c55ce316b79a715050 HTTP/1.1" 200 None 2026-05-08 10:07:19,554 - lava_callback - DEBUG - Processing node 69fb12c55ce316b79a715050: baseline-arm64-clabbe 2026-05-08 10:07:19,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb12c55ce316b79a715050 2026-05-08 10:07:19,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:07:19,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb12c55ce316b79a715050 HTTP/1.1" 200 None 2026-05-08 10:07:19,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:07:19,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-08 10:07:19,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:07:19,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb12c55ce316b79a715050 HTTP/1.1" 200 None 2026-05-08 10:07:19,618 - lava_callback - ERROR - Error processing callback for node 69fb12c55ce316b79a715050: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34086 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:08:22,348 - lava_callback - INFO - Received callback for node 69fdb456e98225c4a2047d4c INFO: 172.21.0.1:40916 - "POST /node/69fdb456e98225c4a2047d4c HTTP/1.0" 202 Accepted 2026-05-08 10:08:22,356 - lava_callback - INFO - Starting async job submit for node 69fdb456e98225c4a2047d4c 2026-05-08 10:08:22,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:08:22,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb456e98225c4a2047d4c HTTP/1.1" 200 None 2026-05-08 10:08:22,411 - lava_callback - DEBUG - Processing node 69fdb456e98225c4a2047d4c: baseline-arm64 2026-05-08 10:08:22,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:08:22,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:08:22,926 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb456e98225c4a2047d4c/log.txt.gz 2026-05-08 10:08:23,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:08:23,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:08:23,316 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb456e98225c4a2047d4c/lava-logs.yaml 2026-05-08 10:08:23,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:08:23,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:08:23,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb456e98225c4a2047d4c/lava_callback.json.gz DEBUG: Setup failed for 69fdb456e98225c4a2047d4c. Transitting job node result: incomplete -> fail 2026-05-08 10:08:23,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:08:23,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb456e98225c4a2047d4c HTTP/1.1" 200 None 2026-05-08 10:08:23,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:08:23,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:08:23,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:08:23,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb456e98225c4a2047d4c HTTP/1.1" 200 None 2026-05-08 10:08:23,661 - lava_callback - INFO - Completed processing callback for node 69fdb456e98225c4a2047d4c INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57498 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:08:40,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:08:40,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49880 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:12:29,168 - lava_callback - INFO - Received callback for node 69fda2b0e98225c4a2046e19 INFO: 172.21.0.1:49884 - "POST /node/69fda2b0e98225c4a2046e19 HTTP/1.0" 202 Accepted 2026-05-08 10:12:29,174 - lava_callback - INFO - Starting async job submit for node 69fda2b0e98225c4a2046e19 2026-05-08 10:12:29,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:12:29,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2b0e98225c4a2046e19 HTTP/1.1" 200 None 2026-05-08 10:12:29,236 - lava_callback - DEBUG - Processing node 69fda2b0e98225c4a2046e19: baseline-arm64-broonie 2026-05-08 10:12:29,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:12:29,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:12:29,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2b0e98225c4a2046e19/log.txt.gz 2026-05-08 10:12:29,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:12:29,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:12:29,898 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2b0e98225c4a2046e19/lava-logs.yaml 2026-05-08 10:12:29,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:12:29,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:12:30,001 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2b0e98225c4a2046e19/lava_callback.json.gz 2026-05-08 10:12:30,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:12:30,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2b0e98225c4a2046e19 HTTP/1.1" 200 None 2026-05-08 10:12:30,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:12:30,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:12:30,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:12:30,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2b0e98225c4a2046e19 HTTP/1.1" 200 None 2026-05-08 10:12:30,074 - lava_callback - INFO - Completed processing callback for node 69fda2b0e98225c4a2046e19 INFO: 172.21.0.1:52712 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:12:40,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:12:40,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60726 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:13:39,795 - lava_callback - INFO - Received callback for node 69fb143e5ce316b79a71510c INFO: 172.21.0.1:58634 - "POST /node/69fb143e5ce316b79a71510c HTTP/1.0" 202 Accepted 2026-05-08 10:13:39,802 - lava_callback - INFO - Starting async job submit for node 69fb143e5ce316b79a71510c 2026-05-08 10:13:39,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:13:39,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb143e5ce316b79a71510c HTTP/1.1" 200 None 2026-05-08 10:13:39,827 - lava_callback - DEBUG - Processing node 69fb143e5ce316b79a71510c: baseline-arm64-clabbe 2026-05-08 10:13:39,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb143e5ce316b79a71510c 2026-05-08 10:13:39,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:13:39,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb143e5ce316b79a71510c HTTP/1.1" 200 None 2026-05-08 10:13:39,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:13:39,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-08 10:13:39,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:13:39,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb143e5ce316b79a71510c HTTP/1.1" 200 None 2026-05-08 10:13:39,891 - lava_callback - ERROR - Error processing callback for node 69fb143e5ce316b79a71510c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:14:39,960 - lava_callback - INFO - Received callback for node 69fb14895ce316b79a71512b INFO: 172.21.0.1:44904 - "POST /node/69fb14895ce316b79a71512b HTTP/1.0" 202 Accepted 2026-05-08 10:14:39,966 - lava_callback - INFO - Starting async job submit for node 69fb14895ce316b79a71512b 2026-05-08 10:14:39,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:14:39,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb14895ce316b79a71512b HTTP/1.1" 200 None 2026-05-08 10:14:39,983 - lava_callback - DEBUG - Processing node 69fb14895ce316b79a71512b: baseline-arm64-clabbe 2026-05-08 10:14:39,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb14895ce316b79a71512b 2026-05-08 10:14:39,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:14:40,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb14895ce316b79a71512b HTTP/1.1" 200 None 2026-05-08 10:14:40,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:14:40,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-08 10:14:40,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:14:40,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb14895ce316b79a71512b HTTP/1.1" 200 None 2026-05-08 10:14:40,037 - lava_callback - ERROR - Error processing callback for node 69fb14895ce316b79a71512b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:15:47,852 - lava_callback - INFO - Received callback for node 69fdb7b9e98225c4a2047edf INFO: 172.21.0.1:60952 - "POST /node/69fdb7b9e98225c4a2047edf HTTP/1.0" 202 Accepted 2026-05-08 10:15:47,859 - lava_callback - INFO - Starting async job submit for node 69fdb7b9e98225c4a2047edf 2026-05-08 10:15:47,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:15:47,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb7b9e98225c4a2047edf HTTP/1.1" 200 None 2026-05-08 10:15:47,878 - lava_callback - DEBUG - Processing node 69fdb7b9e98225c4a2047edf: baseline-nfs-arm64 2026-05-08 10:15:47,879 - lava_callback - WARNING - Failed to upload log 2026-05-08 10:15:47,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:15:47,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:15:47,966 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdb7b9e98225c4a2047edf/lava-logs.yaml 2026-05-08 10:15:47,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:15:48,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:15:48,076 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdb7b9e98225c4a2047edf/lava_callback.json.gz 2026-05-08 10:15:48,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:15:48,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb7b9e98225c4a2047edf HTTP/1.1" 200 None 2026-05-08 10:15:48,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:15:48,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:15:48,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:15:48,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb7b9e98225c4a2047edf HTTP/1.1" 200 None 2026-05-08 10:15:48,135 - lava_callback - INFO - Completed processing callback for node 69fdb7b9e98225c4a2047edf INFO: 172.21.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:16:10,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:16:10,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39706 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:17:19,857 - lava_callback - INFO - Received callback for node 69fb151f5ce316b79a715173 INFO: 172.21.0.1:57986 - "POST /node/69fb151f5ce316b79a715173 HTTP/1.0" 202 Accepted 2026-05-08 10:17:19,863 - lava_callback - INFO - Starting async job submit for node 69fb151f5ce316b79a715173 2026-05-08 10:17:19,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:17:19,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb151f5ce316b79a715173 HTTP/1.1" 200 None 2026-05-08 10:17:19,877 - lava_callback - DEBUG - Processing node 69fb151f5ce316b79a715173: baseline-arm64-clabbe 2026-05-08 10:17:19,878 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb151f5ce316b79a715173 2026-05-08 10:17:19,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:17:19,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb151f5ce316b79a715173 HTTP/1.1" 200 None 2026-05-08 10:17:19,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:17:19,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-08 10:17:19,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:17:19,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb151f5ce316b79a715173 HTTP/1.1" 200 None 2026-05-08 10:17:19,922 - lava_callback - ERROR - Error processing callback for node 69fb151f5ce316b79a715173: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49238 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:18:17,470 - lava_callback - INFO - Received callback for node 69fdb82ae98225c4a2047f0e INFO: 172.21.0.1:49252 - "POST /node/69fdb82ae98225c4a2047f0e HTTP/1.0" 202 Accepted 2026-05-08 10:18:17,477 - lava_callback - INFO - Starting async job submit for node 69fdb82ae98225c4a2047f0e 2026-05-08 10:18:17,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:18:17,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb82ae98225c4a2047f0e HTTP/1.1" 200 None 2026-05-08 10:18:17,529 - lava_callback - DEBUG - Processing node 69fdb82ae98225c4a2047f0e: baseline-arm64 2026-05-08 10:18:17,662 - lava_callback - WARNING - Failed to upload log 2026-05-08 10:18:17,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:18:18,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:18:18,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb82ae98225c4a2047f0e/lava-logs.yaml 2026-05-08 10:18:18,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:18:18,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:18:18,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb82ae98225c4a2047f0e/lava_callback.json.gz 2026-05-08 10:18:18,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:18:18,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb82ae98225c4a2047f0e HTTP/1.1" 200 None 2026-05-08 10:18:18,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:18:18,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:18:18,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:18:18,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb82ae98225c4a2047f0e HTTP/1.1" 200 None 2026-05-08 10:18:18,295 - lava_callback - INFO - Completed processing callback for node 69fdb82ae98225c4a2047f0e INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36124 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:18:40,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:18:40,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:19:52,640 - lava_callback - INFO - Received callback for node 69fdb87be98225c4a2047f30 INFO: 172.21.0.1:39284 - "POST /node/69fdb87be98225c4a2047f30 HTTP/1.0" 202 Accepted 2026-05-08 10:19:52,646 - lava_callback - INFO - Starting async job submit for node 69fdb87be98225c4a2047f30 2026-05-08 10:19:52,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:19:52,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb87be98225c4a2047f30 HTTP/1.1" 200 None 2026-05-08 10:19:52,691 - lava_callback - DEBUG - Processing node 69fdb87be98225c4a2047f30: baseline-arm64 2026-05-08 10:19:52,891 - lava_callback - WARNING - Failed to upload log 2026-05-08 10:19:53,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:19:53,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:19:53,350 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb87be98225c4a2047f30/lava-logs.yaml 2026-05-08 10:19:53,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:19:53,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:19:53,468 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb87be98225c4a2047f30/lava_callback.json.gz 2026-05-08 10:19:53,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:19:53,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb87be98225c4a2047f30 HTTP/1.1" 200 None 2026-05-08 10:19:53,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:19:53,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:19:53,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:19:53,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb87be98225c4a2047f30 HTTP/1.1" 200 None 2026-05-08 10:19:53,623 - lava_callback - INFO - Completed processing callback for node 69fdb87be98225c4a2047f30 INFO: 172.21.0.1:39292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:20:10,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:20:10,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42282 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:22:36,958 - lava_callback - INFO - Received callback for node 69fdb53be98225c4a2047de7 INFO: 172.21.0.1:42288 - "POST /node/69fdb53be98225c4a2047de7 HTTP/1.0" 202 Accepted 2026-05-08 10:22:36,965 - lava_callback - INFO - Starting async job submit for node 69fdb53be98225c4a2047de7 2026-05-08 10:22:37,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:22:37,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb53be98225c4a2047de7 HTTP/1.1" 200 None 2026-05-08 10:22:37,034 - lava_callback - DEBUG - Processing node 69fdb53be98225c4a2047de7: baseline-arm 2026-05-08 10:22:37,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:22:37,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:22:37,745 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fdb53be98225c4a2047de7/log.txt.gz 2026-05-08 10:22:38,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:22:38,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:22:38,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fdb53be98225c4a2047de7/lava-logs.yaml 2026-05-08 10:22:38,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:22:38,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:22:38,427 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fdb53be98225c4a2047de7/lava_callback.json.gz DEBUG: Setup failed for 69fdb53be98225c4a2047de7. Transitting job node result: incomplete -> fail 2026-05-08 10:22:38,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:22:38,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb53be98225c4a2047de7 HTTP/1.1" 200 None 2026-05-08 10:22:38,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:22:38,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 10:22:38,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:22:38,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb53be98225c4a2047de7 HTTP/1.1" 200 None 2026-05-08 10:22:38,758 - lava_callback - INFO - Completed processing callback for node 69fdb53be98225c4a2047de7 2026-05-08 10:22:40,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:22:40,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52124 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:26:51,859 - lava_callback - INFO - Received callback for node 69fb17675ce316b79a715297 INFO: 172.21.0.1:47794 - "POST /node/69fb17675ce316b79a715297 HTTP/1.0" 202 Accepted 2026-05-08 10:26:51,865 - lava_callback - INFO - Starting async job submit for node 69fb17675ce316b79a715297 2026-05-08 10:26:51,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:26:51,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb17675ce316b79a715297 HTTP/1.1" 200 None 2026-05-08 10:26:51,880 - lava_callback - DEBUG - Processing node 69fb17675ce316b79a715297: baseline-arm64-baylibre 2026-05-08 10:26:51,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb17675ce316b79a715297 2026-05-08 10:26:51,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:26:51,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb17675ce316b79a715297 HTTP/1.1" 200 None 2026-05-08 10:26:51,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:26:51,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 10:26:51,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:26:51,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb17675ce316b79a715297 HTTP/1.1" 200 None 2026-05-08 10:26:51,940 - lava_callback - ERROR - Error processing callback for node 69fb17675ce316b79a715297: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:28:11,787 - lava_callback - INFO - Received callback for node 69fb17b35ce316b79a7152bb INFO: 172.21.0.1:34724 - "POST /node/69fb17b35ce316b79a7152bb HTTP/1.0" 202 Accepted 2026-05-08 10:28:11,793 - lava_callback - INFO - Starting async job submit for node 69fb17b35ce316b79a7152bb 2026-05-08 10:28:11,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:28:11,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb17b35ce316b79a7152bb HTTP/1.1" 200 None 2026-05-08 10:28:11,810 - lava_callback - DEBUG - Processing node 69fb17b35ce316b79a7152bb: baseline-arm64-baylibre 2026-05-08 10:28:11,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb17b35ce316b79a7152bb 2026-05-08 10:28:11,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:28:11,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb17b35ce316b79a7152bb HTTP/1.1" 200 None 2026-05-08 10:28:11,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:28:11,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 10:28:11,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:28:11,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb17b35ce316b79a7152bb HTTP/1.1" 200 None 2026-05-08 10:28:11,858 - lava_callback - ERROR - Error processing callback for node 69fb17b35ce316b79a7152bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59926 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:29:23,081 - lava_callback - INFO - Received callback for node 69fdb9c8e98225c4a2047fba INFO: 172.21.0.1:34298 - "POST /node/69fdb9c8e98225c4a2047fba HTTP/1.0" 202 Accepted 2026-05-08 10:29:23,088 - lava_callback - INFO - Starting async job submit for node 69fdb9c8e98225c4a2047fba 2026-05-08 10:29:23,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:29:23,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb9c8e98225c4a2047fba HTTP/1.1" 200 None 2026-05-08 10:29:23,154 - lava_callback - DEBUG - Processing node 69fdb9c8e98225c4a2047fba: baseline-arm64 2026-05-08 10:29:23,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:29:23,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:29:23,656 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb9c8e98225c4a2047fba/log.txt.gz 2026-05-08 10:29:23,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:29:24,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:29:24,207 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb9c8e98225c4a2047fba/lava-logs.yaml 2026-05-08 10:29:24,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:29:24,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:29:24,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb9c8e98225c4a2047fba/lava_callback.json.gz DEBUG: Setup failed for 69fdb9c8e98225c4a2047fba. Transitting job node result: incomplete -> fail 2026-05-08 10:29:24,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:29:24,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb9c8e98225c4a2047fba HTTP/1.1" 200 None 2026-05-08 10:29:24,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:29:24,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:29:24,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:29:24,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb9c8e98225c4a2047fba HTTP/1.1" 200 None 2026-05-08 10:29:24,587 - lava_callback - INFO - Completed processing callback for node 69fdb9c8e98225c4a2047fba INFO: 172.21.0.1:34306 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:29:31,912 - lava_callback - INFO - Received callback for node 69fb17fe5ce316b79a7152dc INFO: 172.21.0.1:45924 - "POST /node/69fb17fe5ce316b79a7152dc HTTP/1.0" 202 Accepted 2026-05-08 10:29:31,917 - lava_callback - INFO - Starting async job submit for node 69fb17fe5ce316b79a7152dc 2026-05-08 10:29:31,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:29:31,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb17fe5ce316b79a7152dc HTTP/1.1" 200 None 2026-05-08 10:29:31,932 - lava_callback - DEBUG - Processing node 69fb17fe5ce316b79a7152dc: baseline-arm64-baylibre 2026-05-08 10:29:31,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb17fe5ce316b79a7152dc 2026-05-08 10:29:31,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:29:31,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb17fe5ce316b79a7152dc HTTP/1.1" 200 None 2026-05-08 10:29:31,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:29:31,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 10:29:31,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:29:31,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb17fe5ce316b79a7152dc HTTP/1.1" 200 None 2026-05-08 10:29:31,984 - lava_callback - ERROR - Error processing callback for node 69fb17fe5ce316b79a7152dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:29:40,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:29:40,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44126 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:30:31,760 - lava_callback - INFO - Received callback for node 69fdb8d0e98225c4a2047f50 INFO: 172.21.0.1:40028 - "POST /node/69fdb8d0e98225c4a2047f50 HTTP/1.0" 202 Accepted 2026-05-08 10:30:31,766 - lava_callback - INFO - Starting async job submit for node 69fdb8d0e98225c4a2047f50 2026-05-08 10:30:31,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:30:31,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb8d0e98225c4a2047f50 HTTP/1.1" 200 None 2026-05-08 10:30:31,804 - lava_callback - DEBUG - Processing node 69fdb8d0e98225c4a2047f50: baseline-arm64 2026-05-08 10:30:32,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:30:32,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:30:32,487 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb8d0e98225c4a2047f50/log.txt.gz 2026-05-08 10:30:32,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:30:33,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:30:33,056 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb8d0e98225c4a2047f50/lava-logs.yaml 2026-05-08 10:30:33,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:30:33,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:30:33,198 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdb8d0e98225c4a2047f50/lava_callback.json.gz 2026-05-08 10:30:33,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:30:33,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb8d0e98225c4a2047f50 HTTP/1.1" 200 None 2026-05-08 10:30:33,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:30:33,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:30:33,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:30:33,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb8d0e98225c4a2047f50 HTTP/1.1" 200 None 2026-05-08 10:30:33,364 - lava_callback - INFO - Completed processing callback for node 69fdb8d0e98225c4a2047f50 INFO: 172.21.0.1:40036 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:30:40,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:30:40,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60758 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:30:51,814 - lava_callback - INFO - Received callback for node 69fb18495ce316b79a7152fc INFO: 172.21.0.1:48164 - "POST /node/69fb18495ce316b79a7152fc HTTP/1.0" 202 Accepted 2026-05-08 10:30:51,820 - lava_callback - INFO - Starting async job submit for node 69fb18495ce316b79a7152fc 2026-05-08 10:30:51,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:30:51,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb18495ce316b79a7152fc HTTP/1.1" 200 None 2026-05-08 10:30:51,835 - lava_callback - DEBUG - Processing node 69fb18495ce316b79a7152fc: baseline-arm64-baylibre 2026-05-08 10:30:51,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb18495ce316b79a7152fc 2026-05-08 10:30:51,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:30:51,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb18495ce316b79a7152fc HTTP/1.1" 200 None 2026-05-08 10:30:51,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:30:51,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 10:30:51,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:30:51,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb18495ce316b79a7152fc HTTP/1.1" 200 None 2026-05-08 10:30:51,880 - lava_callback - ERROR - Error processing callback for node 69fb18495ce316b79a7152fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:31:51,828 - lava_callback - INFO - Received callback for node 69fb18955ce316b79a71531e INFO: 172.21.0.1:47238 - "POST /node/69fb18955ce316b79a71531e HTTP/1.0" 202 Accepted 2026-05-08 10:31:51,834 - lava_callback - INFO - Starting async job submit for node 69fb18955ce316b79a71531e 2026-05-08 10:31:51,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:31:51,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb18955ce316b79a71531e HTTP/1.1" 200 None 2026-05-08 10:31:51,849 - lava_callback - DEBUG - Processing node 69fb18955ce316b79a71531e: baseline-arm64-baylibre 2026-05-08 10:31:51,849 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb18955ce316b79a71531e 2026-05-08 10:31:51,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:31:51,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb18955ce316b79a71531e HTTP/1.1" 200 None 2026-05-08 10:31:51,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:31:51,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 10:31:51,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:31:51,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb18955ce316b79a71531e HTTP/1.1" 200 None 2026-05-08 10:31:51,908 - lava_callback - ERROR - Error processing callback for node 69fb18955ce316b79a71531e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:33:12,206 - lava_callback - INFO - Received callback for node 69fb18df5ce316b79a715341 INFO: 172.21.0.1:33842 - "POST /node/69fb18df5ce316b79a715341 HTTP/1.0" 202 Accepted 2026-05-08 10:33:12,211 - lava_callback - INFO - Starting async job submit for node 69fb18df5ce316b79a715341 2026-05-08 10:33:12,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:33:12,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb18df5ce316b79a715341 HTTP/1.1" 200 None 2026-05-08 10:33:12,226 - lava_callback - DEBUG - Processing node 69fb18df5ce316b79a715341: baseline-arm64-baylibre 2026-05-08 10:33:12,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb18df5ce316b79a715341 2026-05-08 10:33:12,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:33:12,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb18df5ce316b79a715341 HTTP/1.1" 200 None 2026-05-08 10:33:12,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:33:12,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 10:33:12,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:33:12,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb18df5ce316b79a715341 HTTP/1.1" 200 None 2026-05-08 10:33:12,286 - lava_callback - ERROR - Error processing callback for node 69fb18df5ce316b79a715341: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40152 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:34:40,625 - lava_callback - INFO - Received callback for node 69fb192e5ce316b79a715364 INFO: 172.21.0.1:59424 - "POST /node/69fb192e5ce316b79a715364 HTTP/1.0" 202 Accepted 2026-05-08 10:34:40,631 - lava_callback - INFO - Starting async job submit for node 69fb192e5ce316b79a715364 2026-05-08 10:34:40,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:34:40,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb192e5ce316b79a715364 HTTP/1.1" 200 None 2026-05-08 10:34:40,647 - lava_callback - DEBUG - Processing node 69fb192e5ce316b79a715364: baseline-arm64-clabbe 2026-05-08 10:34:40,647 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb192e5ce316b79a715364 2026-05-08 10:34:40,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:34:40,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb192e5ce316b79a715364 HTTP/1.1" 200 None 2026-05-08 10:34:40,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:34:40,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 10:34:40,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:34:40,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb192e5ce316b79a715364 HTTP/1.1" 200 None 2026-05-08 10:34:40,705 - lava_callback - ERROR - Error processing callback for node 69fb192e5ce316b79a715364: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59454 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:34:46,933 - lava_callback - INFO - Received callback for node 69fdb927e98225c4a2047f71 INFO: 172.21.0.1:59468 - "POST /node/69fdb927e98225c4a2047f71 HTTP/1.0" 202 Accepted 2026-05-08 10:34:46,941 - lava_callback - INFO - Starting async job submit for node 69fdb927e98225c4a2047f71 2026-05-08 10:34:46,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:34:46,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb927e98225c4a2047f71 HTTP/1.1" 200 None 2026-05-08 10:34:46,984 - lava_callback - DEBUG - Processing node 69fdb927e98225c4a2047f71: baseline-nfs-arm64 2026-05-08 10:34:47,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:34:47,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:34:47,666 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdb927e98225c4a2047f71/log.txt.gz 2026-05-08 10:34:47,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:34:48,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:34:48,081 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdb927e98225c4a2047f71/lava-logs.yaml 2026-05-08 10:34:48,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:34:48,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:34:48,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdb927e98225c4a2047f71/lava_callback.json.gz 2026-05-08 10:34:48,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:34:48,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb927e98225c4a2047f71 HTTP/1.1" 200 None 2026-05-08 10:34:48,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:34:48,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:34:48,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:34:48,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb927e98225c4a2047f71 HTTP/1.1" 200 None 2026-05-08 10:34:48,324 - lava_callback - INFO - Completed processing callback for node 69fdb927e98225c4a2047f71 INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:35:10,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:35:10,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58700 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:35:40,620 - lava_callback - INFO - Received callback for node 69fb19785ce316b79a715383 INFO: 172.21.0.1:56894 - "POST /node/69fb19785ce316b79a715383 HTTP/1.0" 202 Accepted 2026-05-08 10:35:40,630 - lava_callback - INFO - Starting async job submit for node 69fb19785ce316b79a715383 2026-05-08 10:35:40,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:35:40,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb19785ce316b79a715383 HTTP/1.1" 200 None 2026-05-08 10:35:40,646 - lava_callback - DEBUG - Processing node 69fb19785ce316b79a715383: baseline-arm64-clabbe 2026-05-08 10:35:40,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb19785ce316b79a715383 2026-05-08 10:35:40,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:35:40,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb19785ce316b79a715383 HTTP/1.1" 200 None 2026-05-08 10:35:40,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:35:40,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 10:35:40,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:35:40,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb19785ce316b79a715383 HTTP/1.1" 200 None 2026-05-08 10:35:40,698 - lava_callback - ERROR - Error processing callback for node 69fb19785ce316b79a715383: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:36:08,273 - lava_callback - INFO - Received callback for node 69fdb80fe98225c4a2047f03 INFO: 172.21.0.1:40368 - "POST /node/69fdb80fe98225c4a2047f03 HTTP/1.0" 202 Accepted 2026-05-08 10:36:08,321 - lava_callback - INFO - Starting async job submit for node 69fdb80fe98225c4a2047f03 2026-05-08 10:36:08,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:36:08,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb80fe98225c4a2047f03 HTTP/1.1" 200 None 2026-05-08 10:36:08,390 - lava_callback - DEBUG - Processing node 69fdb80fe98225c4a2047f03: baseline-arm-pengutronix 2026-05-08 10:36:08,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:36:08,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:36:08,613 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fdb80fe98225c4a2047f03/log.txt.gz 2026-05-08 10:36:08,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:36:08,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:36:08,811 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fdb80fe98225c4a2047f03/lava-logs.yaml 2026-05-08 10:36:08,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:36:08,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:36:08,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fdb80fe98225c4a2047f03/lava_callback.json.gz DEBUG: Setup failed for 69fdb80fe98225c4a2047f03. Transitting job node result: incomplete -> fail 2026-05-08 10:36:08,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:36:08,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb80fe98225c4a2047f03 HTTP/1.1" 200 None 2026-05-08 10:36:08,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:36:08,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 10:36:08,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:36:09,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb80fe98225c4a2047f03 HTTP/1.1" 200 None 2026-05-08 10:36:09,087 - lava_callback - INFO - Completed processing callback for node 69fdb80fe98225c4a2047f03 2026-05-08 10:36:11,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:36:11,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 10:36:14,097 - lava_callback - INFO - Received callback for node 69fda2ade98225c4a2046e13 INFO: 172.21.0.1:41534 - "POST /node/69fda2ade98225c4a2046e13 HTTP/1.0" 202 Accepted 2026-05-08 10:36:14,103 - lava_callback - INFO - Starting async job submit for node 69fda2ade98225c4a2046e13 2026-05-08 10:36:14,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:36:14,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2ade98225c4a2046e13 HTTP/1.1" 200 None 2026-05-08 10:36:14,141 - lava_callback - DEBUG - Processing node 69fda2ade98225c4a2046e13: baseline-arm64-broonie 2026-05-08 10:36:14,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:36:14,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:36:14,470 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2ade98225c4a2046e13/log.txt.gz 2026-05-08 10:36:14,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:36:14,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:36:14,764 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2ade98225c4a2046e13/lava-logs.yaml 2026-05-08 10:36:14,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:36:14,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:36:14,895 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2ade98225c4a2046e13/lava_callback.json.gz 2026-05-08 10:36:14,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:36:14,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2ade98225c4a2046e13 HTTP/1.1" 200 None 2026-05-08 10:36:14,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:36:14,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:36:14,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:36:14,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2ade98225c4a2046e13 HTTP/1.1" 200 None 2026-05-08 10:36:14,979 - lava_callback - INFO - Completed processing callback for node 69fda2ade98225c4a2046e13 INFO: 172.21.0.1:41548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:36:41,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:36:41,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40102 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:37:00,674 - lava_callback - INFO - Received callback for node 69fb19c35ce316b79a7153a7 INFO: 172.21.0.1:60700 - "POST /node/69fb19c35ce316b79a7153a7 HTTP/1.0" 202 Accepted 2026-05-08 10:37:00,680 - lava_callback - INFO - Starting async job submit for node 69fb19c35ce316b79a7153a7 2026-05-08 10:37:00,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:37:00,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb19c35ce316b79a7153a7 HTTP/1.1" 200 None 2026-05-08 10:37:00,703 - lava_callback - DEBUG - Processing node 69fb19c35ce316b79a7153a7: baseline-arm64-clabbe 2026-05-08 10:37:00,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb19c35ce316b79a7153a7 2026-05-08 10:37:00,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:37:00,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb19c35ce316b79a7153a7 HTTP/1.1" 200 None 2026-05-08 10:37:00,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:37:00,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 10:37:00,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:37:00,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb19c35ce316b79a7153a7 HTTP/1.1" 200 None 2026-05-08 10:37:00,747 - lava_callback - ERROR - Error processing callback for node 69fb19c35ce316b79a7153a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:38:20,682 - lava_callback - INFO - Received callback for node 69fb1a0e5ce316b79a7153c5 INFO: 172.21.0.1:46084 - "POST /node/69fb1a0e5ce316b79a7153c5 HTTP/1.0" 202 Accepted 2026-05-08 10:38:20,688 - lava_callback - INFO - Starting async job submit for node 69fb1a0e5ce316b79a7153c5 2026-05-08 10:38:20,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:38:20,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb1a0e5ce316b79a7153c5 HTTP/1.1" 200 None 2026-05-08 10:38:20,703 - lava_callback - DEBUG - Processing node 69fb1a0e5ce316b79a7153c5: baseline-arm64-clabbe 2026-05-08 10:38:20,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb1a0e5ce316b79a7153c5 2026-05-08 10:38:20,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:38:20,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb1a0e5ce316b79a7153c5 HTTP/1.1" 200 None 2026-05-08 10:38:20,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:38:20,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 10:38:20,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:38:20,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb1a0e5ce316b79a7153c5 HTTP/1.1" 200 None 2026-05-08 10:38:20,754 - lava_callback - ERROR - Error processing callback for node 69fb1a0e5ce316b79a7153c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:39:40,741 - lava_callback - INFO - Received callback for node 69fb1a5a5ce316b79a7153e8 INFO: 172.21.0.1:59396 - "POST /node/69fb1a5a5ce316b79a7153e8 HTTP/1.0" 202 Accepted 2026-05-08 10:39:40,747 - lava_callback - INFO - Starting async job submit for node 69fb1a5a5ce316b79a7153e8 2026-05-08 10:39:40,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:39:40,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb1a5a5ce316b79a7153e8 HTTP/1.1" 200 None 2026-05-08 10:39:40,762 - lava_callback - DEBUG - Processing node 69fb1a5a5ce316b79a7153e8: baseline-arm64-clabbe 2026-05-08 10:39:40,762 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb1a5a5ce316b79a7153e8 2026-05-08 10:39:40,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:39:40,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb1a5a5ce316b79a7153e8 HTTP/1.1" 200 None 2026-05-08 10:39:40,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:39:40,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 10:39:40,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:39:40,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb1a5a5ce316b79a7153e8 HTTP/1.1" 200 None 2026-05-08 10:39:40,807 - lava_callback - ERROR - Error processing callback for node 69fb1a5a5ce316b79a7153e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:40:40,803 - lava_callback - INFO - Received callback for node 69fb1aa45ce316b79a715411 INFO: 172.21.0.1:57120 - "POST /node/69fb1aa45ce316b79a715411 HTTP/1.0" 202 Accepted 2026-05-08 10:40:40,808 - lava_callback - INFO - Starting async job submit for node 69fb1aa45ce316b79a715411 2026-05-08 10:40:40,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:40:40,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb1aa45ce316b79a715411 HTTP/1.1" 200 None 2026-05-08 10:40:40,825 - lava_callback - DEBUG - Processing node 69fb1aa45ce316b79a715411: baseline-arm64-clabbe 2026-05-08 10:40:40,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb1aa45ce316b79a715411 2026-05-08 10:40:40,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:40:40,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb1aa45ce316b79a715411 HTTP/1.1" 200 None 2026-05-08 10:40:40,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:40:40,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f85604a8609de22f0a4574 HTTP/1.1" 200 None 2026-05-08 10:40:40,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:40:40,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb1aa45ce316b79a715411 HTTP/1.1" 200 None 2026-05-08 10:40:40,873 - lava_callback - ERROR - Error processing callback for node 69fb1aa45ce316b79a715411: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:42:36,206 - lava_callback - INFO - Received callback for node 69fdb976e98225c4a2047f9b INFO: 172.21.0.1:35866 - "POST /node/69fdb976e98225c4a2047f9b HTTP/1.0" 202 Accepted 2026-05-08 10:42:36,214 - lava_callback - INFO - Starting async job submit for node 69fdb976e98225c4a2047f9b 2026-05-08 10:42:36,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:42:36,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb976e98225c4a2047f9b HTTP/1.1" 200 None 2026-05-08 10:42:36,273 - lava_callback - DEBUG - Processing node 69fdb976e98225c4a2047f9b: baseline-nfs-arm64 INFO: 172.21.0.1:35872 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:42:37,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:42:37,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:42:37,562 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdb976e98225c4a2047f9b/log.txt.gz 2026-05-08 10:42:38,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:42:38,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:42:38,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdb976e98225c4a2047f9b/lava-logs.yaml 2026-05-08 10:42:38,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:42:38,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:42:38,471 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdb976e98225c4a2047f9b/lava_callback.json.gz DEBUG: Setup failed for 69fdb976e98225c4a2047f9b. Transitting job node result: incomplete -> fail 2026-05-08 10:42:38,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:42:38,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb976e98225c4a2047f9b HTTP/1.1" 200 None 2026-05-08 10:42:38,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:42:38,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:42:38,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:42:38,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb976e98225c4a2047f9b HTTP/1.1" 200 None 2026-05-08 10:42:38,697 - lava_callback - INFO - Completed processing callback for node 69fdb976e98225c4a2047f9b 2026-05-08 10:42:41,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:42:41,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44798 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:42:50,785 - lava_callback - INFO - Received callback for node 69fdb7afe98225c4a2047edc INFO: 172.21.0.1:46094 - "POST /node/69fdb7afe98225c4a2047edc HTTP/1.0" 202 Accepted 2026-05-08 10:42:50,793 - lava_callback - INFO - Starting async job submit for node 69fdb7afe98225c4a2047edc 2026-05-08 10:42:50,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:42:50,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb7afe98225c4a2047edc HTTP/1.1" 200 None 2026-05-08 10:42:50,903 - lava_callback - DEBUG - Processing node 69fdb7afe98225c4a2047edc: ltp-smoke 2026-05-08 10:42:51,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:42:51,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:42:51,564 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fdb7afe98225c4a2047edc/log.txt.gz 2026-05-08 10:42:51,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:42:52,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:42:52,006 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fdb7afe98225c4a2047edc/lava-logs.yaml 2026-05-08 10:42:52,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:42:52,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:42:52,132 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fdb7afe98225c4a2047edc/lava_callback.json.gz 2026-05-08 10:42:52,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:42:52,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdb7afe98225c4a2047edc HTTP/1.1" 200 None 2026-05-08 10:42:52,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:42:52,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c90e98225c4a20469a4 HTTP/1.1" 200 None 2026-05-08 10:42:52,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:42:52,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdb7afe98225c4a2047edc HTTP/1.1" 200 None 2026-05-08 10:42:52,445 - lava_callback - INFO - Completed processing callback for node 69fdb7afe98225c4a2047edc INFO: 172.21.0.1:46110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34492 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:43:11,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:43:11,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-08 10:43:12,135 - lava_callback - INFO - Received callback for node 69fdbb75e98225c4a204804a INFO: 172.21.0.1:59556 - "POST /node/69fdbb75e98225c4a204804a HTTP/1.0" 202 Accepted 2026-05-08 10:43:12,142 - lava_callback - INFO - Starting async job submit for node 69fdbb75e98225c4a204804a 2026-05-08 10:43:12,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:43:12,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdbb75e98225c4a204804a HTTP/1.1" 200 None 2026-05-08 10:43:12,185 - lava_callback - DEBUG - Processing node 69fdbb75e98225c4a204804a: baseline-arm64 2026-05-08 10:43:12,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:43:12,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:43:12,947 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdbb75e98225c4a204804a/log.txt.gz 2026-05-08 10:43:13,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:43:13,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:43:13,341 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdbb75e98225c4a204804a/lava-logs.yaml 2026-05-08 10:43:13,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:43:13,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:43:13,485 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fdbb75e98225c4a204804a/lava_callback.json.gz 2026-05-08 10:43:13,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:43:13,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdbb75e98225c4a204804a HTTP/1.1" 200 None 2026-05-08 10:43:13,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:43:13,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:43:13,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:43:13,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdbb75e98225c4a204804a HTTP/1.1" 200 None 2026-05-08 10:43:13,607 - lava_callback - INFO - Completed processing callback for node 69fdbb75e98225c4a204804a INFO: 172.21.0.1:59562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:43:22,825 - lava_callback - INFO - Received callback for node 69fdba19e98225c4a2047fd5 INFO: 172.21.0.1:32806 - "POST /node/69fdba19e98225c4a2047fd5 HTTP/1.0" 202 Accepted 2026-05-08 10:43:22,832 - lava_callback - INFO - Starting async job submit for node 69fdba19e98225c4a2047fd5 2026-05-08 10:43:22,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:43:22,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdba19e98225c4a2047fd5 HTTP/1.1" 200 None 2026-05-08 10:43:22,957 - lava_callback - DEBUG - Processing node 69fdba19e98225c4a2047fd5: baseline-arm 2026-05-08 10:43:23,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:43:23,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:43:23,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fdba19e98225c4a2047fd5/log.txt.gz 2026-05-08 10:43:24,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:43:24,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:43:24,317 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fdba19e98225c4a2047fd5/lava-logs.yaml 2026-05-08 10:43:24,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:43:24,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:43:24,445 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fdba19e98225c4a2047fd5/lava_callback.json.gz DEBUG: Setup failed for 69fdba19e98225c4a2047fd5. Transitting job node result: incomplete -> fail 2026-05-08 10:43:24,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:43:24,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdba19e98225c4a2047fd5 HTTP/1.1" 200 None 2026-05-08 10:43:24,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:43:24,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 10:43:24,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:43:24,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdba19e98225c4a2047fd5 HTTP/1.1" 200 None 2026-05-08 10:43:24,722 - lava_callback - INFO - Completed processing callback for node 69fdba19e98225c4a2047fd5 INFO: 172.21.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50278 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:43:41,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:43:41,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36798 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:49:07,854 - lava_callback - INFO - Received callback for node 69fdbd17e98225c4a20480fb INFO: 172.21.0.1:36806 - "POST /node/69fdbd17e98225c4a20480fb HTTP/1.0" 202 Accepted 2026-05-08 10:49:07,861 - lava_callback - INFO - Starting async job submit for node 69fdbd17e98225c4a20480fb 2026-05-08 10:49:07,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:49:07,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdbd17e98225c4a20480fb HTTP/1.1" 200 None 2026-05-08 10:49:07,910 - lava_callback - DEBUG - Processing node 69fdbd17e98225c4a20480fb: baseline-nfs-arm64 2026-05-08 10:49:08,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:49:08,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:49:08,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdbd17e98225c4a20480fb/log.txt.gz 2026-05-08 10:49:08,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:49:09,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:49:09,025 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdbd17e98225c4a20480fb/lava-logs.yaml 2026-05-08 10:49:09,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:49:09,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:49:09,143 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdbd17e98225c4a20480fb/lava_callback.json.gz 2026-05-08 10:49:09,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:49:09,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdbd17e98225c4a20480fb HTTP/1.1" 200 None 2026-05-08 10:49:09,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:49:09,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:49:09,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:49:09,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdbd17e98225c4a20480fb HTTP/1.1" 200 None 2026-05-08 10:49:09,276 - lava_callback - INFO - Completed processing callback for node 69fdbd17e98225c4a20480fb 2026-05-08 10:49:11,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:49:11,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:52:54,251 - lava_callback - INFO - Received callback for node 69fda2b4e98225c4a2046e22 INFO: 172.21.0.1:44658 - "POST /node/69fda2b4e98225c4a2046e22 HTTP/1.0" 202 Accepted 2026-05-08 10:52:54,257 - lava_callback - INFO - Starting async job submit for node 69fda2b4e98225c4a2046e22 2026-05-08 10:52:54,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:52:54,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2b4e98225c4a2046e22 HTTP/1.1" 200 None 2026-05-08 10:52:54,296 - lava_callback - DEBUG - Processing node 69fda2b4e98225c4a2046e22: baseline-arm64-broonie 2026-05-08 10:52:54,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:52:54,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:52:54,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2b4e98225c4a2046e22/log.txt.gz 2026-05-08 10:52:54,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:52:54,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:52:54,932 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2b4e98225c4a2046e22/lava-logs.yaml 2026-05-08 10:52:54,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 10:52:55,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 10:52:55,028 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fda2b4e98225c4a2046e22/lava_callback.json.gz 2026-05-08 10:52:55,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:52:55,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fda2b4e98225c4a2046e22 HTTP/1.1" 200 None 2026-05-08 10:52:55,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:52:55,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 10:52:55,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:52:55,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fda2b4e98225c4a2046e22 HTTP/1.1" 200 None 2026-05-08 10:52:55,105 - lava_callback - INFO - Completed processing callback for node 69fda2b4e98225c4a2046e22 INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:53:11,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:53:11,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51020 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:55:33,345 - lava_callback - INFO - Received callback for node 69fb1e105ce316b79a71556a INFO: 172.21.0.1:57992 - "POST /node/69fb1e105ce316b79a71556a HTTP/1.0" 202 Accepted 2026-05-08 10:55:33,351 - lava_callback - INFO - Starting async job submit for node 69fb1e105ce316b79a71556a 2026-05-08 10:55:33,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:55:33,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb1e105ce316b79a71556a HTTP/1.1" 200 None 2026-05-08 10:55:33,366 - lava_callback - DEBUG - Processing node 69fb1e105ce316b79a71556a: baseline-arm64-baylibre 2026-05-08 10:55:33,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb1e105ce316b79a71556a 2026-05-08 10:55:33,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:55:33,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb1e105ce316b79a71556a HTTP/1.1" 200 None 2026-05-08 10:55:33,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:55:33,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 10:55:33,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:55:33,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb1e105ce316b79a71556a HTTP/1.1" 200 None 2026-05-08 10:55:33,415 - lava_callback - ERROR - Error processing callback for node 69fb1e105ce316b79a71556a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59930 - "GET / HTTP/1.0" 200 OK 2026-05-08 10:57:13,310 - lava_callback - INFO - Received callback for node 69fb1e795ce316b79a71558a INFO: 172.21.0.1:51880 - "POST /node/69fb1e795ce316b79a71558a HTTP/1.0" 202 Accepted 2026-05-08 10:57:13,316 - lava_callback - INFO - Starting async job submit for node 69fb1e795ce316b79a71558a 2026-05-08 10:57:13,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:57:13,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb1e795ce316b79a71558a HTTP/1.1" 200 None 2026-05-08 10:57:13,332 - lava_callback - DEBUG - Processing node 69fb1e795ce316b79a71558a: baseline-arm64-baylibre 2026-05-08 10:57:13,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb1e795ce316b79a71558a 2026-05-08 10:57:13,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:57:13,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb1e795ce316b79a71558a HTTP/1.1" 200 None 2026-05-08 10:57:13,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:57:13,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 10:57:13,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 10:57:13,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb1e795ce316b79a71558a HTTP/1.1" 200 None 2026-05-08 10:57:13,392 - lava_callback - ERROR - Error processing callback for node 69fb1e795ce316b79a71558a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58440 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:03:13,655 - lava_callback - INFO - Received callback for node 69fb1fe45ce316b79a715600 INFO: 172.21.0.1:36208 - "POST /node/69fb1fe45ce316b79a715600 HTTP/1.0" 202 Accepted 2026-05-08 11:03:13,664 - lava_callback - INFO - Starting async job submit for node 69fb1fe45ce316b79a715600 2026-05-08 11:03:13,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:03:13,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb1fe45ce316b79a715600 HTTP/1.1" 200 None 2026-05-08 11:03:13,682 - lava_callback - DEBUG - Processing node 69fb1fe45ce316b79a715600: baseline-arm64-baylibre 2026-05-08 11:03:13,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb1fe45ce316b79a715600 2026-05-08 11:03:13,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:03:13,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb1fe45ce316b79a715600 HTTP/1.1" 200 None 2026-05-08 11:03:13,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:03:13,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 11:03:13,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:03:13,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb1fe45ce316b79a715600 HTTP/1.1" 200 None 2026-05-08 11:03:13,729 - lava_callback - ERROR - Error processing callback for node 69fb1fe45ce316b79a715600: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:06:21,896 - lava_callback - INFO - Received callback for node 69fb209e5ce316b79a715630 INFO: 172.21.0.1:37486 - "POST /node/69fb209e5ce316b79a715630 HTTP/1.0" 202 Accepted 2026-05-08 11:06:21,901 - lava_callback - INFO - Starting async job submit for node 69fb209e5ce316b79a715630 2026-05-08 11:06:21,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:06:21,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb209e5ce316b79a715630 HTTP/1.1" 200 None 2026-05-08 11:06:21,916 - lava_callback - DEBUG - Processing node 69fb209e5ce316b79a715630: baseline-arm64-clabbe 2026-05-08 11:06:21,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb209e5ce316b79a715630 2026-05-08 11:06:21,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:06:21,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb209e5ce316b79a715630 HTTP/1.1" 200 None 2026-05-08 11:06:21,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:06:21,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 11:06:21,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:06:21,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb209e5ce316b79a715630 HTTP/1.1" 200 None 2026-05-08 11:06:21,962 - lava_callback - ERROR - Error processing callback for node 69fb209e5ce316b79a715630: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37012 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:07:51,633 - lava_callback - INFO - Received callback for node 69fdbfdde98225c4a204823b INFO: 172.21.0.1:46396 - "POST /node/69fdbfdde98225c4a204823b HTTP/1.0" 202 Accepted 2026-05-08 11:07:51,639 - lava_callback - INFO - Starting async job submit for node 69fdbfdde98225c4a204823b 2026-05-08 11:07:51,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:07:51,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdbfdde98225c4a204823b HTTP/1.1" 200 None 2026-05-08 11:07:51,713 - lava_callback - DEBUG - Processing node 69fdbfdde98225c4a204823b: ltp-smoke 2026-05-08 11:07:52,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 11:07:52,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 11:07:52,283 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fdbfdde98225c4a204823b/log.txt.gz 2026-05-08 11:07:52,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 11:07:52,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 11:07:52,781 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fdbfdde98225c4a204823b/lava-logs.yaml 2026-05-08 11:07:52,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 11:07:52,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 11:07:52,918 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fdbfdde98225c4a204823b/lava_callback.json.gz 2026-05-08 11:07:53,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:07:53,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdbfdde98225c4a204823b HTTP/1.1" 200 None 2026-05-08 11:07:53,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:07:53,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c90e98225c4a20469a4 HTTP/1.1" 200 None 2026-05-08 11:07:53,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:07:53,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdbfdde98225c4a204823b HTTP/1.1" 200 None 2026-05-08 11:07:53,216 - lava_callback - INFO - Completed processing callback for node 69fdbfdde98225c4a204823b INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48430 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:08:11,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:08:11,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:08:21,949 - lava_callback - INFO - Received callback for node 69fb21155ce316b79a71566e INFO: 172.21.0.1:51880 - "POST /node/69fb21155ce316b79a71566e HTTP/1.0" 202 Accepted 2026-05-08 11:08:21,954 - lava_callback - INFO - Starting async job submit for node 69fb21155ce316b79a71566e 2026-05-08 11:08:21,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:08:21,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb21155ce316b79a71566e HTTP/1.1" 200 None 2026-05-08 11:08:21,969 - lava_callback - DEBUG - Processing node 69fb21155ce316b79a71566e: baseline-arm64-clabbe 2026-05-08 11:08:21,970 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb21155ce316b79a71566e 2026-05-08 11:08:21,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:08:21,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb21155ce316b79a71566e HTTP/1.1" 200 None 2026-05-08 11:08:21,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:08:21,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 11:08:21,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:08:22,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb21155ce316b79a71566e HTTP/1.1" 200 None 2026-05-08 11:08:22,016 - lava_callback - ERROR - Error processing callback for node 69fb21155ce316b79a71566e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-08 11:08:25,356 - lava_callback - INFO - Received callback for node 69fdbf93e98225c4a2048217 INFO: 172.21.0.1:51886 - "POST /node/69fdbf93e98225c4a2048217 HTTP/1.0" 202 Accepted 2026-05-08 11:08:25,364 - lava_callback - INFO - Starting async job submit for node 69fdbf93e98225c4a2048217 2026-05-08 11:08:25,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:08:25,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdbf93e98225c4a2048217 HTTP/1.1" 200 None 2026-05-08 11:08:25,435 - lava_callback - DEBUG - Processing node 69fdbf93e98225c4a2048217: baseline-nfs-arm64 INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:08:26,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 11:08:26,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 11:08:26,671 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdbf93e98225c4a2048217/log.txt.gz 2026-05-08 11:08:27,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 11:08:27,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 11:08:27,416 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdbf93e98225c4a2048217/lava-logs.yaml 2026-05-08 11:08:27,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 11:08:27,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 11:08:27,573 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fdbf93e98225c4a2048217/lava_callback.json.gz DEBUG: Setup failed for 69fdbf93e98225c4a2048217. Transitting job node result: incomplete -> fail 2026-05-08 11:08:27,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:08:27,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdbf93e98225c4a2048217 HTTP/1.1" 200 None 2026-05-08 11:08:27,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:08:27,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c9de98225c4a20469b5 HTTP/1.1" 200 None 2026-05-08 11:08:27,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:08:27,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdbf93e98225c4a2048217 HTTP/1.1" 200 None 2026-05-08 11:08:27,886 - lava_callback - INFO - Completed processing callback for node 69fdbf93e98225c4a2048217 INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:08:41,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:08:41,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:11:22,150 - lava_callback - INFO - Received callback for node 69fb21ca5ce316b79a715698 INFO: 172.21.0.1:42304 - "POST /node/69fb21ca5ce316b79a715698 HTTP/1.0" 202 Accepted 2026-05-08 11:11:22,156 - lava_callback - INFO - Starting async job submit for node 69fb21ca5ce316b79a715698 2026-05-08 11:11:22,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:11:22,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb21ca5ce316b79a715698 HTTP/1.1" 200 None 2026-05-08 11:11:22,171 - lava_callback - DEBUG - Processing node 69fb21ca5ce316b79a715698: baseline-arm64-clabbe 2026-05-08 11:11:22,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb21ca5ce316b79a715698 2026-05-08 11:11:22,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:11:22,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb21ca5ce316b79a715698 HTTP/1.1" 200 None 2026-05-08 11:11:22,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:11:22,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 11:11:22,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:11:22,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb21ca5ce316b79a715698 HTTP/1.1" 200 None 2026-05-08 11:11:22,217 - lava_callback - ERROR - Error processing callback for node 69fb21ca5ce316b79a715698: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:13:22,165 - lava_callback - INFO - Received callback for node 69fb22425ce316b79a7156c1 INFO: 172.21.0.1:46052 - "POST /node/69fb22425ce316b79a7156c1 HTTP/1.0" 202 Accepted 2026-05-08 11:13:22,171 - lava_callback - INFO - Starting async job submit for node 69fb22425ce316b79a7156c1 2026-05-08 11:13:22,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:13:22,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb22425ce316b79a7156c1 HTTP/1.1" 200 None 2026-05-08 11:13:22,188 - lava_callback - DEBUG - Processing node 69fb22425ce316b79a7156c1: baseline-arm64-clabbe 2026-05-08 11:13:22,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb22425ce316b79a7156c1 2026-05-08 11:13:22,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:13:22,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb22425ce316b79a7156c1 HTTP/1.1" 200 None 2026-05-08 11:13:22,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:13:22,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 11:13:22,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:13:22,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb22425ce316b79a7156c1 HTTP/1.1" 200 None 2026-05-08 11:13:22,235 - lava_callback - ERROR - Error processing callback for node 69fb22425ce316b79a7156c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:14:50,462 - lava_callback - INFO - Received callback for node 69fdbdbde98225c4a2048144 INFO: 172.21.0.1:39398 - "POST /node/69fdbdbde98225c4a2048144 HTTP/1.0" 202 Accepted 2026-05-08 11:14:50,509 - lava_callback - INFO - Starting async job submit for node 69fdbdbde98225c4a2048144 2026-05-08 11:14:50,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:14:50,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdbdbde98225c4a2048144 HTTP/1.1" 200 None 2026-05-08 11:14:50,549 - lava_callback - DEBUG - Processing node 69fdbdbde98225c4a2048144: baseline-arm-pengutronix 2026-05-08 11:14:50,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 11:14:50,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 11:14:50,799 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fdbdbde98225c4a2048144/log.txt.gz 2026-05-08 11:14:50,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 11:14:50,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 11:14:50,976 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fdbdbde98225c4a2048144/lava-logs.yaml 2026-05-08 11:14:50,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-08 11:14:51,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-08 11:14:51,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fdbdbde98225c4a2048144/lava_callback.json.gz DEBUG: Setup failed for 69fdbdbde98225c4a2048144. Transitting job node result: incomplete -> fail 2026-05-08 11:14:51,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:14:51,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fdbdbde98225c4a2048144 HTTP/1.1" 200 None 2026-05-08 11:14:51,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:14:51,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9c87e98225c4a204699a HTTP/1.1" 200 None 2026-05-08 11:14:51,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:14:51,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fdbdbde98225c4a2048144 HTTP/1.1" 200 None 2026-05-08 11:14:51,210 - lava_callback - INFO - Completed processing callback for node 69fdbdbde98225c4a2048144 INFO: 172.21.0.1:39404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:15:11,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:15:11,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:16:22,335 - lava_callback - INFO - Received callback for node 69fb22f75ce316b79a7156e9 INFO: 172.21.0.1:53558 - "POST /node/69fb22f75ce316b79a7156e9 HTTP/1.0" 202 Accepted 2026-05-08 11:16:22,341 - lava_callback - INFO - Starting async job submit for node 69fb22f75ce316b79a7156e9 2026-05-08 11:16:22,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:16:22,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb22f75ce316b79a7156e9 HTTP/1.1" 200 None 2026-05-08 11:16:22,356 - lava_callback - DEBUG - Processing node 69fb22f75ce316b79a7156e9: baseline-arm64-clabbe 2026-05-08 11:16:22,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb22f75ce316b79a7156e9 2026-05-08 11:16:22,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:16:22,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb22f75ce316b79a7156e9 HTTP/1.1" 200 None 2026-05-08 11:16:22,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:16:22,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 11:16:22,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:16:22,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb22f75ce316b79a7156e9 HTTP/1.1" 200 None 2026-05-08 11:16:22,407 - lava_callback - ERROR - Error processing callback for node 69fb22f75ce316b79a7156e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:18:22,344 - lava_callback - INFO - Received callback for node 69fb236f5ce316b79a71572a INFO: 172.21.0.1:49276 - "POST /node/69fb236f5ce316b79a71572a HTTP/1.0" 202 Accepted 2026-05-08 11:18:22,350 - lava_callback - INFO - Starting async job submit for node 69fb236f5ce316b79a71572a 2026-05-08 11:18:22,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:18:22,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb236f5ce316b79a71572a HTTP/1.1" 200 None 2026-05-08 11:18:22,366 - lava_callback - DEBUG - Processing node 69fb236f5ce316b79a71572a: baseline-arm64-clabbe 2026-05-08 11:18:22,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb236f5ce316b79a71572a 2026-05-08 11:18:22,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:18:22,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb236f5ce316b79a71572a HTTP/1.1" 200 None 2026-05-08 11:18:22,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:18:22,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-08 11:18:22,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:18:22,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb236f5ce316b79a71572a HTTP/1.1" 200 None 2026-05-08 11:18:22,423 - lava_callback - ERROR - Error processing callback for node 69fb236f5ce316b79a71572a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:29:02,923 - lava_callback - INFO - Received callback for node 69fb25f65ce316b79a7157f4 INFO: 172.21.0.1:47704 - "POST /node/69fb25f65ce316b79a7157f4 HTTP/1.0" 202 Accepted 2026-05-08 11:29:02,928 - lava_callback - INFO - Starting async job submit for node 69fb25f65ce316b79a7157f4 2026-05-08 11:29:02,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:29:02,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb25f65ce316b79a7157f4 HTTP/1.1" 200 None 2026-05-08 11:29:02,943 - lava_callback - DEBUG - Processing node 69fb25f65ce316b79a7157f4: baseline-arm-clabbe 2026-05-08 11:29:02,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb25f65ce316b79a7157f4 2026-05-08 11:29:02,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:29:02,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb25f65ce316b79a7157f4 HTTP/1.1" 200 None 2026-05-08 11:29:02,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:29:02,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 11:29:02,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:29:02,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb25f65ce316b79a7157f4 HTTP/1.1" 200 None 2026-05-08 11:29:02,988 - lava_callback - ERROR - Error processing callback for node 69fb25f65ce316b79a7157f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:29:42,903 - lava_callback - INFO - Received callback for node 69fb261c5ce316b79a715806 INFO: 172.21.0.1:46834 - "POST /node/69fb261c5ce316b79a715806 HTTP/1.0" 202 Accepted 2026-05-08 11:29:42,909 - lava_callback - INFO - Starting async job submit for node 69fb261c5ce316b79a715806 2026-05-08 11:29:42,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:29:42,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb261c5ce316b79a715806 HTTP/1.1" 200 None 2026-05-08 11:29:42,925 - lava_callback - DEBUG - Processing node 69fb261c5ce316b79a715806: baseline-arm-clabbe 2026-05-08 11:29:42,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb261c5ce316b79a715806 2026-05-08 11:29:42,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:29:42,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb261c5ce316b79a715806 HTTP/1.1" 200 None 2026-05-08 11:29:42,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:29:42,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 11:29:42,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:29:42,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb261c5ce316b79a715806 HTTP/1.1" 200 None 2026-05-08 11:29:42,979 - lava_callback - ERROR - Error processing callback for node 69fb261c5ce316b79a715806: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:30:22,949 - lava_callback - INFO - Received callback for node 69fb26415ce316b79a715819 INFO: 172.21.0.1:39076 - "POST /node/69fb26415ce316b79a715819 HTTP/1.0" 202 Accepted 2026-05-08 11:30:22,954 - lava_callback - INFO - Starting async job submit for node 69fb26415ce316b79a715819 2026-05-08 11:30:22,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:30:22,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb26415ce316b79a715819 HTTP/1.1" 200 None 2026-05-08 11:30:22,969 - lava_callback - DEBUG - Processing node 69fb26415ce316b79a715819: baseline-arm-clabbe 2026-05-08 11:30:22,970 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb26415ce316b79a715819 2026-05-08 11:30:22,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:30:22,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb26415ce316b79a715819 HTTP/1.1" 200 None 2026-05-08 11:30:22,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:30:22,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 11:30:22,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:30:23,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb26415ce316b79a715819 HTTP/1.1" 200 None 2026-05-08 11:30:23,021 - lava_callback - ERROR - Error processing callback for node 69fb26415ce316b79a715819: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56986 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:31:02,943 - lava_callback - INFO - Received callback for node 69fb266f5ce316b79a71582d INFO: 172.21.0.1:54534 - "POST /node/69fb266f5ce316b79a71582d HTTP/1.0" 202 Accepted 2026-05-08 11:31:02,948 - lava_callback - INFO - Starting async job submit for node 69fb266f5ce316b79a71582d 2026-05-08 11:31:02,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:31:02,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb266f5ce316b79a71582d HTTP/1.1" 200 None 2026-05-08 11:31:02,965 - lava_callback - DEBUG - Processing node 69fb266f5ce316b79a71582d: baseline-arm-clabbe 2026-05-08 11:31:02,965 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb266f5ce316b79a71582d 2026-05-08 11:31:02,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:31:02,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb266f5ce316b79a71582d HTTP/1.1" 200 None 2026-05-08 11:31:02,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:31:02,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 11:31:02,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:31:03,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb266f5ce316b79a71582d HTTP/1.1" 200 None 2026-05-08 11:31:03,016 - lava_callback - ERROR - Error processing callback for node 69fb266f5ce316b79a71582d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:31:42,999 - lava_callback - INFO - Received callback for node 69fb26955ce316b79a71583f INFO: 172.21.0.1:36234 - "POST /node/69fb26955ce316b79a71583f HTTP/1.0" 202 Accepted 2026-05-08 11:31:43,005 - lava_callback - INFO - Starting async job submit for node 69fb26955ce316b79a71583f 2026-05-08 11:31:43,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:31:43,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb26955ce316b79a71583f HTTP/1.1" 200 None 2026-05-08 11:31:43,022 - lava_callback - DEBUG - Processing node 69fb26955ce316b79a71583f: baseline-arm-clabbe 2026-05-08 11:31:43,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb26955ce316b79a71583f 2026-05-08 11:31:43,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:31:43,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb26955ce316b79a71583f HTTP/1.1" 200 None 2026-05-08 11:31:43,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:31:43,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 11:31:43,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:31:43,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb26955ce316b79a71583f HTTP/1.1" 200 None 2026-05-08 11:31:43,077 - lava_callback - ERROR - Error processing callback for node 69fb26955ce316b79a71583f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK 2026-05-08 11:32:23,139 - lava_callback - INFO - Received callback for node 69fb26ba5ce316b79a715852 INFO: 172.21.0.1:39106 - "POST /node/69fb26ba5ce316b79a715852 HTTP/1.0" 202 Accepted 2026-05-08 11:32:23,145 - lava_callback - INFO - Starting async job submit for node 69fb26ba5ce316b79a715852 2026-05-08 11:32:23,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:32:23,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb26ba5ce316b79a715852 HTTP/1.1" 200 None 2026-05-08 11:32:23,164 - lava_callback - DEBUG - Processing node 69fb26ba5ce316b79a715852: baseline-arm-clabbe 2026-05-08 11:32:23,165 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb26ba5ce316b79a715852 2026-05-08 11:32:23,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:32:23,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb26ba5ce316b79a715852 HTTP/1.1" 200 None 2026-05-08 11:32:23,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:32:23,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-08 11:32:23,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 11:32:23,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb26ba5ce316b79a715852 HTTP/1.1" 200 None 2026-05-08 11:32:23,224 - lava_callback - ERROR - Error processing callback for node 69fb26ba5ce316b79a715852: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:24:58,259 - lava_callback - INFO - Received callback for node 69fb33055ce316b79a7158a6 INFO: 172.21.0.1:41276 - "POST /node/69fb33055ce316b79a7158a6 HTTP/1.0" 202 Accepted 2026-05-08 12:24:58,264 - lava_callback - INFO - Starting async job submit for node 69fb33055ce316b79a7158a6 2026-05-08 12:24:58,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:24:58,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb33055ce316b79a7158a6 HTTP/1.1" 200 None 2026-05-08 12:24:58,288 - lava_callback - DEBUG - Processing node 69fb33055ce316b79a7158a6: baseline-arm64-baylibre 2026-05-08 12:24:58,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb33055ce316b79a7158a6 2026-05-08 12:24:58,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:24:58,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb33055ce316b79a7158a6 HTTP/1.1" 200 None 2026-05-08 12:24:58,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:24:58,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-08 12:24:58,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:24:58,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb33055ce316b79a7158a6 HTTP/1.1" 200 None 2026-05-08 12:24:58,334 - lava_callback - ERROR - Error processing callback for node 69fb33055ce316b79a7158a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:26:18,457 - lava_callback - INFO - Received callback for node 69fb335c5ce316b79a7158c9 INFO: 172.21.0.1:45090 - "POST /node/69fb335c5ce316b79a7158c9 HTTP/1.0" 202 Accepted 2026-05-08 12:26:18,463 - lava_callback - INFO - Starting async job submit for node 69fb335c5ce316b79a7158c9 2026-05-08 12:26:18,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:26:18,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb335c5ce316b79a7158c9 HTTP/1.1" 200 None 2026-05-08 12:26:18,478 - lava_callback - DEBUG - Processing node 69fb335c5ce316b79a7158c9: baseline-arm64-baylibre 2026-05-08 12:26:18,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb335c5ce316b79a7158c9 2026-05-08 12:26:18,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:26:18,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb335c5ce316b79a7158c9 HTTP/1.1" 200 None 2026-05-08 12:26:18,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:26:18,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-08 12:26:18,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:26:18,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb335c5ce316b79a7158c9 HTTP/1.1" 200 None 2026-05-08 12:26:18,523 - lava_callback - ERROR - Error processing callback for node 69fb335c5ce316b79a7158c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:27:38,331 - lava_callback - INFO - Received callback for node 69fb33ac5ce316b79a7158ed INFO: 172.21.0.1:56606 - "POST /node/69fb33ac5ce316b79a7158ed HTTP/1.0" 202 Accepted 2026-05-08 12:27:38,337 - lava_callback - INFO - Starting async job submit for node 69fb33ac5ce316b79a7158ed 2026-05-08 12:27:38,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:27:38,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb33ac5ce316b79a7158ed HTTP/1.1" 200 None 2026-05-08 12:27:38,352 - lava_callback - DEBUG - Processing node 69fb33ac5ce316b79a7158ed: baseline-arm64-baylibre 2026-05-08 12:27:38,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb33ac5ce316b79a7158ed 2026-05-08 12:27:38,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:27:38,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb33ac5ce316b79a7158ed HTTP/1.1" 200 None 2026-05-08 12:27:38,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:27:38,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-08 12:27:38,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:27:38,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb33ac5ce316b79a7158ed HTTP/1.1" 200 None 2026-05-08 12:27:38,398 - lava_callback - ERROR - Error processing callback for node 69fb33ac5ce316b79a7158ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50120 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:28:58,497 - lava_callback - INFO - Received callback for node 69fb33fd5ce316b79a715912 INFO: 172.21.0.1:50126 - "POST /node/69fb33fd5ce316b79a715912 HTTP/1.0" 202 Accepted 2026-05-08 12:28:58,503 - lava_callback - INFO - Starting async job submit for node 69fb33fd5ce316b79a715912 2026-05-08 12:28:58,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:28:58,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb33fd5ce316b79a715912 HTTP/1.1" 200 None 2026-05-08 12:28:58,524 - lava_callback - DEBUG - Processing node 69fb33fd5ce316b79a715912: baseline-arm64-baylibre 2026-05-08 12:28:58,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb33fd5ce316b79a715912 2026-05-08 12:28:58,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:28:58,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb33fd5ce316b79a715912 HTTP/1.1" 200 None 2026-05-08 12:28:58,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:28:58,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-08 12:28:58,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:28:58,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb33fd5ce316b79a715912 HTTP/1.1" 200 None 2026-05-08 12:28:58,602 - lava_callback - ERROR - Error processing callback for node 69fb33fd5ce316b79a715912: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45446 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:30:18,533 - lava_callback - INFO - Received callback for node 69fb344f5ce316b79a715932 INFO: 172.21.0.1:45456 - "POST /node/69fb344f5ce316b79a715932 HTTP/1.0" 202 Accepted 2026-05-08 12:30:18,539 - lava_callback - INFO - Starting async job submit for node 69fb344f5ce316b79a715932 2026-05-08 12:30:18,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:30:18,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb344f5ce316b79a715932 HTTP/1.1" 200 None 2026-05-08 12:30:18,554 - lava_callback - DEBUG - Processing node 69fb344f5ce316b79a715932: baseline-arm64-baylibre 2026-05-08 12:30:18,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb344f5ce316b79a715932 2026-05-08 12:30:18,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:30:18,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb344f5ce316b79a715932 HTTP/1.1" 200 None 2026-05-08 12:30:18,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:30:18,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-08 12:30:18,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:30:18,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb344f5ce316b79a715932 HTTP/1.1" 200 None 2026-05-08 12:30:18,598 - lava_callback - ERROR - Error processing callback for node 69fb344f5ce316b79a715932: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:31:38,574 - lava_callback - INFO - Received callback for node 69fb349f5ce316b79a715957 INFO: 172.21.0.1:48472 - "POST /node/69fb349f5ce316b79a715957 HTTP/1.0" 202 Accepted 2026-05-08 12:31:38,580 - lava_callback - INFO - Starting async job submit for node 69fb349f5ce316b79a715957 2026-05-08 12:31:38,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:31:38,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb349f5ce316b79a715957 HTTP/1.1" 200 None 2026-05-08 12:31:38,598 - lava_callback - DEBUG - Processing node 69fb349f5ce316b79a715957: baseline-arm64-baylibre 2026-05-08 12:31:38,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb349f5ce316b79a715957 2026-05-08 12:31:38,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:31:38,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb349f5ce316b79a715957 HTTP/1.1" 200 None 2026-05-08 12:31:38,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:31:38,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-08 12:31:38,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:31:38,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb349f5ce316b79a715957 HTTP/1.1" 200 None 2026-05-08 12:31:38,644 - lava_callback - ERROR - Error processing callback for node 69fb349f5ce316b79a715957: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:33:05,291 - lava_callback - INFO - Received callback for node 69fb34f35ce316b79a71597d INFO: 172.21.0.1:39166 - "POST /node/69fb34f35ce316b79a71597d HTTP/1.0" 202 Accepted 2026-05-08 12:33:05,296 - lava_callback - INFO - Starting async job submit for node 69fb34f35ce316b79a71597d 2026-05-08 12:33:05,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:33:05,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb34f35ce316b79a71597d HTTP/1.1" 200 None 2026-05-08 12:33:05,312 - lava_callback - DEBUG - Processing node 69fb34f35ce316b79a71597d: baseline-arm64-clabbe 2026-05-08 12:33:05,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb34f35ce316b79a71597d 2026-05-08 12:33:05,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:33:05,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb34f35ce316b79a71597d HTTP/1.1" 200 None 2026-05-08 12:33:05,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:33:05,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-08 12:33:05,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:33:05,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb34f35ce316b79a71597d HTTP/1.1" 200 None 2026-05-08 12:33:05,362 - lava_callback - ERROR - Error processing callback for node 69fb34f35ce316b79a71597d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:35:25,380 - lava_callback - INFO - Received callback for node 69fb35805ce316b79a7159b9 INFO: 172.21.0.1:48362 - "POST /node/69fb35805ce316b79a7159b9 HTTP/1.0" 202 Accepted 2026-05-08 12:35:25,386 - lava_callback - INFO - Starting async job submit for node 69fb35805ce316b79a7159b9 2026-05-08 12:35:25,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:35:25,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb35805ce316b79a7159b9 HTTP/1.1" 200 None 2026-05-08 12:35:25,406 - lava_callback - DEBUG - Processing node 69fb35805ce316b79a7159b9: baseline-arm64-clabbe 2026-05-08 12:35:25,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb35805ce316b79a7159b9 2026-05-08 12:35:25,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:35:25,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb35805ce316b79a7159b9 HTTP/1.1" 200 None 2026-05-08 12:35:25,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:35:25,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-08 12:35:25,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:35:25,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb35805ce316b79a7159b9 HTTP/1.1" 200 None 2026-05-08 12:35:25,460 - lava_callback - ERROR - Error processing callback for node 69fb35805ce316b79a7159b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55266 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:36:45,447 - lava_callback - INFO - Received callback for node 69fb35cd5ce316b79a7159cf INFO: 172.21.0.1:47598 - "POST /node/69fb35cd5ce316b79a7159cf HTTP/1.0" 202 Accepted 2026-05-08 12:36:45,455 - lava_callback - INFO - Starting async job submit for node 69fb35cd5ce316b79a7159cf 2026-05-08 12:36:45,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:36:45,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb35cd5ce316b79a7159cf HTTP/1.1" 200 None 2026-05-08 12:36:45,471 - lava_callback - DEBUG - Processing node 69fb35cd5ce316b79a7159cf: baseline-arm64-clabbe 2026-05-08 12:36:45,471 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb35cd5ce316b79a7159cf 2026-05-08 12:36:45,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:36:45,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb35cd5ce316b79a7159cf HTTP/1.1" 200 None 2026-05-08 12:36:45,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:36:45,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-08 12:36:45,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:36:45,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb35cd5ce316b79a7159cf HTTP/1.1" 200 None 2026-05-08 12:36:45,531 - lava_callback - ERROR - Error processing callback for node 69fb35cd5ce316b79a7159cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:38:05,474 - lava_callback - INFO - Received callback for node 69fb361a5ce316b79a7159fe INFO: 172.21.0.1:34286 - "POST /node/69fb361a5ce316b79a7159fe HTTP/1.0" 202 Accepted 2026-05-08 12:38:05,484 - lava_callback - INFO - Starting async job submit for node 69fb361a5ce316b79a7159fe 2026-05-08 12:38:05,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:38:05,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb361a5ce316b79a7159fe HTTP/1.1" 200 None 2026-05-08 12:38:05,509 - lava_callback - DEBUG - Processing node 69fb361a5ce316b79a7159fe: baseline-arm64-clabbe 2026-05-08 12:38:05,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb361a5ce316b79a7159fe 2026-05-08 12:38:05,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:38:05,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb361a5ce316b79a7159fe HTTP/1.1" 200 None 2026-05-08 12:38:05,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:38:05,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-08 12:38:05,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:38:05,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb361a5ce316b79a7159fe HTTP/1.1" 200 None 2026-05-08 12:38:05,562 - lava_callback - ERROR - Error processing callback for node 69fb361a5ce316b79a7159fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:39:25,504 - lava_callback - INFO - Received callback for node 69fb36695ce316b79a715a17 INFO: 172.21.0.1:49306 - "POST /node/69fb36695ce316b79a715a17 HTTP/1.0" 202 Accepted 2026-05-08 12:39:25,510 - lava_callback - INFO - Starting async job submit for node 69fb36695ce316b79a715a17 2026-05-08 12:39:25,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:39:25,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb36695ce316b79a715a17 HTTP/1.1" 200 None 2026-05-08 12:39:25,525 - lava_callback - DEBUG - Processing node 69fb36695ce316b79a715a17: baseline-arm64-clabbe 2026-05-08 12:39:25,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb36695ce316b79a715a17 2026-05-08 12:39:25,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:39:25,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb36695ce316b79a715a17 HTTP/1.1" 200 None 2026-05-08 12:39:25,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:39:25,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-08 12:39:25,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:39:25,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb36695ce316b79a715a17 HTTP/1.1" 200 None 2026-05-08 12:39:25,572 - lava_callback - ERROR - Error processing callback for node 69fb36695ce316b79a715a17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:40:45,752 - lava_callback - INFO - Received callback for node 69fb36b75ce316b79a715a3e INFO: 172.21.0.1:46812 - "POST /node/69fb36b75ce316b79a715a3e HTTP/1.0" 202 Accepted 2026-05-08 12:40:45,760 - lava_callback - INFO - Starting async job submit for node 69fb36b75ce316b79a715a3e 2026-05-08 12:40:45,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:40:45,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb36b75ce316b79a715a3e HTTP/1.1" 200 None 2026-05-08 12:40:45,776 - lava_callback - DEBUG - Processing node 69fb36b75ce316b79a715a3e: baseline-arm64-clabbe 2026-05-08 12:40:45,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb36b75ce316b79a715a3e 2026-05-08 12:40:45,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:40:45,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb36b75ce316b79a715a3e HTTP/1.1" 200 None 2026-05-08 12:40:45,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:40:45,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-08 12:40:45,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:40:45,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb36b75ce316b79a715a3e HTTP/1.1" 200 None 2026-05-08 12:40:45,827 - lava_callback - ERROR - Error processing callback for node 69fb36b75ce316b79a715a3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60634 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:41:39,204 - lava_callback - INFO - Received callback for node 69fb36f15ce316b79a715a5f INFO: 172.21.0.1:60638 - "POST /node/69fb36f15ce316b79a715a5f HTTP/1.0" 202 Accepted 2026-05-08 12:41:39,210 - lava_callback - INFO - Starting async job submit for node 69fb36f15ce316b79a715a5f 2026-05-08 12:41:39,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:41:39,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb36f15ce316b79a715a5f HTTP/1.1" 200 None 2026-05-08 12:41:39,225 - lava_callback - DEBUG - Processing node 69fb36f15ce316b79a715a5f: baseline-arm-baylibre 2026-05-08 12:41:39,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb36f15ce316b79a715a5f 2026-05-08 12:41:39,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:41:39,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb36f15ce316b79a715a5f HTTP/1.1" 200 None 2026-05-08 12:41:39,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:41:39,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-08 12:41:39,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:41:39,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb36f15ce316b79a715a5f HTTP/1.1" 200 None 2026-05-08 12:41:39,276 - lava_callback - ERROR - Error processing callback for node 69fb36f15ce316b79a715a5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42192 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:42:19,121 - lava_callback - INFO - Received callback for node 69fb371a5ce316b79a715a6f INFO: 172.21.0.1:42194 - "POST /node/69fb371a5ce316b79a715a6f HTTP/1.0" 202 Accepted 2026-05-08 12:42:19,126 - lava_callback - INFO - Starting async job submit for node 69fb371a5ce316b79a715a6f 2026-05-08 12:42:19,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:42:19,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb371a5ce316b79a715a6f HTTP/1.1" 200 None 2026-05-08 12:42:19,142 - lava_callback - DEBUG - Processing node 69fb371a5ce316b79a715a6f: baseline-arm-baylibre 2026-05-08 12:42:19,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb371a5ce316b79a715a6f 2026-05-08 12:42:19,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:42:19,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb371a5ce316b79a715a6f HTTP/1.1" 200 None 2026-05-08 12:42:19,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:42:19,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-08 12:42:19,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:42:19,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb371a5ce316b79a715a6f HTTP/1.1" 200 None 2026-05-08 12:42:19,227 - lava_callback - ERROR - Error processing callback for node 69fb371a5ce316b79a715a6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:42:59,188 - lava_callback - INFO - Received callback for node 69fb373f5ce316b79a715a81 INFO: 172.21.0.1:49344 - "POST /node/69fb373f5ce316b79a715a81 HTTP/1.0" 202 Accepted 2026-05-08 12:42:59,194 - lava_callback - INFO - Starting async job submit for node 69fb373f5ce316b79a715a81 2026-05-08 12:42:59,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:42:59,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb373f5ce316b79a715a81 HTTP/1.1" 200 None 2026-05-08 12:42:59,208 - lava_callback - DEBUG - Processing node 69fb373f5ce316b79a715a81: baseline-arm-baylibre 2026-05-08 12:42:59,209 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb373f5ce316b79a715a81 2026-05-08 12:42:59,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:42:59,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb373f5ce316b79a715a81 HTTP/1.1" 200 None 2026-05-08 12:42:59,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:42:59,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-08 12:42:59,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:42:59,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb373f5ce316b79a715a81 HTTP/1.1" 200 None 2026-05-08 12:42:59,257 - lava_callback - ERROR - Error processing callback for node 69fb373f5ce316b79a715a81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40492 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:43:19,210 - lava_callback - INFO - Received callback for node 69fb37655ce316b79a715a95 INFO: 172.21.0.1:40496 - "POST /node/69fb37655ce316b79a715a95 HTTP/1.0" 202 Accepted 2026-05-08 12:43:19,216 - lava_callback - INFO - Starting async job submit for node 69fb37655ce316b79a715a95 2026-05-08 12:43:19,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:43:19,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb37655ce316b79a715a95 HTTP/1.1" 200 None 2026-05-08 12:43:19,263 - lava_callback - DEBUG - Processing node 69fb37655ce316b79a715a95: baseline-arm-baylibre 2026-05-08 12:43:19,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb37655ce316b79a715a95 2026-05-08 12:43:19,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:43:19,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb37655ce316b79a715a95 HTTP/1.1" 200 None 2026-05-08 12:43:19,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:43:19,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-08 12:43:19,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:43:19,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb37655ce316b79a715a95 HTTP/1.1" 200 None 2026-05-08 12:43:19,307 - lava_callback - ERROR - Error processing callback for node 69fb37655ce316b79a715a95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41234 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:44:39,275 - lava_callback - INFO - Received callback for node 69fb37af5ce316b79a715ab7 INFO: 172.21.0.1:41240 - "POST /node/69fb37af5ce316b79a715ab7 HTTP/1.0" 202 Accepted 2026-05-08 12:44:39,281 - lava_callback - INFO - Starting async job submit for node 69fb37af5ce316b79a715ab7 2026-05-08 12:44:39,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:44:39,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb37af5ce316b79a715ab7 HTTP/1.1" 200 None 2026-05-08 12:44:39,297 - lava_callback - DEBUG - Processing node 69fb37af5ce316b79a715ab7: baseline-arm-baylibre 2026-05-08 12:44:39,297 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb37af5ce316b79a715ab7 2026-05-08 12:44:39,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:44:39,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb37af5ce316b79a715ab7 HTTP/1.1" 200 None 2026-05-08 12:44:39,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:44:39,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-08 12:44:39,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:44:39,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb37af5ce316b79a715ab7 HTTP/1.1" 200 None 2026-05-08 12:44:39,365 - lava_callback - ERROR - Error processing callback for node 69fb37af5ce316b79a715ab7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:45:59,330 - lava_callback - INFO - Received callback for node 69fb37f85ce316b79a715adf INFO: 172.21.0.1:59248 - "POST /node/69fb37f85ce316b79a715adf HTTP/1.0" 202 Accepted 2026-05-08 12:45:59,336 - lava_callback - INFO - Starting async job submit for node 69fb37f85ce316b79a715adf 2026-05-08 12:45:59,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:45:59,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb37f85ce316b79a715adf HTTP/1.1" 200 None 2026-05-08 12:45:59,352 - lava_callback - DEBUG - Processing node 69fb37f85ce316b79a715adf: baseline-arm-baylibre 2026-05-08 12:45:59,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb37f85ce316b79a715adf 2026-05-08 12:45:59,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:45:59,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb37f85ce316b79a715adf HTTP/1.1" 200 None 2026-05-08 12:45:59,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:45:59,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-08 12:45:59,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:45:59,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb37f85ce316b79a715adf HTTP/1.1" 200 None 2026-05-08 12:45:59,407 - lava_callback - ERROR - Error processing callback for node 69fb37f85ce316b79a715adf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38908 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:46:25,786 - lava_callback - INFO - Received callback for node 69fb381f5ce316b79a715af0 INFO: 172.21.0.1:36934 - "POST /node/69fb381f5ce316b79a715af0 HTTP/1.0" 202 Accepted 2026-05-08 12:46:25,792 - lava_callback - INFO - Starting async job submit for node 69fb381f5ce316b79a715af0 2026-05-08 12:46:25,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:46:25,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb381f5ce316b79a715af0 HTTP/1.1" 200 None 2026-05-08 12:46:25,807 - lava_callback - DEBUG - Processing node 69fb381f5ce316b79a715af0: baseline-arm-clabbe 2026-05-08 12:46:25,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb381f5ce316b79a715af0 2026-05-08 12:46:25,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:46:25,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb381f5ce316b79a715af0 HTTP/1.1" 200 None 2026-05-08 12:46:25,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:46:25,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-08 12:46:25,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:46:25,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb381f5ce316b79a715af0 HTTP/1.1" 200 None 2026-05-08 12:46:25,868 - lava_callback - ERROR - Error processing callback for node 69fb381f5ce316b79a715af0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:46:59,387 - lava_callback - INFO - Received callback for node 69fb383f5ce316b79a715b05 INFO: 172.21.0.1:52574 - "POST /node/69fb383f5ce316b79a715b05 HTTP/1.0" 202 Accepted 2026-05-08 12:46:59,393 - lava_callback - INFO - Starting async job submit for node 69fb383f5ce316b79a715b05 2026-05-08 12:46:59,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:46:59,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb383f5ce316b79a715b05 HTTP/1.1" 200 None 2026-05-08 12:46:59,408 - lava_callback - DEBUG - Processing node 69fb383f5ce316b79a715b05: baseline-arm-baylibre 2026-05-08 12:46:59,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb383f5ce316b79a715b05 2026-05-08 12:46:59,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:46:59,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb383f5ce316b79a715b05 HTTP/1.1" 200 None 2026-05-08 12:46:59,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:46:59,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 12:46:59,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:46:59,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb383f5ce316b79a715b05 HTTP/1.1" 200 None 2026-05-08 12:46:59,463 - lava_callback - ERROR - Error processing callback for node 69fb383f5ce316b79a715b05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:48:59,484 - lava_callback - INFO - Received callback for node 69fb38a95ce316b79a715b31 INFO: 172.21.0.1:32920 - "POST /node/69fb38a95ce316b79a715b31 HTTP/1.0" 202 Accepted 2026-05-08 12:48:59,489 - lava_callback - INFO - Starting async job submit for node 69fb38a95ce316b79a715b31 2026-05-08 12:48:59,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:48:59,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb38a95ce316b79a715b31 HTTP/1.1" 200 None 2026-05-08 12:48:59,505 - lava_callback - DEBUG - Processing node 69fb38a95ce316b79a715b31: baseline-arm-baylibre 2026-05-08 12:48:59,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb38a95ce316b79a715b31 2026-05-08 12:48:59,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:48:59,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb38a95ce316b79a715b31 HTTP/1.1" 200 None 2026-05-08 12:48:59,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:48:59,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 12:48:59,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:48:59,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb38a95ce316b79a715b31 HTTP/1.1" 200 None 2026-05-08 12:48:59,560 - lava_callback - ERROR - Error processing callback for node 69fb38a95ce316b79a715b31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48538 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:51:26,016 - lava_callback - INFO - Received callback for node 69fb393d5ce316b79a715b74 INFO: 172.21.0.1:38352 - "POST /node/69fb393d5ce316b79a715b74 HTTP/1.0" 202 Accepted 2026-05-08 12:51:26,021 - lava_callback - INFO - Starting async job submit for node 69fb393d5ce316b79a715b74 2026-05-08 12:51:26,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:51:26,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb393d5ce316b79a715b74 HTTP/1.1" 200 None 2026-05-08 12:51:26,037 - lava_callback - DEBUG - Processing node 69fb393d5ce316b79a715b74: baseline-arm-clabbe 2026-05-08 12:51:26,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb393d5ce316b79a715b74 2026-05-08 12:51:26,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:51:26,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb393d5ce316b79a715b74 HTTP/1.1" 200 None 2026-05-08 12:51:26,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:51:26,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-08 12:51:26,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:51:26,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb393d5ce316b79a715b74 HTTP/1.1" 200 None 2026-05-08 12:51:26,083 - lava_callback - ERROR - Error processing callback for node 69fb393d5ce316b79a715b74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33896 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:51:59,679 - lava_callback - INFO - Received callback for node 69fb395e5ce316b79a715b7e INFO: 172.21.0.1:33902 - "POST /node/69fb395e5ce316b79a715b7e HTTP/1.0" 202 Accepted 2026-05-08 12:51:59,684 - lava_callback - INFO - Starting async job submit for node 69fb395e5ce316b79a715b7e 2026-05-08 12:51:59,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:51:59,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb395e5ce316b79a715b7e HTTP/1.1" 200 None 2026-05-08 12:51:59,706 - lava_callback - DEBUG - Processing node 69fb395e5ce316b79a715b7e: baseline-arm-baylibre 2026-05-08 12:51:59,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb395e5ce316b79a715b7e 2026-05-08 12:51:59,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:51:59,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb395e5ce316b79a715b7e HTTP/1.1" 200 None 2026-05-08 12:51:59,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:51:59,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 12:51:59,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:51:59,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb395e5ce316b79a715b7e HTTP/1.1" 200 None 2026-05-08 12:51:59,753 - lava_callback - ERROR - Error processing callback for node 69fb395e5ce316b79a715b7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:52:26,024 - lava_callback - INFO - Received callback for node 69fb39865ce316b79a715b94 INFO: 172.21.0.1:38968 - "POST /node/69fb39865ce316b79a715b94 HTTP/1.0" 202 Accepted 2026-05-08 12:52:26,030 - lava_callback - INFO - Starting async job submit for node 69fb39865ce316b79a715b94 2026-05-08 12:52:26,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:52:26,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb39865ce316b79a715b94 HTTP/1.1" 200 None 2026-05-08 12:52:26,054 - lava_callback - DEBUG - Processing node 69fb39865ce316b79a715b94: baseline-arm-clabbe 2026-05-08 12:52:26,055 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb39865ce316b79a715b94 2026-05-08 12:52:26,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:52:26,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb39865ce316b79a715b94 HTTP/1.1" 200 None 2026-05-08 12:52:26,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:52:26,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 12:52:26,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:52:26,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb39865ce316b79a715b94 HTTP/1.1" 200 None 2026-05-08 12:52:26,109 - lava_callback - ERROR - Error processing callback for node 69fb39865ce316b79a715b94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:52:59,660 - lava_callback - INFO - Received callback for node 69fb39a75ce316b79a715ba5 INFO: 172.21.0.1:39642 - "POST /node/69fb39a75ce316b79a715ba5 HTTP/1.0" 202 Accepted 2026-05-08 12:52:59,666 - lava_callback - INFO - Starting async job submit for node 69fb39a75ce316b79a715ba5 2026-05-08 12:52:59,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:52:59,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb39a75ce316b79a715ba5 HTTP/1.1" 200 None 2026-05-08 12:52:59,681 - lava_callback - DEBUG - Processing node 69fb39a75ce316b79a715ba5: baseline-arm-baylibre 2026-05-08 12:52:59,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb39a75ce316b79a715ba5 2026-05-08 12:52:59,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:52:59,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb39a75ce316b79a715ba5 HTTP/1.1" 200 None 2026-05-08 12:52:59,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:52:59,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 12:52:59,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:52:59,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb39a75ce316b79a715ba5 HTTP/1.1" 200 None 2026-05-08 12:52:59,727 - lava_callback - ERROR - Error processing callback for node 69fb39a75ce316b79a715ba5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:55:06,138 - lava_callback - INFO - Received callback for node 69fb3a1a5ce316b79a715bd6 INFO: 172.21.0.1:43376 - "POST /node/69fb3a1a5ce316b79a715bd6 HTTP/1.0" 202 Accepted 2026-05-08 12:55:06,143 - lava_callback - INFO - Starting async job submit for node 69fb3a1a5ce316b79a715bd6 2026-05-08 12:55:06,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:55:06,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3a1a5ce316b79a715bd6 HTTP/1.1" 200 None 2026-05-08 12:55:06,165 - lava_callback - DEBUG - Processing node 69fb3a1a5ce316b79a715bd6: baseline-arm-clabbe 2026-05-08 12:55:06,166 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3a1a5ce316b79a715bd6 2026-05-08 12:55:06,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:55:06,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3a1a5ce316b79a715bd6 HTTP/1.1" 200 None 2026-05-08 12:55:06,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:55:06,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-08 12:55:06,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:55:06,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3a1a5ce316b79a715bd6 HTTP/1.1" 200 None 2026-05-08 12:55:06,232 - lava_callback - ERROR - Error processing callback for node 69fb3a1a5ce316b79a715bd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:55:46,087 - lava_callback - INFO - Received callback for node 69fb3a435ce316b79a715bec INFO: 172.21.0.1:44136 - "POST /node/69fb3a435ce316b79a715bec HTTP/1.0" 202 Accepted 2026-05-08 12:55:46,093 - lava_callback - INFO - Starting async job submit for node 69fb3a435ce316b79a715bec 2026-05-08 12:55:46,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:55:46,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3a435ce316b79a715bec HTTP/1.1" 200 None 2026-05-08 12:55:46,113 - lava_callback - DEBUG - Processing node 69fb3a435ce316b79a715bec: baseline-arm-clabbe 2026-05-08 12:55:46,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3a435ce316b79a715bec 2026-05-08 12:55:46,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:55:46,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3a435ce316b79a715bec HTTP/1.1" 200 None 2026-05-08 12:55:46,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:55:46,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-08 12:55:46,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:55:46,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3a435ce316b79a715bec HTTP/1.1" 200 None 2026-05-08 12:55:46,166 - lava_callback - ERROR - Error processing callback for node 69fb3a435ce316b79a715bec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:56:26,129 - lava_callback - INFO - Received callback for node 69fb3a6a5ce316b79a715c01 INFO: 172.21.0.1:34966 - "POST /node/69fb3a6a5ce316b79a715c01 HTTP/1.0" 202 Accepted 2026-05-08 12:56:26,135 - lava_callback - INFO - Starting async job submit for node 69fb3a6a5ce316b79a715c01 2026-05-08 12:56:26,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:56:26,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3a6a5ce316b79a715c01 HTTP/1.1" 200 None 2026-05-08 12:56:26,150 - lava_callback - DEBUG - Processing node 69fb3a6a5ce316b79a715c01: baseline-arm-clabbe 2026-05-08 12:56:26,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3a6a5ce316b79a715c01 2026-05-08 12:56:26,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:56:26,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3a6a5ce316b79a715c01 HTTP/1.1" 200 None 2026-05-08 12:56:26,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:56:26,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 12:56:26,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:56:26,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3a6a5ce316b79a715c01 HTTP/1.1" 200 None 2026-05-08 12:56:26,204 - lava_callback - ERROR - Error processing callback for node 69fb3a6a5ce316b79a715c01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51310 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:57:06,106 - lava_callback - INFO - Received callback for node 69fb3a905ce316b79a715c10 INFO: 172.21.0.1:46514 - "POST /node/69fb3a905ce316b79a715c10 HTTP/1.0" 202 Accepted 2026-05-08 12:57:06,116 - lava_callback - INFO - Starting async job submit for node 69fb3a905ce316b79a715c10 2026-05-08 12:57:06,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:57:06,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3a905ce316b79a715c10 HTTP/1.1" 200 None 2026-05-08 12:57:06,141 - lava_callback - DEBUG - Processing node 69fb3a905ce316b79a715c10: baseline-arm-clabbe 2026-05-08 12:57:06,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3a905ce316b79a715c10 2026-05-08 12:57:06,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:57:06,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3a905ce316b79a715c10 HTTP/1.1" 200 None 2026-05-08 12:57:06,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:57:06,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 12:57:06,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:57:06,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3a905ce316b79a715c10 HTTP/1.1" 200 None 2026-05-08 12:57:06,200 - lava_callback - ERROR - Error processing callback for node 69fb3a905ce316b79a715c10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:57:40,090 - lava_callback - INFO - Received callback for node 69fb3ab55ce316b79a715c20 INFO: 172.21.0.1:36826 - "POST /node/69fb3ab55ce316b79a715c20 HTTP/1.0" 202 Accepted 2026-05-08 12:57:40,095 - lava_callback - INFO - Starting async job submit for node 69fb3ab55ce316b79a715c20 2026-05-08 12:57:40,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:57:40,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3ab55ce316b79a715c20 HTTP/1.1" 200 None 2026-05-08 12:57:40,110 - lava_callback - DEBUG - Processing node 69fb3ab55ce316b79a715c20: baseline-arm-baylibre 2026-05-08 12:57:40,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3ab55ce316b79a715c20 2026-05-08 12:57:40,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:57:40,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3ab55ce316b79a715c20 HTTP/1.1" 200 None 2026-05-08 12:57:40,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:57:40,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 12:57:40,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:57:40,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3ab55ce316b79a715c20 HTTP/1.1" 200 None 2026-05-08 12:57:40,164 - lava_callback - ERROR - Error processing callback for node 69fb3ab55ce316b79a715c20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43554 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:58:26,231 - lava_callback - INFO - Received callback for node 69fb3ae05ce316b79a715c33 INFO: 172.21.0.1:55128 - "POST /node/69fb3ae05ce316b79a715c33 HTTP/1.0" 202 Accepted 2026-05-08 12:58:26,237 - lava_callback - INFO - Starting async job submit for node 69fb3ae05ce316b79a715c33 2026-05-08 12:58:26,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:58:26,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3ae05ce316b79a715c33 HTTP/1.1" 200 None 2026-05-08 12:58:26,253 - lava_callback - DEBUG - Processing node 69fb3ae05ce316b79a715c33: baseline-arm-clabbe 2026-05-08 12:58:26,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3ae05ce316b79a715c33 2026-05-08 12:58:26,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:58:26,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3ae05ce316b79a715c33 HTTP/1.1" 200 None 2026-05-08 12:58:26,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:58:26,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 12:58:26,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:58:26,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3ae05ce316b79a715c33 HTTP/1.1" 200 None 2026-05-08 12:58:26,309 - lava_callback - ERROR - Error processing callback for node 69fb3ae05ce316b79a715c33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57814 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:59:00,025 - lava_callback - INFO - Received callback for node 69fb3b045ce316b79a715c46 INFO: 172.21.0.1:41074 - "POST /node/69fb3b045ce316b79a715c46 HTTP/1.0" 202 Accepted 2026-05-08 12:59:00,031 - lava_callback - INFO - Starting async job submit for node 69fb3b045ce316b79a715c46 2026-05-08 12:59:00,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:59:00,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3b045ce316b79a715c46 HTTP/1.1" 200 None 2026-05-08 12:59:00,046 - lava_callback - DEBUG - Processing node 69fb3b045ce316b79a715c46: baseline-arm-baylibre 2026-05-08 12:59:00,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3b045ce316b79a715c46 2026-05-08 12:59:00,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:59:00,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3b045ce316b79a715c46 HTTP/1.1" 200 None 2026-05-08 12:59:00,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:59:00,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 12:59:00,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:59:00,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3b045ce316b79a715c46 HTTP/1.1" 200 None 2026-05-08 12:59:00,096 - lava_callback - ERROR - Error processing callback for node 69fb3b045ce316b79a715c46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55172 - "GET / HTTP/1.0" 200 OK 2026-05-08 12:59:26,283 - lava_callback - INFO - Received callback for node 69fb3b2b5ce316b79a715c56 INFO: 172.21.0.1:38472 - "POST /node/69fb3b2b5ce316b79a715c56 HTTP/1.0" 202 Accepted 2026-05-08 12:59:26,288 - lava_callback - INFO - Starting async job submit for node 69fb3b2b5ce316b79a715c56 2026-05-08 12:59:26,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:59:26,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3b2b5ce316b79a715c56 HTTP/1.1" 200 None 2026-05-08 12:59:26,305 - lava_callback - DEBUG - Processing node 69fb3b2b5ce316b79a715c56: baseline-arm-clabbe 2026-05-08 12:59:26,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3b2b5ce316b79a715c56 2026-05-08 12:59:26,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:59:26,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3b2b5ce316b79a715c56 HTTP/1.1" 200 None 2026-05-08 12:59:26,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:59:26,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 12:59:26,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 12:59:26,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3b2b5ce316b79a715c56 HTTP/1.1" 200 None 2026-05-08 12:59:26,353 - lava_callback - ERROR - Error processing callback for node 69fb3b2b5ce316b79a715c56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41752 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:00:06,463 - lava_callback - INFO - Received callback for node 69fb3b535ce316b79a715c67 INFO: 172.21.0.1:36096 - "POST /node/69fb3b535ce316b79a715c67 HTTP/1.0" 202 Accepted 2026-05-08 13:00:06,469 - lava_callback - INFO - Starting async job submit for node 69fb3b535ce316b79a715c67 2026-05-08 13:00:06,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:00:06,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3b535ce316b79a715c67 HTTP/1.1" 200 None 2026-05-08 13:00:06,505 - lava_callback - DEBUG - Processing node 69fb3b535ce316b79a715c67: baseline-arm-clabbe 2026-05-08 13:00:06,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3b535ce316b79a715c67 2026-05-08 13:00:06,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:00:06,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3b535ce316b79a715c67 HTTP/1.1" 200 None 2026-05-08 13:00:06,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36100 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:00:06,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 13:00:06,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:00:06,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3b535ce316b79a715c67 HTTP/1.1" 200 None 2026-05-08 13:00:06,581 - lava_callback - ERROR - Error processing callback for node 69fb3b535ce316b79a715c67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42406 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:00:46,285 - lava_callback - INFO - Received callback for node 69fb3b785ce316b79a715c75 INFO: 172.21.0.1:39036 - "POST /node/69fb3b785ce316b79a715c75 HTTP/1.0" 202 Accepted 2026-05-08 13:00:46,291 - lava_callback - INFO - Starting async job submit for node 69fb3b785ce316b79a715c75 2026-05-08 13:00:46,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:00:46,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3b785ce316b79a715c75 HTTP/1.1" 200 None 2026-05-08 13:00:46,306 - lava_callback - DEBUG - Processing node 69fb3b785ce316b79a715c75: baseline-arm-clabbe 2026-05-08 13:00:46,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3b785ce316b79a715c75 2026-05-08 13:00:46,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:00:46,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3b785ce316b79a715c75 HTTP/1.1" 200 None 2026-05-08 13:00:46,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:00:46,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-08 13:00:46,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:00:46,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3b785ce316b79a715c75 HTTP/1.1" 200 None 2026-05-08 13:00:46,360 - lava_callback - ERROR - Error processing callback for node 69fb3b785ce316b79a715c75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42748 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:01:26,297 - lava_callback - INFO - Received callback for node 69fb3b9e5ce316b79a715c8a INFO: 172.21.0.1:52740 - "POST /node/69fb3b9e5ce316b79a715c8a HTTP/1.0" 202 Accepted 2026-05-08 13:01:26,303 - lava_callback - INFO - Starting async job submit for node 69fb3b9e5ce316b79a715c8a 2026-05-08 13:01:26,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:01:26,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3b9e5ce316b79a715c8a HTTP/1.1" 200 None 2026-05-08 13:01:26,318 - lava_callback - DEBUG - Processing node 69fb3b9e5ce316b79a715c8a: baseline-arm-clabbe 2026-05-08 13:01:26,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3b9e5ce316b79a715c8a 2026-05-08 13:01:26,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:01:26,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3b9e5ce316b79a715c8a HTTP/1.1" 200 None 2026-05-08 13:01:26,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:01:26,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-08 13:01:26,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:01:26,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3b9e5ce316b79a715c8a HTTP/1.1" 200 None 2026-05-08 13:01:26,363 - lava_callback - ERROR - Error processing callback for node 69fb3b9e5ce316b79a715c8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33550 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:02:46,375 - lava_callback - INFO - Received callback for node 69fb3be85ce316b79a715ca4 INFO: 172.21.0.1:33720 - "POST /node/69fb3be85ce316b79a715ca4 HTTP/1.0" 202 Accepted 2026-05-08 13:02:46,380 - lava_callback - INFO - Starting async job submit for node 69fb3be85ce316b79a715ca4 2026-05-08 13:02:46,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:02:46,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3be85ce316b79a715ca4 HTTP/1.1" 200 None 2026-05-08 13:02:46,395 - lava_callback - DEBUG - Processing node 69fb3be85ce316b79a715ca4: baseline-arm-clabbe 2026-05-08 13:02:46,395 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3be85ce316b79a715ca4 2026-05-08 13:02:46,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:02:46,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3be85ce316b79a715ca4 HTTP/1.1" 200 None 2026-05-08 13:02:46,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:02:46,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:02:46,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:02:46,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3be85ce316b79a715ca4 HTTP/1.1" 200 None 2026-05-08 13:02:46,441 - lava_callback - ERROR - Error processing callback for node 69fb3be85ce316b79a715ca4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53760 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:03:26,325 - lava_callback - INFO - Received callback for node 69fb3c0d5ce316b79a715cb5 INFO: 172.21.0.1:51676 - "POST /node/69fb3c0d5ce316b79a715cb5 HTTP/1.0" 202 Accepted 2026-05-08 13:03:26,331 - lava_callback - INFO - Starting async job submit for node 69fb3c0d5ce316b79a715cb5 2026-05-08 13:03:26,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:03:26,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3c0d5ce316b79a715cb5 HTTP/1.1" 200 None 2026-05-08 13:03:26,346 - lava_callback - DEBUG - Processing node 69fb3c0d5ce316b79a715cb5: baseline-arm-clabbe 2026-05-08 13:03:26,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3c0d5ce316b79a715cb5 2026-05-08 13:03:26,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:03:26,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3c0d5ce316b79a715cb5 HTTP/1.1" 200 None 2026-05-08 13:03:26,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:03:26,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:03:26,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:03:26,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3c0d5ce316b79a715cb5 HTTP/1.1" 200 None 2026-05-08 13:03:26,393 - lava_callback - ERROR - Error processing callback for node 69fb3c0d5ce316b79a715cb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38778 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:04:06,469 - lava_callback - INFO - Received callback for node 69fb3c335ce316b79a715cc5 INFO: 172.21.0.1:36052 - "POST /node/69fb3c335ce316b79a715cc5 HTTP/1.0" 202 Accepted 2026-05-08 13:04:06,474 - lava_callback - INFO - Starting async job submit for node 69fb3c335ce316b79a715cc5 2026-05-08 13:04:06,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:04:06,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3c335ce316b79a715cc5 HTTP/1.1" 200 None 2026-05-08 13:04:06,529 - lava_callback - DEBUG - Processing node 69fb3c335ce316b79a715cc5: baseline-arm-clabbe 2026-05-08 13:04:06,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3c335ce316b79a715cc5 2026-05-08 13:04:06,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:04:06,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3c335ce316b79a715cc5 HTTP/1.1" 200 None 2026-05-08 13:04:06,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:04:06,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:04:06,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:04:06,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3c335ce316b79a715cc5 HTTP/1.1" 200 None 2026-05-08 13:04:06,584 - lava_callback - ERROR - Error processing callback for node 69fb3c335ce316b79a715cc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45730 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:05:46,430 - lava_callback - INFO - Received callback for node 69fb3ca05ce316b79a715ce9 INFO: 172.21.0.1:50596 - "POST /node/69fb3ca05ce316b79a715ce9 HTTP/1.0" 202 Accepted 2026-05-08 13:05:46,435 - lava_callback - INFO - Starting async job submit for node 69fb3ca05ce316b79a715ce9 2026-05-08 13:05:46,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:05:46,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3ca05ce316b79a715ce9 HTTP/1.1" 200 None 2026-05-08 13:05:46,450 - lava_callback - DEBUG - Processing node 69fb3ca05ce316b79a715ce9: baseline-arm-clabbe 2026-05-08 13:05:46,451 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3ca05ce316b79a715ce9 2026-05-08 13:05:46,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:05:46,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3ca05ce316b79a715ce9 HTTP/1.1" 200 None 2026-05-08 13:05:46,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:05:46,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:05:46,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:05:46,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3ca05ce316b79a715ce9 HTTP/1.1" 200 None 2026-05-08 13:05:46,503 - lava_callback - ERROR - Error processing callback for node 69fb3ca05ce316b79a715ce9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50752 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:06:20,468 - lava_callback - INFO - Received callback for node 69fb3cc25ce316b79a715cfa INFO: 172.21.0.1:54136 - "POST /node/69fb3cc25ce316b79a715cfa HTTP/1.0" 202 Accepted 2026-05-08 13:06:20,474 - lava_callback - INFO - Starting async job submit for node 69fb3cc25ce316b79a715cfa 2026-05-08 13:06:20,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:06:20,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3cc25ce316b79a715cfa HTTP/1.1" 200 None 2026-05-08 13:06:20,489 - lava_callback - DEBUG - Processing node 69fb3cc25ce316b79a715cfa: baseline-arm-baylibre 2026-05-08 13:06:20,489 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3cc25ce316b79a715cfa 2026-05-08 13:06:20,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:06:20,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3cc25ce316b79a715cfa HTTP/1.1" 200 None 2026-05-08 13:06:20,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:06:20,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:06:20,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:06:20,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3cc25ce316b79a715cfa HTTP/1.1" 200 None 2026-05-08 13:06:20,534 - lava_callback - ERROR - Error processing callback for node 69fb3cc25ce316b79a715cfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:07:00,398 - lava_callback - INFO - Received callback for node 69fb3ce75ce316b79a715d08 INFO: 172.21.0.1:52144 - "POST /node/69fb3ce75ce316b79a715d08 HTTP/1.0" 202 Accepted 2026-05-08 13:07:00,403 - lava_callback - INFO - Starting async job submit for node 69fb3ce75ce316b79a715d08 2026-05-08 13:07:00,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:07:00,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3ce75ce316b79a715d08 HTTP/1.1" 200 None 2026-05-08 13:07:00,428 - lava_callback - DEBUG - Processing node 69fb3ce75ce316b79a715d08: baseline-arm-baylibre 2026-05-08 13:07:00,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3ce75ce316b79a715d08 2026-05-08 13:07:00,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:07:00,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3ce75ce316b79a715d08 HTTP/1.1" 200 None 2026-05-08 13:07:00,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:07:00,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:07:00,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:07:00,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3ce75ce316b79a715d08 HTTP/1.1" 200 None 2026-05-08 13:07:00,480 - lava_callback - ERROR - Error processing callback for node 69fb3ce75ce316b79a715d08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58396 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:07:46,557 - lava_callback - INFO - Received callback for node 69fb3d0f5ce316b79a715d19 INFO: 172.21.0.1:58402 - "POST /node/69fb3d0f5ce316b79a715d19 HTTP/1.0" 202 Accepted 2026-05-08 13:07:46,562 - lava_callback - INFO - Starting async job submit for node 69fb3d0f5ce316b79a715d19 2026-05-08 13:07:46,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:07:46,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3d0f5ce316b79a715d19 HTTP/1.1" 200 None 2026-05-08 13:07:46,579 - lava_callback - DEBUG - Processing node 69fb3d0f5ce316b79a715d19: baseline-arm-clabbe 2026-05-08 13:07:46,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3d0f5ce316b79a715d19 2026-05-08 13:07:46,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:07:46,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3d0f5ce316b79a715d19 HTTP/1.1" 200 None 2026-05-08 13:07:46,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:07:46,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:07:46,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:07:46,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3d0f5ce316b79a715d19 HTTP/1.1" 200 None 2026-05-08 13:07:46,624 - lava_callback - ERROR - Error processing callback for node 69fb3d0f5ce316b79a715d19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52064 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:08:20,708 - lava_callback - INFO - Received callback for node 69fb3d315ce316b79a715d27 INFO: 172.21.0.1:47892 - "POST /node/69fb3d315ce316b79a715d27 HTTP/1.0" 202 Accepted 2026-05-08 13:08:20,714 - lava_callback - INFO - Starting async job submit for node 69fb3d315ce316b79a715d27 2026-05-08 13:08:20,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:08:20,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3d315ce316b79a715d27 HTTP/1.1" 200 None 2026-05-08 13:08:20,729 - lava_callback - DEBUG - Processing node 69fb3d315ce316b79a715d27: baseline-arm-baylibre 2026-05-08 13:08:20,729 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3d315ce316b79a715d27 2026-05-08 13:08:20,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:08:20,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3d315ce316b79a715d27 HTTP/1.1" 200 None 2026-05-08 13:08:20,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:08:20,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:08:20,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:08:20,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3d315ce316b79a715d27 HTTP/1.1" 200 None 2026-05-08 13:08:20,776 - lava_callback - ERROR - Error processing callback for node 69fb3d315ce316b79a715d27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:09:00,496 - lava_callback - INFO - Received callback for node 69fb3d595ce316b79a715d35 INFO: 172.21.0.1:44978 - "POST /node/69fb3d595ce316b79a715d35 HTTP/1.0" 202 Accepted 2026-05-08 13:09:00,503 - lava_callback - INFO - Starting async job submit for node 69fb3d595ce316b79a715d35 2026-05-08 13:09:00,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:09:00,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3d595ce316b79a715d35 HTTP/1.1" 200 None 2026-05-08 13:09:00,518 - lava_callback - DEBUG - Processing node 69fb3d595ce316b79a715d35: baseline-arm-baylibre 2026-05-08 13:09:00,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3d595ce316b79a715d35 2026-05-08 13:09:00,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:09:00,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3d595ce316b79a715d35 HTTP/1.1" 200 None 2026-05-08 13:09:00,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:09:00,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:09:00,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:09:00,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3d595ce316b79a715d35 HTTP/1.1" 200 None 2026-05-08 13:09:00,567 - lava_callback - ERROR - Error processing callback for node 69fb3d595ce316b79a715d35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58950 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:09:20,507 - lava_callback - INFO - Received callback for node 69fb3d7c5ce316b79a715d45 INFO: 172.21.0.1:34176 - "POST /node/69fb3d7c5ce316b79a715d45 HTTP/1.0" 202 Accepted 2026-05-08 13:09:20,512 - lava_callback - INFO - Starting async job submit for node 69fb3d7c5ce316b79a715d45 2026-05-08 13:09:20,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:09:20,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3d7c5ce316b79a715d45 HTTP/1.1" 200 None 2026-05-08 13:09:20,532 - lava_callback - DEBUG - Processing node 69fb3d7c5ce316b79a715d45: baseline-arm-baylibre 2026-05-08 13:09:20,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3d7c5ce316b79a715d45 2026-05-08 13:09:20,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:09:20,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3d7c5ce316b79a715d45 HTTP/1.1" 200 None 2026-05-08 13:09:20,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:09:20,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:09:20,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:09:20,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3d7c5ce316b79a715d45 HTTP/1.1" 200 None 2026-05-08 13:09:20,580 - lava_callback - ERROR - Error processing callback for node 69fb3d7c5ce316b79a715d45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:10:00,573 - lava_callback - INFO - Received callback for node 69fb3da55ce316b79a715d53 INFO: 172.21.0.1:46704 - "POST /node/69fb3da55ce316b79a715d53 HTTP/1.0" 202 Accepted 2026-05-08 13:10:00,580 - lava_callback - INFO - Starting async job submit for node 69fb3da55ce316b79a715d53 2026-05-08 13:10:00,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:10:00,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3da55ce316b79a715d53 HTTP/1.1" 200 None 2026-05-08 13:10:00,597 - lava_callback - DEBUG - Processing node 69fb3da55ce316b79a715d53: baseline-arm-baylibre 2026-05-08 13:10:00,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3da55ce316b79a715d53 2026-05-08 13:10:00,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:10:00,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3da55ce316b79a715d53 HTTP/1.1" 200 None 2026-05-08 13:10:00,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:10:00,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:10:00,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:10:00,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3da55ce316b79a715d53 HTTP/1.1" 200 None 2026-05-08 13:10:00,642 - lava_callback - ERROR - Error processing callback for node 69fb3da55ce316b79a715d53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:10:40,614 - lava_callback - INFO - Received callback for node 69fb3dcc5ce316b79a715d61 INFO: 172.21.0.1:38326 - "POST /node/69fb3dcc5ce316b79a715d61 HTTP/1.0" 202 Accepted 2026-05-08 13:10:40,620 - lava_callback - INFO - Starting async job submit for node 69fb3dcc5ce316b79a715d61 2026-05-08 13:10:40,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:10:40,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3dcc5ce316b79a715d61 HTTP/1.1" 200 None 2026-05-08 13:10:40,643 - lava_callback - DEBUG - Processing node 69fb3dcc5ce316b79a715d61: baseline-arm-baylibre 2026-05-08 13:10:40,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3dcc5ce316b79a715d61 2026-05-08 13:10:40,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:10:40,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3dcc5ce316b79a715d61 HTTP/1.1" 200 None 2026-05-08 13:10:40,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:10:40,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:10:40,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:10:40,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3dcc5ce316b79a715d61 HTTP/1.1" 200 None 2026-05-08 13:10:40,688 - lava_callback - ERROR - Error processing callback for node 69fb3dcc5ce316b79a715d61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:11:20,684 - lava_callback - INFO - Received callback for node 69fb3df25ce316b79a715d73 INFO: 172.21.0.1:48004 - "POST /node/69fb3df25ce316b79a715d73 HTTP/1.0" 202 Accepted 2026-05-08 13:11:20,690 - lava_callback - INFO - Starting async job submit for node 69fb3df25ce316b79a715d73 2026-05-08 13:11:20,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:11:20,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3df25ce316b79a715d73 HTTP/1.1" 200 None 2026-05-08 13:11:20,731 - lava_callback - DEBUG - Processing node 69fb3df25ce316b79a715d73: baseline-arm-baylibre 2026-05-08 13:11:20,731 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3df25ce316b79a715d73 2026-05-08 13:11:20,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:11:20,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3df25ce316b79a715d73 HTTP/1.1" 200 None 2026-05-08 13:11:20,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:11:20,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:11:20,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:11:20,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3df25ce316b79a715d73 HTTP/1.1" 200 None 2026-05-08 13:11:20,785 - lava_callback - ERROR - Error processing callback for node 69fb3df25ce316b79a715d73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33278 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:12:06,686 - lava_callback - INFO - Received callback for node 69fb3e175ce316b79a715d7c INFO: 172.21.0.1:33290 - "POST /node/69fb3e175ce316b79a715d7c HTTP/1.0" 202 Accepted 2026-05-08 13:12:06,692 - lava_callback - INFO - Starting async job submit for node 69fb3e175ce316b79a715d7c 2026-05-08 13:12:06,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:12:06,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3e175ce316b79a715d7c HTTP/1.1" 200 None 2026-05-08 13:12:06,711 - lava_callback - DEBUG - Processing node 69fb3e175ce316b79a715d7c: baseline-arm-clabbe 2026-05-08 13:12:06,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3e175ce316b79a715d7c 2026-05-08 13:12:06,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:12:06,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3e175ce316b79a715d7c HTTP/1.1" 200 None 2026-05-08 13:12:06,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:12:06,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:12:06,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:12:06,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3e175ce316b79a715d7c HTTP/1.1" 200 None 2026-05-08 13:12:06,755 - lava_callback - ERROR - Error processing callback for node 69fb3e175ce316b79a715d7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:12:46,746 - lava_callback - INFO - Received callback for node 69fb3e3c5ce316b79a715d89 INFO: 172.21.0.1:34808 - "POST /node/69fb3e3c5ce316b79a715d89 HTTP/1.0" 202 Accepted 2026-05-08 13:12:46,751 - lava_callback - INFO - Starting async job submit for node 69fb3e3c5ce316b79a715d89 2026-05-08 13:12:46,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:12:46,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3e3c5ce316b79a715d89 HTTP/1.1" 200 None 2026-05-08 13:12:46,766 - lava_callback - DEBUG - Processing node 69fb3e3c5ce316b79a715d89: baseline-arm-clabbe 2026-05-08 13:12:46,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3e3c5ce316b79a715d89 2026-05-08 13:12:46,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:12:46,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3e3c5ce316b79a715d89 HTTP/1.1" 200 None 2026-05-08 13:12:46,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:12:46,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:12:46,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:12:46,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3e3c5ce316b79a715d89 HTTP/1.1" 200 None 2026-05-08 13:12:46,810 - lava_callback - ERROR - Error processing callback for node 69fb3e3c5ce316b79a715d89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43922 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:13:26,782 - lava_callback - INFO - Received callback for node 69fb3e615ce316b79a715d9a INFO: 172.21.0.1:43934 - "POST /node/69fb3e615ce316b79a715d9a HTTP/1.0" 202 Accepted 2026-05-08 13:13:26,788 - lava_callback - INFO - Starting async job submit for node 69fb3e615ce316b79a715d9a 2026-05-08 13:13:26,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:13:26,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3e615ce316b79a715d9a HTTP/1.1" 200 None 2026-05-08 13:13:26,803 - lava_callback - DEBUG - Processing node 69fb3e615ce316b79a715d9a: baseline-arm-clabbe 2026-05-08 13:13:26,803 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3e615ce316b79a715d9a 2026-05-08 13:13:26,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:13:26,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3e615ce316b79a715d9a HTTP/1.1" 200 None 2026-05-08 13:13:26,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:13:26,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:13:26,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:13:26,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3e615ce316b79a715d9a HTTP/1.1" 200 None 2026-05-08 13:13:26,883 - lava_callback - ERROR - Error processing callback for node 69fb3e615ce316b79a715d9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52410 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:13:46,667 - lava_callback - INFO - Received callback for node 69fb3e865ce316b79a715da7 INFO: 172.21.0.1:52426 - "POST /node/69fb3e865ce316b79a715da7 HTTP/1.0" 202 Accepted 2026-05-08 13:13:46,673 - lava_callback - INFO - Starting async job submit for node 69fb3e865ce316b79a715da7 2026-05-08 13:13:46,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:13:46,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3e865ce316b79a715da7 HTTP/1.1" 200 None 2026-05-08 13:13:46,688 - lava_callback - DEBUG - Processing node 69fb3e865ce316b79a715da7: baseline-arm-clabbe 2026-05-08 13:13:46,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3e865ce316b79a715da7 2026-05-08 13:13:46,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:13:46,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3e865ce316b79a715da7 HTTP/1.1" 200 None 2026-05-08 13:13:46,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:13:46,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:13:46,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:13:46,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3e865ce316b79a715da7 HTTP/1.1" 200 None 2026-05-08 13:13:46,734 - lava_callback - ERROR - Error processing callback for node 69fb3e865ce316b79a715da7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:14:26,748 - lava_callback - INFO - Received callback for node 69fb3eab5ce316b79a715db5 INFO: 172.21.0.1:47854 - "POST /node/69fb3eab5ce316b79a715db5 HTTP/1.0" 202 Accepted 2026-05-08 13:14:26,754 - lava_callback - INFO - Starting async job submit for node 69fb3eab5ce316b79a715db5 2026-05-08 13:14:26,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:14:26,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3eab5ce316b79a715db5 HTTP/1.1" 200 None 2026-05-08 13:14:26,769 - lava_callback - DEBUG - Processing node 69fb3eab5ce316b79a715db5: baseline-arm-clabbe 2026-05-08 13:14:26,769 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3eab5ce316b79a715db5 2026-05-08 13:14:26,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:14:26,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3eab5ce316b79a715db5 HTTP/1.1" 200 None 2026-05-08 13:14:26,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:14:26,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:14:26,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:14:26,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3eab5ce316b79a715db5 HTTP/1.1" 200 None 2026-05-08 13:14:26,870 - lava_callback - ERROR - Error processing callback for node 69fb3eab5ce316b79a715db5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:15:06,766 - lava_callback - INFO - Received callback for node 69fb3ed15ce316b79a715dc3 INFO: 172.21.0.1:43084 - "POST /node/69fb3ed15ce316b79a715dc3 HTTP/1.0" 202 Accepted 2026-05-08 13:15:06,771 - lava_callback - INFO - Starting async job submit for node 69fb3ed15ce316b79a715dc3 2026-05-08 13:15:06,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:15:06,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3ed15ce316b79a715dc3 HTTP/1.1" 200 None 2026-05-08 13:15:06,787 - lava_callback - DEBUG - Processing node 69fb3ed15ce316b79a715dc3: baseline-arm-clabbe 2026-05-08 13:15:06,787 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3ed15ce316b79a715dc3 2026-05-08 13:15:06,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:15:06,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3ed15ce316b79a715dc3 HTTP/1.1" 200 None 2026-05-08 13:15:06,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:15:06,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:15:06,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:15:06,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3ed15ce316b79a715dc3 HTTP/1.1" 200 None 2026-05-08 13:15:06,849 - lava_callback - ERROR - Error processing callback for node 69fb3ed15ce316b79a715dc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:15:46,806 - lava_callback - INFO - Received callback for node 69fb3ef75ce316b79a715dd2 INFO: 172.21.0.1:55810 - "POST /node/69fb3ef75ce316b79a715dd2 HTTP/1.0" 202 Accepted 2026-05-08 13:15:46,811 - lava_callback - INFO - Starting async job submit for node 69fb3ef75ce316b79a715dd2 2026-05-08 13:15:46,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:15:46,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3ef75ce316b79a715dd2 HTTP/1.1" 200 None 2026-05-08 13:15:46,827 - lava_callback - DEBUG - Processing node 69fb3ef75ce316b79a715dd2: baseline-arm-clabbe 2026-05-08 13:15:46,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3ef75ce316b79a715dd2 2026-05-08 13:15:46,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:15:46,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3ef75ce316b79a715dd2 HTTP/1.1" 200 None 2026-05-08 13:15:46,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:15:46,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:15:46,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:15:46,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3ef75ce316b79a715dd2 HTTP/1.1" 200 None 2026-05-08 13:15:46,890 - lava_callback - ERROR - Error processing callback for node 69fb3ef75ce316b79a715dd2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:16:26,774 - lava_callback - INFO - Received callback for node 69fb3f1d5ce316b79a715de1 INFO: 172.21.0.1:54822 - "POST /node/69fb3f1d5ce316b79a715de1 HTTP/1.0" 202 Accepted 2026-05-08 13:16:26,779 - lava_callback - INFO - Starting async job submit for node 69fb3f1d5ce316b79a715de1 2026-05-08 13:16:26,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:16:26,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3f1d5ce316b79a715de1 HTTP/1.1" 200 None 2026-05-08 13:16:26,805 - lava_callback - DEBUG - Processing node 69fb3f1d5ce316b79a715de1: baseline-arm-clabbe 2026-05-08 13:16:26,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3f1d5ce316b79a715de1 2026-05-08 13:16:26,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:16:26,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3f1d5ce316b79a715de1 HTTP/1.1" 200 None 2026-05-08 13:16:26,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:16:26,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:16:26,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:16:26,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3f1d5ce316b79a715de1 HTTP/1.1" 200 None 2026-05-08 13:16:26,869 - lava_callback - ERROR - Error processing callback for node 69fb3f1d5ce316b79a715de1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:17:06,835 - lava_callback - INFO - Received callback for node 69fb3f415ce316b79a715def INFO: 172.21.0.1:52252 - "POST /node/69fb3f415ce316b79a715def HTTP/1.0" 202 Accepted 2026-05-08 13:17:06,841 - lava_callback - INFO - Starting async job submit for node 69fb3f415ce316b79a715def 2026-05-08 13:17:06,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:17:06,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3f415ce316b79a715def HTTP/1.1" 200 None 2026-05-08 13:17:06,856 - lava_callback - DEBUG - Processing node 69fb3f415ce316b79a715def: baseline-arm-clabbe 2026-05-08 13:17:06,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb3f415ce316b79a715def 2026-05-08 13:17:06,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:17:06,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb3f415ce316b79a715def HTTP/1.1" 200 None 2026-05-08 13:17:06,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:17:06,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-08 13:17:06,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:17:06,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb3f415ce316b79a715def HTTP/1.1" 200 None 2026-05-08 13:17:06,909 - lava_callback - ERROR - Error processing callback for node 69fb3f415ce316b79a715def: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53812 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:32:41,994 - lava_callback - INFO - Received callback for node 69fb42e85ce316b79a715eaa INFO: 172.21.0.1:58136 - "POST /node/69fb42e85ce316b79a715eaa HTTP/1.0" 202 Accepted 2026-05-08 13:32:42,000 - lava_callback - INFO - Starting async job submit for node 69fb42e85ce316b79a715eaa 2026-05-08 13:32:42,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:32:42,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb42e85ce316b79a715eaa HTTP/1.1" 200 None 2026-05-08 13:32:42,017 - lava_callback - DEBUG - Processing node 69fb42e85ce316b79a715eaa: baseline-arm64-baylibre 2026-05-08 13:32:42,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb42e85ce316b79a715eaa 2026-05-08 13:32:42,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:32:42,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb42e85ce316b79a715eaa HTTP/1.1" 200 None 2026-05-08 13:32:42,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:32:42,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 13:32:42,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:32:42,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb42e85ce316b79a715eaa HTTP/1.1" 200 None 2026-05-08 13:32:42,073 - lava_callback - ERROR - Error processing callback for node 69fb42e85ce316b79a715eaa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:33:41,925 - lava_callback - INFO - Received callback for node 69fb43335ce316b79a715eca INFO: 172.21.0.1:47302 - "POST /node/69fb43335ce316b79a715eca HTTP/1.0" 202 Accepted 2026-05-08 13:33:41,930 - lava_callback - INFO - Starting async job submit for node 69fb43335ce316b79a715eca 2026-05-08 13:33:41,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:33:41,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb43335ce316b79a715eca HTTP/1.1" 200 None 2026-05-08 13:33:41,945 - lava_callback - DEBUG - Processing node 69fb43335ce316b79a715eca: baseline-arm64-baylibre 2026-05-08 13:33:41,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb43335ce316b79a715eca 2026-05-08 13:33:41,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:33:41,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb43335ce316b79a715eca HTTP/1.1" 200 None 2026-05-08 13:33:41,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:33:41,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 13:33:41,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:33:41,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb43335ce316b79a715eca HTTP/1.1" 200 None 2026-05-08 13:33:41,990 - lava_callback - ERROR - Error processing callback for node 69fb43335ce316b79a715eca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:35:02,016 - lava_callback - INFO - Received callback for node 69fb437c5ce316b79a715eee INFO: 172.21.0.1:33140 - "POST /node/69fb437c5ce316b79a715eee HTTP/1.0" 202 Accepted 2026-05-08 13:35:02,021 - lava_callback - INFO - Starting async job submit for node 69fb437c5ce316b79a715eee 2026-05-08 13:35:02,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:35:02,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb437c5ce316b79a715eee HTTP/1.1" 200 None 2026-05-08 13:35:02,037 - lava_callback - DEBUG - Processing node 69fb437c5ce316b79a715eee: baseline-arm64-baylibre 2026-05-08 13:35:02,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb437c5ce316b79a715eee 2026-05-08 13:35:02,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:35:02,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb437c5ce316b79a715eee HTTP/1.1" 200 None 2026-05-08 13:35:02,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:35:02,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 13:35:02,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:35:02,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb437c5ce316b79a715eee HTTP/1.1" 200 None 2026-05-08 13:35:02,081 - lava_callback - ERROR - Error processing callback for node 69fb437c5ce316b79a715eee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49020 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:36:22,074 - lava_callback - INFO - Received callback for node 69fb43cc5ce316b79a715f10 INFO: 172.21.0.1:35298 - "POST /node/69fb43cc5ce316b79a715f10 HTTP/1.0" 202 Accepted 2026-05-08 13:36:22,080 - lava_callback - INFO - Starting async job submit for node 69fb43cc5ce316b79a715f10 2026-05-08 13:36:22,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:36:22,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb43cc5ce316b79a715f10 HTTP/1.1" 200 None 2026-05-08 13:36:22,095 - lava_callback - DEBUG - Processing node 69fb43cc5ce316b79a715f10: baseline-arm64-baylibre 2026-05-08 13:36:22,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb43cc5ce316b79a715f10 2026-05-08 13:36:22,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:36:22,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb43cc5ce316b79a715f10 HTTP/1.1" 200 None 2026-05-08 13:36:22,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:36:22,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 13:36:22,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:36:22,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb43cc5ce316b79a715f10 HTTP/1.1" 200 None 2026-05-08 13:36:22,154 - lava_callback - ERROR - Error processing callback for node 69fb43cc5ce316b79a715f10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:38:22,378 - lava_callback - INFO - Received callback for node 69fb44455ce316b79a715f35 INFO: 172.21.0.1:38652 - "POST /node/69fb44455ce316b79a715f35 HTTP/1.0" 202 Accepted 2026-05-08 13:38:22,384 - lava_callback - INFO - Starting async job submit for node 69fb44455ce316b79a715f35 2026-05-08 13:38:22,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:38:22,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb44455ce316b79a715f35 HTTP/1.1" 200 None 2026-05-08 13:38:22,404 - lava_callback - DEBUG - Processing node 69fb44455ce316b79a715f35: baseline-arm64-baylibre 2026-05-08 13:38:22,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb44455ce316b79a715f35 2026-05-08 13:38:22,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:38:22,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb44455ce316b79a715f35 HTTP/1.1" 200 None 2026-05-08 13:38:22,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:38:22,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 13:38:22,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:38:22,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb44455ce316b79a715f35 HTTP/1.1" 200 None 2026-05-08 13:38:22,453 - lava_callback - ERROR - Error processing callback for node 69fb44455ce316b79a715f35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43066 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:40:22,304 - lava_callback - INFO - Received callback for node 69fb44be5ce316b79a715f5f INFO: 172.21.0.1:46126 - "POST /node/69fb44be5ce316b79a715f5f HTTP/1.0" 202 Accepted 2026-05-08 13:40:22,309 - lava_callback - INFO - Starting async job submit for node 69fb44be5ce316b79a715f5f 2026-05-08 13:40:22,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:40:22,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb44be5ce316b79a715f5f HTTP/1.1" 200 None 2026-05-08 13:40:22,329 - lava_callback - DEBUG - Processing node 69fb44be5ce316b79a715f5f: baseline-arm64-baylibre 2026-05-08 13:40:22,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb44be5ce316b79a715f5f 2026-05-08 13:40:22,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:40:22,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb44be5ce316b79a715f5f HTTP/1.1" 200 None 2026-05-08 13:40:22,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:40:22,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 13:40:22,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:40:22,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb44be5ce316b79a715f5f HTTP/1.1" 200 None 2026-05-08 13:40:22,375 - lava_callback - ERROR - Error processing callback for node 69fb44be5ce316b79a715f5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:41:47,801 - lava_callback - INFO - Received callback for node 69fb45105ce316b79a715f7b INFO: 172.21.0.1:36848 - "POST /node/69fb45105ce316b79a715f7b HTTP/1.0" 202 Accepted 2026-05-08 13:41:47,807 - lava_callback - INFO - Starting async job submit for node 69fb45105ce316b79a715f7b 2026-05-08 13:41:47,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:41:47,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb45105ce316b79a715f7b HTTP/1.1" 200 None 2026-05-08 13:41:47,822 - lava_callback - DEBUG - Processing node 69fb45105ce316b79a715f7b: baseline-arm64-clabbe 2026-05-08 13:41:47,822 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb45105ce316b79a715f7b 2026-05-08 13:41:47,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:41:47,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb45105ce316b79a715f7b HTTP/1.1" 200 None 2026-05-08 13:41:47,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:41:47,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 13:41:47,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:41:47,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb45105ce316b79a715f7b HTTP/1.1" 200 None 2026-05-08 13:41:47,887 - lava_callback - ERROR - Error processing callback for node 69fb45105ce316b79a715f7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59140 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:43:27,876 - lava_callback - INFO - Received callback for node 69fb45785ce316b79a715fa3 INFO: 172.21.0.1:59148 - "POST /node/69fb45785ce316b79a715fa3 HTTP/1.0" 202 Accepted 2026-05-08 13:43:27,882 - lava_callback - INFO - Starting async job submit for node 69fb45785ce316b79a715fa3 2026-05-08 13:43:27,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:43:27,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb45785ce316b79a715fa3 HTTP/1.1" 200 None 2026-05-08 13:43:27,897 - lava_callback - DEBUG - Processing node 69fb45785ce316b79a715fa3: baseline-arm64-clabbe 2026-05-08 13:43:27,897 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb45785ce316b79a715fa3 2026-05-08 13:43:27,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:43:27,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb45785ce316b79a715fa3 HTTP/1.1" 200 None 2026-05-08 13:43:27,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:43:27,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 13:43:27,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:43:27,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb45785ce316b79a715fa3 HTTP/1.1" 200 None 2026-05-08 13:43:27,942 - lava_callback - ERROR - Error processing callback for node 69fb45785ce316b79a715fa3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48346 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:44:47,880 - lava_callback - INFO - Received callback for node 69fb45c65ce316b79a715fbf INFO: 172.21.0.1:48358 - "POST /node/69fb45c65ce316b79a715fbf HTTP/1.0" 202 Accepted 2026-05-08 13:44:47,886 - lava_callback - INFO - Starting async job submit for node 69fb45c65ce316b79a715fbf 2026-05-08 13:44:47,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:44:47,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb45c65ce316b79a715fbf HTTP/1.1" 200 None 2026-05-08 13:44:47,938 - lava_callback - DEBUG - Processing node 69fb45c65ce316b79a715fbf: baseline-arm64-clabbe 2026-05-08 13:44:47,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb45c65ce316b79a715fbf 2026-05-08 13:44:47,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:44:47,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb45c65ce316b79a715fbf HTTP/1.1" 200 None 2026-05-08 13:44:47,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:44:48,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 13:44:48,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:44:48,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb45c65ce316b79a715fbf HTTP/1.1" 200 None 2026-05-08 13:44:48,049 - lava_callback - ERROR - Error processing callback for node 69fb45c65ce316b79a715fbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60632 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:46:07,946 - lava_callback - INFO - Received callback for node 69fb46145ce316b79a715fe3 INFO: 172.21.0.1:60634 - "POST /node/69fb46145ce316b79a715fe3 HTTP/1.0" 202 Accepted 2026-05-08 13:46:07,952 - lava_callback - INFO - Starting async job submit for node 69fb46145ce316b79a715fe3 2026-05-08 13:46:07,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:46:07,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb46145ce316b79a715fe3 HTTP/1.1" 200 None 2026-05-08 13:46:07,966 - lava_callback - DEBUG - Processing node 69fb46145ce316b79a715fe3: baseline-arm64-clabbe 2026-05-08 13:46:07,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb46145ce316b79a715fe3 2026-05-08 13:46:07,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:46:07,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb46145ce316b79a715fe3 HTTP/1.1" 200 None 2026-05-08 13:46:07,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:46:07,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 13:46:08,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:46:08,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb46145ce316b79a715fe3 HTTP/1.1" 200 None 2026-05-08 13:46:08,018 - lava_callback - ERROR - Error processing callback for node 69fb46145ce316b79a715fe3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:47:28,032 - lava_callback - INFO - Received callback for node 69fb46635ce316b79a71600f INFO: 172.21.0.1:56006 - "POST /node/69fb46635ce316b79a71600f HTTP/1.0" 202 Accepted 2026-05-08 13:47:28,037 - lava_callback - INFO - Starting async job submit for node 69fb46635ce316b79a71600f 2026-05-08 13:47:28,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:47:28,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb46635ce316b79a71600f HTTP/1.1" 200 None 2026-05-08 13:47:28,054 - lava_callback - DEBUG - Processing node 69fb46635ce316b79a71600f: baseline-arm64-clabbe 2026-05-08 13:47:28,054 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb46635ce316b79a71600f 2026-05-08 13:47:28,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:47:28,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb46635ce316b79a71600f HTTP/1.1" 200 None 2026-05-08 13:47:28,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:47:28,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 13:47:28,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:47:28,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb46635ce316b79a71600f HTTP/1.1" 200 None 2026-05-08 13:47:28,108 - lava_callback - ERROR - Error processing callback for node 69fb46635ce316b79a71600f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50446 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:48:48,003 - lava_callback - INFO - Received callback for node 69fb46b15ce316b79a716026 INFO: 172.21.0.1:50452 - "POST /node/69fb46b15ce316b79a716026 HTTP/1.0" 202 Accepted 2026-05-08 13:48:48,009 - lava_callback - INFO - Starting async job submit for node 69fb46b15ce316b79a716026 2026-05-08 13:48:48,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:48:48,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb46b15ce316b79a716026 HTTP/1.1" 200 None 2026-05-08 13:48:48,051 - lava_callback - DEBUG - Processing node 69fb46b15ce316b79a716026: baseline-arm64-clabbe 2026-05-08 13:48:48,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb46b15ce316b79a716026 2026-05-08 13:48:48,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:48:48,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb46b15ce316b79a716026 HTTP/1.1" 200 None 2026-05-08 13:48:48,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 13:48:48,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-08 13:48:48,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:50460 - "GET / HTTP/1.0" 200 OK 2026-05-08 13:48:48,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb46b15ce316b79a716026 HTTP/1.1" 200 None 2026-05-08 13:48:48,155 - lava_callback - ERROR - Error processing callback for node 69fb46b15ce316b79a716026: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34234 - "GET / HTTP/1.0" 200 OK 2026-05-08 14:20:04,623 - lava_callback - INFO - Received callback for node 69fb4e115ce316b79a716095 INFO: 172.21.0.1:56634 - "POST /node/69fb4e115ce316b79a716095 HTTP/1.0" 202 Accepted 2026-05-08 14:20:04,628 - lava_callback - INFO - Starting async job submit for node 69fb4e115ce316b79a716095 2026-05-08 14:20:04,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:20:04,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb4e115ce316b79a716095 HTTP/1.1" 200 None 2026-05-08 14:20:04,644 - lava_callback - DEBUG - Processing node 69fb4e115ce316b79a716095: baseline-arm64-baylibre 2026-05-08 14:20:04,644 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb4e115ce316b79a716095 2026-05-08 14:20:04,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:20:04,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb4e115ce316b79a716095 HTTP/1.1" 200 None 2026-05-08 14:20:04,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:20:04,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 14:20:04,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:20:04,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb4e115ce316b79a716095 HTTP/1.1" 200 None 2026-05-08 14:20:04,688 - lava_callback - ERROR - Error processing callback for node 69fb4e115ce316b79a716095: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK 2026-05-08 14:23:04,664 - lava_callback - INFO - Received callback for node 69fb4ec65ce316b79a7160bf INFO: 172.21.0.1:51226 - "POST /node/69fb4ec65ce316b79a7160bf HTTP/1.0" 202 Accepted 2026-05-08 14:23:04,669 - lava_callback - INFO - Starting async job submit for node 69fb4ec65ce316b79a7160bf 2026-05-08 14:23:04,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:23:04,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb4ec65ce316b79a7160bf HTTP/1.1" 200 None 2026-05-08 14:23:04,685 - lava_callback - DEBUG - Processing node 69fb4ec65ce316b79a7160bf: baseline-arm64-baylibre 2026-05-08 14:23:04,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb4ec65ce316b79a7160bf 2026-05-08 14:23:04,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:23:04,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb4ec65ce316b79a7160bf HTTP/1.1" 200 None 2026-05-08 14:23:04,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:23:04,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 14:23:04,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:23:04,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb4ec65ce316b79a7160bf HTTP/1.1" 200 None 2026-05-08 14:23:04,730 - lava_callback - ERROR - Error processing callback for node 69fb4ec65ce316b79a7160bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38258 - "GET / HTTP/1.0" 200 OK 2026-05-08 14:24:24,924 - lava_callback - INFO - Received callback for node 69fb4f165ce316b79a7160e1 INFO: 172.21.0.1:51188 - "POST /node/69fb4f165ce316b79a7160e1 HTTP/1.0" 202 Accepted 2026-05-08 14:24:24,930 - lava_callback - INFO - Starting async job submit for node 69fb4f165ce316b79a7160e1 2026-05-08 14:24:24,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:24:24,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb4f165ce316b79a7160e1 HTTP/1.1" 200 None 2026-05-08 14:24:24,953 - lava_callback - DEBUG - Processing node 69fb4f165ce316b79a7160e1: baseline-arm64-baylibre 2026-05-08 14:24:24,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb4f165ce316b79a7160e1 2026-05-08 14:24:24,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:24:24,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb4f165ce316b79a7160e1 HTTP/1.1" 200 None 2026-05-08 14:24:24,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:24:24,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 14:24:24,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:24:25,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb4f165ce316b79a7160e1 HTTP/1.1" 200 None 2026-05-08 14:24:25,007 - lava_callback - ERROR - Error processing callback for node 69fb4f165ce316b79a7160e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38548 - "GET / HTTP/1.0" 200 OK 2026-05-08 14:26:04,815 - lava_callback - INFO - Received callback for node 69fb4f675ce316b79a7160fe INFO: 172.21.0.1:38328 - "POST /node/69fb4f675ce316b79a7160fe HTTP/1.0" 202 Accepted 2026-05-08 14:26:04,821 - lava_callback - INFO - Starting async job submit for node 69fb4f675ce316b79a7160fe 2026-05-08 14:26:04,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:26:04,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb4f675ce316b79a7160fe HTTP/1.1" 200 None 2026-05-08 14:26:04,837 - lava_callback - DEBUG - Processing node 69fb4f675ce316b79a7160fe: baseline-arm64-baylibre 2026-05-08 14:26:04,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb4f675ce316b79a7160fe 2026-05-08 14:26:04,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:26:04,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb4f675ce316b79a7160fe HTTP/1.1" 200 None 2026-05-08 14:26:04,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:26:04,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 14:26:04,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:26:04,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb4f675ce316b79a7160fe HTTP/1.1" 200 None 2026-05-08 14:26:04,891 - lava_callback - ERROR - Error processing callback for node 69fb4f675ce316b79a7160fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44134 - "GET / HTTP/1.0" 200 OK 2026-05-08 14:29:04,932 - lava_callback - INFO - Received callback for node 69fb501b5ce316b79a716120 INFO: 172.21.0.1:37668 - "POST /node/69fb501b5ce316b79a716120 HTTP/1.0" 202 Accepted 2026-05-08 14:29:04,938 - lava_callback - INFO - Starting async job submit for node 69fb501b5ce316b79a716120 2026-05-08 14:29:04,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:29:04,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb501b5ce316b79a716120 HTTP/1.1" 200 None 2026-05-08 14:29:04,952 - lava_callback - DEBUG - Processing node 69fb501b5ce316b79a716120: baseline-arm64-baylibre 2026-05-08 14:29:04,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb501b5ce316b79a716120 2026-05-08 14:29:04,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:29:04,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb501b5ce316b79a716120 HTTP/1.1" 200 None 2026-05-08 14:29:04,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:29:04,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 14:29:04,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:29:04,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb501b5ce316b79a716120 HTTP/1.1" 200 None 2026-05-08 14:29:04,997 - lava_callback - ERROR - Error processing callback for node 69fb501b5ce316b79a716120: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK 2026-05-08 14:31:45,122 - lava_callback - INFO - Received callback for node 69fb50bc5ce316b79a716143 INFO: 172.21.0.1:50454 - "POST /node/69fb50bc5ce316b79a716143 HTTP/1.0" 202 Accepted 2026-05-08 14:31:45,127 - lava_callback - INFO - Starting async job submit for node 69fb50bc5ce316b79a716143 2026-05-08 14:31:45,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:31:45,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb50bc5ce316b79a716143 HTTP/1.1" 200 None 2026-05-08 14:31:45,160 - lava_callback - DEBUG - Processing node 69fb50bc5ce316b79a716143: baseline-arm64-baylibre 2026-05-08 14:31:45,160 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb50bc5ce316b79a716143 2026-05-08 14:31:45,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:31:45,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb50bc5ce316b79a716143 HTTP/1.1" 200 None 2026-05-08 14:31:45,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:31:45,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 14:31:45,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:31:45,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb50bc5ce316b79a716143 HTTP/1.1" 200 None 2026-05-08 14:31:45,205 - lava_callback - ERROR - Error processing callback for node 69fb50bc5ce316b79a716143: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET / HTTP/1.0" 200 OK 2026-05-08 14:33:09,724 - lava_callback - INFO - Received callback for node 69fb51175ce316b79a716164 INFO: 172.21.0.1:52670 - "POST /node/69fb51175ce316b79a716164 HTTP/1.0" 202 Accepted 2026-05-08 14:33:09,731 - lava_callback - INFO - Starting async job submit for node 69fb51175ce316b79a716164 2026-05-08 14:33:09,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:33:09,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb51175ce316b79a716164 HTTP/1.1" 200 None 2026-05-08 14:33:09,748 - lava_callback - DEBUG - Processing node 69fb51175ce316b79a716164: baseline-arm64-clabbe 2026-05-08 14:33:09,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fb51175ce316b79a716164 2026-05-08 14:33:09,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:33:09,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fb51175ce316b79a716164 HTTP/1.1" 200 None 2026-05-08 14:33:09,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:33:09,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-08 14:33:09,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-08 14:33:09,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fb51175ce316b79a716164 HTTP/1.1" 200 None 2026-05-08 14:33:09,824 - lava_callback - ERROR - Error processing callback for node 69fb51175ce316b79a716164: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error