INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59054 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:33:24,732 - lava_callback - INFO - Received callback for node 69c80262123b47fd2376fe6c 2026-03-28 16:33:24,739 - lava_callback - INFO - Starting async job submit for node 69c80262123b47fd2376fe6c INFO: 172.21.0.1:57656 - "POST /node/69c80262123b47fd2376fe6c HTTP/1.0" 202 Accepted 2026-03-28 16:33:24,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:33:24,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80262123b47fd2376fe6c HTTP/1.1" 200 None 2026-03-28 16:33:24,795 - lava_callback - DEBUG - Processing node 69c80262123b47fd2376fe6c: baseline-arm 2026-03-28 16:33:24,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:33:25,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:33:25,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c80262123b47fd2376fe6c/log.txt.gz 2026-03-28 16:33:25,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:33:25,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:33:25,776 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c80262123b47fd2376fe6c/lava-logs.yaml 2026-03-28 16:33:25,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:33:25,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:33:25,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c80262123b47fd2376fe6c/lava_callback.json.gz 2026-03-28 16:33:25,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:33:25,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80262123b47fd2376fe6c HTTP/1.1" 200 None 2026-03-28 16:33:25,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:33:26,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff48123b47fd2376d751 HTTP/1.1" 200 None 2026-03-28 16:33:26,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:33:26,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80262123b47fd2376fe6c HTTP/1.1" 200 None 2026-03-28 16:33:26,038 - lava_callback - INFO - Completed processing callback for node 69c80262123b47fd2376fe6c INFO: 172.21.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:33:56,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:33:56,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:41:32,133 - lava_callback - INFO - Received callback for node 69c804b0123b47fd2376fe9a INFO: 172.21.0.1:51462 - "POST /node/69c804b0123b47fd2376fe9a HTTP/1.0" 202 Accepted 2026-03-28 16:41:32,139 - lava_callback - INFO - Starting async job submit for node 69c804b0123b47fd2376fe9a 2026-03-28 16:41:32,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:41:32,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804b0123b47fd2376fe9a HTTP/1.1" 200 None 2026-03-28 16:41:32,206 - lava_callback - DEBUG - Processing node 69c804b0123b47fd2376fe9a: baseline-arm 2026-03-28 16:41:32,214 - lava_callback - WARNING - Failed to upload log 2026-03-28 16:41:32,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:41:32,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:41:32,386 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c804b0123b47fd2376fe9a/lava-logs.yaml 2026-03-28 16:41:32,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:41:32,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:41:32,553 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c804b0123b47fd2376fe9a/lava_callback.json.gz 2026-03-28 16:41:32,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:41:32,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804b0123b47fd2376fe9a HTTP/1.1" 200 None 2026-03-28 16:41:32,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:41:32,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:41:32,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:41:32,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804b0123b47fd2376fe9a HTTP/1.1" 200 None 2026-03-28 16:41:32,639 - lava_callback - INFO - Completed processing callback for node 69c804b0123b47fd2376fe9a 2026-03-28 16:41:34,710 - lava_callback - INFO - Received callback for node 69c804b0123b47fd2376fe97 INFO: 172.21.0.1:51470 - "POST /node/69c804b0123b47fd2376fe97 HTTP/1.0" 202 Accepted 2026-03-28 16:41:34,717 - lava_callback - INFO - Starting async job submit for node 69c804b0123b47fd2376fe97 2026-03-28 16:41:34,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:41:34,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804b0123b47fd2376fe97 HTTP/1.1" 200 None 2026-03-28 16:41:34,736 - lava_callback - DEBUG - Processing node 69c804b0123b47fd2376fe97: baseline-arm 2026-03-28 16:41:34,742 - lava_callback - WARNING - Failed to upload log 2026-03-28 16:41:34,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:41:34,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:41:34,858 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c804b0123b47fd2376fe97/lava-logs.yaml 2026-03-28 16:41:34,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:41:34,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:41:34,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c804b0123b47fd2376fe97/lava_callback.json.gz 2026-03-28 16:41:34,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:41:34,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804b0123b47fd2376fe97 HTTP/1.1" 200 None 2026-03-28 16:41:34,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:41:35,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:41:35,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:41:35,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804b0123b47fd2376fe97 HTTP/1.1" 200 None 2026-03-28 16:41:35,094 - lava_callback - INFO - Completed processing callback for node 69c804b0123b47fd2376fe97 INFO: 172.21.0.1:51474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:41:56,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:41:56,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47286 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:41:58,838 - lava_callback - INFO - Received callback for node 69c561c9abf66a8f4d9bbd7e INFO: 172.21.0.1:47292 - "POST /node/69c561c9abf66a8f4d9bbd7e HTTP/1.0" 202 Accepted 2026-03-28 16:41:58,843 - lava_callback - INFO - Starting async job submit for node 69c561c9abf66a8f4d9bbd7e 2026-03-28 16:41:58,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:41:58,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c561c9abf66a8f4d9bbd7e HTTP/1.1" 200 None 2026-03-28 16:41:58,859 - lava_callback - DEBUG - Processing node 69c561c9abf66a8f4d9bbd7e: baseline-arm-baylibre 2026-03-28 16:41:58,859 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c561c9abf66a8f4d9bbd7e 2026-03-28 16:41:58,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:41:58,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c561c9abf66a8f4d9bbd7e HTTP/1.1" 200 None 2026-03-28 16:41:58,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:41:58,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 16:41:58,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:41:58,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c561c9abf66a8f4d9bbd7e HTTP/1.1" 200 None 2026-03-28 16:41:58,919 - lava_callback - ERROR - Error processing callback for node 69c561c9abf66a8f4d9bbd7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:42:06,946 - lava_callback - INFO - Received callback for node 69c804b3123b47fd2376fea6 INFO: 172.21.0.1:33924 - "POST /node/69c804b3123b47fd2376fea6 HTTP/1.0" 202 Accepted 2026-03-28 16:42:06,998 - lava_callback - INFO - Starting async job submit for node 69c804b3123b47fd2376fea6 2026-03-28 16:42:07,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:07,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804b3123b47fd2376fea6 HTTP/1.1" 200 None 2026-03-28 16:42:07,031 - lava_callback - DEBUG - Processing node 69c804b3123b47fd2376fea6: baseline-arm 2026-03-28 16:42:07,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:07,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:07,311 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c804b3123b47fd2376fea6/log.txt.gz 2026-03-28 16:42:07,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:07,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:07,557 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c804b3123b47fd2376fea6/lava-logs.yaml 2026-03-28 16:42:07,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:07,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:07,718 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c804b3123b47fd2376fea6/lava_callback.json.gz 2026-03-28 16:42:07,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:07,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804b3123b47fd2376fea6 HTTP/1.1" 200 None 2026-03-28 16:42:07,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:07,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:42:07,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:07,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804b3123b47fd2376fea6 HTTP/1.1" 200 None 2026-03-28 16:42:07,794 - lava_callback - INFO - Completed processing callback for node 69c804b3123b47fd2376fea6 INFO: 172.21.0.1:52660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:42:26,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:26,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41206 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:42:38,225 - lava_callback - INFO - Received callback for node 69c561efabf66a8f4d9bbd91 INFO: 172.21.0.1:41220 - "POST /node/69c561efabf66a8f4d9bbd91 HTTP/1.0" 202 Accepted 2026-03-28 16:42:38,230 - lava_callback - INFO - Starting async job submit for node 69c561efabf66a8f4d9bbd91 2026-03-28 16:42:38,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:38,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c561efabf66a8f4d9bbd91 HTTP/1.1" 200 None 2026-03-28 16:42:38,250 - lava_callback - DEBUG - Processing node 69c561efabf66a8f4d9bbd91: baseline-arm-baylibre 2026-03-28 16:42:38,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c561efabf66a8f4d9bbd91 2026-03-28 16:42:38,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:38,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c561efabf66a8f4d9bbd91 HTTP/1.1" 200 None 2026-03-28 16:42:38,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:38,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 16:42:38,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:38,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c561efabf66a8f4d9bbd91 HTTP/1.1" 200 None 2026-03-28 16:42:38,311 - lava_callback - ERROR - Error processing callback for node 69c561efabf66a8f4d9bbd91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:42:45,493 - lava_callback - INFO - Received callback for node 69c804b2123b47fd2376fea3 INFO: 172.21.0.1:60168 - "POST /node/69c804b2123b47fd2376fea3 HTTP/1.0" 202 Accepted 2026-03-28 16:42:45,499 - lava_callback - INFO - Starting async job submit for node 69c804b2123b47fd2376fea3 2026-03-28 16:42:45,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:45,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804b2123b47fd2376fea3 HTTP/1.1" 200 None 2026-03-28 16:42:45,546 - lava_callback - DEBUG - Processing node 69c804b2123b47fd2376fea3: baseline-arm 2026-03-28 16:42:45,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:45,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:45,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c804b2123b47fd2376fea3/log.txt.gz 2026-03-28 16:42:46,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:46,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:46,257 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c804b2123b47fd2376fea3/lava-logs.yaml 2026-03-28 16:42:46,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:46,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:46,394 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c804b2123b47fd2376fea3/lava_callback.json.gz 2026-03-28 16:42:46,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:46,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804b2123b47fd2376fea3 HTTP/1.1" 200 None 2026-03-28 16:42:46,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:46,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:42:46,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:46,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804b2123b47fd2376fea3 HTTP/1.1" 200 None 2026-03-28 16:42:46,473 - lava_callback - INFO - Completed processing callback for node 69c804b2123b47fd2376fea3 INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:42:47,995 - lava_callback - INFO - Received callback for node 69c804d1123b47fd2376ff05 INFO: 172.21.0.1:60180 - "POST /node/69c804d1123b47fd2376ff05 HTTP/1.0" 202 Accepted 2026-03-28 16:42:48,041 - lava_callback - INFO - Starting async job submit for node 69c804d1123b47fd2376ff05 2026-03-28 16:42:48,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:48,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804d1123b47fd2376ff05 HTTP/1.1" 200 None 2026-03-28 16:42:48,118 - lava_callback - DEBUG - Processing node 69c804d1123b47fd2376ff05: baseline-arm-pengutronix 2026-03-28 16:42:48,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:48,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:48,426 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c804d1123b47fd2376ff05/log.txt.gz 2026-03-28 16:42:48,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:48,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:48,655 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c804d1123b47fd2376ff05/lava-logs.yaml 2026-03-28 16:42:48,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:48,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:48,797 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c804d1123b47fd2376ff05/lava_callback.json.gz 2026-03-28 16:42:48,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:48,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804d1123b47fd2376ff05 HTTP/1.1" 200 None 2026-03-28 16:42:48,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:48,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:42:48,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:48,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804d1123b47fd2376ff05 HTTP/1.1" 200 None 2026-03-28 16:42:48,875 - lava_callback - INFO - Completed processing callback for node 69c804d1123b47fd2376ff05 INFO: 172.21.0.1:60186 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:42:53,745 - lava_callback - INFO - Received callback for node 69c804af123b47fd2376fe94 INFO: 172.21.0.1:42446 - "POST /node/69c804af123b47fd2376fe94 HTTP/1.0" 202 Accepted 2026-03-28 16:42:53,751 - lava_callback - INFO - Starting async job submit for node 69c804af123b47fd2376fe94 2026-03-28 16:42:53,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:53,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804af123b47fd2376fe94 HTTP/1.1" 200 None 2026-03-28 16:42:53,787 - lava_callback - DEBUG - Processing node 69c804af123b47fd2376fe94: baseline-arm 2026-03-28 16:42:53,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:54,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:54,131 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c804af123b47fd2376fe94/log.txt.gz 2026-03-28 16:42:54,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:54,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:54,422 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c804af123b47fd2376fe94/lava-logs.yaml 2026-03-28 16:42:54,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:54,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:54,561 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c804af123b47fd2376fe94/lava_callback.json.gz 2026-03-28 16:42:54,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:54,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804af123b47fd2376fe94 HTTP/1.1" 200 None 2026-03-28 16:42:54,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:54,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:42:54,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:54,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804af123b47fd2376fe94 HTTP/1.1" 200 None 2026-03-28 16:42:54,662 - lava_callback - INFO - Completed processing callback for node 69c804af123b47fd2376fe94 2026-03-28 16:42:55,853 - lava_callback - INFO - Received callback for node 69c804cd123b47fd2376fefc INFO: 172.21.0.1:42450 - "POST /node/69c804cd123b47fd2376fefc HTTP/1.0" 202 Accepted 2026-03-28 16:42:55,860 - lava_callback - INFO - Starting async job submit for node 69c804cd123b47fd2376fefc 2026-03-28 16:42:55,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:55,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804cd123b47fd2376fefc HTTP/1.1" 200 None 2026-03-28 16:42:55,903 - lava_callback - DEBUG - Processing node 69c804cd123b47fd2376fefc: baseline-arm-pengutronix 2026-03-28 16:42:56,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:56,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:56,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-28 16:42:56,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:56,205 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c804cd123b47fd2376fefc/log.txt.gz 2026-03-28 16:42:56,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:42:56,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:56,481 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c804cd123b47fd2376fefc/lava-logs.yaml 2026-03-28 16:42:56,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:42:56,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:42:56,798 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c804cd123b47fd2376fefc/lava_callback.json.gz 2026-03-28 16:42:56,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:56,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804cd123b47fd2376fefc HTTP/1.1" 200 None 2026-03-28 16:42:56,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:56,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:42:56,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:56,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804cd123b47fd2376fefc HTTP/1.1" 200 None 2026-03-28 16:42:56,877 - lava_callback - INFO - Completed processing callback for node 69c804cd123b47fd2376fefc 2026-03-28 16:42:59,713 - lava_callback - INFO - Received callback for node 69c804cf123b47fd2376feff INFO: 172.21.0.1:38240 - "POST /node/69c804cf123b47fd2376feff HTTP/1.0" 202 Accepted 2026-03-28 16:42:59,719 - lava_callback - INFO - Starting async job submit for node 69c804cf123b47fd2376feff 2026-03-28 16:42:59,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:42:59,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804cf123b47fd2376feff HTTP/1.1" 200 None 2026-03-28 16:42:59,755 - lava_callback - DEBUG - Processing node 69c804cf123b47fd2376feff: baseline-arm-pengutronix 2026-03-28 16:42:59,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:00,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:00,039 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c804cf123b47fd2376feff/log.txt.gz 2026-03-28 16:43:00,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:00,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:00,335 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c804cf123b47fd2376feff/lava-logs.yaml 2026-03-28 16:43:00,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:00,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:00,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c804cf123b47fd2376feff/lava_callback.json.gz 2026-03-28 16:43:00,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:00,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804cf123b47fd2376feff HTTP/1.1" 200 None 2026-03-28 16:43:00,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:00,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:43:00,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:00,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804cf123b47fd2376feff HTTP/1.1" 200 None 2026-03-28 16:43:00,586 - lava_callback - INFO - Completed processing callback for node 69c804cf123b47fd2376feff 2026-03-28 16:43:02,280 - lava_callback - INFO - Received callback for node 69c804c3123b47fd2376fedb INFO: 172.21.0.1:38244 - "POST /node/69c804c3123b47fd2376fedb HTTP/1.0" 202 Accepted 2026-03-28 16:43:02,286 - lava_callback - INFO - Starting async job submit for node 69c804c3123b47fd2376fedb 2026-03-28 16:43:02,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:02,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c3123b47fd2376fedb HTTP/1.1" 200 None 2026-03-28 16:43:02,330 - lava_callback - DEBUG - Processing node 69c804c3123b47fd2376fedb: baseline-arm-clabbe 2026-03-28 16:43:02,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:02,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:02,674 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c804c3123b47fd2376fedb/log.txt.gz 2026-03-28 16:43:02,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:02,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:02,998 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c804c3123b47fd2376fedb/lava-logs.yaml 2026-03-28 16:43:03,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:03,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:03,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c804c3123b47fd2376fedb/lava_callback.json.gz 2026-03-28 16:43:03,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:03,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c3123b47fd2376fedb HTTP/1.1" 200 None 2026-03-28 16:43:03,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:03,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:43:03,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:03,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804c3123b47fd2376fedb HTTP/1.1" 200 None 2026-03-28 16:43:03,227 - lava_callback - INFO - Completed processing callback for node 69c804c3123b47fd2376fedb 2026-03-28 16:43:05,710 - lava_callback - INFO - Received callback for node 69c804bd123b47fd2376fec7 INFO: 172.21.0.1:38258 - "POST /node/69c804bd123b47fd2376fec7 HTTP/1.0" 202 Accepted 2026-03-28 16:43:05,716 - lava_callback - INFO - Starting async job submit for node 69c804bd123b47fd2376fec7 2026-03-28 16:43:05,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:05,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804bd123b47fd2376fec7 HTTP/1.1" 200 None 2026-03-28 16:43:05,754 - lava_callback - DEBUG - Processing node 69c804bd123b47fd2376fec7: baseline-arm-broonie 2026-03-28 16:43:05,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:06,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:06,078 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c804bd123b47fd2376fec7/log.txt.gz 2026-03-28 16:43:06,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:06,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:06,391 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c804bd123b47fd2376fec7/lava-logs.yaml 2026-03-28 16:43:06,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:43:06,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:06,527 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c804bd123b47fd2376fec7/lava_callback.json.gz 2026-03-28 16:43:06,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:06,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804bd123b47fd2376fec7 HTTP/1.1" 200 None 2026-03-28 16:43:06,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:06,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:43:06,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:06,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804bd123b47fd2376fec7 HTTP/1.1" 200 None 2026-03-28 16:43:06,611 - lava_callback - INFO - Completed processing callback for node 69c804bd123b47fd2376fec7 2026-03-28 16:43:13,277 - lava_callback - INFO - Received callback for node 69c804be123b47fd2376feca INFO: 172.21.0.1:33984 - "POST /node/69c804be123b47fd2376feca HTTP/1.0" 202 Accepted 2026-03-28 16:43:13,283 - lava_callback - INFO - Starting async job submit for node 69c804be123b47fd2376feca 2026-03-28 16:43:13,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:13,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804be123b47fd2376feca HTTP/1.1" 200 None 2026-03-28 16:43:13,322 - lava_callback - DEBUG - Processing node 69c804be123b47fd2376feca: baseline-arm-broonie 2026-03-28 16:43:13,431 - lava_callback - INFO - Received callback for node 69c80502123b47fd2376ff90 2026-03-28 16:43:13,494 - lava_callback - INFO - Starting async job submit for node 69c80502123b47fd2376ff90 INFO: 172.21.0.1:33986 - "POST /node/69c80502123b47fd2376ff90 HTTP/1.0" 202 Accepted 2026-03-28 16:43:13,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:13,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80502123b47fd2376ff90 HTTP/1.1" 200 None 2026-03-28 16:43:13,640 - lava_callback - DEBUG - Processing node 69c80502123b47fd2376ff90: baseline-arm 2026-03-28 16:43:13,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:13,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:13,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:13,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c804be123b47fd2376feca/log.txt.gz 2026-03-28 16:43:13,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:14,006 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c80502123b47fd2376ff90/log.txt.gz 2026-03-28 16:43:14,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:14,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:14,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:14,335 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c804be123b47fd2376feca/lava-logs.yaml 2026-03-28 16:43:14,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:14,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c80502123b47fd2376ff90/lava-logs.yaml 2026-03-28 16:43:14,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:14,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:14,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:14,488 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c80502123b47fd2376ff90/lava_callback.json.gz 2026-03-28 16:43:14,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:14,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:14,517 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c804be123b47fd2376feca/lava_callback.json.gz 2026-03-28 16:43:14,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:14,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80502123b47fd2376ff90 HTTP/1.1" 200 None 2026-03-28 16:43:14,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:14,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804be123b47fd2376feca HTTP/1.1" 200 None 2026-03-28 16:43:14,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:14,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:43:14,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:14,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:43:14,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:14,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80502123b47fd2376ff90 HTTP/1.1" 200 None 2026-03-28 16:43:14,603 - lava_callback - INFO - Completed processing callback for node 69c80502123b47fd2376ff90 2026-03-28 16:43:14,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804be123b47fd2376feca HTTP/1.1" 200 None 2026-03-28 16:43:14,646 - lava_callback - INFO - Completed processing callback for node 69c804be123b47fd2376feca INFO: 172.21.0.1:33990 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-28 16:43:16,487 - lava_callback - INFO - Received callback for node 69c80503123b47fd2376ff93 INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33994 - "POST /node/69c80503123b47fd2376ff93 HTTP/1.0" 202 Accepted 2026-03-28 16:43:16,538 - lava_callback - INFO - Starting async job submit for node 69c80503123b47fd2376ff93 2026-03-28 16:43:16,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:16,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80503123b47fd2376ff93 HTTP/1.1" 200 None 2026-03-28 16:43:16,571 - lava_callback - DEBUG - Processing node 69c80503123b47fd2376ff93: baseline-arm 2026-03-28 16:43:16,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:16,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:16,827 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c80503123b47fd2376ff93/log.txt.gz 2026-03-28 16:43:16,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:17,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:17,051 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c80503123b47fd2376ff93/lava-logs.yaml 2026-03-28 16:43:17,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:17,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:17,173 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c80503123b47fd2376ff93/lava_callback.json.gz 2026-03-28 16:43:17,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:17,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80503123b47fd2376ff93 HTTP/1.1" 200 None 2026-03-28 16:43:17,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:17,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:43:17,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:17,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80503123b47fd2376ff93 HTTP/1.1" 200 None 2026-03-28 16:43:17,253 - lava_callback - INFO - Completed processing callback for node 69c80503123b47fd2376ff93 2026-03-28 16:43:18,302 - lava_callback - INFO - Received callback for node 69c56215abf66a8f4d9bbd99 INFO: 172.21.0.1:34004 - "POST /node/69c56215abf66a8f4d9bbd99 HTTP/1.0" 202 Accepted 2026-03-28 16:43:18,307 - lava_callback - INFO - Starting async job submit for node 69c56215abf66a8f4d9bbd99 2026-03-28 16:43:18,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:18,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56215abf66a8f4d9bbd99 HTTP/1.1" 200 None 2026-03-28 16:43:18,323 - lava_callback - DEBUG - Processing node 69c56215abf66a8f4d9bbd99: baseline-arm-baylibre 2026-03-28 16:43:18,323 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56215abf66a8f4d9bbd99 2026-03-28 16:43:18,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:18,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56215abf66a8f4d9bbd99 HTTP/1.1" 200 None 2026-03-28 16:43:18,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:18,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 16:43:18,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:18,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56215abf66a8f4d9bbd99 HTTP/1.1" 200 None 2026-03-28 16:43:18,378 - lava_callback - ERROR - Error processing callback for node 69c56215abf66a8f4d9bbd99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:43:25,270 - lava_callback - INFO - Received callback for node 69c804bc123b47fd2376febe INFO: 172.21.0.1:60292 - "POST /node/69c804bc123b47fd2376febe HTTP/1.0" 202 Accepted 2026-03-28 16:43:25,276 - lava_callback - INFO - Starting async job submit for node 69c804bc123b47fd2376febe 2026-03-28 16:43:25,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:25,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804bc123b47fd2376febe HTTP/1.1" 200 None 2026-03-28 16:43:25,312 - lava_callback - DEBUG - Processing node 69c804bc123b47fd2376febe: baseline-arm-broonie 2026-03-28 16:43:25,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:25,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:25,657 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c804bc123b47fd2376febe/log.txt.gz 2026-03-28 16:43:25,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:25,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:25,973 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c804bc123b47fd2376febe/lava-logs.yaml 2026-03-28 16:43:25,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:43:26,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:43:26,131 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c804bc123b47fd2376febe/lava_callback.json.gz 2026-03-28 16:43:26,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:26,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:26,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804bc123b47fd2376febe HTTP/1.1" 200 None 2026-03-28 16:43:26,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:26,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-28 16:43:26,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:43:26,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:26,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804bc123b47fd2376febe HTTP/1.1" 200 None 2026-03-28 16:43:26,218 - lava_callback - INFO - Completed processing callback for node 69c804bc123b47fd2376febe INFO: 172.21.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41568 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:43:56,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:56,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43098 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:43:58,300 - lava_callback - INFO - Received callback for node 69c5623aabf66a8f4d9bbda3 INFO: 172.21.0.1:43114 - "POST /node/69c5623aabf66a8f4d9bbda3 HTTP/1.0" 202 Accepted 2026-03-28 16:43:58,306 - lava_callback - INFO - Starting async job submit for node 69c5623aabf66a8f4d9bbda3 2026-03-28 16:43:58,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:58,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5623aabf66a8f4d9bbda3 HTTP/1.1" 200 None 2026-03-28 16:43:58,322 - lava_callback - DEBUG - Processing node 69c5623aabf66a8f4d9bbda3: baseline-arm-baylibre 2026-03-28 16:43:58,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5623aabf66a8f4d9bbda3 2026-03-28 16:43:58,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:58,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5623aabf66a8f4d9bbda3 HTTP/1.1" 200 None 2026-03-28 16:43:58,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:58,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 16:43:58,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:43:58,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5623aabf66a8f4d9bbda3 HTTP/1.1" 200 None 2026-03-28 16:43:58,373 - lava_callback - ERROR - Error processing callback for node 69c5623aabf66a8f4d9bbda3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:44:16,657 - lava_callback - INFO - Received callback for node 69c8054f123b47fd23770006 INFO: 172.21.0.1:38186 - "POST /node/69c8054f123b47fd23770006 HTTP/1.0" 202 Accepted 2026-03-28 16:44:16,663 - lava_callback - INFO - Starting async job submit for node 69c8054f123b47fd23770006 2026-03-28 16:44:16,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:16,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8054f123b47fd23770006 HTTP/1.1" 200 None 2026-03-28 16:44:16,682 - lava_callback - DEBUG - Processing node 69c8054f123b47fd23770006: baseline-arm 2026-03-28 16:44:16,687 - lava_callback - WARNING - Failed to upload log 2026-03-28 16:44:16,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:44:16,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:44:16,831 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c8054f123b47fd23770006/lava-logs.yaml 2026-03-28 16:44:16,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:44:16,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:44:16,975 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c8054f123b47fd23770006/lava_callback.json.gz 2026-03-28 16:44:16,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:17,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8054f123b47fd23770006 HTTP/1.1" 200 None 2026-03-28 16:44:17,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:17,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:44:17,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:17,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8054f123b47fd23770006 HTTP/1.1" 200 None 2026-03-28 16:44:17,049 - lava_callback - INFO - Completed processing callback for node 69c8054f123b47fd23770006 2026-03-28 16:44:17,643 - lava_callback - INFO - Received callback for node 69c804e9123b47fd2376ff53 INFO: 172.21.0.1:38202 - "POST /node/69c804e9123b47fd2376ff53 HTTP/1.0" 202 Accepted 2026-03-28 16:44:17,650 - lava_callback - INFO - Starting async job submit for node 69c804e9123b47fd2376ff53 2026-03-28 16:44:17,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:17,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804e9123b47fd2376ff53 HTTP/1.1" 200 None 2026-03-28 16:44:17,697 - lava_callback - DEBUG - Processing node 69c804e9123b47fd2376ff53: ltp-dio 2026-03-28 16:44:18,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:44:18,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:44:18,235 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69c804e9123b47fd2376ff53/log.txt.gz 2026-03-28 16:44:18,306 - lava_callback - INFO - Received callback for node 69c5625fabf66a8f4d9bbdb2 INFO: 172.21.0.1:38218 - "POST /node/69c5625fabf66a8f4d9bbdb2 HTTP/1.0" 202 Accepted 2026-03-28 16:44:18,326 - lava_callback - INFO - Starting async job submit for node 69c5625fabf66a8f4d9bbdb2 2026-03-28 16:44:18,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:18,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5625fabf66a8f4d9bbdb2 HTTP/1.1" 200 None 2026-03-28 16:44:18,439 - lava_callback - DEBUG - Processing node 69c5625fabf66a8f4d9bbdb2: baseline-arm-baylibre 2026-03-28 16:44:18,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5625fabf66a8f4d9bbdb2 2026-03-28 16:44:18,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:18,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:44:18,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5625fabf66a8f4d9bbdb2 HTTP/1.1" 200 None 2026-03-28 16:44:18,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:18,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 16:44:18,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:18,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5625fabf66a8f4d9bbdb2 HTTP/1.1" 200 None 2026-03-28 16:44:18,533 - lava_callback - ERROR - Error processing callback for node 69c5625fabf66a8f4d9bbdb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:44:18,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:44:18,782 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69c804e9123b47fd2376ff53/lava-logs.yaml 2026-03-28 16:44:18,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:44:19,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:44:19,003 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69c804e9123b47fd2376ff53/lava_callback.json.gz 2026-03-28 16:44:19,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:19,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804e9123b47fd2376ff53 HTTP/1.1" 200 None 2026-03-28 16:44:19,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:19,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:44:19,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:19,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804e9123b47fd2376ff53 HTTP/1.1" 200 None 2026-03-28 16:44:19,106 - lava_callback - INFO - Completed processing callback for node 69c804e9123b47fd2376ff53 2026-03-28 16:44:26,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:26,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50994 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:44:29,339 - lava_callback - INFO - Received callback for node 69c804c4123b47fd2376fedf INFO: 172.21.0.1:51002 - "POST /node/69c804c4123b47fd2376fedf HTTP/1.0" 202 Accepted 2026-03-28 16:44:29,345 - lava_callback - INFO - Starting async job submit for node 69c804c4123b47fd2376fedf 2026-03-28 16:44:29,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:29,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c4123b47fd2376fedf HTTP/1.1" 200 None 2026-03-28 16:44:29,381 - lava_callback - DEBUG - Processing node 69c804c4123b47fd2376fedf: baseline-arm-clabbe 2026-03-28 16:44:29,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:44:29,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:44:29,688 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c804c4123b47fd2376fedf/log.txt.gz 2026-03-28 16:44:29,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:44:29,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:44:29,988 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c804c4123b47fd2376fedf/lava-logs.yaml 2026-03-28 16:44:29,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:44:30,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:44:30,142 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c804c4123b47fd2376fedf/lava_callback.json.gz 2026-03-28 16:44:30,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:30,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c4123b47fd2376fedf HTTP/1.1" 200 None 2026-03-28 16:44:30,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:30,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:44:30,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:30,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804c4123b47fd2376fedf HTTP/1.1" 200 None 2026-03-28 16:44:30,233 - lava_callback - INFO - Completed processing callback for node 69c804c4123b47fd2376fedf INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:44:56,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:56,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:44:58,351 - lava_callback - INFO - Received callback for node 69c56285abf66a8f4d9bbdbb INFO: 172.21.0.1:32782 - "POST /node/69c56285abf66a8f4d9bbdbb HTTP/1.0" 202 Accepted 2026-03-28 16:44:58,356 - lava_callback - INFO - Starting async job submit for node 69c56285abf66a8f4d9bbdbb 2026-03-28 16:44:58,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:58,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56285abf66a8f4d9bbdbb HTTP/1.1" 200 None 2026-03-28 16:44:58,388 - lava_callback - DEBUG - Processing node 69c56285abf66a8f4d9bbdbb: baseline-arm-baylibre 2026-03-28 16:44:58,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56285abf66a8f4d9bbdbb 2026-03-28 16:44:58,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:58,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56285abf66a8f4d9bbdbb HTTP/1.1" 200 None 2026-03-28 16:44:58,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:58,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 16:44:58,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:44:58,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56285abf66a8f4d9bbdbb HTTP/1.1" 200 None 2026-03-28 16:44:58,446 - lava_callback - ERROR - Error processing callback for node 69c56285abf66a8f4d9bbdbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:45:43,495 - lava_callback - INFO - Received callback for node 69c562ababf66a8f4d9bbde3 INFO: 172.21.0.1:47420 - "POST /node/69c562ababf66a8f4d9bbde3 HTTP/1.0" 202 Accepted 2026-03-28 16:45:43,503 - lava_callback - INFO - Starting async job submit for node 69c562ababf66a8f4d9bbde3 2026-03-28 16:45:43,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:45:43,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562ababf66a8f4d9bbde3 HTTP/1.1" 200 None 2026-03-28 16:45:43,529 - lava_callback - DEBUG - Processing node 69c562ababf66a8f4d9bbde3: baseline-arm-clabbe 2026-03-28 16:45:43,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562ababf66a8f4d9bbde3 2026-03-28 16:45:43,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:45:43,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562ababf66a8f4d9bbde3 HTTP/1.1" 200 None 2026-03-28 16:45:43,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:45:43,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 16:45:43,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:45:43,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562ababf66a8f4d9bbde3 HTTP/1.1" 200 None 2026-03-28 16:45:43,614 - lava_callback - ERROR - Error processing callback for node 69c562ababf66a8f4d9bbde3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:46:08,321 - lava_callback - INFO - Received callback for node 69c804c8123b47fd2376feeb INFO: 172.21.0.1:34634 - "POST /node/69c804c8123b47fd2376feeb HTTP/1.0" 202 Accepted 2026-03-28 16:46:08,328 - lava_callback - INFO - Starting async job submit for node 69c804c8123b47fd2376feeb 2026-03-28 16:46:08,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:08,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c8123b47fd2376feeb HTTP/1.1" 200 None 2026-03-28 16:46:08,380 - lava_callback - DEBUG - Processing node 69c804c8123b47fd2376feeb: baseline-arm-clabbe 2026-03-28 16:46:08,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:09,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:09,051 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c804c8123b47fd2376feeb/log.txt.gz 2026-03-28 16:46:09,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:09,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:09,456 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c804c8123b47fd2376feeb/lava-logs.yaml 2026-03-28 16:46:09,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:09,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:09,880 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c804c8123b47fd2376feeb/lava_callback.json.gz 2026-03-28 16:46:09,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:09,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c8123b47fd2376feeb HTTP/1.1" 200 None 2026-03-28 16:46:09,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:09,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:46:09,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:09,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804c8123b47fd2376feeb HTTP/1.1" 200 None 2026-03-28 16:46:09,977 - lava_callback - INFO - Completed processing callback for node 69c804c8123b47fd2376feeb 2026-03-28 16:46:13,607 - lava_callback - INFO - Received callback for node 69c804e4123b47fd2376ff4a INFO: 172.21.0.1:43754 - "POST /node/69c804e4123b47fd2376ff4a HTTP/1.0" 202 Accepted 2026-03-28 16:46:13,613 - lava_callback - INFO - Starting async job submit for node 69c804e4123b47fd2376ff4a 2026-03-28 16:46:13,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:13,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804e4123b47fd2376ff4a HTTP/1.1" 200 None 2026-03-28 16:46:13,677 - lava_callback - DEBUG - Processing node 69c804e4123b47fd2376ff4a: ltp-containers 2026-03-28 16:46:14,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:14,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:14,421 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69c804e4123b47fd2376ff4a/log.txt.gz 2026-03-28 16:46:14,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:14,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:14,997 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69c804e4123b47fd2376ff4a/lava-logs.yaml 2026-03-28 16:46:15,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43768 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-28 16:46:15,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:15,497 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69c804e4123b47fd2376ff4a/lava_callback.json.gz 2026-03-28 16:46:15,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:15,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804e4123b47fd2376ff4a HTTP/1.1" 200 None 2026-03-28 16:46:15,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:15,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:46:15,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:15,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804e4123b47fd2376ff4a HTTP/1.1" 200 None 2026-03-28 16:46:15,616 - lava_callback - INFO - Completed processing callback for node 69c804e4123b47fd2376ff4a INFO: 172.21.0.1:43776 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:46:23,749 - lava_callback - INFO - Received callback for node 69c562d0abf66a8f4d9bbdfb INFO: 172.21.0.1:54708 - "POST /node/69c562d0abf66a8f4d9bbdfb HTTP/1.0" 202 Accepted 2026-03-28 16:46:23,759 - lava_callback - INFO - Starting async job submit for node 69c562d0abf66a8f4d9bbdfb 2026-03-28 16:46:23,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:23,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562d0abf66a8f4d9bbdfb HTTP/1.1" 200 None 2026-03-28 16:46:23,786 - lava_callback - DEBUG - Processing node 69c562d0abf66a8f4d9bbdfb: baseline-arm-clabbe 2026-03-28 16:46:23,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562d0abf66a8f4d9bbdfb 2026-03-28 16:46:23,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:23,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562d0abf66a8f4d9bbdfb HTTP/1.1" 200 None 2026-03-28 16:46:23,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:23,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 16:46:23,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:23,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562d0abf66a8f4d9bbdfb HTTP/1.1" 200 None 2026-03-28 16:46:23,878 - lava_callback - ERROR - Error processing callback for node 69c562d0abf66a8f4d9bbdfb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:46:25,370 - lava_callback - INFO - Received callback for node 69c804e8123b47fd2376ff50 INFO: 172.21.0.1:54724 - "POST /node/69c804e8123b47fd2376ff50 HTTP/1.0" 202 Accepted 2026-03-28 16:46:25,377 - lava_callback - INFO - Starting async job submit for node 69c804e8123b47fd2376ff50 2026-03-28 16:46:25,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:25,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804e8123b47fd2376ff50 HTTP/1.1" 200 None 2026-03-28 16:46:25,417 - lava_callback - DEBUG - Processing node 69c804e8123b47fd2376ff50: ltp-cve 2026-03-28 16:46:25,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:26,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:26,121 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69c804e8123b47fd2376ff50/log.txt.gz 2026-03-28 16:46:26,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:26,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:26,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:46:26,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:26,796 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69c804e8123b47fd2376ff50/lava-logs.yaml 2026-03-28 16:46:26,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:27,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:27,007 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69c804e8123b47fd2376ff50/lava_callback.json.gz 2026-03-28 16:46:27,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:27,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804e8123b47fd2376ff50 HTTP/1.1" 200 None 2026-03-28 16:46:27,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:27,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:46:27,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:27,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804e8123b47fd2376ff50 HTTP/1.1" 200 None 2026-03-28 16:46:27,117 - lava_callback - INFO - Completed processing callback for node 69c804e8123b47fd2376ff50 2026-03-28 16:46:33,858 - lava_callback - INFO - Received callback for node 69c804f5123b47fd2376ff82 INFO: 172.21.0.1:34124 - "POST /node/69c804f5123b47fd2376ff82 HTTP/1.0" 202 Accepted 2026-03-28 16:46:33,872 - lava_callback - INFO - Starting async job submit for node 69c804f5123b47fd2376ff82 2026-03-28 16:46:33,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:33,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804f5123b47fd2376ff82 HTTP/1.1" 200 None 2026-03-28 16:46:33,944 - lava_callback - DEBUG - Processing node 69c804f5123b47fd2376ff82: ltp-syscalls 2026-03-28 16:46:35,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:35,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:35,972 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c804f5123b47fd2376ff82/log.txt.gz 2026-03-28 16:46:36,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:46:37,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:37,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c804f5123b47fd2376ff82/lava-logs.yaml 2026-03-28 16:46:37,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:37,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:37,796 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c804f5123b47fd2376ff82/lava_callback.json.gz 2026-03-28 16:46:37,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:37,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804f5123b47fd2376ff82 HTTP/1.1" 200 None 2026-03-28 16:46:37,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:37,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:46:37,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:37,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804f5123b47fd2376ff82 HTTP/1.1" 200 None 2026-03-28 16:46:37,966 - lava_callback - INFO - Completed processing callback for node 69c804f5123b47fd2376ff82 2026-03-28 16:46:38,467 - lava_callback - INFO - Received callback for node 69c562dbabf66a8f4d9bbe18 INFO: 172.21.0.1:34140 - "POST /node/69c562dbabf66a8f4d9bbe18 HTTP/1.0" 202 Accepted 2026-03-28 16:46:38,476 - lava_callback - INFO - Starting async job submit for node 69c562dbabf66a8f4d9bbe18 2026-03-28 16:46:38,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:38,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562dbabf66a8f4d9bbe18 HTTP/1.1" 200 None 2026-03-28 16:46:38,510 - lava_callback - DEBUG - Processing node 69c562dbabf66a8f4d9bbe18: baseline-arm-baylibre 2026-03-28 16:46:38,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562dbabf66a8f4d9bbe18 2026-03-28 16:46:38,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:38,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562dbabf66a8f4d9bbe18 HTTP/1.1" 200 None 2026-03-28 16:46:38,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:38,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 16:46:38,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:38,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562dbabf66a8f4d9bbe18 HTTP/1.1" 200 None 2026-03-28 16:46:38,614 - lava_callback - ERROR - Error processing callback for node 69c562dbabf66a8f4d9bbe18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:46:39,163 - lava_callback - INFO - Received callback for node 69c562dcabf66a8f4d9bbe1b INFO: 172.21.0.1:34148 - "POST /node/69c562dcabf66a8f4d9bbe1b HTTP/1.0" 202 Accepted 2026-03-28 16:46:39,169 - lava_callback - INFO - Starting async job submit for node 69c562dcabf66a8f4d9bbe1b 2026-03-28 16:46:39,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:39,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562dcabf66a8f4d9bbe1b HTTP/1.1" 200 None 2026-03-28 16:46:39,186 - lava_callback - DEBUG - Processing node 69c562dcabf66a8f4d9bbe1b: baseline-arm-baylibre 2026-03-28 16:46:39,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562dcabf66a8f4d9bbe1b 2026-03-28 16:46:39,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:39,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562dcabf66a8f4d9bbe1b HTTP/1.1" 200 None 2026-03-28 16:46:39,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:39,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 16:46:39,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:39,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562dcabf66a8f4d9bbe1b HTTP/1.1" 200 None 2026-03-28 16:46:39,245 - lava_callback - ERROR - Error processing callback for node 69c562dcabf66a8f4d9bbe1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:46:39,846 - lava_callback - INFO - Received callback for node 69c562deabf66a8f4d9bbe1e INFO: 172.21.0.1:54888 - "POST /node/69c562deabf66a8f4d9bbe1e HTTP/1.0" 202 Accepted 2026-03-28 16:46:39,856 - lava_callback - INFO - Starting async job submit for node 69c562deabf66a8f4d9bbe1e 2026-03-28 16:46:39,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:39,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562deabf66a8f4d9bbe1e HTTP/1.1" 200 None 2026-03-28 16:46:39,895 - lava_callback - DEBUG - Processing node 69c562deabf66a8f4d9bbe1e: baseline-arm-baylibre 2026-03-28 16:46:39,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562deabf66a8f4d9bbe1e 2026-03-28 16:46:39,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:39,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562deabf66a8f4d9bbe1e HTTP/1.1" 200 None 2026-03-28 16:46:39,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:39,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 16:46:39,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:40,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562deabf66a8f4d9bbe1e HTTP/1.1" 200 None 2026-03-28 16:46:40,013 - lava_callback - ERROR - Error processing callback for node 69c562deabf66a8f4d9bbe1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:46:40,512 - lava_callback - INFO - Received callback for node 69c562dfabf66a8f4d9bbe21 INFO: 172.21.0.1:54902 - "POST /node/69c562dfabf66a8f4d9bbe21 HTTP/1.0" 202 Accepted 2026-03-28 16:46:40,521 - lava_callback - INFO - Starting async job submit for node 69c562dfabf66a8f4d9bbe21 2026-03-28 16:46:40,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:40,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562dfabf66a8f4d9bbe21 HTTP/1.1" 200 None 2026-03-28 16:46:40,539 - lava_callback - DEBUG - Processing node 69c562dfabf66a8f4d9bbe21: baseline-arm-baylibre 2026-03-28 16:46:40,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562dfabf66a8f4d9bbe21 2026-03-28 16:46:40,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:40,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562dfabf66a8f4d9bbe21 HTTP/1.1" 200 None 2026-03-28 16:46:40,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:40,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 16:46:40,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:40,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562dfabf66a8f4d9bbe21 HTTP/1.1" 200 None 2026-03-28 16:46:40,600 - lava_callback - ERROR - Error processing callback for node 69c562dfabf66a8f4d9bbe21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:46:41,198 - lava_callback - INFO - Received callback for node 69c562e2abf66a8f4d9bbe30 INFO: 172.21.0.1:54904 - "POST /node/69c562e2abf66a8f4d9bbe30 HTTP/1.0" 202 Accepted 2026-03-28 16:46:41,208 - lava_callback - INFO - Starting async job submit for node 69c562e2abf66a8f4d9bbe30 2026-03-28 16:46:41,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:41,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562e2abf66a8f4d9bbe30 HTTP/1.1" 200 None 2026-03-28 16:46:41,235 - lava_callback - DEBUG - Processing node 69c562e2abf66a8f4d9bbe30: baseline-arm-baylibre 2026-03-28 16:46:41,235 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562e2abf66a8f4d9bbe30 2026-03-28 16:46:41,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:41,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562e2abf66a8f4d9bbe30 HTTP/1.1" 200 None 2026-03-28 16:46:41,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:41,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 16:46:41,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:41,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562e2abf66a8f4d9bbe30 HTTP/1.1" 200 None 2026-03-28 16:46:41,341 - lava_callback - ERROR - Error processing callback for node 69c562e2abf66a8f4d9bbe30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:46:41,876 - lava_callback - INFO - Received callback for node 69c562e3abf66a8f4d9bbe35 INFO: 172.21.0.1:54906 - "POST /node/69c562e3abf66a8f4d9bbe35 HTTP/1.0" 202 Accepted 2026-03-28 16:46:41,896 - lava_callback - INFO - Starting async job submit for node 69c562e3abf66a8f4d9bbe35 2026-03-28 16:46:41,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:41,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562e3abf66a8f4d9bbe35 HTTP/1.1" 200 None 2026-03-28 16:46:41,945 - lava_callback - DEBUG - Processing node 69c562e3abf66a8f4d9bbe35: baseline-arm-baylibre 2026-03-28 16:46:41,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562e3abf66a8f4d9bbe35 2026-03-28 16:46:41,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:41,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562e3abf66a8f4d9bbe35 HTTP/1.1" 200 None 2026-03-28 16:46:41,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:41,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 16:46:41,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:42,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562e3abf66a8f4d9bbe35 HTTP/1.1" 200 None 2026-03-28 16:46:42,027 - lava_callback - ERROR - Error processing callback for node 69c562e3abf66a8f4d9bbe35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:46:43,712 - lava_callback - INFO - Received callback for node 69c562ebabf66a8f4d9bbe6b INFO: 172.21.0.1:54914 - "POST /node/69c562ebabf66a8f4d9bbe6b HTTP/1.0" 202 Accepted 2026-03-28 16:46:43,721 - lava_callback - INFO - Starting async job submit for node 69c562ebabf66a8f4d9bbe6b 2026-03-28 16:46:43,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:43,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562ebabf66a8f4d9bbe6b HTTP/1.1" 200 None 2026-03-28 16:46:43,756 - lava_callback - DEBUG - Processing node 69c562ebabf66a8f4d9bbe6b: baseline-arm-clabbe 2026-03-28 16:46:43,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562ebabf66a8f4d9bbe6b 2026-03-28 16:46:43,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:43,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562ebabf66a8f4d9bbe6b HTTP/1.1" 200 None 2026-03-28 16:46:43,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:43,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 16:46:43,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:43,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562ebabf66a8f4d9bbe6b HTTP/1.1" 200 None 2026-03-28 16:46:43,862 - lava_callback - ERROR - Error processing callback for node 69c562ebabf66a8f4d9bbe6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:46:44,380 - lava_callback - INFO - Received callback for node 69c562f0abf66a8f4d9bbe78 INFO: 172.21.0.1:54920 - "POST /node/69c562f0abf66a8f4d9bbe78 HTTP/1.0" 202 Accepted 2026-03-28 16:46:44,388 - lava_callback - INFO - Starting async job submit for node 69c562f0abf66a8f4d9bbe78 2026-03-28 16:46:44,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:44,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562f0abf66a8f4d9bbe78 HTTP/1.1" 200 None 2026-03-28 16:46:44,420 - lava_callback - DEBUG - Processing node 69c562f0abf66a8f4d9bbe78: baseline-arm-clabbe 2026-03-28 16:46:44,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562f0abf66a8f4d9bbe78 2026-03-28 16:46:44,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:44,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562f0abf66a8f4d9bbe78 HTTP/1.1" 200 None 2026-03-28 16:46:44,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:44,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 16:46:44,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:44,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562f0abf66a8f4d9bbe78 HTTP/1.1" 200 None 2026-03-28 16:46:44,505 - lava_callback - ERROR - Error processing callback for node 69c562f0abf66a8f4d9bbe78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:46:45,044 - lava_callback - INFO - Received callback for node 69c562f1abf66a8f4d9bbe7b INFO: 172.21.0.1:54932 - "POST /node/69c562f1abf66a8f4d9bbe7b HTTP/1.0" 202 Accepted 2026-03-28 16:46:45,055 - lava_callback - INFO - Starting async job submit for node 69c562f1abf66a8f4d9bbe7b 2026-03-28 16:46:45,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:45,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562f1abf66a8f4d9bbe7b HTTP/1.1" 200 None 2026-03-28 16:46:45,115 - lava_callback - DEBUG - Processing node 69c562f1abf66a8f4d9bbe7b: baseline-arm-clabbe 2026-03-28 16:46:45,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562f1abf66a8f4d9bbe7b 2026-03-28 16:46:45,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:45,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562f1abf66a8f4d9bbe7b HTTP/1.1" 200 None 2026-03-28 16:46:45,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:45,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 16:46:45,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:45,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562f1abf66a8f4d9bbe7b HTTP/1.1" 200 None 2026-03-28 16:46:45,223 - lava_callback - ERROR - Error processing callback for node 69c562f1abf66a8f4d9bbe7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:46:45,743 - lava_callback - INFO - Received callback for node 69c562f2abf66a8f4d9bbe7e INFO: 172.21.0.1:54948 - "POST /node/69c562f2abf66a8f4d9bbe7e HTTP/1.0" 202 Accepted 2026-03-28 16:46:45,752 - lava_callback - INFO - Starting async job submit for node 69c562f2abf66a8f4d9bbe7e 2026-03-28 16:46:45,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:45,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562f2abf66a8f4d9bbe7e HTTP/1.1" 200 None 2026-03-28 16:46:45,778 - lava_callback - DEBUG - Processing node 69c562f2abf66a8f4d9bbe7e: baseline-arm-clabbe 2026-03-28 16:46:45,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562f2abf66a8f4d9bbe7e 2026-03-28 16:46:45,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:45,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562f2abf66a8f4d9bbe7e HTTP/1.1" 200 None 2026-03-28 16:46:45,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:45,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 16:46:45,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:45,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562f2abf66a8f4d9bbe7e HTTP/1.1" 200 None 2026-03-28 16:46:45,885 - lava_callback - ERROR - Error processing callback for node 69c562f2abf66a8f4d9bbe7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54970 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:46:53,499 - lava_callback - INFO - Received callback for node 69c804ba123b47fd2376febb INFO: 172.21.0.1:47030 - "POST /node/69c804ba123b47fd2376febb HTTP/1.0" 202 Accepted 2026-03-28 16:46:53,508 - lava_callback - INFO - Starting async job submit for node 69c804ba123b47fd2376febb 2026-03-28 16:46:53,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:53,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804ba123b47fd2376febb HTTP/1.1" 200 None 2026-03-28 16:46:53,603 - lava_callback - DEBUG - Processing node 69c804ba123b47fd2376febb: baseline-arm-broonie 2026-03-28 16:46:54,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:54,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:54,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c804ba123b47fd2376febb/log.txt.gz 2026-03-28 16:46:54,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:55,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:55,293 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c804ba123b47fd2376febb/lava-logs.yaml 2026-03-28 16:46:55,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:55,428 - lava_callback - INFO - Received callback for node 69c804e2123b47fd2376ff47 INFO: 172.21.0.1:47042 - "POST /node/69c804e2123b47fd2376ff47 HTTP/1.0" 202 Accepted 2026-03-28 16:46:55,436 - lava_callback - INFO - Starting async job submit for node 69c804e2123b47fd2376ff47 2026-03-28 16:46:55,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:55,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:55,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c804ba123b47fd2376febb/lava_callback.json.gz 2026-03-28 16:46:55,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:55,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804e2123b47fd2376ff47 HTTP/1.1" 200 None 2026-03-28 16:46:55,521 - lava_callback - DEBUG - Processing node 69c804e2123b47fd2376ff47: ltp-cap_bounds 2026-03-28 16:46:55,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804ba123b47fd2376febb HTTP/1.1" 200 None 2026-03-28 16:46:55,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:55,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:46:55,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:55,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804ba123b47fd2376febb HTTP/1.1" 200 None 2026-03-28 16:46:55,802 - lava_callback - INFO - Completed processing callback for node 69c804ba123b47fd2376febb 2026-03-28 16:46:56,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:56,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:56,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:46:56,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:56,744 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c804e2123b47fd2376ff47/log.txt.gz 2026-03-28 16:46:57,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:57,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:57,874 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c804e2123b47fd2376ff47/lava-logs.yaml 2026-03-28 16:46:57,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:46:58,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:46:58,056 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69c804e2123b47fd2376ff47/lava_callback.json.gz 2026-03-28 16:46:58,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:58,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804e2123b47fd2376ff47 HTTP/1.1" 200 None 2026-03-28 16:46:58,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:58,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:46:58,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:46:58,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804e2123b47fd2376ff47 HTTP/1.1" 200 None 2026-03-28 16:46:58,165 - lava_callback - INFO - Completed processing callback for node 69c804e2123b47fd2376ff47 2026-03-28 16:47:03,516 - lava_callback - INFO - Received callback for node 69c562f5abf66a8f4d9bbe87 INFO: 172.21.0.1:54884 - "POST /node/69c562f5abf66a8f4d9bbe87 HTTP/1.0" 202 Accepted 2026-03-28 16:47:03,522 - lava_callback - INFO - Starting async job submit for node 69c562f5abf66a8f4d9bbe87 2026-03-28 16:47:03,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:03,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562f5abf66a8f4d9bbe87 HTTP/1.1" 200 None 2026-03-28 16:47:03,545 - lava_callback - DEBUG - Processing node 69c562f5abf66a8f4d9bbe87: baseline-arm-clabbe 2026-03-28 16:47:03,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562f5abf66a8f4d9bbe87 2026-03-28 16:47:03,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:03,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562f5abf66a8f4d9bbe87 HTTP/1.1" 200 None 2026-03-28 16:47:03,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:03,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 16:47:03,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:03,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562f5abf66a8f4d9bbe87 HTTP/1.1" 200 None 2026-03-28 16:47:03,603 - lava_callback - ERROR - Error processing callback for node 69c562f5abf66a8f4d9bbe87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 16:47:04,316 - lava_callback - INFO - Received callback for node 69c562f6abf66a8f4d9bbe8a INFO: 172.21.0.1:54890 - "POST /node/69c562f6abf66a8f4d9bbe8a HTTP/1.0" 202 Accepted 2026-03-28 16:47:04,325 - lava_callback - INFO - Starting async job submit for node 69c562f6abf66a8f4d9bbe8a 2026-03-28 16:47:04,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:04,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562f6abf66a8f4d9bbe8a HTTP/1.1" 200 None 2026-03-28 16:47:04,355 - lava_callback - DEBUG - Processing node 69c562f6abf66a8f4d9bbe8a: baseline-arm-clabbe 2026-03-28 16:47:04,355 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c562f6abf66a8f4d9bbe8a 2026-03-28 16:47:04,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:04,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c562f6abf66a8f4d9bbe8a HTTP/1.1" 200 None 2026-03-28 16:47:04,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:04,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 16:47:04,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:04,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c562f6abf66a8f4d9bbe8a HTTP/1.1" 200 None 2026-03-28 16:47:04,460 - lava_callback - ERROR - Error processing callback for node 69c562f6abf66a8f4d9bbe8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:47:26,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:26,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:47:43,643 - lava_callback - INFO - Received callback for node 69c56319abf66a8f4d9bbefa INFO: 172.21.0.1:58452 - "POST /node/69c56319abf66a8f4d9bbefa HTTP/1.0" 202 Accepted 2026-03-28 16:47:43,652 - lava_callback - INFO - Starting async job submit for node 69c56319abf66a8f4d9bbefa 2026-03-28 16:47:43,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:43,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56319abf66a8f4d9bbefa HTTP/1.1" 200 None 2026-03-28 16:47:43,677 - lava_callback - DEBUG - Processing node 69c56319abf66a8f4d9bbefa: baseline-arm-clabbe 2026-03-28 16:47:43,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56319abf66a8f4d9bbefa 2026-03-28 16:47:43,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:43,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56319abf66a8f4d9bbefa HTTP/1.1" 200 None 2026-03-28 16:47:43,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:43,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 16:47:43,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:43,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56319abf66a8f4d9bbefa HTTP/1.1" 200 None 2026-03-28 16:47:43,743 - lava_callback - ERROR - Error processing callback for node 69c56319abf66a8f4d9bbefa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:47:51,487 - lava_callback - INFO - Received callback for node 69c804c9123b47fd2376feee INFO: 172.21.0.1:42640 - "POST /node/69c804c9123b47fd2376feee HTTP/1.0" 202 Accepted 2026-03-28 16:47:51,495 - lava_callback - INFO - Starting async job submit for node 69c804c9123b47fd2376feee 2026-03-28 16:47:51,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:51,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c9123b47fd2376feee HTTP/1.1" 200 None 2026-03-28 16:47:51,547 - lava_callback - DEBUG - Processing node 69c804c9123b47fd2376feee: baseline-arm-clabbe 2026-03-28 16:47:51,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:47:52,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:47:52,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c804c9123b47fd2376feee/log.txt.gz 2026-03-28 16:47:52,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:47:53,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:47:53,729 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c804c9123b47fd2376feee/lava-logs.yaml 2026-03-28 16:47:53,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:47:54,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:47:54,413 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c804c9123b47fd2376feee/lava_callback.json.gz 2026-03-28 16:47:54,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:54,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c9123b47fd2376feee HTTP/1.1" 200 None 2026-03-28 16:47:54,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:54,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:47:54,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:47:54,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804c9123b47fd2376feee HTTP/1.1" 200 None 2026-03-28 16:47:54,531 - lava_callback - INFO - Completed processing callback for node 69c804c9123b47fd2376feee 2026-03-28 16:47:56,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:42656 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:47:56,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45220 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:48:23,708 - lava_callback - INFO - Received callback for node 69c56341abf66a8f4d9bbf4a INFO: 172.21.0.1:42290 - "POST /node/69c56341abf66a8f4d9bbf4a HTTP/1.0" 202 Accepted 2026-03-28 16:48:23,715 - lava_callback - INFO - Starting async job submit for node 69c56341abf66a8f4d9bbf4a 2026-03-28 16:48:23,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:48:23,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56341abf66a8f4d9bbf4a HTTP/1.1" 200 None 2026-03-28 16:48:23,734 - lava_callback - DEBUG - Processing node 69c56341abf66a8f4d9bbf4a: baseline-arm-clabbe 2026-03-28 16:48:23,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56341abf66a8f4d9bbf4a 2026-03-28 16:48:23,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:48:23,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56341abf66a8f4d9bbf4a HTTP/1.1" 200 None 2026-03-28 16:48:23,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:48:23,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 16:48:23,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:48:23,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56341abf66a8f4d9bbf4a HTTP/1.1" 200 None 2026-03-28 16:48:23,859 - lava_callback - ERROR - Error processing callback for node 69c56341abf66a8f4d9bbf4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40538 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:50:13,766 - lava_callback - INFO - Received callback for node 69c804ea123b47fd2376ff56 INFO: 172.21.0.1:35796 - "POST /node/69c804ea123b47fd2376ff56 HTTP/1.0" 202 Accepted 2026-03-28 16:50:13,774 - lava_callback - INFO - Starting async job submit for node 69c804ea123b47fd2376ff56 2026-03-28 16:50:13,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:50:13,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804ea123b47fd2376ff56 HTTP/1.1" 200 None 2026-03-28 16:50:13,838 - lava_callback - DEBUG - Processing node 69c804ea123b47fd2376ff56: ltp-fs_bind 2026-03-28 16:50:14,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35812 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-28 16:50:15,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:50:15,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c804ea123b47fd2376ff56/log.txt.gz 2026-03-28 16:50:15,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:50:16,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:50:16,614 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c804ea123b47fd2376ff56/lava-logs.yaml 2026-03-28 16:50:16,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:50:17,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:50:17,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69c804ea123b47fd2376ff56/lava_callback.json.gz 2026-03-28 16:50:17,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:50:17,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804ea123b47fd2376ff56 HTTP/1.1" 200 None 2026-03-28 16:50:17,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:50:17,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:50:17,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:50:17,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804ea123b47fd2376ff56 HTTP/1.1" 200 None 2026-03-28 16:50:17,750 - lava_callback - INFO - Completed processing callback for node 69c804ea123b47fd2376ff56 INFO: 172.21.0.1:58876 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:50:26,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:50:26,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:50:54,003 - lava_callback - INFO - Received callback for node 69c804ef123b47fd2376ff5f INFO: 172.21.0.1:55178 - "POST /node/69c804ef123b47fd2376ff5f HTTP/1.0" 202 Accepted 2026-03-28 16:50:54,013 - lava_callback - INFO - Starting async job submit for node 69c804ef123b47fd2376ff5f 2026-03-28 16:50:54,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:50:54,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804ef123b47fd2376ff5f HTTP/1.1" 200 None 2026-03-28 16:50:54,076 - lava_callback - DEBUG - Processing node 69c804ef123b47fd2376ff5f: ltp-ipc 2026-03-28 16:50:54,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:50:55,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:50:55,476 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69c804ef123b47fd2376ff5f/log.txt.gz 2026-03-28 16:50:55,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:50:56,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:50:56,905 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69c804ef123b47fd2376ff5f/lava-logs.yaml 2026-03-28 16:50:56,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:50:58,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:50:58,047 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69c804ef123b47fd2376ff5f/lava_callback.json.gz 2026-03-28 16:50:58,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:50:58,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804ef123b47fd2376ff5f HTTP/1.1" 200 None 2026-03-28 16:50:58,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:50:58,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:50:58,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:50:58,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804ef123b47fd2376ff5f HTTP/1.1" 200 None 2026-03-28 16:50:58,176 - lava_callback - INFO - Completed processing callback for node 69c804ef123b47fd2376ff5f 2026-03-28 16:51:05,641 - lava_callback - INFO - Received callback for node 69c80264123b47fd2376fe6f INFO: 172.21.0.1:58274 - "POST /node/69c80264123b47fd2376fe6f HTTP/1.0" 202 Accepted 2026-03-28 16:51:05,652 - lava_callback - INFO - Starting async job submit for node 69c80264123b47fd2376fe6f 2026-03-28 16:51:05,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:05,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80264123b47fd2376fe6f HTTP/1.1" 200 None 2026-03-28 16:51:05,758 - lava_callback - DEBUG - Processing node 69c80264123b47fd2376fe6f: ltp-smoke 2026-03-28 16:51:06,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:51:07,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:51:07,423 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c80264123b47fd2376fe6f/log.txt.gz 2026-03-28 16:51:07,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:51:08,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:51:08,974 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c80264123b47fd2376fe6f/lava-logs.yaml 2026-03-28 16:51:08,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:51:09,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:51:09,985 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c80264123b47fd2376fe6f/lava_callback.json.gz 2026-03-28 16:51:10,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:10,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80264123b47fd2376fe6f HTTP/1.1" 200 None 2026-03-28 16:51:10,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:10,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff48123b47fd2376d751 HTTP/1.1" 200 None 2026-03-28 16:51:10,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:10,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80264123b47fd2376fe6f HTTP/1.1" 200 None 2026-03-28 16:51:10,427 - lava_callback - INFO - Completed processing callback for node 69c80264123b47fd2376fe6f 2026-03-28 16:51:13,493 - lava_callback - INFO - Received callback for node 69c806f2123b47fd237700ec INFO: 172.21.0.1:50360 - "POST /node/69c806f2123b47fd237700ec HTTP/1.0" 202 Accepted 2026-03-28 16:51:13,500 - lava_callback - INFO - Starting async job submit for node 69c806f2123b47fd237700ec 2026-03-28 16:51:13,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:13,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c806f2123b47fd237700ec HTTP/1.1" 200 None 2026-03-28 16:51:13,525 - lava_callback - DEBUG - Processing node 69c806f2123b47fd237700ec: baseline-arm 2026-03-28 16:51:13,530 - lava_callback - WARNING - Failed to upload log 2026-03-28 16:51:13,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:51:14,075 - lava_callback - INFO - Received callback for node 69c804e5123b47fd2376ff4d INFO: 172.21.0.1:50372 - "POST /node/69c804e5123b47fd2376ff4d HTTP/1.0" 202 Accepted 2026-03-28 16:51:14,086 - lava_callback - INFO - Starting async job submit for node 69c804e5123b47fd2376ff4d 2026-03-28 16:51:14,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:14,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804e5123b47fd2376ff4d HTTP/1.1" 200 None 2026-03-28 16:51:14,152 - lava_callback - DEBUG - Processing node 69c804e5123b47fd2376ff4d: ltp-controllers 2026-03-28 16:51:14,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:51:14,654 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c806f2123b47fd237700ec/lava-logs.yaml 2026-03-28 16:51:14,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:51:14,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50378 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-28 16:51:15,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:51:15,696 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c806f2123b47fd237700ec/lava_callback.json.gz 2026-03-28 16:51:15,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:15,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c806f2123b47fd237700ec HTTP/1.1" 200 None 2026-03-28 16:51:15,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:15,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:51:15,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:15,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c806f2123b47fd237700ec HTTP/1.1" 200 None 2026-03-28 16:51:15,818 - lava_callback - INFO - Completed processing callback for node 69c806f2123b47fd237700ec 2026-03-28 16:51:15,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:51:15,876 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69c804e5123b47fd2376ff4d/log.txt.gz 2026-03-28 16:51:16,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50390 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:51:17,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:51:17,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69c804e5123b47fd2376ff4d/lava-logs.yaml 2026-03-28 16:51:17,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:51:18,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:51:18,349 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69c804e5123b47fd2376ff4d/lava_callback.json.gz 2026-03-28 16:51:18,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:18,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804e5123b47fd2376ff4d HTTP/1.1" 200 None 2026-03-28 16:51:18,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:18,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:51:18,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:18,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804e5123b47fd2376ff4d HTTP/1.1" 200 None 2026-03-28 16:51:18,475 - lava_callback - INFO - Completed processing callback for node 69c804e5123b47fd2376ff4d INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:51:26,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:26,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-28 16:51:34,089 - lava_callback - INFO - Received callback for node 69c804ee123b47fd2376ff5c INFO: 172.21.0.1:60190 - "POST /node/69c804ee123b47fd2376ff5c HTTP/1.0" 202 Accepted 2026-03-28 16:51:34,100 - lava_callback - INFO - Starting async job submit for node 69c804ee123b47fd2376ff5c 2026-03-28 16:51:34,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:34,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804ee123b47fd2376ff5c HTTP/1.1" 200 None 2026-03-28 16:51:34,160 - lava_callback - DEBUG - Processing node 69c804ee123b47fd2376ff5c: ltp-input 2026-03-28 16:51:34,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:51:35,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:51:35,722 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69c804ee123b47fd2376ff5c/log.txt.gz 2026-03-28 16:51:36,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:51:37,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:51:37,075 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69c804ee123b47fd2376ff5c/lava-logs.yaml 2026-03-28 16:51:37,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:51:38,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:51:38,034 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69c804ee123b47fd2376ff5c/lava_callback.json.gz 2026-03-28 16:51:38,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:38,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804ee123b47fd2376ff5c HTTP/1.1" 200 None 2026-03-28 16:51:38,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:38,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:51:38,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:38,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804ee123b47fd2376ff5c HTTP/1.1" 200 None 2026-03-28 16:51:38,168 - lava_callback - INFO - Completed processing callback for node 69c804ee123b47fd2376ff5c INFO: 172.21.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34828 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:51:56,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:51:56,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40966 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:53:02,343 - lava_callback - INFO - Received callback for node 69c8074d123b47fd23770137 INFO: 172.21.0.1:45342 - "POST /node/69c8074d123b47fd23770137 HTTP/1.0" 202 Accepted 2026-03-28 16:53:02,350 - lava_callback - INFO - Starting async job submit for node 69c8074d123b47fd23770137 2026-03-28 16:53:02,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:02,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8074d123b47fd23770137 HTTP/1.1" 200 None 2026-03-28 16:53:02,389 - lava_callback - DEBUG - Processing node 69c8074d123b47fd23770137: baseline-arm64 2026-03-28 16:53:02,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:02,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:02,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8074d123b47fd23770137/log.txt.gz 2026-03-28 16:53:02,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:03,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:03,091 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8074d123b47fd23770137/lava-logs.yaml 2026-03-28 16:53:03,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:03,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:03,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8074d123b47fd23770137/lava_callback.json.gz 2026-03-28 16:53:03,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:03,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8074d123b47fd23770137 HTTP/1.1" 200 None 2026-03-28 16:53:03,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:03,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:53:03,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:03,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8074d123b47fd23770137 HTTP/1.1" 200 None 2026-03-28 16:53:03,415 - lava_callback - INFO - Completed processing callback for node 69c8074d123b47fd23770137 INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:53:16,983 - lava_callback - INFO - Received callback for node 69c8076a123b47fd237701a0 INFO: 172.21.0.1:58852 - "POST /node/69c8076a123b47fd237701a0 HTTP/1.0" 202 Accepted 2026-03-28 16:53:16,989 - lava_callback - INFO - Starting async job submit for node 69c8076a123b47fd237701a0 2026-03-28 16:53:16,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:17,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8076a123b47fd237701a0 HTTP/1.1" 200 None 2026-03-28 16:53:17,007 - lava_callback - DEBUG - Processing node 69c8076a123b47fd237701a0: baseline-nfs-arm64 2026-03-28 16:53:17,009 - lava_callback - WARNING - Failed to upload log 2026-03-28 16:53:17,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:17,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:17,137 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076a123b47fd237701a0/lava-logs.yaml 2026-03-28 16:53:17,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:17,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:17,257 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076a123b47fd237701a0/lava_callback.json.gz 2026-03-28 16:53:17,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:17,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8076a123b47fd237701a0 HTTP/1.1" 200 None 2026-03-28 16:53:17,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:17,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:53:17,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:17,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8076a123b47fd237701a0 HTTP/1.1" 200 None 2026-03-28 16:53:17,343 - lava_callback - INFO - Completed processing callback for node 69c8076a123b47fd237701a0 2026-03-28 16:53:22,384 - lava_callback - INFO - Received callback for node 69c80759123b47fd23770158 INFO: 172.21.0.1:42980 - "POST /node/69c80759123b47fd23770158 HTTP/1.0" 202 Accepted 2026-03-28 16:53:22,390 - lava_callback - INFO - Starting async job submit for node 69c80759123b47fd23770158 2026-03-28 16:53:22,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:22,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80759123b47fd23770158 HTTP/1.1" 200 None 2026-03-28 16:53:22,423 - lava_callback - DEBUG - Processing node 69c80759123b47fd23770158: baseline-arm64 2026-03-28 16:53:22,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:22,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:22,765 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80759123b47fd23770158/log.txt.gz 2026-03-28 16:53:22,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:23,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:23,048 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80759123b47fd23770158/lava-logs.yaml 2026-03-28 16:53:23,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:23,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:23,208 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80759123b47fd23770158/lava_callback.json.gz 2026-03-28 16:53:23,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:23,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80759123b47fd23770158 HTTP/1.1" 200 None 2026-03-28 16:53:23,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:23,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:53:23,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:23,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80759123b47fd23770158 HTTP/1.1" 200 None 2026-03-28 16:53:23,281 - lava_callback - INFO - Completed processing callback for node 69c80759123b47fd23770158 INFO: 172.21.0.1:42986 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:53:26,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:26,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42664 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:53:38,295 - lava_callback - INFO - Received callback for node 69c8074e123b47fd2377013d INFO: 172.21.0.1:42680 - "POST /node/69c8074e123b47fd2377013d HTTP/1.0" 202 Accepted 2026-03-28 16:53:38,301 - lava_callback - INFO - Starting async job submit for node 69c8074e123b47fd2377013d 2026-03-28 16:53:38,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:38,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8074e123b47fd2377013d HTTP/1.1" 200 None 2026-03-28 16:53:38,364 - lava_callback - DEBUG - Processing node 69c8074e123b47fd2377013d: baseline-arm64 2026-03-28 16:53:38,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:38,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:38,846 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8074e123b47fd2377013d/log.txt.gz 2026-03-28 16:53:39,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:39,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:39,279 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8074e123b47fd2377013d/lava-logs.yaml 2026-03-28 16:53:39,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:39,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:39,479 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8074e123b47fd2377013d/lava_callback.json.gz 2026-03-28 16:53:39,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:39,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8074e123b47fd2377013d HTTP/1.1" 200 None 2026-03-28 16:53:39,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:39,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:53:39,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:39,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8074e123b47fd2377013d HTTP/1.1" 200 None 2026-03-28 16:53:39,573 - lava_callback - INFO - Completed processing callback for node 69c8074e123b47fd2377013d 2026-03-28 16:53:46,220 - lava_callback - INFO - Received callback for node 69c8075a123b47fd2377015b INFO: 172.21.0.1:47128 - "POST /node/69c8075a123b47fd2377015b HTTP/1.0" 202 Accepted 2026-03-28 16:53:46,226 - lava_callback - INFO - Starting async job submit for node 69c8075a123b47fd2377015b 2026-03-28 16:53:46,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:46,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8075a123b47fd2377015b HTTP/1.1" 200 None 2026-03-28 16:53:46,266 - lava_callback - DEBUG - Processing node 69c8075a123b47fd2377015b: baseline-arm64 2026-03-28 16:53:46,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47132 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:53:46,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:46,613 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075a123b47fd2377015b/log.txt.gz 2026-03-28 16:53:46,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:46,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:46,941 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075a123b47fd2377015b/lava-logs.yaml 2026-03-28 16:53:46,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:47,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:47,096 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075a123b47fd2377015b/lava_callback.json.gz 2026-03-28 16:53:47,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:47,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8075a123b47fd2377015b HTTP/1.1" 200 None 2026-03-28 16:53:47,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:47,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:53:47,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:47,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8075a123b47fd2377015b HTTP/1.1" 200 None 2026-03-28 16:53:47,224 - lava_callback - INFO - Completed processing callback for node 69c8075a123b47fd2377015b 2026-03-28 16:53:48,564 - lava_callback - INFO - Received callback for node 69c80750123b47fd23770143 INFO: 172.21.0.1:47146 - "POST /node/69c80750123b47fd23770143 HTTP/1.0" 202 Accepted 2026-03-28 16:53:48,576 - lava_callback - INFO - Starting async job submit for node 69c80750123b47fd23770143 2026-03-28 16:53:48,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:48,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80750123b47fd23770143 HTTP/1.1" 200 None 2026-03-28 16:53:48,691 - lava_callback - DEBUG - Processing node 69c80750123b47fd23770143: baseline-arm64 2026-03-28 16:53:48,876 - lava_callback - WARNING - Failed to upload log 2026-03-28 16:53:48,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:49,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:49,467 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80750123b47fd23770143/lava-logs.yaml 2026-03-28 16:53:49,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47150 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:53:49,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:49,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80750123b47fd23770143/lava_callback.json.gz 2026-03-28 16:53:49,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:49,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80750123b47fd23770143 HTTP/1.1" 200 None 2026-03-28 16:53:49,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:50,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:53:50,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:50,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80750123b47fd23770143 HTTP/1.1" 200 None 2026-03-28 16:53:50,128 - lava_callback - INFO - Completed processing callback for node 69c80750123b47fd23770143 2026-03-28 16:53:56,484 - lava_callback - INFO - Received callback for node 69c8075e123b47fd23770164 INFO: 172.21.0.1:44900 - "POST /node/69c8075e123b47fd23770164 HTTP/1.0" 202 Accepted 2026-03-28 16:53:56,495 - lava_callback - INFO - Starting async job submit for node 69c8075e123b47fd23770164 INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:53:56,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:56,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8075e123b47fd23770164 HTTP/1.1" 200 None 2026-03-28 16:53:56,573 - lava_callback - DEBUG - Processing node 69c8075e123b47fd23770164: baseline-arm64 2026-03-28 16:53:56,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:56,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-28 16:53:57,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:57,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:57,715 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075e123b47fd23770164/log.txt.gz 2026-03-28 16:53:57,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:58,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:58,799 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075e123b47fd23770164/lava-logs.yaml 2026-03-28 16:53:58,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:53:59,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:53:59,003 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075e123b47fd23770164/lava_callback.json.gz 2026-03-28 16:53:59,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:59,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8075e123b47fd23770164 HTTP/1.1" 200 None 2026-03-28 16:53:59,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:59,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:53:59,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:53:59,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8075e123b47fd23770164 HTTP/1.1" 200 None 2026-03-28 16:53:59,110 - lava_callback - INFO - Completed processing callback for node 69c8075e123b47fd23770164 2026-03-28 16:54:01,350 - lava_callback - INFO - Received callback for node 69c80754123b47fd2377014c INFO: 172.21.0.1:58622 - "POST /node/69c80754123b47fd2377014c HTTP/1.0" 202 Accepted 2026-03-28 16:54:01,359 - lava_callback - INFO - Starting async job submit for node 69c80754123b47fd2377014c 2026-03-28 16:54:01,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:01,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80754123b47fd2377014c HTTP/1.1" 200 None 2026-03-28 16:54:01,446 - lava_callback - DEBUG - Processing node 69c80754123b47fd2377014c: baseline-arm64 2026-03-28 16:54:01,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:02,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:02,469 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80754123b47fd2377014c/log.txt.gz 2026-03-28 16:54:02,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:03,019 - lava_callback - INFO - Received callback for node 69c80758123b47fd23770155 INFO: 172.21.0.1:58638 - "POST /node/69c80758123b47fd23770155 HTTP/1.0" 202 Accepted 2026-03-28 16:54:03,033 - lava_callback - INFO - Starting async job submit for node 69c80758123b47fd23770155 2026-03-28 16:54:03,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:03,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80758123b47fd23770155 HTTP/1.1" 200 None 2026-03-28 16:54:03,110 - lava_callback - DEBUG - Processing node 69c80758123b47fd23770155: baseline-arm64 2026-03-28 16:54:04,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:04,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:04,106 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80754123b47fd2377014c/lava-logs.yaml 2026-03-28 16:54:04,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:04,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:04,418 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80758123b47fd23770155/log.txt.gz 2026-03-28 16:54:04,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:04,478 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80754123b47fd2377014c/lava_callback.json.gz 2026-03-28 16:54:04,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:04,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80754123b47fd2377014c HTTP/1.1" 200 None 2026-03-28 16:54:04,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:04,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:04,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:04,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80754123b47fd2377014c HTTP/1.1" 200 None 2026-03-28 16:54:04,768 - lava_callback - INFO - Completed processing callback for node 69c80754123b47fd2377014c 2026-03-28 16:54:05,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:05,964 - lava_callback - INFO - Received callback for node 69c804ec123b47fd2376ff59 INFO: 172.21.0.1:58654 - "POST /node/69c804ec123b47fd2376ff59 HTTP/1.0" 202 Accepted 2026-03-28 16:54:05,975 - lava_callback - INFO - Starting async job submit for node 69c804ec123b47fd2376ff59 2026-03-28 16:54:06,059 - lava_callback - INFO - Received callback for node 69c80755123b47fd2377014f 2026-03-28 16:54:06,076 - lava_callback - INFO - Starting async job submit for node 69c80755123b47fd2377014f INFO: 172.21.0.1:58664 - "POST /node/69c80755123b47fd2377014f HTTP/1.0" 202 Accepted 2026-03-28 16:54:06,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:06,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:06,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804ec123b47fd2376ff59 HTTP/1.1" 200 None 2026-03-28 16:54:06,134 - lava_callback - DEBUG - Processing node 69c804ec123b47fd2376ff59: ltp-fsx 2026-03-28 16:54:06,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80755123b47fd2377014f HTTP/1.1" 200 None 2026-03-28 16:54:06,165 - lava_callback - DEBUG - Processing node 69c80755123b47fd2377014f: baseline-arm64 2026-03-28 16:54:06,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:06,247 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80758123b47fd23770155/lava-logs.yaml 2026-03-28 16:54:06,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:06,334 - lava_callback - INFO - Received callback for node 69c8075d123b47fd23770161 2026-03-28 16:54:06,344 - lava_callback - INFO - Starting async job submit for node 69c8075d123b47fd23770161 INFO: 172.21.0.1:58668 - "POST /node/69c8075d123b47fd23770161 HTTP/1.0" 202 Accepted INFO: 172.21.0.1:58678 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:54:06,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:06,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8075d123b47fd23770161 HTTP/1.1" 200 None 2026-03-28 16:54:06,662 - lava_callback - DEBUG - Processing node 69c8075d123b47fd23770161: baseline-arm64 2026-03-28 16:54:07,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:07,661 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80758123b47fd23770155/lava_callback.json.gz 2026-03-28 16:54:08,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:08,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:08,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80758123b47fd23770155 HTTP/1.1" 200 None 2026-03-28 16:54:08,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:08,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:08,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:08,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:08,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:08,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80758123b47fd23770155 HTTP/1.1" 200 None 2026-03-28 16:54:08,484 - lava_callback - INFO - Completed processing callback for node 69c80758123b47fd23770155 2026-03-28 16:54:09,064 - lava_callback - INFO - Received callback for node 69c8075f123b47fd23770167 INFO: 172.21.0.1:58690 - "POST /node/69c8075f123b47fd23770167 HTTP/1.0" 202 Accepted 2026-03-28 16:54:09,079 - lava_callback - INFO - Starting async job submit for node 69c8075f123b47fd23770167 2026-03-28 16:54:09,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:09,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8075f123b47fd23770167 HTTP/1.1" 200 None 2026-03-28 16:54:09,147 - lava_callback - DEBUG - Processing node 69c8075f123b47fd23770167: baseline-arm64 2026-03-28 16:54:09,393 - lava_callback - INFO - Received callback for node 69c8074f123b47fd23770140 2026-03-28 16:54:09,410 - lava_callback - INFO - Starting async job submit for node 69c8074f123b47fd23770140 INFO: 172.21.0.1:58700 - "POST /node/69c8074f123b47fd23770140 HTTP/1.0" 202 Accepted 2026-03-28 16:54:09,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:09,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:09,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:09,541 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69c804ec123b47fd2376ff59/log.txt.gz 2026-03-28 16:54:09,542 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80755123b47fd2377014f/log.txt.gz 2026-03-28 16:54:09,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:09,624 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075d123b47fd23770161/log.txt.gz 2026-03-28 16:54:09,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8074f123b47fd23770140 HTTP/1.1" 200 None 2026-03-28 16:54:09,816 - lava_callback - DEBUG - Processing node 69c8074f123b47fd23770140: baseline-arm64 2026-03-28 16:54:11,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:11,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:11,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:11,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:11,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:11,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:11,729 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075f123b47fd23770167/log.txt.gz 2026-03-28 16:54:11,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:11,795 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8074f123b47fd23770140/log.txt.gz 2026-03-28 16:54:11,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:11,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:11,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:11,927 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075d123b47fd23770161/lava-logs.yaml 2026-03-28 16:54:11,944 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80755123b47fd2377014f/lava-logs.yaml 2026-03-28 16:54:11,976 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69c804ec123b47fd2376ff59/lava-logs.yaml 2026-03-28 16:54:11,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:12,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:12,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:12,164 - lava_callback - INFO - Received callback for node 69c8074e123b47fd2377013a 2026-03-28 16:54:12,246 - lava_callback - INFO - Starting async job submit for node 69c8074e123b47fd2377013a INFO: 172.21.0.1:35690 - "POST /node/69c8074e123b47fd2377013a HTTP/1.0" 202 Accepted 2026-03-28 16:54:12,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:12,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8074e123b47fd2377013a HTTP/1.1" 200 None 2026-03-28 16:54:12,426 - lava_callback - DEBUG - Processing node 69c8074e123b47fd2377013a: baseline-arm64 2026-03-28 16:54:12,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:12,552 - lava_callback - INFO - Received callback for node 69c80757123b47fd23770152 2026-03-28 16:54:12,606 - lava_callback - INFO - Starting async job submit for node 69c80757123b47fd23770152 INFO: 172.21.0.1:35694 - "POST /node/69c80757123b47fd23770152 HTTP/1.0" 202 Accepted 2026-03-28 16:54:12,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:12,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:12,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80757123b47fd23770152 HTTP/1.1" 200 None 2026-03-28 16:54:12,764 - lava_callback - DEBUG - Processing node 69c80757123b47fd23770152: baseline-arm64 2026-03-28 16:54:13,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:13,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:13,689 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075d123b47fd23770161/lava_callback.json.gz 2026-03-28 16:54:13,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:13,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80755123b47fd2377014f/lava_callback.json.gz 2026-03-28 16:54:13,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:13,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:13,827 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8074e123b47fd2377013a/log.txt.gz 2026-03-28 16:54:13,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:13,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:13,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:13,925 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69c804ec123b47fd2376ff59/lava_callback.json.gz 2026-03-28 16:54:13,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8075d123b47fd23770161 HTTP/1.1" 200 None 2026-03-28 16:54:13,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:13,950 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8074f123b47fd23770140/lava-logs.yaml 2026-03-28 16:54:13,959 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075f123b47fd23770167/lava-logs.yaml 2026-03-28 16:54:13,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:13,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:13,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:13,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:14,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:14,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80755123b47fd2377014f HTTP/1.1" 200 None 2026-03-28 16:54:14,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:14,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:14,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:14,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804ec123b47fd2376ff59 HTTP/1.1" 200 None 2026-03-28 16:54:14,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:14,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:14,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:14,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:54:14,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:14,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8075d123b47fd23770161 HTTP/1.1" 200 None 2026-03-28 16:54:14,265 - lava_callback - INFO - Completed processing callback for node 69c8075d123b47fd23770161 2026-03-28 16:54:14,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80755123b47fd2377014f HTTP/1.1" 200 None 2026-03-28 16:54:14,326 - lava_callback - INFO - Completed processing callback for node 69c80755123b47fd2377014f 2026-03-28 16:54:14,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804ec123b47fd2376ff59 HTTP/1.1" 200 None 2026-03-28 16:54:14,429 - lava_callback - INFO - Completed processing callback for node 69c804ec123b47fd2376ff59 2026-03-28 16:54:14,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35704 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-28 16:54:15,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:15,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80757123b47fd23770152/log.txt.gz 2026-03-28 16:54:15,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:15,791 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8074f123b47fd23770140/lava_callback.json.gz 2026-03-28 16:54:15,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:15,803 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075f123b47fd23770167/lava_callback.json.gz 2026-03-28 16:54:15,918 - lava_callback - INFO - Received callback for node 69c80752123b47fd23770146 2026-03-28 16:54:15,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:35706 - "POST /node/69c80752123b47fd23770146 HTTP/1.0" 202 Accepted 2026-03-28 16:54:15,951 - lava_callback - INFO - Starting async job submit for node 69c80752123b47fd23770146 2026-03-28 16:54:15,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:16,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:16,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:16,035 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8074e123b47fd2377013a/lava-logs.yaml 2026-03-28 16:54:16,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8075f123b47fd23770167 HTTP/1.1" 200 None 2026-03-28 16:54:16,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8074f123b47fd23770140 HTTP/1.1" 200 None 2026-03-28 16:54:16,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:16,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:16,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:16,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80752123b47fd23770146 HTTP/1.1" 200 None 2026-03-28 16:54:16,127 - lava_callback - DEBUG - Processing node 69c80752123b47fd23770146: baseline-arm64 2026-03-28 16:54:16,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:16,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:16,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:16,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:16,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8075f123b47fd23770167 HTTP/1.1" 200 None 2026-03-28 16:54:16,378 - lava_callback - INFO - Completed processing callback for node 69c8075f123b47fd23770167 2026-03-28 16:54:16,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8074f123b47fd23770140 HTTP/1.1" 200 None 2026-03-28 16:54:16,390 - lava_callback - INFO - Completed processing callback for node 69c8074f123b47fd23770140 INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:54:16,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:16,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:17,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:17,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80752123b47fd23770146/log.txt.gz 2026-03-28 16:54:17,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:17,813 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8074e123b47fd2377013a/lava_callback.json.gz 2026-03-28 16:54:17,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:17,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8074e123b47fd2377013a HTTP/1.1" 200 None 2026-03-28 16:54:17,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:17,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:18,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:18,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:18,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:18,043 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80757123b47fd23770152/lava-logs.yaml 2026-03-28 16:54:18,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8074e123b47fd2377013a HTTP/1.1" 200 None 2026-03-28 16:54:18,060 - lava_callback - INFO - Completed processing callback for node 69c8074e123b47fd2377013a 2026-03-28 16:54:18,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:19,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:19,402 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80752123b47fd23770146/lava-logs.yaml 2026-03-28 16:54:19,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:19,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:19,440 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80757123b47fd23770152/lava_callback.json.gz 2026-03-28 16:54:19,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:19,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80757123b47fd23770152 HTTP/1.1" 200 None 2026-03-28 16:54:19,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:19,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:19,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:19,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80757123b47fd23770152 HTTP/1.1" 200 None 2026-03-28 16:54:19,590 - lava_callback - INFO - Completed processing callback for node 69c80757123b47fd23770152 2026-03-28 16:54:20,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:20,712 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80752123b47fd23770146/lava_callback.json.gz 2026-03-28 16:54:20,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:20,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80752123b47fd23770146 HTTP/1.1" 200 None 2026-03-28 16:54:20,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:20,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:20,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:20,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80752123b47fd23770146 HTTP/1.1" 200 None 2026-03-28 16:54:20,956 - lava_callback - INFO - Completed processing callback for node 69c80752123b47fd23770146 2026-03-28 16:54:24,089 - lava_callback - INFO - Received callback for node 69c80769123b47fd2377019d INFO: 172.21.0.1:58770 - "POST /node/69c80769123b47fd2377019d HTTP/1.0" 202 Accepted 2026-03-28 16:54:24,101 - lava_callback - INFO - Starting async job submit for node 69c80769123b47fd2377019d 2026-03-28 16:54:24,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:24,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80769123b47fd2377019d HTTP/1.1" 200 None 2026-03-28 16:54:24,187 - lava_callback - DEBUG - Processing node 69c80769123b47fd2377019d: baseline-nfs-arm64 2026-03-28 16:54:25,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:25,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:25,974 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80769123b47fd2377019d/log.txt.gz 2026-03-28 16:54:26,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58784 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:54:26,698 - lava_callback - INFO - Received callback for node 69c80791123b47fd2377021f INFO: 172.21.0.1:58796 - "POST /node/69c80791123b47fd2377021f HTTP/1.0" 202 Accepted 2026-03-28 16:54:26,707 - lava_callback - INFO - Starting async job submit for node 69c80791123b47fd2377021f 2026-03-28 16:54:26,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:26,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:26,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-28 16:54:26,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80791123b47fd2377021f HTTP/1.1" 200 None 2026-03-28 16:54:26,782 - lava_callback - DEBUG - Processing node 69c80791123b47fd2377021f: baseline-arm64-pengutronix 2026-03-28 16:54:26,796 - lava_callback - INFO - Received callback for node 69c80767123b47fd23770199 INFO: 172.21.0.1:58810 - "POST /node/69c80767123b47fd23770199 HTTP/1.0" 202 Accepted 2026-03-28 16:54:26,829 - lava_callback - INFO - Starting async job submit for node 69c80767123b47fd23770199 2026-03-28 16:54:26,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:27,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80767123b47fd23770199 HTTP/1.1" 200 None 2026-03-28 16:54:27,029 - lava_callback - DEBUG - Processing node 69c80767123b47fd23770199: baseline-nfs-arm64 2026-03-28 16:54:27,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:27,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:27,938 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c80791123b47fd2377021f/log.txt.gz 2026-03-28 16:54:28,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:28,068 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80769123b47fd2377019d/lava-logs.yaml 2026-03-28 16:54:28,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:28,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:28,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:29,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:29,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:29,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80769123b47fd2377019d/lava_callback.json.gz 2026-03-28 16:54:29,534 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80767123b47fd23770199/log.txt.gz 2026-03-28 16:54:29,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:29,577 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c80791123b47fd2377021f/lava-logs.yaml 2026-03-28 16:54:29,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:29,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:29,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80769123b47fd2377019d HTTP/1.1" 200 None 2026-03-28 16:54:29,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:29,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:29,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:29,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80769123b47fd2377019d HTTP/1.1" 200 None 2026-03-28 16:54:29,921 - lava_callback - INFO - Completed processing callback for node 69c80769123b47fd2377019d 2026-03-28 16:54:30,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:31,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:31,281 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c80791123b47fd2377021f/lava_callback.json.gz 2026-03-28 16:54:31,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:31,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80791123b47fd2377021f HTTP/1.1" 200 None 2026-03-28 16:54:31,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:31,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:31,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:31,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80791123b47fd2377021f HTTP/1.1" 200 None 2026-03-28 16:54:31,433 - lava_callback - INFO - Completed processing callback for node 69c80791123b47fd2377021f 2026-03-28 16:54:31,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:31,482 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80767123b47fd23770199/lava-logs.yaml 2026-03-28 16:54:31,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:32,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:32,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80767123b47fd23770199/lava_callback.json.gz 2026-03-28 16:54:32,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:32,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80767123b47fd23770199 HTTP/1.1" 200 None 2026-03-28 16:54:32,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:32,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:32,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:33,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80767123b47fd23770199 HTTP/1.1" 200 None 2026-03-28 16:54:33,020 - lava_callback - INFO - Completed processing callback for node 69c80767123b47fd23770199 2026-03-28 16:54:33,446 - lava_callback - INFO - Received callback for node 69c8076f123b47fd237701ac INFO: 172.21.0.1:59038 - "POST /node/69c8076f123b47fd237701ac HTTP/1.0" 202 Accepted 2026-03-28 16:54:33,460 - lava_callback - INFO - Starting async job submit for node 69c8076f123b47fd237701ac 2026-03-28 16:54:33,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:33,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8076f123b47fd237701ac HTTP/1.1" 200 None 2026-03-28 16:54:33,554 - lava_callback - DEBUG - Processing node 69c8076f123b47fd237701ac: baseline-nfs-arm64 2026-03-28 16:54:34,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:34,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:34,508 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076f123b47fd237701ac/log.txt.gz 2026-03-28 16:54:34,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:35,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:35,946 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076f123b47fd237701ac/lava-logs.yaml 2026-03-28 16:54:35,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:59052 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:54:36,512 - lava_callback - INFO - Received callback for node 69c80796123b47fd2377022c INFO: 172.21.0.1:59056 - "POST /node/69c80796123b47fd2377022c HTTP/1.0" 202 Accepted 2026-03-28 16:54:36,522 - lava_callback - INFO - Starting async job submit for node 69c80796123b47fd2377022c 2026-03-28 16:54:36,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:36,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80796123b47fd2377022c HTTP/1.1" 200 None 2026-03-28 16:54:36,601 - lava_callback - DEBUG - Processing node 69c80796123b47fd2377022c: baseline-arm64-foundriesio 2026-03-28 16:54:37,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:37,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:37,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076f123b47fd237701ac/lava_callback.json.gz 2026-03-28 16:54:37,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:37,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8076f123b47fd237701ac HTTP/1.1" 200 None 2026-03-28 16:54:37,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:37,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:37,507 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c80796123b47fd2377022c/log.txt.gz 2026-03-28 16:54:37,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:37,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:37,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8076f123b47fd237701ac HTTP/1.1" 200 None 2026-03-28 16:54:37,654 - lava_callback - INFO - Completed processing callback for node 69c8076f123b47fd237701ac 2026-03-28 16:54:37,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:39,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:39,341 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c80796123b47fd2377022c/lava-logs.yaml 2026-03-28 16:54:39,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:40,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:40,700 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c80796123b47fd2377022c/lava_callback.json.gz 2026-03-28 16:54:40,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:40,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80796123b47fd2377022c HTTP/1.1" 200 None 2026-03-28 16:54:40,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:40,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:40,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:40,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80796123b47fd2377022c HTTP/1.1" 200 None 2026-03-28 16:54:40,870 - lava_callback - INFO - Completed processing callback for node 69c80796123b47fd2377022c 2026-03-28 16:54:41,986 - lava_callback - INFO - Received callback for node 69c8076d123b47fd237701a9 INFO: 172.21.0.1:52842 - "POST /node/69c8076d123b47fd237701a9 HTTP/1.0" 202 Accepted 2026-03-28 16:54:41,996 - lava_callback - INFO - Starting async job submit for node 69c8076d123b47fd237701a9 2026-03-28 16:54:42,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:42,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8076d123b47fd237701a9 HTTP/1.1" 200 None 2026-03-28 16:54:42,065 - lava_callback - DEBUG - Processing node 69c8076d123b47fd237701a9: baseline-nfs-arm64 2026-03-28 16:54:42,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:43,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:43,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076d123b47fd237701a9/log.txt.gz 2026-03-28 16:54:44,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:45,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:45,286 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076d123b47fd237701a9/lava-logs.yaml 2026-03-28 16:54:45,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:45,815 - lava_callback - INFO - Received callback for node 69c8077a123b47fd237701c3 INFO: 172.21.0.1:52858 - "POST /node/69c8077a123b47fd237701c3 HTTP/1.0" 202 Accepted 2026-03-28 16:54:45,824 - lava_callback - INFO - Starting async job submit for node 69c8077a123b47fd237701c3 2026-03-28 16:54:45,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:45,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8077a123b47fd237701c3 HTTP/1.1" 200 None 2026-03-28 16:54:45,903 - lava_callback - DEBUG - Processing node 69c8077a123b47fd237701c3: baseline-arm64-broonie 2026-03-28 16:54:46,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:46,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:46,514 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076d123b47fd237701a9/lava_callback.json.gz INFO: 172.21.0.1:52872 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:54:46,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:46,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8076d123b47fd237701a9 HTTP/1.1" 200 None 2026-03-28 16:54:46,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:46,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:46,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:46,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8076d123b47fd237701a9 HTTP/1.1" 200 None 2026-03-28 16:54:46,698 - lava_callback - INFO - Completed processing callback for node 69c8076d123b47fd237701a9 2026-03-28 16:54:46,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:46,837 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c8077a123b47fd237701c3/log.txt.gz 2026-03-28 16:54:47,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:47,763 - lava_callback - INFO - Received callback for node 69c80781123b47fd237701d4 INFO: 172.21.0.1:52884 - "POST /node/69c80781123b47fd237701d4 HTTP/1.0" 202 Accepted 2026-03-28 16:54:47,772 - lava_callback - INFO - Starting async job submit for node 69c80781123b47fd237701d4 2026-03-28 16:54:47,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:47,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80781123b47fd237701d4 HTTP/1.1" 200 None 2026-03-28 16:54:47,856 - lava_callback - DEBUG - Processing node 69c80781123b47fd237701d4: baseline-arm64-broonie 2026-03-28 16:54:48,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:48,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:48,492 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c8077a123b47fd237701c3/lava-logs.yaml 2026-03-28 16:54:48,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:49,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:49,287 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80781123b47fd237701d4/log.txt.gz 2026-03-28 16:54:49,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:54:49,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:49,838 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c8077a123b47fd237701c3/lava_callback.json.gz 2026-03-28 16:54:49,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:49,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8077a123b47fd237701c3 HTTP/1.1" 200 None 2026-03-28 16:54:49,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:49,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:49,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:50,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8077a123b47fd237701c3 HTTP/1.1" 200 None 2026-03-28 16:54:50,016 - lava_callback - INFO - Completed processing callback for node 69c8077a123b47fd237701c3 2026-03-28 16:54:50,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:50,729 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80781123b47fd237701d4/lava-logs.yaml 2026-03-28 16:54:50,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:51,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:51,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80781123b47fd237701d4/lava_callback.json.gz 2026-03-28 16:54:51,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:51,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80781123b47fd237701d4 HTTP/1.1" 200 None 2026-03-28 16:54:51,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:51,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:51,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:51,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80781123b47fd237701d4 HTTP/1.1" 200 None 2026-03-28 16:54:51,762 - lava_callback - INFO - Completed processing callback for node 69c80781123b47fd237701d4 2026-03-28 16:54:53,706 - lava_callback - INFO - Received callback for node 69c80793123b47fd23770222 INFO: 172.21.0.1:58764 - "POST /node/69c80793123b47fd23770222 HTTP/1.0" 202 Accepted 2026-03-28 16:54:53,716 - lava_callback - INFO - Starting async job submit for node 69c80793123b47fd23770222 2026-03-28 16:54:53,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:53,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80793123b47fd23770222 HTTP/1.1" 200 None 2026-03-28 16:54:53,801 - lava_callback - DEBUG - Processing node 69c80793123b47fd23770222: baseline-arm64-pengutronix 2026-03-28 16:54:53,975 - lava_callback - INFO - Received callback for node 69c804f2123b47fd2376ff7c INFO: 172.21.0.1:58768 - "POST /node/69c804f2123b47fd2376ff7c HTTP/1.0" 202 Accepted 2026-03-28 16:54:54,001 - lava_callback - INFO - Starting async job submit for node 69c804f2123b47fd2376ff7c 2026-03-28 16:54:54,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:54,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804f2123b47fd2376ff7c HTTP/1.1" 200 None 2026-03-28 16:54:54,131 - lava_callback - DEBUG - Processing node 69c804f2123b47fd2376ff7c: ltp-sched 2026-03-28 16:54:54,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:54,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:55,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:55,333 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c80793123b47fd23770222/log.txt.gz 2026-03-28 16:54:55,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:55,420 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69c804f2123b47fd2376ff7c/log.txt.gz 2026-03-28 16:54:55,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:55,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:56,455 - lava_callback - INFO - Received callback for node 69c80764123b47fd23770173 INFO: 172.21.0.1:58784 - "POST /node/69c80764123b47fd23770173 HTTP/1.0" 202 Accepted 2026-03-28 16:54:56,469 - lava_callback - INFO - Starting async job submit for node 69c80764123b47fd23770173 INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:54:56,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:56,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80764123b47fd23770173 HTTP/1.1" 200 None 2026-03-28 16:54:56,544 - lava_callback - DEBUG - Processing node 69c80764123b47fd23770173: baseline-nfs-arm64 2026-03-28 16:54:56,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:56,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-28 16:54:57,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:57,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:57,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c80793123b47fd23770222/lava-logs.yaml 2026-03-28 16:54:57,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:57,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:57,413 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69c804f2123b47fd2376ff7c/lava-logs.yaml 2026-03-28 16:54:57,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:58,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:58,126 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80764123b47fd23770173/log.txt.gz 2026-03-28 16:54:58,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:54:58,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:58,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c80793123b47fd23770222/lava_callback.json.gz 2026-03-28 16:54:58,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:58,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80793123b47fd23770222 HTTP/1.1" 200 None 2026-03-28 16:54:58,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:58,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:54:58,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:58,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80793123b47fd23770222 HTTP/1.1" 200 None 2026-03-28 16:54:58,719 - lava_callback - INFO - Completed processing callback for node 69c80793123b47fd23770222 2026-03-28 16:54:58,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:54:58,774 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69c804f2123b47fd2376ff7c/lava_callback.json.gz 2026-03-28 16:54:58,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:58,891 - lava_callback - INFO - Received callback for node 69c80770123b47fd237701b3 2026-03-28 16:54:58,902 - lava_callback - INFO - Starting async job submit for node 69c80770123b47fd237701b3 INFO: 172.21.0.1:58792 - "POST /node/69c80770123b47fd237701b3 HTTP/1.0" 202 Accepted 2026-03-28 16:54:58,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804f2123b47fd2376ff7c HTTP/1.1" 200 None 2026-03-28 16:54:58,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:58,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:59,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:54:59,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:54:59,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80770123b47fd237701b3 HTTP/1.1" 200 None 2026-03-28 16:54:59,046 - lava_callback - DEBUG - Processing node 69c80770123b47fd237701b3: baseline-nfs-arm64 2026-03-28 16:54:59,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804f2123b47fd2376ff7c HTTP/1.1" 200 None 2026-03-28 16:54:59,102 - lava_callback - INFO - Completed processing callback for node 69c804f2123b47fd2376ff7c 2026-03-28 16:54:59,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:00,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:00,362 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80764123b47fd23770173/lava-logs.yaml 2026-03-28 16:55:00,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:00,534 - lava_callback - INFO - Received callback for node 69c80795123b47fd23770229 INFO: 172.21.0.1:58474 - "POST /node/69c80795123b47fd23770229 HTTP/1.0" 202 Accepted 2026-03-28 16:55:00,548 - lava_callback - INFO - Starting async job submit for node 69c80795123b47fd23770229 2026-03-28 16:55:00,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:00,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:00,593 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80770123b47fd237701b3/log.txt.gz 2026-03-28 16:55:00,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:00,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80795123b47fd23770229 HTTP/1.1" 200 None 2026-03-28 16:55:00,680 - lava_callback - DEBUG - Processing node 69c80795123b47fd23770229: baseline-arm64-pengutronix 2026-03-28 16:55:00,714 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80764123b47fd23770173/lava_callback.json.gz 2026-03-28 16:55:00,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:00,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80764123b47fd23770173 HTTP/1.1" 200 None 2026-03-28 16:55:00,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:00,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:55:01,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:01,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80764123b47fd23770173 HTTP/1.1" 200 None 2026-03-28 16:55:01,163 - lava_callback - INFO - Completed processing callback for node 69c80764123b47fd23770173 2026-03-28 16:55:01,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:01,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:01,644 - lava_callback - INFO - Received callback for node 69c8076b123b47fd237701a3 INFO: 172.21.0.1:58486 - "POST /node/69c8076b123b47fd237701a3 HTTP/1.0" 202 Accepted 2026-03-28 16:55:01,656 - lava_callback - INFO - Starting async job submit for node 69c8076b123b47fd237701a3 2026-03-28 16:55:01,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:01,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8076b123b47fd237701a3 HTTP/1.1" 200 None 2026-03-28 16:55:01,754 - lava_callback - DEBUG - Processing node 69c8076b123b47fd237701a3: baseline-nfs-arm64 2026-03-28 16:55:02,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:02,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:02,421 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c80795123b47fd23770229/log.txt.gz 2026-03-28 16:55:02,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:02,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:02,697 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80770123b47fd237701b3/lava-logs.yaml 2026-03-28 16:55:02,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:03,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:03,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076b123b47fd237701a3/log.txt.gz 2026-03-28 16:55:03,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:04,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:04,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80770123b47fd237701b3/lava_callback.json.gz 2026-03-28 16:55:04,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:04,242 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c80795123b47fd23770229/lava-logs.yaml 2026-03-28 16:55:04,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:04,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:04,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80770123b47fd237701b3 HTTP/1.1" 200 None 2026-03-28 16:55:04,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:04,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:04,341 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076b123b47fd237701a3/lava-logs.yaml 2026-03-28 16:55:04,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:04,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:55:04,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:04,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80770123b47fd237701b3 HTTP/1.1" 200 None 2026-03-28 16:55:04,436 - lava_callback - INFO - Received callback for node 69c80797123b47fd2377022f INFO: 172.21.0.1:58492 - "POST /node/69c80797123b47fd2377022f HTTP/1.0" 202 Accepted 2026-03-28 16:55:04,462 - lava_callback - INFO - Starting async job submit for node 69c80797123b47fd2377022f 2026-03-28 16:55:04,509 - lava_callback - INFO - Completed processing callback for node 69c80770123b47fd237701b3 2026-03-28 16:55:04,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:04,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80797123b47fd2377022f HTTP/1.1" 200 None 2026-03-28 16:55:04,587 - lava_callback - DEBUG - Processing node 69c80797123b47fd2377022f: baseline-arm64-foundriesio 2026-03-28 16:55:05,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:05,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:05,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c80795123b47fd23770229/lava_callback.json.gz 2026-03-28 16:55:05,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:05,875 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076b123b47fd237701a3/lava_callback.json.gz 2026-03-28 16:55:05,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:05,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:05,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80795123b47fd23770229 HTTP/1.1" 200 None 2026-03-28 16:55:05,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:05,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8076b123b47fd237701a3 HTTP/1.1" 200 None 2026-03-28 16:55:05,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:05,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:55:05,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:05,988 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c80797123b47fd2377022f/log.txt.gz 2026-03-28 16:55:05,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:06,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:55:06,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:06,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80795123b47fd23770229 HTTP/1.1" 200 None 2026-03-28 16:55:06,120 - lava_callback - INFO - Completed processing callback for node 69c80795123b47fd23770229 2026-03-28 16:55:06,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8076b123b47fd237701a3 HTTP/1.1" 200 None 2026-03-28 16:55:06,189 - lava_callback - INFO - Completed processing callback for node 69c8076b123b47fd237701a3 INFO: 172.21.0.1:58504 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:55:06,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:07,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:07,683 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c80797123b47fd2377022f/lava-logs.yaml 2026-03-28 16:55:07,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:08,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:08,847 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c80797123b47fd2377022f/lava_callback.json.gz 2026-03-28 16:55:08,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:08,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80797123b47fd2377022f HTTP/1.1" 200 None 2026-03-28 16:55:08,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:08,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:55:08,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:09,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80797123b47fd2377022f HTTP/1.1" 200 None 2026-03-28 16:55:09,032 - lava_callback - INFO - Completed processing callback for node 69c80797123b47fd2377022f 2026-03-28 16:55:10,192 - lava_callback - INFO - Received callback for node 69c80762123b47fd2377016d INFO: 172.21.0.1:44896 - "POST /node/69c80762123b47fd2377016d HTTP/1.0" 202 Accepted 2026-03-28 16:55:10,203 - lava_callback - INFO - Starting async job submit for node 69c80762123b47fd2377016d 2026-03-28 16:55:10,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:10,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80762123b47fd2377016d HTTP/1.1" 200 None 2026-03-28 16:55:10,276 - lava_callback - DEBUG - Processing node 69c80762123b47fd2377016d: baseline-nfs-arm64 2026-03-28 16:55:10,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:11,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:11,667 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80762123b47fd2377016d/log.txt.gz 2026-03-28 16:55:11,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:13,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:13,300 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80762123b47fd2377016d/lava-logs.yaml 2026-03-28 16:55:13,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:13,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:13,454 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80762123b47fd2377016d/lava_callback.json.gz 2026-03-28 16:55:13,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:13,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80762123b47fd2377016d HTTP/1.1" 200 None 2026-03-28 16:55:13,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:13,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:55:13,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:13,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80762123b47fd2377016d HTTP/1.1" 200 None 2026-03-28 16:55:13,546 - lava_callback - INFO - Completed processing callback for node 69c80762123b47fd2377016d 2026-03-28 16:55:14,073 - lava_callback - INFO - Received callback for node 69c8077d123b47fd237701cb INFO: 172.21.0.1:44908 - "POST /node/69c8077d123b47fd237701cb HTTP/1.0" 202 Accepted 2026-03-28 16:55:14,083 - lava_callback - INFO - Starting async job submit for node 69c8077d123b47fd237701cb 2026-03-28 16:55:14,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:14,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8077d123b47fd237701cb HTTP/1.1" 200 None 2026-03-28 16:55:14,155 - lava_callback - DEBUG - Processing node 69c8077d123b47fd237701cb: baseline-arm64-broonie 2026-03-28 16:55:14,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:15,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:15,065 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c8077d123b47fd237701cb/log.txt.gz INFO: 172.21.0.1:44918 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-28 16:55:15,261 - lava_callback - INFO - Received callback for node 69c8078c123b47fd23770212 INFO: 172.21.0.1:44920 - "POST /node/69c8078c123b47fd23770212 HTTP/1.0" 202 Accepted 2026-03-28 16:55:15,269 - lava_callback - INFO - Starting async job submit for node 69c8078c123b47fd23770212 2026-03-28 16:55:15,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:15,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:15,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8078c123b47fd23770212 HTTP/1.1" 200 None 2026-03-28 16:55:15,318 - lava_callback - DEBUG - Processing node 69c8078c123b47fd23770212: baseline-arm64-clabbe 2026-03-28 16:55:15,589 - lava_callback - INFO - Received callback for node 69c8077e123b47fd237701ce INFO: 172.21.0.1:44926 - "POST /node/69c8077e123b47fd237701ce HTTP/1.0" 202 Accepted 2026-03-28 16:55:15,613 - lava_callback - INFO - Starting async job submit for node 69c8077e123b47fd237701ce 2026-03-28 16:55:15,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:15,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8077e123b47fd237701ce HTTP/1.1" 200 None 2026-03-28 16:55:15,771 - lava_callback - DEBUG - Processing node 69c8077e123b47fd237701ce: baseline-arm64-broonie 2026-03-28 16:55:15,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:16,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:55:16,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:16,622 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c8078c123b47fd23770212/log.txt.gz 2026-03-28 16:55:16,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:16,811 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c8077e123b47fd237701ce/log.txt.gz 2026-03-28 16:55:16,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:16,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:16,981 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c8077d123b47fd237701cb/lava-logs.yaml 2026-03-28 16:55:16,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:17,091 - lava_callback - INFO - Received callback for node 69c80783123b47fd237701db INFO: 172.21.0.1:44940 - "POST /node/69c80783123b47fd237701db HTTP/1.0" 202 Accepted 2026-03-28 16:55:17,110 - lava_callback - INFO - Starting async job submit for node 69c80783123b47fd237701db 2026-03-28 16:55:17,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:17,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80783123b47fd237701db HTTP/1.1" 200 None 2026-03-28 16:55:17,239 - lava_callback - DEBUG - Processing node 69c80783123b47fd237701db: baseline-arm64-broonie 2026-03-28 16:55:17,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:17,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:18,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:18,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c8077d123b47fd237701cb/lava_callback.json.gz 2026-03-28 16:55:18,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:18,402 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80783123b47fd237701db/log.txt.gz 2026-03-28 16:55:18,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:18,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8077d123b47fd237701cb HTTP/1.1" 200 None 2026-03-28 16:55:18,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:18,541 - lava_callback - INFO - Received callback for node 69c80785123b47fd237701de INFO: 172.21.0.1:44956 - "POST /node/69c80785123b47fd237701de HTTP/1.0" 202 Accepted 2026-03-28 16:55:18,575 - lava_callback - INFO - Starting async job submit for node 69c80785123b47fd237701de 2026-03-28 16:55:18,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:55:18,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:18,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:18,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:18,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:18,661 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c8078c123b47fd23770212/lava-logs.yaml 2026-03-28 16:55:18,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c8077e123b47fd237701ce/lava-logs.yaml 2026-03-28 16:55:18,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:18,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:18,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:18,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80785123b47fd237701de HTTP/1.1" 200 None 2026-03-28 16:55:18,731 - lava_callback - DEBUG - Processing node 69c80785123b47fd237701de: baseline-arm64-broonie 2026-03-28 16:55:18,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8077d123b47fd237701cb HTTP/1.1" 200 None 2026-03-28 16:55:18,774 - lava_callback - INFO - Completed processing callback for node 69c8077d123b47fd237701cb 2026-03-28 16:55:19,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:20,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:20,121 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c8078c123b47fd23770212/lava_callback.json.gz 2026-03-28 16:55:20,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:20,180 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c8077e123b47fd237701ce/lava_callback.json.gz 2026-03-28 16:55:20,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:20,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:20,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8078c123b47fd23770212 HTTP/1.1" 200 None 2026-03-28 16:55:20,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:20,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8077e123b47fd237701ce HTTP/1.1" 200 None 2026-03-28 16:55:20,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:20,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:55:20,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:55:20,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:20,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:20,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:20,300 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80783123b47fd237701db/lava-logs.yaml 2026-03-28 16:55:20,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:20,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8077e123b47fd237701ce HTTP/1.1" 200 None 2026-03-28 16:55:20,383 - lava_callback - INFO - Completed processing callback for node 69c8077e123b47fd237701ce 2026-03-28 16:55:20,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8078c123b47fd23770212 HTTP/1.1" 200 None 2026-03-28 16:55:20,405 - lava_callback - INFO - Completed processing callback for node 69c8078c123b47fd23770212 2026-03-28 16:55:20,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:20,525 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80785123b47fd237701de/log.txt.gz 2026-03-28 16:55:20,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:20,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:20,914 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80783123b47fd237701db/lava_callback.json.gz 2026-03-28 16:55:20,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:20,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80783123b47fd237701db HTTP/1.1" 200 None 2026-03-28 16:55:20,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:20,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:55:20,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:21,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80783123b47fd237701db HTTP/1.1" 200 None 2026-03-28 16:55:21,035 - lava_callback - INFO - Completed processing callback for node 69c80783123b47fd237701db 2026-03-28 16:55:21,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:21,918 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80785123b47fd237701de/lava-logs.yaml 2026-03-28 16:55:21,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:23,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:23,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80785123b47fd237701de/lava_callback.json.gz 2026-03-28 16:55:23,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:23,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80785123b47fd237701de HTTP/1.1" 200 None 2026-03-28 16:55:23,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:23,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:55:23,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:23,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80785123b47fd237701de HTTP/1.1" 200 None 2026-03-28 16:55:23,307 - lava_callback - INFO - Completed processing callback for node 69c80785123b47fd237701de INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:55:26,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:26,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:40850 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:55:45,702 - lava_callback - INFO - Received callback for node 69c80786123b47fd237701fc INFO: 172.21.0.1:33726 - "POST /node/69c80786123b47fd237701fc HTTP/1.0" 202 Accepted 2026-03-28 16:55:45,712 - lava_callback - INFO - Starting async job submit for node 69c80786123b47fd237701fc 2026-03-28 16:55:45,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:45,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80786123b47fd237701fc HTTP/1.1" 200 None 2026-03-28 16:55:45,773 - lava_callback - DEBUG - Processing node 69c80786123b47fd237701fc: baseline-arm64-broonie 2026-03-28 16:55:46,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33738 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:55:47,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:47,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80786123b47fd237701fc/log.txt.gz 2026-03-28 16:55:47,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:55:48,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:48,596 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80786123b47fd237701fc/lava-logs.yaml 2026-03-28 16:55:48,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33754 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:55:49,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:55:49,704 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80786123b47fd237701fc/lava_callback.json.gz 2026-03-28 16:55:49,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:49,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80786123b47fd237701fc HTTP/1.1" 200 None 2026-03-28 16:55:49,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:49,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:55:49,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:49,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80786123b47fd237701fc HTTP/1.1" 200 None 2026-03-28 16:55:49,821 - lava_callback - INFO - Completed processing callback for node 69c80786123b47fd237701fc INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:55:56,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:55:56,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38680 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:56:14,046 - lava_callback - INFO - Received callback for node 69c804f7123b47fd2376ff85 INFO: 172.21.0.1:49270 - "POST /node/69c804f7123b47fd2376ff85 HTTP/1.0" 202 Accepted 2026-03-28 16:56:14,056 - lava_callback - INFO - Starting async job submit for node 69c804f7123b47fd2376ff85 2026-03-28 16:56:14,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:14,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804f7123b47fd2376ff85 HTTP/1.1" 200 None 2026-03-28 16:56:14,111 - lava_callback - DEBUG - Processing node 69c804f7123b47fd2376ff85: ltp-syscalls-ipc 2026-03-28 16:56:14,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49284 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-28 16:56:15,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:56:15,664 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c804f7123b47fd2376ff85/log.txt.gz 2026-03-28 16:56:15,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:56:17,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:56:17,214 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c804f7123b47fd2376ff85/lava-logs.yaml 2026-03-28 16:56:17,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:56:18,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:56:18,338 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69c804f7123b47fd2376ff85/lava_callback.json.gz 2026-03-28 16:56:18,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:18,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804f7123b47fd2376ff85 HTTP/1.1" 200 None 2026-03-28 16:56:18,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:18,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:56:18,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:18,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804f7123b47fd2376ff85 HTTP/1.1" 200 None 2026-03-28 16:56:18,473 - lava_callback - INFO - Completed processing callback for node 69c804f7123b47fd2376ff85 2026-03-28 16:56:25,968 - lava_callback - INFO - Received callback for node 69c8077b123b47fd237701c6 INFO: 172.21.0.1:39402 - "POST /node/69c8077b123b47fd237701c6 HTTP/1.0" 202 Accepted 2026-03-28 16:56:25,978 - lava_callback - INFO - Starting async job submit for node 69c8077b123b47fd237701c6 2026-03-28 16:56:26,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:26,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8077b123b47fd237701c6 HTTP/1.1" 200 None 2026-03-28 16:56:26,040 - lava_callback - DEBUG - Processing node 69c8077b123b47fd237701c6: baseline-arm64-broonie 2026-03-28 16:56:26,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39414 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:56:26,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:26,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-28 16:56:27,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:56:27,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c8077b123b47fd237701c6/log.txt.gz 2026-03-28 16:56:27,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:56:28,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:56:28,582 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c8077b123b47fd237701c6/lava-logs.yaml 2026-03-28 16:56:28,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:56:29,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:56:29,569 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c8077b123b47fd237701c6/lava_callback.json.gz 2026-03-28 16:56:29,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:29,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8077b123b47fd237701c6 HTTP/1.1" 200 None 2026-03-28 16:56:29,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:29,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:56:29,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:29,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8077b123b47fd237701c6 HTTP/1.1" 200 None 2026-03-28 16:56:29,712 - lava_callback - INFO - Completed processing callback for node 69c8077b123b47fd237701c6 2026-03-28 16:56:32,133 - lava_callback - INFO - Received callback for node 69c80753123b47fd23770149 INFO: 172.21.0.1:43792 - "POST /node/69c80753123b47fd23770149 HTTP/1.0" 202 Accepted 2026-03-28 16:56:32,143 - lava_callback - INFO - Starting async job submit for node 69c80753123b47fd23770149 2026-03-28 16:56:32,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:32,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80753123b47fd23770149 HTTP/1.1" 200 None 2026-03-28 16:56:32,196 - lava_callback - DEBUG - Processing node 69c80753123b47fd23770149: baseline-arm64 2026-03-28 16:56:32,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:56:33,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:56:33,864 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80753123b47fd23770149/log.txt.gz 2026-03-28 16:56:34,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:56:35,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:56:35,352 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80753123b47fd23770149/lava-logs.yaml 2026-03-28 16:56:35,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:56:36,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:56:36,443 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80753123b47fd23770149/lava_callback.json.gz 2026-03-28 16:56:36,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:36,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80753123b47fd23770149 HTTP/1.1" 200 None 2026-03-28 16:56:36,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:43808 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:56:36,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:56:36,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:36,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80753123b47fd23770149 HTTP/1.1" 200 None 2026-03-28 16:56:36,541 - lava_callback - INFO - Completed processing callback for node 69c80753123b47fd23770149 2026-03-28 16:56:43,107 - lava_callback - INFO - Received callback for node 69c80763123b47fd23770170 INFO: 172.21.0.1:33292 - "POST /node/69c80763123b47fd23770170 HTTP/1.0" 202 Accepted 2026-03-28 16:56:43,117 - lava_callback - INFO - Starting async job submit for node 69c80763123b47fd23770170 2026-03-28 16:56:43,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:43,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80763123b47fd23770170 HTTP/1.1" 200 None 2026-03-28 16:56:43,176 - lava_callback - DEBUG - Processing node 69c80763123b47fd23770170: baseline-nfs-arm64 2026-03-28 16:56:43,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:56:44,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:56:44,817 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80763123b47fd23770170/log.txt.gz 2026-03-28 16:56:45,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:56:46,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:56:46,395 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80763123b47fd23770170/lava-logs.yaml 2026-03-28 16:56:46,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:56:47,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:56:47,572 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80763123b47fd23770170/lava_callback.json.gz 2026-03-28 16:56:47,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:47,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80763123b47fd23770170 HTTP/1.1" 200 None 2026-03-28 16:56:47,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:47,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:56:47,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:47,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80763123b47fd23770170 HTTP/1.1" 200 None 2026-03-28 16:56:47,701 - lava_callback - INFO - Completed processing callback for node 69c80763123b47fd23770170 INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59386 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:56:56,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:56:56,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-28 16:57:05,769 - lava_callback - INFO - Received callback for node 69c80780123b47fd237701d1 INFO: 172.21.0.1:34122 - "POST /node/69c80780123b47fd237701d1 HTTP/1.0" 202 Accepted 2026-03-28 16:57:05,777 - lava_callback - INFO - Starting async job submit for node 69c80780123b47fd237701d1 2026-03-28 16:57:05,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:57:05,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80780123b47fd237701d1 HTTP/1.1" 200 None 2026-03-28 16:57:05,835 - lava_callback - DEBUG - Processing node 69c80780123b47fd237701d1: baseline-arm64-broonie 2026-03-28 16:57:06,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34138 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:57:07,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:57:07,268 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80780123b47fd237701d1/log.txt.gz 2026-03-28 16:57:07,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:57:08,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:57:08,712 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80780123b47fd237701d1/lava-logs.yaml 2026-03-28 16:57:08,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:57:09,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:57:09,829 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c80780123b47fd237701d1/lava_callback.json.gz 2026-03-28 16:57:09,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:57:09,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80780123b47fd237701d1 HTTP/1.1" 200 None 2026-03-28 16:57:09,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:57:09,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 16:57:09,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:57:09,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80780123b47fd237701d1 HTTP/1.1" 200 None 2026-03-28 16:57:09,955 - lava_callback - INFO - Completed processing callback for node 69c80780123b47fd237701d1 INFO: 172.21.0.1:38338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:57:26,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:57:27,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-28 16:57:34,055 - lava_callback - INFO - Received callback for node 69c804f1123b47fd2376ff62 INFO: 172.21.0.1:59102 - "POST /node/69c804f1123b47fd2376ff62 HTTP/1.0" 202 Accepted 2026-03-28 16:57:34,062 - lava_callback - INFO - Starting async job submit for node 69c804f1123b47fd2376ff62 2026-03-28 16:57:34,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:57:34,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804f1123b47fd2376ff62 HTTP/1.1" 200 None 2026-03-28 16:57:34,132 - lava_callback - DEBUG - Processing node 69c804f1123b47fd2376ff62: ltp-pty 2026-03-28 16:57:34,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:57:35,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:57:35,687 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69c804f1123b47fd2376ff62/log.txt.gz 2026-03-28 16:57:36,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:59106 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:57:37,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:57:37,174 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69c804f1123b47fd2376ff62/lava-logs.yaml 2026-03-28 16:57:37,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:57:38,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:57:38,336 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69c804f1123b47fd2376ff62/lava_callback.json.gz 2026-03-28 16:57:38,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:57:38,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804f1123b47fd2376ff62 HTTP/1.1" 200 None 2026-03-28 16:57:38,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:57:38,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:57:38,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:57:38,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804f1123b47fd2376ff62 HTTP/1.1" 200 None 2026-03-28 16:57:38,470 - lava_callback - INFO - Completed processing callback for node 69c804f1123b47fd2376ff62 INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:57:57,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:57:57,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57222 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:58:54,118 - lava_callback - INFO - Received callback for node 69c804fa123b47fd2376ff8b INFO: 172.21.0.1:46522 - "POST /node/69c804fa123b47fd2376ff8b HTTP/1.0" 202 Accepted 2026-03-28 16:58:54,124 - lava_callback - INFO - Starting async job submit for node 69c804fa123b47fd2376ff8b 2026-03-28 16:58:54,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:58:54,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804fa123b47fd2376ff8b HTTP/1.1" 200 None 2026-03-28 16:58:54,174 - lava_callback - DEBUG - Processing node 69c804fa123b47fd2376ff8b: ltp-watchqueue 2026-03-28 16:58:54,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:58:54,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:58:54,698 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c804fa123b47fd2376ff8b/log.txt.gz 2026-03-28 16:58:54,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:58:55,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:58:55,285 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c804fa123b47fd2376ff8b/lava-logs.yaml 2026-03-28 16:58:55,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:58:55,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:58:55,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69c804fa123b47fd2376ff8b/lava_callback.json.gz 2026-03-28 16:58:55,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:58:55,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804fa123b47fd2376ff8b HTTP/1.1" 200 None 2026-03-28 16:58:55,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:58:55,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:58:55,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:58:55,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804fa123b47fd2376ff8b HTTP/1.1" 200 None 2026-03-28 16:58:55,592 - lava_callback - INFO - Completed processing callback for node 69c804fa123b47fd2376ff8b INFO: 172.21.0.1:46530 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:58:57,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:58:57,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:59:20,280 - lava_callback - INFO - Received callback for node 69c804b1123b47fd2376fea0 INFO: 172.21.0.1:36600 - "POST /node/69c804b1123b47fd2376fea0 HTTP/1.0" 202 Accepted 2026-03-28 16:59:20,287 - lava_callback - INFO - Starting async job submit for node 69c804b1123b47fd2376fea0 2026-03-28 16:59:20,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:59:20,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804b1123b47fd2376fea0 HTTP/1.1" 200 None 2026-03-28 16:59:20,355 - lava_callback - DEBUG - Processing node 69c804b1123b47fd2376fea0: baseline-arm 2026-03-28 16:59:20,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:59:21,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:59:21,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c804b1123b47fd2376fea0/log.txt.gz 2026-03-28 16:59:21,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:59:21,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:59:21,735 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c804b1123b47fd2376fea0/lava-logs.yaml 2026-03-28 16:59:21,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 16:59:21,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 16:59:21,934 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c804b1123b47fd2376fea0/lava_callback.json.gz DEBUG: Setup failed for 69c804b1123b47fd2376fea0. Transitting job node result: incomplete -> fail 2026-03-28 16:59:22,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:59:22,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804b1123b47fd2376fea0 HTTP/1.1" 200 None 2026-03-28 16:59:22,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:59:22,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 16:59:22,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:59:22,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804b1123b47fd2376fea0 HTTP/1.1" 200 None 2026-03-28 16:59:22,214 - lava_callback - INFO - Completed processing callback for node 69c804b1123b47fd2376fea0 INFO: 172.21.0.1:36602 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:59:27,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:59:27,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK 2026-03-28 16:59:39,477 - lava_callback - INFO - Received callback for node 69c565e8abf66a8f4d9bc0a6 INFO: 172.21.0.1:50260 - "POST /node/69c565e8abf66a8f4d9bc0a6 HTTP/1.0" 202 Accepted 2026-03-28 16:59:39,483 - lava_callback - INFO - Starting async job submit for node 69c565e8abf66a8f4d9bc0a6 2026-03-28 16:59:39,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:59:39,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c565e8abf66a8f4d9bc0a6 HTTP/1.1" 200 None 2026-03-28 16:59:39,500 - lava_callback - DEBUG - Processing node 69c565e8abf66a8f4d9bc0a6: baseline-arm-baylibre 2026-03-28 16:59:39,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c565e8abf66a8f4d9bc0a6 2026-03-28 16:59:39,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:59:39,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c565e8abf66a8f4d9bc0a6 HTTP/1.1" 200 None 2026-03-28 16:59:39,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:59:39,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 16:59:39,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 16:59:39,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c565e8abf66a8f4d9bc0a6 HTTP/1.1" 200 None 2026-03-28 16:59:39,567 - lava_callback - ERROR - Error processing callback for node 69c565e8abf66a8f4d9bc0a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37914 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:00:17,804 - lava_callback - INFO - Received callback for node 69c80761123b47fd2377016a INFO: 172.21.0.1:37920 - "POST /node/69c80761123b47fd2377016a HTTP/1.0" 202 Accepted 2026-03-28 17:00:17,811 - lava_callback - INFO - Starting async job submit for node 69c80761123b47fd2377016a 2026-03-28 17:00:17,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:00:17,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80761123b47fd2377016a HTTP/1.1" 200 None 2026-03-28 17:00:17,891 - lava_callback - DEBUG - Processing node 69c80761123b47fd2377016a: baseline-arm64 2026-03-28 17:00:18,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:00:18,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:00:18,447 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80761123b47fd2377016a/log.txt.gz 2026-03-28 17:00:18,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:00:18,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:00:18,898 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80761123b47fd2377016a/lava-logs.yaml 2026-03-28 17:00:18,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:00:19,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:00:19,079 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80761123b47fd2377016a/lava_callback.json.gz DEBUG: Setup failed for 69c80761123b47fd2377016a. Transitting job node result: incomplete -> fail 2026-03-28 17:00:19,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:00:19,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80761123b47fd2377016a HTTP/1.1" 200 None 2026-03-28 17:00:19,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:00:19,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:00:19,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:00:19,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80761123b47fd2377016a HTTP/1.1" 200 None 2026-03-28 17:00:19,307 - lava_callback - INFO - Completed processing callback for node 69c80761123b47fd2377016a INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:00:27,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:00:27,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:00:59,265 - lava_callback - INFO - Received callback for node 69c5663babf66a8f4d9bc0d4 INFO: 172.21.0.1:44032 - "POST /node/69c5663babf66a8f4d9bc0d4 HTTP/1.0" 202 Accepted 2026-03-28 17:00:59,270 - lava_callback - INFO - Starting async job submit for node 69c5663babf66a8f4d9bc0d4 2026-03-28 17:00:59,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:00:59,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5663babf66a8f4d9bc0d4 HTTP/1.1" 200 None 2026-03-28 17:00:59,286 - lava_callback - DEBUG - Processing node 69c5663babf66a8f4d9bc0d4: baseline-arm-baylibre 2026-03-28 17:00:59,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5663babf66a8f4d9bc0d4 2026-03-28 17:00:59,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:00:59,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5663babf66a8f4d9bc0d4 HTTP/1.1" 200 None 2026-03-28 17:00:59,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:00:59,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 17:00:59,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:00:59,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5663babf66a8f4d9bc0d4 HTTP/1.1" 200 None 2026-03-28 17:00:59,342 - lava_callback - ERROR - Error processing callback for node 69c5663babf66a8f4d9bc0d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44976 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-28 17:01:15,556 - lava_callback - INFO - Received callback for node 69c804d0123b47fd2376ff02 INFO: 172.21.0.1:44988 - "POST /node/69c804d0123b47fd2376ff02 HTTP/1.0" 202 Accepted 2026-03-28 17:01:15,610 - lava_callback - INFO - Starting async job submit for node 69c804d0123b47fd2376ff02 2026-03-28 17:01:15,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:15,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804d0123b47fd2376ff02 HTTP/1.1" 200 None 2026-03-28 17:01:15,649 - lava_callback - DEBUG - Processing node 69c804d0123b47fd2376ff02: baseline-arm-pengutronix 2026-03-28 17:01:15,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:01:15,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:01:15,880 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c804d0123b47fd2376ff02/log.txt.gz 2026-03-28 17:01:15,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:01:16,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:01:16,103 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c804d0123b47fd2376ff02/lava-logs.yaml 2026-03-28 17:01:16,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:01:16,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:01:16,233 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c804d0123b47fd2376ff02/lava_callback.json.gz DEBUG: Setup failed for 69c804d0123b47fd2376ff02. Transitting job node result: incomplete -> fail 2026-03-28 17:01:16,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:16,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804d0123b47fd2376ff02 HTTP/1.1" 200 None 2026-03-28 17:01:16,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:16,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 17:01:16,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:16,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804d0123b47fd2376ff02 HTTP/1.1" 200 None 2026-03-28 17:01:16,419 - lava_callback - INFO - Completed processing callback for node 69c804d0123b47fd2376ff02 INFO: 172.21.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:01:27,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:27,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:01:39,285 - lava_callback - INFO - Received callback for node 69c56665abf66a8f4d9bc0e1 INFO: 172.21.0.1:56342 - "POST /node/69c56665abf66a8f4d9bc0e1 HTTP/1.0" 202 Accepted 2026-03-28 17:01:39,291 - lava_callback - INFO - Starting async job submit for node 69c56665abf66a8f4d9bc0e1 2026-03-28 17:01:39,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:39,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56665abf66a8f4d9bc0e1 HTTP/1.1" 200 None 2026-03-28 17:01:39,306 - lava_callback - DEBUG - Processing node 69c56665abf66a8f4d9bc0e1: baseline-arm-baylibre 2026-03-28 17:01:39,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56665abf66a8f4d9bc0e1 2026-03-28 17:01:39,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:39,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56665abf66a8f4d9bc0e1 HTTP/1.1" 200 None 2026-03-28 17:01:39,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:39,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 17:01:39,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:39,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56665abf66a8f4d9bc0e1 HTTP/1.1" 200 None 2026-03-28 17:01:39,358 - lava_callback - ERROR - Error processing callback for node 69c56665abf66a8f4d9bc0e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 17:01:46,106 - lava_callback - INFO - Received callback for node 69c804f9123b47fd2376ff88 INFO: 172.21.0.1:37232 - "POST /node/69c804f9123b47fd2376ff88 HTTP/1.0" 202 Accepted 2026-03-28 17:01:46,113 - lava_callback - INFO - Starting async job submit for node 69c804f9123b47fd2376ff88 2026-03-28 17:01:46,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:46,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804f9123b47fd2376ff88 HTTP/1.1" 200 None 2026-03-28 17:01:46,162 - lava_callback - DEBUG - Processing node 69c804f9123b47fd2376ff88: ltp-timers INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:01:46,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:01:46,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:01:46,892 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69c804f9123b47fd2376ff88/log.txt.gz 2026-03-28 17:01:47,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:01:47,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:01:47,343 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69c804f9123b47fd2376ff88/lava-logs.yaml 2026-03-28 17:01:47,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:01:47,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:01:47,531 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69c804f9123b47fd2376ff88/lava_callback.json.gz 2026-03-28 17:01:47,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:47,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804f9123b47fd2376ff88 HTTP/1.1" 200 None 2026-03-28 17:01:47,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:47,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 17:01:47,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:47,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804f9123b47fd2376ff88 HTTP/1.1" 200 None 2026-03-28 17:01:47,647 - lava_callback - INFO - Completed processing callback for node 69c804f9123b47fd2376ff88 INFO: 172.21.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57512 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:01:57,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:01:57,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39104 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:03:18,588 - lava_callback - INFO - Received callback for node 69c8075b123b47fd2377015e INFO: 172.21.0.1:39116 - "POST /node/69c8075b123b47fd2377015e HTTP/1.0" 202 Accepted 2026-03-28 17:03:18,595 - lava_callback - INFO - Starting async job submit for node 69c8075b123b47fd2377015e 2026-03-28 17:03:18,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:03:18,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8075b123b47fd2377015e HTTP/1.1" 200 None 2026-03-28 17:03:18,633 - lava_callback - DEBUG - Processing node 69c8075b123b47fd2377015e: baseline-arm64 2026-03-28 17:03:19,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:03:19,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:03:19,326 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075b123b47fd2377015e/log.txt.gz 2026-03-28 17:03:19,395 - lava_callback - INFO - Received callback for node 69c566d5abf66a8f4d9bc0fb INFO: 172.21.0.1:39130 - "POST /node/69c566d5abf66a8f4d9bc0fb HTTP/1.0" 202 Accepted 2026-03-28 17:03:19,411 - lava_callback - INFO - Starting async job submit for node 69c566d5abf66a8f4d9bc0fb 2026-03-28 17:03:19,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:03:19,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c566d5abf66a8f4d9bc0fb HTTP/1.1" 200 None 2026-03-28 17:03:19,507 - lava_callback - DEBUG - Processing node 69c566d5abf66a8f4d9bc0fb: baseline-arm-baylibre 2026-03-28 17:03:19,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c566d5abf66a8f4d9bc0fb 2026-03-28 17:03:19,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:03:19,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c566d5abf66a8f4d9bc0fb HTTP/1.1" 200 None 2026-03-28 17:03:19,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:03:19,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:03:19,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 17:03:19,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:03:19,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c566d5abf66a8f4d9bc0fb HTTP/1.1" 200 None 2026-03-28 17:03:19,658 - lava_callback - ERROR - Error processing callback for node 69c566d5abf66a8f4d9bc0fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 17:03:19,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:03:19,943 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075b123b47fd2377015e/lava-logs.yaml 2026-03-28 17:03:19,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:03:20,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:03:20,124 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8075b123b47fd2377015e/lava_callback.json.gz 2026-03-28 17:03:20,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:03:20,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8075b123b47fd2377015e HTTP/1.1" 200 None 2026-03-28 17:03:20,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:03:20,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:03:20,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:03:20,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8075b123b47fd2377015e HTTP/1.1" 200 None 2026-03-28 17:03:20,274 - lava_callback - INFO - Completed processing callback for node 69c8075b123b47fd2377015e INFO: 172.21.0.1:42348 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:03:27,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:03:27,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:04:39,482 - lava_callback - INFO - Received callback for node 69c56724abf66a8f4d9bc126 INFO: 172.21.0.1:46094 - "POST /node/69c56724abf66a8f4d9bc126 HTTP/1.0" 202 Accepted 2026-03-28 17:04:39,487 - lava_callback - INFO - Starting async job submit for node 69c56724abf66a8f4d9bc126 2026-03-28 17:04:39,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:04:39,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56724abf66a8f4d9bc126 HTTP/1.1" 200 None 2026-03-28 17:04:39,516 - lava_callback - DEBUG - Processing node 69c56724abf66a8f4d9bc126: baseline-arm-baylibre 2026-03-28 17:04:39,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56724abf66a8f4d9bc126 2026-03-28 17:04:39,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:04:39,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56724abf66a8f4d9bc126 HTTP/1.1" 200 None 2026-03-28 17:04:39,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:04:39,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 17:04:39,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:04:39,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56724abf66a8f4d9bc126 HTTP/1.1" 200 None 2026-03-28 17:04:39,575 - lava_callback - ERROR - Error processing callback for node 69c56724abf66a8f4d9bc126: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:05:59,537 - lava_callback - INFO - Received callback for node 69c56775abf66a8f4d9bc13e INFO: 172.21.0.1:57702 - "POST /node/69c56775abf66a8f4d9bc13e HTTP/1.0" 202 Accepted 2026-03-28 17:05:59,543 - lava_callback - INFO - Starting async job submit for node 69c56775abf66a8f4d9bc13e 2026-03-28 17:05:59,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:05:59,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56775abf66a8f4d9bc13e HTTP/1.1" 200 None 2026-03-28 17:05:59,558 - lava_callback - DEBUG - Processing node 69c56775abf66a8f4d9bc13e: baseline-arm-baylibre 2026-03-28 17:05:59,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56775abf66a8f4d9bc13e 2026-03-28 17:05:59,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:05:59,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56775abf66a8f4d9bc13e HTTP/1.1" 200 None 2026-03-28 17:05:59,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:05:59,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 17:05:59,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:05:59,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56775abf66a8f4d9bc13e HTTP/1.1" 200 None 2026-03-28 17:05:59,616 - lava_callback - ERROR - Error processing callback for node 69c56775abf66a8f4d9bc13e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:06:43,197 - lava_callback - INFO - Received callback for node 69c80a81123b47fd2377047f INFO: 172.21.0.1:50788 - "POST /node/69c80a81123b47fd2377047f HTTP/1.0" 202 Accepted 2026-03-28 17:06:43,203 - lava_callback - INFO - Starting async job submit for node 69c80a81123b47fd2377047f 2026-03-28 17:06:43,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:06:43,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80a81123b47fd2377047f HTTP/1.1" 200 None 2026-03-28 17:06:43,222 - lava_callback - DEBUG - Processing node 69c80a81123b47fd2377047f: baseline-arm 2026-03-28 17:06:43,227 - lava_callback - WARNING - Failed to upload log 2026-03-28 17:06:43,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:06:43,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:06:43,362 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c80a81123b47fd2377047f/lava-logs.yaml 2026-03-28 17:06:43,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:06:43,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:06:43,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c80a81123b47fd2377047f/lava_callback.json.gz 2026-03-28 17:06:43,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:06:43,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80a81123b47fd2377047f HTTP/1.1" 200 None 2026-03-28 17:06:43,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:06:43,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 17:06:43,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:06:43,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80a81123b47fd2377047f HTTP/1.1" 200 None 2026-03-28 17:06:43,536 - lava_callback - INFO - Completed processing callback for node 69c80a81123b47fd2377047f INFO: 172.21.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55154 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:06:57,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:06:57,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38980 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:08:04,600 - lava_callback - INFO - Received callback for node 69c567f0abf66a8f4d9bc16e INFO: 172.21.0.1:51496 - "POST /node/69c567f0abf66a8f4d9bc16e HTTP/1.0" 202 Accepted 2026-03-28 17:08:04,606 - lava_callback - INFO - Starting async job submit for node 69c567f0abf66a8f4d9bc16e 2026-03-28 17:08:04,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:08:04,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c567f0abf66a8f4d9bc16e HTTP/1.1" 200 None 2026-03-28 17:08:04,622 - lava_callback - DEBUG - Processing node 69c567f0abf66a8f4d9bc16e: baseline-arm-clabbe 2026-03-28 17:08:04,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c567f0abf66a8f4d9bc16e 2026-03-28 17:08:04,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:08:04,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c567f0abf66a8f4d9bc16e HTTP/1.1" 200 None 2026-03-28 17:08:04,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:08:04,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 17:08:04,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:08:04,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c567f0abf66a8f4d9bc16e HTTP/1.1" 200 None 2026-03-28 17:08:04,677 - lava_callback - ERROR - Error processing callback for node 69c567f0abf66a8f4d9bc16e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:08:57,371 - lava_callback - INFO - Received callback for node 69c80b1b123b47fd237704a6 INFO: 172.21.0.1:45658 - "POST /node/69c80b1b123b47fd237704a6 HTTP/1.0" 202 Accepted 2026-03-28 17:08:57,377 - lava_callback - INFO - Starting async job submit for node 69c80b1b123b47fd237704a6 2026-03-28 17:08:57,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:08:57,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80b1b123b47fd237704a6 HTTP/1.1" 200 None 2026-03-28 17:08:57,399 - lava_callback - DEBUG - Processing node 69c80b1b123b47fd237704a6: baseline-nfs-arm64 2026-03-28 17:08:57,400 - lava_callback - WARNING - Failed to upload log 2026-03-28 17:08:57,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:08:57,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:08:57,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80b1b123b47fd237704a6/lava-logs.yaml 2026-03-28 17:08:57,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:08:57,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:08:57,711 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80b1b123b47fd237704a6/lava_callback.json.gz 2026-03-28 17:08:57,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:08:57,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80b1b123b47fd237704a6 HTTP/1.1" 200 None 2026-03-28 17:08:57,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:08:57,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:08:57,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:08:57,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80b1b123b47fd237704a6 HTTP/1.1" 200 None 2026-03-28 17:08:57,773 - lava_callback - INFO - Completed processing callback for node 69c80b1b123b47fd237704a6 INFO: 172.21.0.1:42508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:09:27,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:09:27,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46436 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:09:44,633 - lava_callback - INFO - Received callback for node 69c5684aabf66a8f4d9bc18c INFO: 172.21.0.1:43418 - "POST /node/69c5684aabf66a8f4d9bc18c HTTP/1.0" 202 Accepted 2026-03-28 17:09:44,639 - lava_callback - INFO - Starting async job submit for node 69c5684aabf66a8f4d9bc18c 2026-03-28 17:09:44,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:09:44,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5684aabf66a8f4d9bc18c HTTP/1.1" 200 None 2026-03-28 17:09:44,656 - lava_callback - DEBUG - Processing node 69c5684aabf66a8f4d9bc18c: baseline-arm-clabbe 2026-03-28 17:09:44,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5684aabf66a8f4d9bc18c 2026-03-28 17:09:44,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:09:44,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5684aabf66a8f4d9bc18c HTTP/1.1" 200 None 2026-03-28 17:09:44,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:09:44,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 17:09:44,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:09:44,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5684aabf66a8f4d9bc18c HTTP/1.1" 200 None 2026-03-28 17:09:44,733 - lava_callback - ERROR - Error processing callback for node 69c5684aabf66a8f4d9bc18c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41744 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:10:59,887 - lava_callback - INFO - Received callback for node 69c5689eabf66a8f4d9bc1a5 INFO: 172.21.0.1:33534 - "POST /node/69c5689eabf66a8f4d9bc1a5 HTTP/1.0" 202 Accepted 2026-03-28 17:10:59,892 - lava_callback - INFO - Starting async job submit for node 69c5689eabf66a8f4d9bc1a5 2026-03-28 17:10:59,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:10:59,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5689eabf66a8f4d9bc1a5 HTTP/1.1" 200 None 2026-03-28 17:10:59,909 - lava_callback - DEBUG - Processing node 69c5689eabf66a8f4d9bc1a5: baseline-arm64-baylibre 2026-03-28 17:10:59,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5689eabf66a8f4d9bc1a5 2026-03-28 17:10:59,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:10:59,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5689eabf66a8f4d9bc1a5 HTTP/1.1" 200 None 2026-03-28 17:10:59,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:10:59,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 17:10:59,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:10:59,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5689eabf66a8f4d9bc1a5 HTTP/1.1" 200 None 2026-03-28 17:10:59,979 - lava_callback - ERROR - Error processing callback for node 69c5689eabf66a8f4d9bc1a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:11:18,295 - lava_callback - INFO - Received callback for node 69c80b81123b47fd237704c5 INFO: 172.21.0.1:43168 - "POST /node/69c80b81123b47fd237704c5 HTTP/1.0" 202 Accepted 2026-03-28 17:11:18,301 - lava_callback - INFO - Starting async job submit for node 69c80b81123b47fd237704c5 2026-03-28 17:11:18,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:11:18,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80b81123b47fd237704c5 HTTP/1.1" 200 None 2026-03-28 17:11:18,346 - lava_callback - DEBUG - Processing node 69c80b81123b47fd237704c5: baseline-arm64 2026-03-28 17:11:18,485 - lava_callback - WARNING - Failed to upload log 2026-03-28 17:11:18,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:11:18,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:11:18,770 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80b81123b47fd237704c5/lava-logs.yaml 2026-03-28 17:11:18,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:11:18,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:11:18,917 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80b81123b47fd237704c5/lava_callback.json.gz 2026-03-28 17:11:18,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:11:18,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80b81123b47fd237704c5 HTTP/1.1" 200 None 2026-03-28 17:11:18,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:11:18,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:11:18,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:11:19,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80b81123b47fd237704c5 HTTP/1.1" 200 None 2026-03-28 17:11:19,062 - lava_callback - INFO - Completed processing callback for node 69c80b81123b47fd237704c5 INFO: 172.21.0.1:56296 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:11:27,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:11:27,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:12:19,942 - lava_callback - INFO - Received callback for node 69c568efabf66a8f4d9bc1ae INFO: 172.21.0.1:55292 - "POST /node/69c568efabf66a8f4d9bc1ae HTTP/1.0" 202 Accepted 2026-03-28 17:12:19,947 - lava_callback - INFO - Starting async job submit for node 69c568efabf66a8f4d9bc1ae 2026-03-28 17:12:19,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:12:19,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c568efabf66a8f4d9bc1ae HTTP/1.1" 200 None 2026-03-28 17:12:19,963 - lava_callback - DEBUG - Processing node 69c568efabf66a8f4d9bc1ae: baseline-arm64-baylibre 2026-03-28 17:12:19,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c568efabf66a8f4d9bc1ae 2026-03-28 17:12:19,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:12:19,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c568efabf66a8f4d9bc1ae HTTP/1.1" 200 None 2026-03-28 17:12:19,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:12:19,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 17:12:19,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:12:20,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c568efabf66a8f4d9bc1ae HTTP/1.1" 200 None 2026-03-28 17:12:20,024 - lava_callback - ERROR - Error processing callback for node 69c568efabf66a8f4d9bc1ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50226 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:12:43,944 - lava_callback - INFO - Received callback for node 69c80bce123b47fd237704d6 INFO: 172.21.0.1:50830 - "POST /node/69c80bce123b47fd237704d6 HTTP/1.0" 202 Accepted 2026-03-28 17:12:43,950 - lava_callback - INFO - Starting async job submit for node 69c80bce123b47fd237704d6 2026-03-28 17:12:43,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:12:43,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80bce123b47fd237704d6 HTTP/1.1" 200 None 2026-03-28 17:12:43,987 - lava_callback - DEBUG - Processing node 69c80bce123b47fd237704d6: baseline-arm64 2026-03-28 17:12:44,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:12:44,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:12:44,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80bce123b47fd237704d6/log.txt.gz 2026-03-28 17:12:44,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:12:45,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:12:45,097 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80bce123b47fd237704d6/lava-logs.yaml 2026-03-28 17:12:45,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:12:45,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:12:45,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80bce123b47fd237704d6/lava_callback.json.gz 2026-03-28 17:12:45,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:12:45,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80bce123b47fd237704d6 HTTP/1.1" 200 None 2026-03-28 17:12:45,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:12:45,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:12:45,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:12:45,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80bce123b47fd237704d6 HTTP/1.1" 200 None 2026-03-28 17:12:45,353 - lava_callback - INFO - Completed processing callback for node 69c80bce123b47fd237704d6 INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET /node/6941fd20bb27571da24afd99%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42824 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:12:57,192 - lava_callback - INFO - Received callback for node 69c80766123b47fd23770176 INFO: 172.21.0.1:42832 - "POST /node/69c80766123b47fd23770176 HTTP/1.0" 202 Accepted 2026-03-28 17:12:57,200 - lava_callback - INFO - Starting async job submit for node 69c80766123b47fd23770176 2026-03-28 17:12:57,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:12:57,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:12:57,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80766123b47fd23770176 HTTP/1.1" 200 None 2026-03-28 17:12:57,264 - lava_callback - DEBUG - Processing node 69c80766123b47fd23770176: baseline-nfs-arm64 2026-03-28 17:12:57,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-28 17:12:58,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:12:58,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:12:58,557 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80766123b47fd23770176/log.txt.gz 2026-03-28 17:12:59,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:12:59,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:12:59,422 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80766123b47fd23770176/lava-logs.yaml 2026-03-28 17:12:59,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:12:59,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:12:59,642 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80766123b47fd23770176/lava_callback.json.gz DEBUG: Setup failed for 69c80766123b47fd23770176. Transitting job node result: incomplete -> fail 2026-03-28 17:12:59,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:12:59,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80766123b47fd23770176 HTTP/1.1" 200 None 2026-03-28 17:12:59,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:12:59,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:12:59,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:12:59,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80766123b47fd23770176 HTTP/1.1" 200 None 2026-03-28 17:12:59,887 - lava_callback - INFO - Completed processing callback for node 69c80766123b47fd23770176 INFO: 172.21.0.1:44350 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:13:14,312 - lava_callback - INFO - Received callback for node 69c804f4123b47fd2376ff7f INFO: 172.21.0.1:52408 - "POST /node/69c804f4123b47fd2376ff7f HTTP/1.0" 202 Accepted 2026-03-28 17:13:14,361 - lava_callback - INFO - Starting async job submit for node 69c804f4123b47fd2376ff7f 2026-03-28 17:13:14,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:13:14,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804f4123b47fd2376ff7f HTTP/1.1" 200 None 2026-03-28 17:13:14,402 - lava_callback - DEBUG - Processing node 69c804f4123b47fd2376ff7f: ltp-smoke 2026-03-28 17:13:14,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:13:14,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:13:14,651 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c804f4123b47fd2376ff7f/log.txt.gz 2026-03-28 17:13:14,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:13:14,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:13:14,851 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c804f4123b47fd2376ff7f/lava-logs.yaml 2026-03-28 17:13:14,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:13:14,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:13:14,989 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c804f4123b47fd2376ff7f/lava_callback.json.gz 2026-03-28 17:13:15,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:13:15,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804f4123b47fd2376ff7f HTTP/1.1" 200 None 2026-03-28 17:13:15,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:13:15,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 17:13:15,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:13:15,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804f4123b47fd2376ff7f HTTP/1.1" 200 None 2026-03-28 17:13:15,128 - lava_callback - INFO - Completed processing callback for node 69c804f4123b47fd2376ff7f INFO: 172.21.0.1:52410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:13:27,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:13:27,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35242 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:13:39,992 - lava_callback - INFO - Received callback for node 69c56940abf66a8f4d9bc1bf INFO: 172.21.0.1:38490 - "POST /node/69c56940abf66a8f4d9bc1bf HTTP/1.0" 202 Accepted 2026-03-28 17:13:39,998 - lava_callback - INFO - Starting async job submit for node 69c56940abf66a8f4d9bc1bf 2026-03-28 17:13:39,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:13:40,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56940abf66a8f4d9bc1bf HTTP/1.1" 200 None 2026-03-28 17:13:40,018 - lava_callback - DEBUG - Processing node 69c56940abf66a8f4d9bc1bf: baseline-arm64-baylibre 2026-03-28 17:13:40,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56940abf66a8f4d9bc1bf 2026-03-28 17:13:40,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:13:40,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56940abf66a8f4d9bc1bf HTTP/1.1" 200 None 2026-03-28 17:13:40,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:13:40,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 17:13:40,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:13:40,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56940abf66a8f4d9bc1bf HTTP/1.1" 200 None 2026-03-28 17:13:40,075 - lava_callback - ERROR - Error processing callback for node 69c56940abf66a8f4d9bc1bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58126 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:14:08,412 - lava_callback - INFO - Received callback for node 69c80c18123b47fd237704e7 INFO: 172.21.0.1:58142 - "POST /node/69c80c18123b47fd237704e7 HTTP/1.0" 202 Accepted 2026-03-28 17:14:08,419 - lava_callback - INFO - Starting async job submit for node 69c80c18123b47fd237704e7 2026-03-28 17:14:08,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:14:08,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80c18123b47fd237704e7 HTTP/1.1" 200 None 2026-03-28 17:14:08,472 - lava_callback - DEBUG - Processing node 69c80c18123b47fd237704e7: baseline-arm64 2026-03-28 17:14:08,608 - lava_callback - WARNING - Failed to upload log 2026-03-28 17:14:08,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:14:08,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:14:08,874 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80c18123b47fd237704e7/lava-logs.yaml 2026-03-28 17:14:08,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:14:09,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:14:09,021 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80c18123b47fd237704e7/lava_callback.json.gz 2026-03-28 17:14:09,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:14:09,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80c18123b47fd237704e7 HTTP/1.1" 200 None 2026-03-28 17:14:09,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:14:09,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:14:09,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:14:09,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80c18123b47fd237704e7 HTTP/1.1" 200 None 2026-03-28 17:14:09,177 - lava_callback - INFO - Completed processing callback for node 69c80c18123b47fd237704e7 INFO: 172.21.0.1:44156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:14:27,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:14:27,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:15:00,069 - lava_callback - INFO - Received callback for node 69c56992abf66a8f4d9bc1c9 INFO: 172.21.0.1:47582 - "POST /node/69c56992abf66a8f4d9bc1c9 HTTP/1.0" 202 Accepted 2026-03-28 17:15:00,078 - lava_callback - INFO - Starting async job submit for node 69c56992abf66a8f4d9bc1c9 2026-03-28 17:15:00,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:15:00,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56992abf66a8f4d9bc1c9 HTTP/1.1" 200 None 2026-03-28 17:15:00,103 - lava_callback - DEBUG - Processing node 69c56992abf66a8f4d9bc1c9: baseline-arm64-baylibre 2026-03-28 17:15:00,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56992abf66a8f4d9bc1c9 2026-03-28 17:15:00,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:15:00,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56992abf66a8f4d9bc1c9 HTTP/1.1" 200 None 2026-03-28 17:15:00,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:15:00,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 17:15:00,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:15:00,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56992abf66a8f4d9bc1c9 HTTP/1.1" 200 None 2026-03-28 17:15:00,209 - lava_callback - ERROR - Error processing callback for node 69c56992abf66a8f4d9bc1c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48174 - "GET /node/693e7f133c8f1be6d3cf192a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32818 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:15:43,027 - lava_callback - INFO - Received callback for node 69c8076c123b47fd237701a6 INFO: 172.21.0.1:44946 - "POST /node/69c8076c123b47fd237701a6 HTTP/1.0" 202 Accepted 2026-03-28 17:15:43,035 - lava_callback - INFO - Starting async job submit for node 69c8076c123b47fd237701a6 2026-03-28 17:15:43,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:15:43,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8076c123b47fd237701a6 HTTP/1.1" 200 None 2026-03-28 17:15:43,127 - lava_callback - DEBUG - Processing node 69c8076c123b47fd237701a6: baseline-nfs-arm64 2026-03-28 17:15:43,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:15:43,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:15:43,913 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076c123b47fd237701a6/log.txt.gz 2026-03-28 17:15:44,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:15:44,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:15:44,507 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076c123b47fd237701a6/lava-logs.yaml 2026-03-28 17:15:44,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:15:44,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:15:44,705 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8076c123b47fd237701a6/lava_callback.json.gz 2026-03-28 17:15:44,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:15:44,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8076c123b47fd237701a6 HTTP/1.1" 200 None 2026-03-28 17:15:44,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:15:44,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:15:44,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:15:44,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8076c123b47fd237701a6 HTTP/1.1" 200 None 2026-03-28 17:15:44,881 - lava_callback - INFO - Completed processing callback for node 69c8076c123b47fd237701a6 INFO: 172.21.0.1:44950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33632 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:15:57,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:15:57,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:16:38,797 - lava_callback - INFO - Received callback for node 69c80c90123b47fd2377050e INFO: 172.21.0.1:34118 - "POST /node/69c80c90123b47fd2377050e HTTP/1.0" 202 Accepted 2026-03-28 17:16:38,804 - lava_callback - INFO - Starting async job submit for node 69c80c90123b47fd2377050e 2026-03-28 17:16:38,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:16:38,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80c90123b47fd2377050e HTTP/1.1" 200 None 2026-03-28 17:16:38,867 - lava_callback - DEBUG - Processing node 69c80c90123b47fd2377050e: baseline-nfs-arm64 2026-03-28 17:16:39,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:16:39,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:16:39,573 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80c90123b47fd2377050e/log.txt.gz 2026-03-28 17:16:39,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:16:40,151 - lava_callback - INFO - Received callback for node 69c569e5abf66a8f4d9bc1d8 INFO: 172.21.0.1:34990 - "POST /node/69c569e5abf66a8f4d9bc1d8 HTTP/1.0" 202 Accepted 2026-03-28 17:16:40,159 - lava_callback - INFO - Starting async job submit for node 69c569e5abf66a8f4d9bc1d8 2026-03-28 17:16:40,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:16:40,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:16:40,162 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80c90123b47fd2377050e/lava-logs.yaml 2026-03-28 17:16:40,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:16:40,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c569e5abf66a8f4d9bc1d8 HTTP/1.1" 200 None 2026-03-28 17:16:40,180 - lava_callback - DEBUG - Processing node 69c569e5abf66a8f4d9bc1d8: baseline-arm64-baylibre 2026-03-28 17:16:40,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c569e5abf66a8f4d9bc1d8 2026-03-28 17:16:40,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:16:40,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c569e5abf66a8f4d9bc1d8 HTTP/1.1" 200 None 2026-03-28 17:16:40,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:16:40,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 17:16:40,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:16:40,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c569e5abf66a8f4d9bc1d8 HTTP/1.1" 200 None 2026-03-28 17:16:40,259 - lava_callback - ERROR - Error processing callback for node 69c569e5abf66a8f4d9bc1d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 17:16:40,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:16:40,559 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80c90123b47fd2377050e/lava_callback.json.gz 2026-03-28 17:16:40,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:16:40,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80c90123b47fd2377050e HTTP/1.1" 200 None 2026-03-28 17:16:40,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:16:40,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:16:40,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:16:40,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80c90123b47fd2377050e HTTP/1.1" 200 None 2026-03-28 17:16:40,697 - lava_callback - INFO - Completed processing callback for node 69c80c90123b47fd2377050e INFO: 172.21.0.1:35004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:16:57,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:16:57,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:18:00,632 - lava_callback - INFO - Received callback for node 69c56a36abf66a8f4d9bc1e8 INFO: 172.21.0.1:58600 - "POST /node/69c56a36abf66a8f4d9bc1e8 HTTP/1.0" 202 Accepted 2026-03-28 17:18:00,638 - lava_callback - INFO - Starting async job submit for node 69c56a36abf66a8f4d9bc1e8 2026-03-28 17:18:00,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:18:00,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56a36abf66a8f4d9bc1e8 HTTP/1.1" 200 None 2026-03-28 17:18:00,653 - lava_callback - DEBUG - Processing node 69c56a36abf66a8f4d9bc1e8: baseline-arm64-baylibre 2026-03-28 17:18:00,654 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56a36abf66a8f4d9bc1e8 2026-03-28 17:18:00,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:18:00,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56a36abf66a8f4d9bc1e8 HTTP/1.1" 200 None 2026-03-28 17:18:00,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:18:00,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 17:18:00,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:18:00,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56a36abf66a8f4d9bc1e8 HTTP/1.1" 200 None 2026-03-28 17:18:00,713 - lava_callback - ERROR - Error processing callback for node 69c56a36abf66a8f4d9bc1e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET /node/694ac4b16c96ed51d316f102%5Cn HTTP/1.0" 405 Method Not Allowed 2026-03-28 17:20:45,173 - lava_callback - INFO - Received callback for node 69c56ae1abf66a8f4d9bc217 INFO: 172.21.0.1:53608 - "POST /node/69c56ae1abf66a8f4d9bc217 HTTP/1.0" 202 Accepted 2026-03-28 17:20:45,179 - lava_callback - INFO - Starting async job submit for node 69c56ae1abf66a8f4d9bc217 2026-03-28 17:20:45,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:20:45,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56ae1abf66a8f4d9bc217 HTTP/1.1" 200 None 2026-03-28 17:20:45,194 - lava_callback - DEBUG - Processing node 69c56ae1abf66a8f4d9bc217: baseline-arm64-clabbe 2026-03-28 17:20:45,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56ae1abf66a8f4d9bc217 2026-03-28 17:20:45,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:20:45,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56ae1abf66a8f4d9bc217 HTTP/1.1" 200 None 2026-03-28 17:20:45,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:20:45,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 17:20:45,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:20:45,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56ae1abf66a8f4d9bc217 HTTP/1.1" 200 None 2026-03-28 17:20:45,252 - lava_callback - ERROR - Error processing callback for node 69c56ae1abf66a8f4d9bc217: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:21:45,229 - lava_callback - INFO - Received callback for node 69c56b25abf66a8f4d9bc21d INFO: 172.21.0.1:44504 - "POST /node/69c56b25abf66a8f4d9bc21d HTTP/1.0" 202 Accepted 2026-03-28 17:21:45,234 - lava_callback - INFO - Starting async job submit for node 69c56b25abf66a8f4d9bc21d 2026-03-28 17:21:45,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:21:45,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56b25abf66a8f4d9bc21d HTTP/1.1" 200 None 2026-03-28 17:21:45,250 - lava_callback - DEBUG - Processing node 69c56b25abf66a8f4d9bc21d: baseline-arm-clabbe 2026-03-28 17:21:45,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56b25abf66a8f4d9bc21d 2026-03-28 17:21:45,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:21:45,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56b25abf66a8f4d9bc21d HTTP/1.1" 200 None 2026-03-28 17:21:45,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:21:45,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 17:21:45,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:21:45,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56b25abf66a8f4d9bc21d HTTP/1.1" 200 None 2026-03-28 17:21:45,302 - lava_callback - ERROR - Error processing callback for node 69c56b25abf66a8f4d9bc21d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37060 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:22:45,286 - lava_callback - INFO - Received callback for node 69c56b5eabf66a8f4d9bc230 INFO: 172.21.0.1:57856 - "POST /node/69c56b5eabf66a8f4d9bc230 HTTP/1.0" 202 Accepted 2026-03-28 17:22:45,291 - lava_callback - INFO - Starting async job submit for node 69c56b5eabf66a8f4d9bc230 2026-03-28 17:22:45,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:22:45,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56b5eabf66a8f4d9bc230 HTTP/1.1" 200 None 2026-03-28 17:22:45,312 - lava_callback - DEBUG - Processing node 69c56b5eabf66a8f4d9bc230: baseline-arm64-clabbe 2026-03-28 17:22:45,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56b5eabf66a8f4d9bc230 2026-03-28 17:22:45,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:22:45,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56b5eabf66a8f4d9bc230 HTTP/1.1" 200 None 2026-03-28 17:22:45,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:22:45,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 17:22:45,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:22:45,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56b5eabf66a8f4d9bc230 HTTP/1.1" 200 None 2026-03-28 17:22:45,370 - lava_callback - ERROR - Error processing callback for node 69c56b5eabf66a8f4d9bc230: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54760 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:23:30,307 - lava_callback - INFO - Received callback for node 69c80d41123b47fd23770544 INFO: 172.21.0.1:41800 - "POST /node/69c80d41123b47fd23770544 HTTP/1.0" 202 Accepted 2026-03-28 17:23:30,314 - lava_callback - INFO - Starting async job submit for node 69c80d41123b47fd23770544 2026-03-28 17:23:30,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:23:30,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80d41123b47fd23770544 HTTP/1.1" 200 None 2026-03-28 17:23:30,368 - lava_callback - DEBUG - Processing node 69c80d41123b47fd23770544: baseline-arm64 2026-03-28 17:23:30,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:23:30,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:23:30,943 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80d41123b47fd23770544/log.txt.gz 2026-03-28 17:23:31,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:23:31,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:23:31,414 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80d41123b47fd23770544/lava-logs.yaml 2026-03-28 17:23:31,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:23:31,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:23:31,602 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80d41123b47fd23770544/lava_callback.json.gz DEBUG: Setup failed for 69c80d41123b47fd23770544. Transitting job node result: incomplete -> fail 2026-03-28 17:23:31,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:23:31,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80d41123b47fd23770544 HTTP/1.1" 200 None 2026-03-28 17:23:31,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:23:31,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:23:31,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:23:31,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80d41123b47fd23770544 HTTP/1.1" 200 None 2026-03-28 17:23:31,814 - lava_callback - INFO - Completed processing callback for node 69c80d41123b47fd23770544 INFO: 172.21.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55094 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:23:57,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:23:57,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-28 17:24:05,336 - lava_callback - INFO - Received callback for node 69c56bb1abf66a8f4d9bc239 INFO: 172.21.0.1:44098 - "POST /node/69c56bb1abf66a8f4d9bc239 HTTP/1.0" 202 Accepted 2026-03-28 17:24:05,342 - lava_callback - INFO - Starting async job submit for node 69c56bb1abf66a8f4d9bc239 2026-03-28 17:24:05,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:24:05,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56bb1abf66a8f4d9bc239 HTTP/1.1" 200 None 2026-03-28 17:24:05,357 - lava_callback - DEBUG - Processing node 69c56bb1abf66a8f4d9bc239: baseline-arm64-clabbe 2026-03-28 17:24:05,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56bb1abf66a8f4d9bc239 2026-03-28 17:24:05,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:24:05,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56bb1abf66a8f4d9bc239 HTTP/1.1" 200 None 2026-03-28 17:24:05,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:24:05,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 17:24:05,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:24:05,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56bb1abf66a8f4d9bc239 HTTP/1.1" 200 None 2026-03-28 17:24:05,413 - lava_callback - ERROR - Error processing callback for node 69c56bb1abf66a8f4d9bc239: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:24:08,846 - lava_callback - INFO - Received callback for node 69c80a80123b47fd2377047c INFO: 172.21.0.1:44122 - "POST /node/69c80a80123b47fd2377047c HTTP/1.0" 202 Accepted 2026-03-28 17:24:08,853 - lava_callback - INFO - Starting async job submit for node 69c80a80123b47fd2377047c 2026-03-28 17:24:08,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:24:08,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80a80123b47fd2377047c HTTP/1.1" 200 None 2026-03-28 17:24:08,931 - lava_callback - DEBUG - Processing node 69c80a80123b47fd2377047c: ltp-smoke 2026-03-28 17:24:09,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:24:09,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:24:09,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c80a80123b47fd2377047c/log.txt.gz 2026-03-28 17:24:09,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:24:10,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:24:10,045 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c80a80123b47fd2377047c/lava-logs.yaml 2026-03-28 17:24:10,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:24:10,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:24:10,213 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c80a80123b47fd2377047c/lava_callback.json.gz 2026-03-28 17:24:10,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:24:10,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80a80123b47fd2377047c HTTP/1.1" 200 None 2026-03-28 17:24:10,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:24:10,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff48123b47fd2376d751 HTTP/1.1" 200 None 2026-03-28 17:24:10,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:24:10,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80a80123b47fd2377047c HTTP/1.1" 200 None 2026-03-28 17:24:10,508 - lava_callback - INFO - Completed processing callback for node 69c80a80123b47fd2377047c INFO: 172.21.0.1:42608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48356 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:24:27,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:24:27,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:25:45,429 - lava_callback - INFO - Received callback for node 69c56c05abf66a8f4d9bc246 INFO: 172.21.0.1:51188 - "POST /node/69c56c05abf66a8f4d9bc246 HTTP/1.0" 202 Accepted 2026-03-28 17:25:45,434 - lava_callback - INFO - Starting async job submit for node 69c56c05abf66a8f4d9bc246 2026-03-28 17:25:45,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:25:45,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56c05abf66a8f4d9bc246 HTTP/1.1" 200 None 2026-03-28 17:25:45,450 - lava_callback - DEBUG - Processing node 69c56c05abf66a8f4d9bc246: baseline-arm64-clabbe 2026-03-28 17:25:45,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56c05abf66a8f4d9bc246 2026-03-28 17:25:45,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:25:45,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56c05abf66a8f4d9bc246 HTTP/1.1" 200 None 2026-03-28 17:25:45,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:25:45,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 17:25:45,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:25:45,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56c05abf66a8f4d9bc246 HTTP/1.1" 200 None 2026-03-28 17:25:45,506 - lava_callback - ERROR - Error processing callback for node 69c56c05abf66a8f4d9bc246: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51114 - "GET /node/694adfd66c96ed51d317077e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51116 - "GET /node/698fd70176d4b6342e9d8f04%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:26:03,104 - lava_callback - INFO - Received callback for node 69c80f21123b47fd237705d1 INFO: 172.21.0.1:60594 - "POST /node/69c80f21123b47fd237705d1 HTTP/1.0" 202 Accepted 2026-03-28 17:26:03,110 - lava_callback - INFO - Starting async job submit for node 69c80f21123b47fd237705d1 2026-03-28 17:26:03,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:26:03,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80f21123b47fd237705d1 HTTP/1.1" 200 None 2026-03-28 17:26:03,128 - lava_callback - DEBUG - Processing node 69c80f21123b47fd237705d1: baseline-nfs-arm64 2026-03-28 17:26:03,130 - lava_callback - WARNING - Failed to upload log 2026-03-28 17:26:03,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:26:03,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:26:03,300 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80f21123b47fd237705d1/lava-logs.yaml 2026-03-28 17:26:03,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:26:03,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:26:03,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c80f21123b47fd237705d1/lava_callback.json.gz 2026-03-28 17:26:03,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:26:03,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80f21123b47fd237705d1 HTTP/1.1" 200 None 2026-03-28 17:26:03,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:26:03,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:26:03,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:26:03,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80f21123b47fd237705d1 HTTP/1.1" 200 None 2026-03-28 17:26:03,839 - lava_callback - INFO - Completed processing callback for node 69c80f21123b47fd237705d1 INFO: 172.21.0.1:60604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:26:27,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:26:27,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55972 - "GET /node/699381d2cebe99dd8e06e4b5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:27:05,471 - lava_callback - INFO - Received callback for node 69c56c56abf66a8f4d9bc257 INFO: 172.21.0.1:36864 - "POST /node/69c56c56abf66a8f4d9bc257 HTTP/1.0" 202 Accepted 2026-03-28 17:27:05,476 - lava_callback - INFO - Starting async job submit for node 69c56c56abf66a8f4d9bc257 2026-03-28 17:27:05,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:27:05,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56c56abf66a8f4d9bc257 HTTP/1.1" 200 None 2026-03-28 17:27:05,498 - lava_callback - DEBUG - Processing node 69c56c56abf66a8f4d9bc257: baseline-arm64-clabbe 2026-03-28 17:27:05,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56c56abf66a8f4d9bc257 2026-03-28 17:27:05,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:27:05,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56c56abf66a8f4d9bc257 HTTP/1.1" 200 None 2026-03-28 17:27:05,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:27:05,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 17:27:05,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:27:05,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56c56abf66a8f4d9bc257 HTTP/1.1" 200 None 2026-03-28 17:27:05,556 - lava_callback - ERROR - Error processing callback for node 69c56c56abf66a8f4d9bc257: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:28:25,496 - lava_callback - INFO - Received callback for node 69c56ca9abf66a8f4d9bc26c INFO: 172.21.0.1:38184 - "POST /node/69c56ca9abf66a8f4d9bc26c HTTP/1.0" 202 Accepted 2026-03-28 17:28:25,502 - lava_callback - INFO - Starting async job submit for node 69c56ca9abf66a8f4d9bc26c 2026-03-28 17:28:25,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:28:25,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56ca9abf66a8f4d9bc26c HTTP/1.1" 200 None 2026-03-28 17:28:25,518 - lava_callback - DEBUG - Processing node 69c56ca9abf66a8f4d9bc26c: baseline-arm64-clabbe 2026-03-28 17:28:25,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56ca9abf66a8f4d9bc26c 2026-03-28 17:28:25,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:28:25,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56ca9abf66a8f4d9bc26c HTTP/1.1" 200 None 2026-03-28 17:28:25,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:28:25,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 17:28:25,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:28:25,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56ca9abf66a8f4d9bc26c HTTP/1.1" 200 None 2026-03-28 17:28:25,581 - lava_callback - ERROR - Error processing callback for node 69c56ca9abf66a8f4d9bc26c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36936 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:29:59,832 - lava_callback - INFO - Received callback for node 69c80fda123b47fd237705fd INFO: 172.21.0.1:34308 - "POST /node/69c80fda123b47fd237705fd HTTP/1.0" 202 Accepted 2026-03-28 17:29:59,839 - lava_callback - INFO - Starting async job submit for node 69c80fda123b47fd237705fd 2026-03-28 17:29:59,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:29:59,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80fda123b47fd237705fd HTTP/1.1" 200 None 2026-03-28 17:29:59,903 - lava_callback - DEBUG - Processing node 69c80fda123b47fd237705fd: baseline-arm64 2026-03-28 17:30:00,037 - lava_callback - WARNING - Failed to upload log 2026-03-28 17:30:00,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:30:00,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:30:00,322 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80fda123b47fd237705fd/lava-logs.yaml 2026-03-28 17:30:00,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:30:00,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:30:00,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80fda123b47fd237705fd/lava_callback.json.gz 2026-03-28 17:30:00,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:30:00,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80fda123b47fd237705fd HTTP/1.1" 200 None 2026-03-28 17:30:00,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:30:00,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:30:00,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:30:00,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80fda123b47fd237705fd HTTP/1.1" 200 None 2026-03-28 17:30:00,607 - lava_callback - INFO - Completed processing callback for node 69c80fda123b47fd237705fd 2026-03-28 17:30:05,743 - lava_callback - INFO - Received callback for node 69c56d13abf66a8f4d9bc280 INFO: 172.21.0.1:34316 - "POST /node/69c56d13abf66a8f4d9bc280 HTTP/1.0" 202 Accepted 2026-03-28 17:30:05,748 - lava_callback - INFO - Starting async job submit for node 69c56d13abf66a8f4d9bc280 2026-03-28 17:30:05,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:30:05,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56d13abf66a8f4d9bc280 HTTP/1.1" 200 None 2026-03-28 17:30:05,764 - lava_callback - DEBUG - Processing node 69c56d13abf66a8f4d9bc280: baseline-arm-clabbe 2026-03-28 17:30:05,764 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56d13abf66a8f4d9bc280 2026-03-28 17:30:05,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:30:05,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56d13abf66a8f4d9bc280 HTTP/1.1" 200 None 2026-03-28 17:30:05,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:30:05,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 17:30:05,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:30:05,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56d13abf66a8f4d9bc280 HTTP/1.1" 200 None 2026-03-28 17:30:05,824 - lava_callback - ERROR - Error processing callback for node 69c56d13abf66a8f4d9bc280: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:30:27,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:30:27,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:30:45,593 - lava_callback - INFO - Received callback for node 69c56d3cabf66a8f4d9bc294 INFO: 172.21.0.1:48408 - "POST /node/69c56d3cabf66a8f4d9bc294 HTTP/1.0" 202 Accepted 2026-03-28 17:30:45,599 - lava_callback - INFO - Starting async job submit for node 69c56d3cabf66a8f4d9bc294 2026-03-28 17:30:45,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:30:45,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56d3cabf66a8f4d9bc294 HTTP/1.1" 200 None 2026-03-28 17:30:45,615 - lava_callback - DEBUG - Processing node 69c56d3cabf66a8f4d9bc294: baseline-arm-clabbe 2026-03-28 17:30:45,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56d3cabf66a8f4d9bc294 2026-03-28 17:30:45,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:30:45,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56d3cabf66a8f4d9bc294 HTTP/1.1" 200 None 2026-03-28 17:30:45,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:30:45,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 17:30:45,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:30:45,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56d3cabf66a8f4d9bc294 HTTP/1.1" 200 None 2026-03-28 17:30:45,678 - lava_callback - ERROR - Error processing callback for node 69c56d3cabf66a8f4d9bc294: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:31:51,438 - lava_callback - INFO - Received callback for node 69c80e1a123b47fd2377057f INFO: 172.21.0.1:39586 - "POST /node/69c80e1a123b47fd2377057f HTTP/1.0" 202 Accepted 2026-03-28 17:31:51,445 - lava_callback - INFO - Starting async job submit for node 69c80e1a123b47fd2377057f 2026-03-28 17:31:51,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:31:51,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80e1a123b47fd2377057f HTTP/1.1" 200 None 2026-03-28 17:31:51,483 - lava_callback - DEBUG - Processing node 69c80e1a123b47fd2377057f: baseline-arm64 2026-03-28 17:31:52,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:31:52,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:31:52,168 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80e1a123b47fd2377057f/log.txt.gz 2026-03-28 17:31:52,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:31:52,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:31:52,816 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80e1a123b47fd2377057f/lava-logs.yaml 2026-03-28 17:31:52,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:31:53,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:31:53,004 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c80e1a123b47fd2377057f/lava_callback.json.gz 2026-03-28 17:31:53,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:31:53,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80e1a123b47fd2377057f HTTP/1.1" 200 None 2026-03-28 17:31:53,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:31:53,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:31:53,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:31:53,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80e1a123b47fd2377057f HTTP/1.1" 200 None 2026-03-28 17:31:53,141 - lava_callback - INFO - Completed processing callback for node 69c80e1a123b47fd2377057f INFO: 172.21.0.1:39594 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:31:57,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:31:57,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52902 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:32:55,565 - lava_callback - INFO - Received callback for node 69c80cd0123b47fd2377051c INFO: 172.21.0.1:52904 - "POST /node/69c80cd0123b47fd2377051c HTTP/1.0" 202 Accepted 2026-03-28 17:32:55,572 - lava_callback - INFO - Starting async job submit for node 69c80cd0123b47fd2377051c 2026-03-28 17:32:55,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:32:55,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80cd0123b47fd2377051c HTTP/1.1" 200 None 2026-03-28 17:32:55,640 - lava_callback - DEBUG - Processing node 69c80cd0123b47fd2377051c: baseline-arm 2026-03-28 17:32:56,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52916 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:32:56,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:32:56,533 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c80cd0123b47fd2377051c/log.txt.gz 2026-03-28 17:32:56,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:32:57,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:32:57,113 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c80cd0123b47fd2377051c/lava-logs.yaml 2026-03-28 17:32:57,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:32:57,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:32:57,284 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c80cd0123b47fd2377051c/lava_callback.json.gz DEBUG: Setup failed for 69c80cd0123b47fd2377051c. Transitting job node result: incomplete -> fail 2026-03-28 17:32:57,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:32:57,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80cd0123b47fd2377051c HTTP/1.1" 200 None 2026-03-28 17:32:57,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:32:57,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 17:32:57,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:32:57,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80cd0123b47fd2377051c HTTP/1.1" 200 None 2026-03-28 17:32:57,573 - lava_callback - INFO - Completed processing callback for node 69c80cd0123b47fd2377051c INFO: 172.21.0.1:55836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:33:27,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:33:27,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36786 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:35:49,811 - lava_callback - INFO - Received callback for node 69c8113d123b47fd23770645 INFO: 172.21.0.1:37382 - "POST /node/69c8113d123b47fd23770645 HTTP/1.0" 202 Accepted 2026-03-28 17:35:49,818 - lava_callback - INFO - Starting async job submit for node 69c8113d123b47fd23770645 2026-03-28 17:35:49,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:35:49,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8113d123b47fd23770645 HTTP/1.1" 200 None 2026-03-28 17:35:49,885 - lava_callback - DEBUG - Processing node 69c8113d123b47fd23770645: baseline-arm64 2026-03-28 17:35:50,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:35:50,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:35:50,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8113d123b47fd23770645/log.txt.gz 2026-03-28 17:35:50,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:35:50,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:35:50,580 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8113d123b47fd23770645/lava-logs.yaml 2026-03-28 17:35:50,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:35:50,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:35:50,720 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c8113d123b47fd23770645/lava_callback.json.gz 2026-03-28 17:35:50,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:35:50,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8113d123b47fd23770645 HTTP/1.1" 200 None 2026-03-28 17:35:50,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:35:50,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:35:50,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:35:50,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8113d123b47fd23770645 HTTP/1.1" 200 None 2026-03-28 17:35:50,893 - lava_callback - INFO - Completed processing callback for node 69c8113d123b47fd23770645 INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:35:57,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:35:57,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37412 - "GET /node/694c4f952f7ca341fdeb4764%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:37:01,289 - lava_callback - INFO - Received callback for node 69c56eb2abf66a8f4d9bc2ea INFO: 172.21.0.1:55582 - "POST /node/69c56eb2abf66a8f4d9bc2ea HTTP/1.0" 202 Accepted 2026-03-28 17:37:01,295 - lava_callback - INFO - Starting async job submit for node 69c56eb2abf66a8f4d9bc2ea 2026-03-28 17:37:01,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:37:01,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56eb2abf66a8f4d9bc2ea HTTP/1.1" 200 None 2026-03-28 17:37:01,310 - lava_callback - DEBUG - Processing node 69c56eb2abf66a8f4d9bc2ea: baseline-arm64-baylibre 2026-03-28 17:37:01,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56eb2abf66a8f4d9bc2ea 2026-03-28 17:37:01,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:37:01,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56eb2abf66a8f4d9bc2ea HTTP/1.1" 200 None 2026-03-28 17:37:01,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:37:01,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-28 17:37:01,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:37:01,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56eb2abf66a8f4d9bc2ea HTTP/1.1" 200 None 2026-03-28 17:37:01,400 - lava_callback - ERROR - Error processing callback for node 69c56eb2abf66a8f4d9bc2ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:39:11,626 - lava_callback - INFO - Received callback for node 69c80db4123b47fd2377055a INFO: 172.21.0.1:34332 - "POST /node/69c80db4123b47fd2377055a HTTP/1.0" 202 Accepted 2026-03-28 17:39:11,673 - lava_callback - INFO - Starting async job submit for node 69c80db4123b47fd2377055a 2026-03-28 17:39:11,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:39:11,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80db4123b47fd2377055a HTTP/1.1" 200 None 2026-03-28 17:39:11,711 - lava_callback - DEBUG - Processing node 69c80db4123b47fd2377055a: baseline-arm-pengutronix 2026-03-28 17:39:11,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:39:12,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:39:12,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c80db4123b47fd2377055a/log.txt.gz 2026-03-28 17:39:12,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:39:12,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:39:12,269 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c80db4123b47fd2377055a/lava-logs.yaml 2026-03-28 17:39:12,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:39:12,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:39:12,403 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c80db4123b47fd2377055a/lava_callback.json.gz DEBUG: Setup failed for 69c80db4123b47fd2377055a. Transitting job node result: incomplete -> fail 2026-03-28 17:39:12,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:39:12,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80db4123b47fd2377055a HTTP/1.1" 200 None 2026-03-28 17:39:12,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:39:12,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 17:39:12,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:39:12,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80db4123b47fd2377055a HTTP/1.1" 200 None 2026-03-28 17:39:12,564 - lava_callback - INFO - Completed processing callback for node 69c80db4123b47fd2377055a INFO: 172.21.0.1:34342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:39:27,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:39:27,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:39:46,076 - lava_callback - INFO - Received callback for node 69c56f58abf66a8f4d9bc312 INFO: 172.21.0.1:45966 - "POST /node/69c56f58abf66a8f4d9bc312 HTTP/1.0" 202 Accepted 2026-03-28 17:39:46,085 - lava_callback - INFO - Starting async job submit for node 69c56f58abf66a8f4d9bc312 2026-03-28 17:39:46,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:39:46,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56f58abf66a8f4d9bc312 HTTP/1.1" 200 None 2026-03-28 17:39:46,103 - lava_callback - DEBUG - Processing node 69c56f58abf66a8f4d9bc312: baseline-arm64-clabbe 2026-03-28 17:39:46,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56f58abf66a8f4d9bc312 2026-03-28 17:39:46,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:39:46,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56f58abf66a8f4d9bc312 HTTP/1.1" 200 None 2026-03-28 17:39:46,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:39:46,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-28 17:39:46,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:39:46,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56f58abf66a8f4d9bc312 HTTP/1.1" 200 None 2026-03-28 17:39:46,162 - lava_callback - ERROR - Error processing callback for node 69c56f58abf66a8f4d9bc312: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:41:06,112 - lava_callback - INFO - Received callback for node 69c56fababf66a8f4d9bc31b INFO: 172.21.0.1:60076 - "POST /node/69c56fababf66a8f4d9bc31b HTTP/1.0" 202 Accepted 2026-03-28 17:41:06,117 - lava_callback - INFO - Starting async job submit for node 69c56fababf66a8f4d9bc31b 2026-03-28 17:41:06,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:41:06,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56fababf66a8f4d9bc31b HTTP/1.1" 200 None 2026-03-28 17:41:06,140 - lava_callback - DEBUG - Processing node 69c56fababf66a8f4d9bc31b: baseline-arm64-clabbe 2026-03-28 17:41:06,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56fababf66a8f4d9bc31b 2026-03-28 17:41:06,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:41:06,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56fababf66a8f4d9bc31b HTTP/1.1" 200 None 2026-03-28 17:41:06,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:41:06,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-28 17:41:06,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:41:06,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56fababf66a8f4d9bc31b HTTP/1.1" 200 None 2026-03-28 17:41:06,216 - lava_callback - ERROR - Error processing callback for node 69c56fababf66a8f4d9bc31b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:42:26,244 - lava_callback - INFO - Received callback for node 69c56ffdabf66a8f4d9bc333 INFO: 172.21.0.1:33892 - "POST /node/69c56ffdabf66a8f4d9bc333 HTTP/1.0" 202 Accepted 2026-03-28 17:42:26,249 - lava_callback - INFO - Starting async job submit for node 69c56ffdabf66a8f4d9bc333 2026-03-28 17:42:26,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:42:26,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56ffdabf66a8f4d9bc333 HTTP/1.1" 200 None 2026-03-28 17:42:26,266 - lava_callback - DEBUG - Processing node 69c56ffdabf66a8f4d9bc333: baseline-arm64-clabbe 2026-03-28 17:42:26,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c56ffdabf66a8f4d9bc333 2026-03-28 17:42:26,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:42:26,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c56ffdabf66a8f4d9bc333 HTTP/1.1" 200 None 2026-03-28 17:42:26,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:42:26,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-28 17:42:26,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:42:26,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c56ffdabf66a8f4d9bc333 HTTP/1.1" 200 None 2026-03-28 17:42:26,332 - lava_callback - ERROR - Error processing callback for node 69c56ffdabf66a8f4d9bc333: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:43:46,237 - lava_callback - INFO - Received callback for node 69c5704fabf66a8f4d9bc34e INFO: 172.21.0.1:45708 - "POST /node/69c5704fabf66a8f4d9bc34e HTTP/1.0" 202 Accepted 2026-03-28 17:43:46,243 - lava_callback - INFO - Starting async job submit for node 69c5704fabf66a8f4d9bc34e 2026-03-28 17:43:46,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:43:46,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5704fabf66a8f4d9bc34e HTTP/1.1" 200 None 2026-03-28 17:43:46,261 - lava_callback - DEBUG - Processing node 69c5704fabf66a8f4d9bc34e: baseline-arm64-clabbe 2026-03-28 17:43:46,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5704fabf66a8f4d9bc34e 2026-03-28 17:43:46,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:43:46,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5704fabf66a8f4d9bc34e HTTP/1.1" 200 None 2026-03-28 17:43:46,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:43:46,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-28 17:43:46,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:43:46,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5704fabf66a8f4d9bc34e HTTP/1.1" 200 None 2026-03-28 17:43:46,323 - lava_callback - ERROR - Error processing callback for node 69c5704fabf66a8f4d9bc34e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45462 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:45:06,608 - lava_callback - INFO - Received callback for node 69c5709eabf66a8f4d9bc361 INFO: 172.21.0.1:45472 - "POST /node/69c5709eabf66a8f4d9bc361 HTTP/1.0" 202 Accepted 2026-03-28 17:45:06,615 - lava_callback - INFO - Starting async job submit for node 69c5709eabf66a8f4d9bc361 2026-03-28 17:45:06,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:45:06,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5709eabf66a8f4d9bc361 HTTP/1.1" 200 None 2026-03-28 17:45:06,635 - lava_callback - DEBUG - Processing node 69c5709eabf66a8f4d9bc361: baseline-arm64-clabbe 2026-03-28 17:45:06,635 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5709eabf66a8f4d9bc361 2026-03-28 17:45:06,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:45:06,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5709eabf66a8f4d9bc361 HTTP/1.1" 200 None 2026-03-28 17:45:06,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:45:06,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-28 17:45:06,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:45:06,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5709eabf66a8f4d9bc361 HTTP/1.1" 200 None 2026-03-28 17:45:06,699 - lava_callback - ERROR - Error processing callback for node 69c5709eabf66a8f4d9bc361: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39970 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:46:26,346 - lava_callback - INFO - Received callback for node 69c570efabf66a8f4d9bc380 INFO: 172.21.0.1:38536 - "POST /node/69c570efabf66a8f4d9bc380 HTTP/1.0" 202 Accepted 2026-03-28 17:46:26,352 - lava_callback - INFO - Starting async job submit for node 69c570efabf66a8f4d9bc380 2026-03-28 17:46:26,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:46:26,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c570efabf66a8f4d9bc380 HTTP/1.1" 200 None 2026-03-28 17:46:26,368 - lava_callback - DEBUG - Processing node 69c570efabf66a8f4d9bc380: baseline-arm64-clabbe 2026-03-28 17:46:26,368 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c570efabf66a8f4d9bc380 2026-03-28 17:46:26,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:46:26,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c570efabf66a8f4d9bc380 HTTP/1.1" 200 None 2026-03-28 17:46:26,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:46:26,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None 2026-03-28 17:46:26,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:46:26,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c570efabf66a8f4d9bc380 HTTP/1.1" 200 None 2026-03-28 17:46:26,428 - lava_callback - ERROR - Error processing callback for node 69c570efabf66a8f4d9bc380: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:47:46,399 - lava_callback - INFO - Received callback for node 69c57132abf66a8f4d9bc393 INFO: 172.21.0.1:44926 - "POST /node/69c57132abf66a8f4d9bc393 HTTP/1.0" 202 Accepted 2026-03-28 17:47:46,404 - lava_callback - INFO - Starting async job submit for node 69c57132abf66a8f4d9bc393 2026-03-28 17:47:46,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:47:46,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57132abf66a8f4d9bc393 HTTP/1.1" 200 None 2026-03-28 17:47:46,420 - lava_callback - DEBUG - Processing node 69c57132abf66a8f4d9bc393: baseline-arm-clabbe 2026-03-28 17:47:46,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c57132abf66a8f4d9bc393 2026-03-28 17:47:46,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:47:46,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57132abf66a8f4d9bc393 HTTP/1.1" 200 None 2026-03-28 17:47:46,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:47:46,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None 2026-03-28 17:47:46,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:47:46,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c57132abf66a8f4d9bc393 HTTP/1.1" 200 None 2026-03-28 17:47:46,477 - lava_callback - ERROR - Error processing callback for node 69c57132abf66a8f4d9bc393: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41626 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:48:26,408 - lava_callback - INFO - Received callback for node 69c5715aabf66a8f4d9bc3a6 INFO: 172.21.0.1:43024 - "POST /node/69c5715aabf66a8f4d9bc3a6 HTTP/1.0" 202 Accepted 2026-03-28 17:48:26,414 - lava_callback - INFO - Starting async job submit for node 69c5715aabf66a8f4d9bc3a6 2026-03-28 17:48:26,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:48:26,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5715aabf66a8f4d9bc3a6 HTTP/1.1" 200 None 2026-03-28 17:48:26,430 - lava_callback - DEBUG - Processing node 69c5715aabf66a8f4d9bc3a6: baseline-arm-clabbe 2026-03-28 17:48:26,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5715aabf66a8f4d9bc3a6 2026-03-28 17:48:26,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:48:26,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5715aabf66a8f4d9bc3a6 HTTP/1.1" 200 None 2026-03-28 17:48:26,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:48:26,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None 2026-03-28 17:48:26,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:48:26,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5715aabf66a8f4d9bc3a6 HTTP/1.1" 200 None 2026-03-28 17:48:26,493 - lava_callback - ERROR - Error processing callback for node 69c5715aabf66a8f4d9bc3a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53400 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:49:06,480 - lava_callback - INFO - Received callback for node 69c57182abf66a8f4d9bc3b7 INFO: 172.21.0.1:58276 - "POST /node/69c57182abf66a8f4d9bc3b7 HTTP/1.0" 202 Accepted 2026-03-28 17:49:06,486 - lava_callback - INFO - Starting async job submit for node 69c57182abf66a8f4d9bc3b7 2026-03-28 17:49:06,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:49:06,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57182abf66a8f4d9bc3b7 HTTP/1.1" 200 None 2026-03-28 17:49:06,501 - lava_callback - DEBUG - Processing node 69c57182abf66a8f4d9bc3b7: baseline-arm-clabbe 2026-03-28 17:49:06,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c57182abf66a8f4d9bc3b7 2026-03-28 17:49:06,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:49:06,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57182abf66a8f4d9bc3b7 HTTP/1.1" 200 None INFO: 172.21.0.1:58278 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:49:06,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:49:06,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None 2026-03-28 17:49:06,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:49:06,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c57182abf66a8f4d9bc3b7 HTTP/1.1" 200 None 2026-03-28 17:49:06,581 - lava_callback - ERROR - Error processing callback for node 69c57182abf66a8f4d9bc3b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43616 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:49:46,429 - lava_callback - INFO - Received callback for node 69c571ababf66a8f4d9bc3c7 INFO: 172.21.0.1:47016 - "POST /node/69c571ababf66a8f4d9bc3c7 HTTP/1.0" 202 Accepted 2026-03-28 17:49:46,434 - lava_callback - INFO - Starting async job submit for node 69c571ababf66a8f4d9bc3c7 2026-03-28 17:49:46,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:49:46,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c571ababf66a8f4d9bc3c7 HTTP/1.1" 200 None 2026-03-28 17:49:46,455 - lava_callback - DEBUG - Processing node 69c571ababf66a8f4d9bc3c7: baseline-arm-clabbe 2026-03-28 17:49:46,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c571ababf66a8f4d9bc3c7 2026-03-28 17:49:46,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:49:46,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c571ababf66a8f4d9bc3c7 HTTP/1.1" 200 None 2026-03-28 17:49:46,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:49:46,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None 2026-03-28 17:49:46,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47018 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:49:46,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c571ababf66a8f4d9bc3c7 HTTP/1.1" 200 None 2026-03-28 17:49:46,521 - lava_callback - ERROR - Error processing callback for node 69c571ababf66a8f4d9bc3c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:50:19,689 - lava_callback - INFO - Received callback for node 69c814cd123b47fd237706e7 INFO: 172.21.0.1:53428 - "POST /node/69c814cd123b47fd237706e7 HTTP/1.0" 202 Accepted 2026-03-28 17:50:19,694 - lava_callback - INFO - Starting async job submit for node 69c814cd123b47fd237706e7 2026-03-28 17:50:19,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:50:19,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c814cd123b47fd237706e7 HTTP/1.1" 200 None 2026-03-28 17:50:19,712 - lava_callback - DEBUG - Processing node 69c814cd123b47fd237706e7: baseline-nfs-arm64 2026-03-28 17:50:19,713 - lava_callback - WARNING - Failed to upload log 2026-03-28 17:50:19,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:50:19,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:50:19,890 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c814cd123b47fd237706e7/lava-logs.yaml 2026-03-28 17:50:19,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:50:20,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:50:20,034 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c814cd123b47fd237706e7/lava_callback.json.gz 2026-03-28 17:50:20,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:50:20,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c814cd123b47fd237706e7 HTTP/1.1" 200 None 2026-03-28 17:50:20,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:50:20,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:50:20,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:50:20,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c814cd123b47fd237706e7 HTTP/1.1" 200 None 2026-03-28 17:50:20,112 - lava_callback - INFO - Completed processing callback for node 69c814cd123b47fd237706e7 INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:50:26,538 - lava_callback - INFO - Received callback for node 69c571d3abf66a8f4d9bc3d9 INFO: 172.21.0.1:57418 - "POST /node/69c571d3abf66a8f4d9bc3d9 HTTP/1.0" 202 Accepted 2026-03-28 17:50:26,544 - lava_callback - INFO - Starting async job submit for node 69c571d3abf66a8f4d9bc3d9 2026-03-28 17:50:26,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:50:26,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c571d3abf66a8f4d9bc3d9 HTTP/1.1" 200 None 2026-03-28 17:50:26,560 - lava_callback - DEBUG - Processing node 69c571d3abf66a8f4d9bc3d9: baseline-arm-clabbe 2026-03-28 17:50:26,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c571d3abf66a8f4d9bc3d9 2026-03-28 17:50:26,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:50:26,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c571d3abf66a8f4d9bc3d9 HTTP/1.1" 200 None 2026-03-28 17:50:26,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:50:26,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None 2026-03-28 17:50:26,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:50:26,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c571d3abf66a8f4d9bc3d9 HTTP/1.1" 200 None 2026-03-28 17:50:26,616 - lava_callback - ERROR - Error processing callback for node 69c571d3abf66a8f4d9bc3d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 17:50:27,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:50:27,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET /node/6989379385773790cd34cd41%5Cn HTTP/1.0" 405 Method Not Allowed 2026-03-28 17:51:37,455 - lava_callback - INFO - Received callback for node 69c8107f123b47fd23770616 INFO: 172.21.0.1:41594 - "POST /node/69c8107f123b47fd23770616 HTTP/1.0" 202 Accepted 2026-03-28 17:51:37,463 - lava_callback - INFO - Starting async job submit for node 69c8107f123b47fd23770616 2026-03-28 17:51:37,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:51:37,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8107f123b47fd23770616 HTTP/1.1" 200 None 2026-03-28 17:51:37,522 - lava_callback - DEBUG - Processing node 69c8107f123b47fd23770616: baseline-nfs-arm64 2026-03-28 17:51:38,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:51:38,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:51:38,870 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8107f123b47fd23770616/log.txt.gz 2026-03-28 17:51:39,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:51:39,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:51:39,911 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8107f123b47fd23770616/lava-logs.yaml 2026-03-28 17:51:39,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:51:40,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:51:40,141 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8107f123b47fd23770616/lava_callback.json.gz DEBUG: Setup failed for 69c8107f123b47fd23770616. Transitting job node result: incomplete -> fail 2026-03-28 17:51:40,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:51:40,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8107f123b47fd23770616 HTTP/1.1" 200 None 2026-03-28 17:51:40,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:51:40,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:51:40,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:51:40,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8107f123b47fd23770616 HTTP/1.1" 200 None 2026-03-28 17:51:40,408 - lava_callback - INFO - Completed processing callback for node 69c8107f123b47fd23770616 INFO: 172.21.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:51:57,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:51:57,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50970 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:52:14,246 - lava_callback - INFO - Received callback for node 69c81391123b47fd237706ac INFO: 172.21.0.1:44004 - "POST /node/69c81391123b47fd237706ac HTTP/1.0" 202 Accepted 2026-03-28 17:52:14,253 - lava_callback - INFO - Starting async job submit for node 69c81391123b47fd237706ac 2026-03-28 17:52:14,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:52:14,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81391123b47fd237706ac HTTP/1.1" 200 None 2026-03-28 17:52:14,304 - lava_callback - DEBUG - Processing node 69c81391123b47fd237706ac: baseline-arm64 2026-03-28 17:52:14,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:52:14,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:52:14,818 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c81391123b47fd237706ac/log.txt.gz 2026-03-28 17:52:15,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44006 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-28 17:52:15,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:52:15,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c81391123b47fd237706ac/lava-logs.yaml 2026-03-28 17:52:15,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:52:15,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:52:15,376 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c81391123b47fd237706ac/lava_callback.json.gz DEBUG: Setup failed for 69c81391123b47fd237706ac. Transitting job node result: incomplete -> fail 2026-03-28 17:52:15,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:52:15,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81391123b47fd237706ac HTTP/1.1" 200 None 2026-03-28 17:52:15,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:52:15,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:52:15,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:52:15,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81391123b47fd237706ac HTTP/1.1" 200 None 2026-03-28 17:52:15,575 - lava_callback - INFO - Completed processing callback for node 69c81391123b47fd237706ac INFO: 172.21.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57348 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:52:27,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:52:27,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52698 - "GET /node/69a8d66a911a9cbe7f77d89f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:54:41,040 - lava_callback - INFO - Received callback for node 69c815ae123b47fd23770719 INFO: 172.21.0.1:46864 - "POST /node/69c815ae123b47fd23770719 HTTP/1.0" 202 Accepted 2026-03-28 17:54:41,047 - lava_callback - INFO - Starting async job submit for node 69c815ae123b47fd23770719 2026-03-28 17:54:41,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:54:41,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c815ae123b47fd23770719 HTTP/1.1" 200 None 2026-03-28 17:54:41,095 - lava_callback - DEBUG - Processing node 69c815ae123b47fd23770719: baseline-arm64 2026-03-28 17:54:41,238 - lava_callback - WARNING - Failed to upload log 2026-03-28 17:54:41,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:54:41,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:54:41,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c815ae123b47fd23770719/lava-logs.yaml 2026-03-28 17:54:41,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:54:41,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:54:41,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c815ae123b47fd23770719/lava_callback.json.gz 2026-03-28 17:54:41,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:54:41,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c815ae123b47fd23770719 HTTP/1.1" 200 None 2026-03-28 17:54:41,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:54:41,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:54:41,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:54:41,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c815ae123b47fd23770719 HTTP/1.1" 200 None 2026-03-28 17:54:41,815 - lava_callback - INFO - Completed processing callback for node 69c815ae123b47fd23770719 INFO: 172.21.0.1:46878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:54:57,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:54:57,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:56:23,953 - lava_callback - INFO - Received callback for node 69c811e5123b47fd2377065f INFO: 172.21.0.1:57656 - "POST /node/69c811e5123b47fd2377065f HTTP/1.0" 202 Accepted 2026-03-28 17:56:23,959 - lava_callback - INFO - Starting async job submit for node 69c811e5123b47fd2377065f 2026-03-28 17:56:23,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:56:23,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c811e5123b47fd2377065f HTTP/1.1" 200 None 2026-03-28 17:56:24,000 - lava_callback - DEBUG - Processing node 69c811e5123b47fd2377065f: baseline-nfs-arm64 2026-03-28 17:56:24,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:56:24,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:56:24,720 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c811e5123b47fd2377065f/log.txt.gz 2026-03-28 17:56:24,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:56:25,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:56:25,223 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c811e5123b47fd2377065f/lava-logs.yaml 2026-03-28 17:56:25,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:56:25,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:56:25,552 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c811e5123b47fd2377065f/lava_callback.json.gz 2026-03-28 17:56:25,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:56:25,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c811e5123b47fd2377065f HTTP/1.1" 200 None 2026-03-28 17:56:25,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:56:25,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:56:25,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:56:25,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c811e5123b47fd2377065f HTTP/1.1" 200 None 2026-03-28 17:56:25,694 - lava_callback - INFO - Completed processing callback for node 69c811e5123b47fd2377065f INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:56:27,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:56:27,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:57:02,404 - lava_callback - INFO - Received callback for node 69c5736babf66a8f4d9bc3fd INFO: 172.21.0.1:34202 - "POST /node/69c5736babf66a8f4d9bc3fd HTTP/1.0" 202 Accepted 2026-03-28 17:57:02,410 - lava_callback - INFO - Starting async job submit for node 69c5736babf66a8f4d9bc3fd 2026-03-28 17:57:02,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:57:02,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5736babf66a8f4d9bc3fd HTTP/1.1" 200 None 2026-03-28 17:57:02,444 - lava_callback - DEBUG - Processing node 69c5736babf66a8f4d9bc3fd: baseline-arm64-baylibre 2026-03-28 17:57:02,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5736babf66a8f4d9bc3fd 2026-03-28 17:57:02,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:57:02,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5736babf66a8f4d9bc3fd HTTP/1.1" 200 None 2026-03-28 17:57:02,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:57:02,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-28 17:57:02,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:57:02,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5736babf66a8f4d9bc3fd HTTP/1.1" 200 None 2026-03-28 17:57:02,495 - lava_callback - ERROR - Error processing callback for node 69c5736babf66a8f4d9bc3fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50522 - "GET /node/69af01d6ce46d8ec186ac709%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:58:22,389 - lava_callback - INFO - Received callback for node 69c573bbabf66a8f4d9bc409 INFO: 172.21.0.1:33500 - "POST /node/69c573bbabf66a8f4d9bc409 HTTP/1.0" 202 Accepted 2026-03-28 17:58:22,395 - lava_callback - INFO - Starting async job submit for node 69c573bbabf66a8f4d9bc409 2026-03-28 17:58:22,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:58:22,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c573bbabf66a8f4d9bc409 HTTP/1.1" 200 None 2026-03-28 17:58:22,411 - lava_callback - DEBUG - Processing node 69c573bbabf66a8f4d9bc409: baseline-arm64-baylibre 2026-03-28 17:58:22,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c573bbabf66a8f4d9bc409 2026-03-28 17:58:22,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:58:22,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c573bbabf66a8f4d9bc409 HTTP/1.1" 200 None 2026-03-28 17:58:22,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:58:22,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-28 17:58:22,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:58:22,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c573bbabf66a8f4d9bc409 HTTP/1.1" 200 None 2026-03-28 17:58:22,521 - lava_callback - ERROR - Error processing callback for node 69c573bbabf66a8f4d9bc409: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36082 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:59:20,637 - lava_callback - INFO - Received callback for node 69c816b3123b47fd23770768 INFO: 172.21.0.1:59002 - "POST /node/69c816b3123b47fd23770768 HTTP/1.0" 202 Accepted 2026-03-28 17:59:20,644 - lava_callback - INFO - Starting async job submit for node 69c816b3123b47fd23770768 2026-03-28 17:59:20,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:59:20,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c816b3123b47fd23770768 HTTP/1.1" 200 None 2026-03-28 17:59:20,689 - lava_callback - DEBUG - Processing node 69c816b3123b47fd23770768: baseline-arm64 2026-03-28 17:59:20,889 - lava_callback - WARNING - Failed to upload log 2026-03-28 17:59:21,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:59:21,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:59:21,207 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c816b3123b47fd23770768/lava-logs.yaml 2026-03-28 17:59:21,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 17:59:21,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 17:59:21,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c816b3123b47fd23770768/lava_callback.json.gz 2026-03-28 17:59:21,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:59:21,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c816b3123b47fd23770768 HTTP/1.1" 200 None 2026-03-28 17:59:21,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:59:21,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 17:59:21,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:59:21,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c816b3123b47fd23770768 HTTP/1.1" 200 None 2026-03-28 17:59:21,516 - lava_callback - INFO - Completed processing callback for node 69c816b3123b47fd23770768 INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:59:27,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:59:27,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK 2026-03-28 17:59:42,445 - lava_callback - INFO - Received callback for node 69c5740cabf66a8f4d9bc417 INFO: 172.21.0.1:33886 - "POST /node/69c5740cabf66a8f4d9bc417 HTTP/1.0" 202 Accepted 2026-03-28 17:59:42,451 - lava_callback - INFO - Starting async job submit for node 69c5740cabf66a8f4d9bc417 2026-03-28 17:59:42,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:59:42,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5740cabf66a8f4d9bc417 HTTP/1.1" 200 None 2026-03-28 17:59:42,468 - lava_callback - DEBUG - Processing node 69c5740cabf66a8f4d9bc417: baseline-arm64-baylibre 2026-03-28 17:59:42,468 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5740cabf66a8f4d9bc417 2026-03-28 17:59:42,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:59:42,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5740cabf66a8f4d9bc417 HTTP/1.1" 200 None 2026-03-28 17:59:42,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:59:42,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-28 17:59:42,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 17:59:42,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5740cabf66a8f4d9bc417 HTTP/1.1" 200 None 2026-03-28 17:59:42,523 - lava_callback - ERROR - Error processing callback for node 69c5740cabf66a8f4d9bc417: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52506 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:01:42,556 - lava_callback - INFO - Received callback for node 69c57472abf66a8f4d9bc421 INFO: 172.21.0.1:60088 - "POST /node/69c57472abf66a8f4d9bc421 HTTP/1.0" 202 Accepted 2026-03-28 18:01:42,562 - lava_callback - INFO - Starting async job submit for node 69c57472abf66a8f4d9bc421 2026-03-28 18:01:42,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:01:42,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57472abf66a8f4d9bc421 HTTP/1.1" 200 None 2026-03-28 18:01:42,579 - lava_callback - DEBUG - Processing node 69c57472abf66a8f4d9bc421: baseline-arm64-baylibre 2026-03-28 18:01:42,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c57472abf66a8f4d9bc421 2026-03-28 18:01:42,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:01:42,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57472abf66a8f4d9bc421 HTTP/1.1" 200 None 2026-03-28 18:01:42,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:01:42,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-28 18:01:42,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:01:42,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c57472abf66a8f4d9bc421 HTTP/1.1" 200 None 2026-03-28 18:01:42,681 - lava_callback - ERROR - Error processing callback for node 69c57472abf66a8f4d9bc421: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:03:02,731 - lava_callback - INFO - Received callback for node 69c574c2abf66a8f4d9bc42f INFO: 172.21.0.1:35720 - "POST /node/69c574c2abf66a8f4d9bc42f HTTP/1.0" 202 Accepted 2026-03-28 18:03:02,736 - lava_callback - INFO - Starting async job submit for node 69c574c2abf66a8f4d9bc42f 2026-03-28 18:03:02,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:03:02,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c574c2abf66a8f4d9bc42f HTTP/1.1" 200 None 2026-03-28 18:03:02,751 - lava_callback - DEBUG - Processing node 69c574c2abf66a8f4d9bc42f: baseline-arm64-baylibre 2026-03-28 18:03:02,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c574c2abf66a8f4d9bc42f 2026-03-28 18:03:02,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:03:02,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c574c2abf66a8f4d9bc42f HTTP/1.1" 200 None 2026-03-28 18:03:02,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:03:02,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-28 18:03:02,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:03:02,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c574c2abf66a8f4d9bc42f HTTP/1.1" 200 None 2026-03-28 18:03:02,805 - lava_callback - ERROR - Error processing callback for node 69c574c2abf66a8f4d9bc42f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:03:36,244 - lava_callback - INFO - Received callback for node 69c810e8123b47fd23770639 INFO: 172.21.0.1:35134 - "POST /node/69c810e8123b47fd23770639 HTTP/1.0" 202 Accepted 2026-03-28 18:03:36,293 - lava_callback - INFO - Starting async job submit for node 69c810e8123b47fd23770639 2026-03-28 18:03:36,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:03:36,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c810e8123b47fd23770639 HTTP/1.1" 200 None 2026-03-28 18:03:36,333 - lava_callback - DEBUG - Processing node 69c810e8123b47fd23770639: ltp-smoke 2026-03-28 18:03:36,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:03:36,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:03:36,582 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c810e8123b47fd23770639/log.txt.gz 2026-03-28 18:03:36,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:03:36,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:03:36,828 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c810e8123b47fd23770639/lava-logs.yaml 2026-03-28 18:03:36,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:03:36,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:03:36,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c810e8123b47fd23770639/lava_callback.json.gz 2026-03-28 18:03:36,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:03:36,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c810e8123b47fd23770639 HTTP/1.1" 200 None 2026-03-28 18:03:36,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:03:37,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 18:03:37,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:03:37,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c810e8123b47fd23770639 HTTP/1.1" 200 None 2026-03-28 18:03:37,122 - lava_callback - INFO - Completed processing callback for node 69c810e8123b47fd23770639 INFO: 172.21.0.1:41872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET /node/698638c2177ca0f097bd2c23%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52886 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:03:57,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:03:57,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56692 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:04:22,893 - lava_callback - INFO - Received callback for node 69c57512abf66a8f4d9bc437 INFO: 172.21.0.1:34066 - "POST /node/69c57512abf66a8f4d9bc437 HTTP/1.0" 202 Accepted 2026-03-28 18:04:22,899 - lava_callback - INFO - Starting async job submit for node 69c57512abf66a8f4d9bc437 2026-03-28 18:04:22,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:04:22,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57512abf66a8f4d9bc437 HTTP/1.1" 200 None 2026-03-28 18:04:22,915 - lava_callback - DEBUG - Processing node 69c57512abf66a8f4d9bc437: baseline-arm64-baylibre 2026-03-28 18:04:22,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c57512abf66a8f4d9bc437 2026-03-28 18:04:22,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:04:22,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57512abf66a8f4d9bc437 HTTP/1.1" 200 None 2026-03-28 18:04:22,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:04:22,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-28 18:04:22,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:04:22,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c57512abf66a8f4d9bc437 HTTP/1.1" 200 None 2026-03-28 18:04:22,968 - lava_callback - ERROR - Error processing callback for node 69c57512abf66a8f4d9bc437: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55250 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:05:47,147 - lava_callback - INFO - Received callback for node 69c57567abf66a8f4d9bc449 INFO: 172.21.0.1:55258 - "POST /node/69c57567abf66a8f4d9bc449 HTTP/1.0" 202 Accepted 2026-03-28 18:05:47,153 - lava_callback - INFO - Starting async job submit for node 69c57567abf66a8f4d9bc449 2026-03-28 18:05:47,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:05:47,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57567abf66a8f4d9bc449 HTTP/1.1" 200 None 2026-03-28 18:05:47,170 - lava_callback - DEBUG - Processing node 69c57567abf66a8f4d9bc449: baseline-arm64-clabbe 2026-03-28 18:05:47,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c57567abf66a8f4d9bc449 2026-03-28 18:05:47,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:05:47,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57567abf66a8f4d9bc449 HTTP/1.1" 200 None 2026-03-28 18:05:47,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:05:47,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-28 18:05:47,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:05:47,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c57567abf66a8f4d9bc449 HTTP/1.1" 200 None 2026-03-28 18:05:47,251 - lava_callback - ERROR - Error processing callback for node 69c57567abf66a8f4d9bc449: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:06:08,526 - lava_callback - INFO - Received callback for node 69c81474123b47fd237706d5 INFO: 172.21.0.1:36144 - "POST /node/69c81474123b47fd237706d5 HTTP/1.0" 202 Accepted 2026-03-28 18:06:08,534 - lava_callback - INFO - Starting async job submit for node 69c81474123b47fd237706d5 2026-03-28 18:06:08,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:06:08,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81474123b47fd237706d5 HTTP/1.1" 200 None 2026-03-28 18:06:08,633 - lava_callback - DEBUG - Processing node 69c81474123b47fd237706d5: ltp-smoke 2026-03-28 18:06:09,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:06:09,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:06:09,255 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c81474123b47fd237706d5/log.txt.gz 2026-03-28 18:06:09,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:06:09,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:06:09,777 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c81474123b47fd237706d5/lava-logs.yaml 2026-03-28 18:06:09,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:06:09,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:06:09,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c81474123b47fd237706d5/lava_callback.json.gz 2026-03-28 18:06:10,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:06:10,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81474123b47fd237706d5 HTTP/1.1" 200 None 2026-03-28 18:06:10,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:06:10,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff48123b47fd2376d751 HTTP/1.1" 200 None 2026-03-28 18:06:10,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:06:10,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81474123b47fd237706d5 HTTP/1.1" 200 None 2026-03-28 18:06:10,273 - lava_callback - INFO - Completed processing callback for node 69c81474123b47fd237706d5 INFO: 172.21.0.1:52956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45096 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:06:27,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:06:27,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:07:27,286 - lava_callback - INFO - Received callback for node 69c575caabf66a8f4d9bc461 INFO: 172.21.0.1:49074 - "POST /node/69c575caabf66a8f4d9bc461 HTTP/1.0" 202 Accepted 2026-03-28 18:07:27,292 - lava_callback - INFO - Starting async job submit for node 69c575caabf66a8f4d9bc461 2026-03-28 18:07:27,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:07:27,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c575caabf66a8f4d9bc461 HTTP/1.1" 200 None 2026-03-28 18:07:27,317 - lava_callback - DEBUG - Processing node 69c575caabf66a8f4d9bc461: baseline-arm64-clabbe 2026-03-28 18:07:27,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c575caabf66a8f4d9bc461 2026-03-28 18:07:27,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:07:27,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c575caabf66a8f4d9bc461 HTTP/1.1" 200 None 2026-03-28 18:07:27,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:07:27,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-28 18:07:27,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:07:27,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c575caabf66a8f4d9bc461 HTTP/1.1" 200 None 2026-03-28 18:07:27,373 - lava_callback - ERROR - Error processing callback for node 69c575caabf66a8f4d9bc461: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32980 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:08:47,306 - lava_callback - INFO - Received callback for node 69c5761aabf66a8f4d9bc469 INFO: 172.21.0.1:32996 - "POST /node/69c5761aabf66a8f4d9bc469 HTTP/1.0" 202 Accepted 2026-03-28 18:08:47,312 - lava_callback - INFO - Starting async job submit for node 69c5761aabf66a8f4d9bc469 2026-03-28 18:08:47,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:08:47,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5761aabf66a8f4d9bc469 HTTP/1.1" 200 None 2026-03-28 18:08:47,328 - lava_callback - DEBUG - Processing node 69c5761aabf66a8f4d9bc469: baseline-arm64-clabbe 2026-03-28 18:08:47,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5761aabf66a8f4d9bc469 2026-03-28 18:08:47,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:08:47,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5761aabf66a8f4d9bc469 HTTP/1.1" 200 None 2026-03-28 18:08:47,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:08:47,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-28 18:08:47,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:08:47,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5761aabf66a8f4d9bc469 HTTP/1.1" 200 None 2026-03-28 18:08:47,389 - lava_callback - ERROR - Error processing callback for node 69c5761aabf66a8f4d9bc469: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41766 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:08:54,142 - lava_callback - INFO - Received callback for node 69c81776123b47fd23770795 INFO: 172.21.0.1:41776 - "POST /node/69c81776123b47fd23770795 HTTP/1.0" 202 Accepted 2026-03-28 18:08:54,149 - lava_callback - INFO - Starting async job submit for node 69c81776123b47fd23770795 2026-03-28 18:08:54,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:08:54,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81776123b47fd23770795 HTTP/1.1" 200 None 2026-03-28 18:08:54,200 - lava_callback - DEBUG - Processing node 69c81776123b47fd23770795: baseline-arm64 2026-03-28 18:08:54,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:08:54,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:08:54,728 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c81776123b47fd23770795/log.txt.gz 2026-03-28 18:08:54,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:08:55,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:08:55,154 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c81776123b47fd23770795/lava-logs.yaml 2026-03-28 18:08:55,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:08:55,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:08:55,322 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c81776123b47fd23770795/lava_callback.json.gz DEBUG: Setup failed for 69c81776123b47fd23770795. Transitting job node result: incomplete -> fail 2026-03-28 18:08:55,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:08:55,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81776123b47fd23770795 HTTP/1.1" 200 None 2026-03-28 18:08:55,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:08:55,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 18:08:55,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:08:55,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81776123b47fd23770795 HTTP/1.1" 200 None 2026-03-28 18:08:55,563 - lava_callback - INFO - Completed processing callback for node 69c81776123b47fd23770795 INFO: 172.21.0.1:41792 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:08:57,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:08:57,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET /node/69278df297dccbdf516a69fc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44906 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:10:47,394 - lava_callback - INFO - Received callback for node 69c57693abf66a8f4d9bc489 INFO: 172.21.0.1:44920 - "POST /node/69c57693abf66a8f4d9bc489 HTTP/1.0" 202 Accepted 2026-03-28 18:10:47,400 - lava_callback - INFO - Starting async job submit for node 69c57693abf66a8f4d9bc489 2026-03-28 18:10:47,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:10:47,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57693abf66a8f4d9bc489 HTTP/1.1" 200 None 2026-03-28 18:10:47,416 - lava_callback - DEBUG - Processing node 69c57693abf66a8f4d9bc489: baseline-arm64-clabbe 2026-03-28 18:10:47,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c57693abf66a8f4d9bc489 2026-03-28 18:10:47,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:10:47,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57693abf66a8f4d9bc489 HTTP/1.1" 200 None 2026-03-28 18:10:47,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:10:47,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-28 18:10:47,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:10:47,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c57693abf66a8f4d9bc489 HTTP/1.1" 200 None 2026-03-28 18:10:47,475 - lava_callback - ERROR - Error processing callback for node 69c57693abf66a8f4d9bc489: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:12:07,446 - lava_callback - INFO - Received callback for node 69c576e2abf66a8f4d9bc497 INFO: 172.21.0.1:34710 - "POST /node/69c576e2abf66a8f4d9bc497 HTTP/1.0" 202 Accepted 2026-03-28 18:12:07,452 - lava_callback - INFO - Starting async job submit for node 69c576e2abf66a8f4d9bc497 2026-03-28 18:12:07,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:12:07,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c576e2abf66a8f4d9bc497 HTTP/1.1" 200 None 2026-03-28 18:12:07,468 - lava_callback - DEBUG - Processing node 69c576e2abf66a8f4d9bc497: baseline-arm64-clabbe 2026-03-28 18:12:07,468 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c576e2abf66a8f4d9bc497 2026-03-28 18:12:07,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:12:07,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c576e2abf66a8f4d9bc497 HTTP/1.1" 200 None 2026-03-28 18:12:07,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:12:07,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-28 18:12:07,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:12:07,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c576e2abf66a8f4d9bc497 HTTP/1.1" 200 None 2026-03-28 18:12:07,535 - lava_callback - ERROR - Error processing callback for node 69c576e2abf66a8f4d9bc497: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48300 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:13:25,572 - lava_callback - INFO - Received callback for node 69c817c5123b47fd237707a1 INFO: 172.21.0.1:36106 - "POST /node/69c817c5123b47fd237707a1 HTTP/1.0" 202 Accepted 2026-03-28 18:13:25,578 - lava_callback - INFO - Starting async job submit for node 69c817c5123b47fd237707a1 2026-03-28 18:13:25,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:13:25,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c817c5123b47fd237707a1 HTTP/1.1" 200 None 2026-03-28 18:13:25,627 - lava_callback - DEBUG - Processing node 69c817c5123b47fd237707a1: baseline-nfs-arm64 2026-03-28 18:13:26,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:13:26,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:13:26,287 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c817c5123b47fd237707a1/log.txt.gz INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:13:26,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:13:26,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:13:26,788 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c817c5123b47fd237707a1/lava-logs.yaml 2026-03-28 18:13:26,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:13:27,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:13:27,121 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c817c5123b47fd237707a1/lava_callback.json.gz 2026-03-28 18:13:27,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:13:27,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c817c5123b47fd237707a1 HTTP/1.1" 200 None 2026-03-28 18:13:27,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:13:27,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 18:13:27,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:13:27,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c817c5123b47fd237707a1 HTTP/1.1" 200 None 2026-03-28 18:13:27,274 - lava_callback - INFO - Completed processing callback for node 69c817c5123b47fd237707a1 2026-03-28 18:13:27,525 - lava_callback - INFO - Received callback for node 69c57735abf66a8f4d9bc4a5 INFO: 172.21.0.1:36132 - "POST /node/69c57735abf66a8f4d9bc4a5 HTTP/1.0" 202 Accepted 2026-03-28 18:13:27,534 - lava_callback - INFO - Starting async job submit for node 69c57735abf66a8f4d9bc4a5 2026-03-28 18:13:27,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:13:27,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57735abf66a8f4d9bc4a5 HTTP/1.1" 200 None 2026-03-28 18:13:27,556 - lava_callback - DEBUG - Processing node 69c57735abf66a8f4d9bc4a5: baseline-arm64-clabbe 2026-03-28 18:13:27,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c57735abf66a8f4d9bc4a5 2026-03-28 18:13:27,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:13:27,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c57735abf66a8f4d9bc4a5 HTTP/1.1" 200 None 2026-03-28 18:13:27,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:13:27,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-28 18:13:27,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:13:27,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c57735abf66a8f4d9bc4a5 HTTP/1.1" 200 None 2026-03-28 18:13:27,612 - lava_callback - ERROR - Error processing callback for node 69c57735abf66a8f4d9bc4a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 18:13:27,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:13:27,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:14:18,085 - lava_callback - INFO - Received callback for node 69c8168f123b47fd23770757 INFO: 172.21.0.1:50058 - "POST /node/69c8168f123b47fd23770757 HTTP/1.0" 202 Accepted 2026-03-28 18:14:18,093 - lava_callback - INFO - Starting async job submit for node 69c8168f123b47fd23770757 2026-03-28 18:14:18,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:14:18,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8168f123b47fd23770757 HTTP/1.1" 200 None 2026-03-28 18:14:18,162 - lava_callback - DEBUG - Processing node 69c8168f123b47fd23770757: baseline-arm 2026-03-28 18:14:18,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:14:18,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:14:18,866 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c8168f123b47fd23770757/log.txt.gz 2026-03-28 18:14:19,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:14:19,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:14:19,451 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c8168f123b47fd23770757/lava-logs.yaml 2026-03-28 18:14:19,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:14:19,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:14:19,654 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c8168f123b47fd23770757/lava_callback.json.gz DEBUG: Setup failed for 69c8168f123b47fd23770757. Transitting job node result: incomplete -> fail 2026-03-28 18:14:19,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:14:19,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8168f123b47fd23770757 HTTP/1.1" 200 None 2026-03-28 18:14:19,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:14:19,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 18:14:19,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:14:19,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8168f123b47fd23770757 HTTP/1.1" 200 None 2026-03-28 18:14:19,949 - lava_callback - INFO - Completed processing callback for node 69c8168f123b47fd23770757 INFO: 172.21.0.1:57894 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:14:27,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:14:27,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:16:57,052 - lava_callback - INFO - Received callback for node 69c819ae123b47fd237707fc INFO: 172.21.0.1:48028 - "POST /node/69c819ae123b47fd237707fc HTTP/1.0" 202 Accepted 2026-03-28 18:16:57,058 - lava_callback - INFO - Starting async job submit for node 69c819ae123b47fd237707fc 2026-03-28 18:16:57,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:16:57,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c819ae123b47fd237707fc HTTP/1.1" 200 None 2026-03-28 18:16:57,099 - lava_callback - DEBUG - Processing node 69c819ae123b47fd237707fc: ltp-smoke 2026-03-28 18:16:57,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:16:57,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:16:57,622 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c819ae123b47fd237707fc/log.txt.gz 2026-03-28 18:16:57,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:16:58,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:16:58,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c819ae123b47fd237707fc/lava-logs.yaml 2026-03-28 18:16:58,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:16:58,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:16:58,260 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c819ae123b47fd237707fc/lava_callback.json.gz 2026-03-28 18:16:58,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:16:58,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c819ae123b47fd237707fc HTTP/1.1" 200 None 2026-03-28 18:16:58,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:16:58,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 18:16:58,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:16:58,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c819ae123b47fd237707fc HTTP/1.1" 200 None 2026-03-28 18:16:58,342 - lava_callback - INFO - Completed processing callback for node 69c819ae123b47fd237707fc INFO: 172.21.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:17:27,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:17:27,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:18:53,329 - lava_callback - INFO - Received callback for node 69c81708123b47fd2377077e INFO: 172.21.0.1:39646 - "POST /node/69c81708123b47fd2377077e HTTP/1.0" 202 Accepted 2026-03-28 18:18:53,377 - lava_callback - INFO - Starting async job submit for node 69c81708123b47fd2377077e 2026-03-28 18:18:53,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:18:53,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81708123b47fd2377077e HTTP/1.1" 200 None 2026-03-28 18:18:53,416 - lava_callback - DEBUG - Processing node 69c81708123b47fd2377077e: baseline-arm-pengutronix 2026-03-28 18:18:53,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:18:53,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:18:53,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c81708123b47fd2377077e/log.txt.gz 2026-03-28 18:18:53,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:18:54,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:18:54,145 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c81708123b47fd2377077e/lava-logs.yaml 2026-03-28 18:18:54,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:18:54,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:18:54,288 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c81708123b47fd2377077e/lava_callback.json.gz DEBUG: Setup failed for 69c81708123b47fd2377077e. Transitting job node result: incomplete -> fail 2026-03-28 18:18:54,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:18:54,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81708123b47fd2377077e HTTP/1.1" 200 None 2026-03-28 18:18:54,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:18:54,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 18:18:54,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:18:54,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81708123b47fd2377077e HTTP/1.1" 200 None 2026-03-28 18:18:54,449 - lava_callback - INFO - Completed processing callback for node 69c81708123b47fd2377077e INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:18:57,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:18:57,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33850 - "GET /node/6991f80101ff1e8e0859d4b3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39478 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:19:53,460 - lava_callback - INFO - Received callback for node 69c8172b123b47fd2377078d INFO: 172.21.0.1:39484 - "POST /node/69c8172b123b47fd2377078d HTTP/1.0" 202 Accepted 2026-03-28 18:19:53,469 - lava_callback - INFO - Starting async job submit for node 69c8172b123b47fd2377078d 2026-03-28 18:19:53,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:19:53,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8172b123b47fd2377078d HTTP/1.1" 200 None 2026-03-28 18:19:53,528 - lava_callback - DEBUG - Processing node 69c8172b123b47fd2377078d: baseline-nfs-arm64 2026-03-28 18:19:54,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:19:54,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:19:54,808 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8172b123b47fd2377078d/log.txt.gz 2026-03-28 18:19:55,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:19:55,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:19:55,679 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8172b123b47fd2377078d/lava-logs.yaml 2026-03-28 18:19:55,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:19:55,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:19:55,867 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c8172b123b47fd2377078d/lava_callback.json.gz DEBUG: Setup failed for 69c8172b123b47fd2377078d. Transitting job node result: incomplete -> fail 2026-03-28 18:19:55,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:19:55,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8172b123b47fd2377078d HTTP/1.1" 200 None 2026-03-28 18:19:55,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:19:56,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 18:19:56,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:19:56,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8172b123b47fd2377078d HTTP/1.1" 200 None 2026-03-28 18:19:56,135 - lava_callback - INFO - Completed processing callback for node 69c8172b123b47fd2377078d INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:19:57,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:19:57,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:31:29,997 - lava_callback - INFO - Received callback for node 69c81a4a123b47fd23770820 INFO: 172.21.0.1:36664 - "POST /node/69c81a4a123b47fd23770820 HTTP/1.0" 202 Accepted 2026-03-28 18:31:30,005 - lava_callback - INFO - Starting async job submit for node 69c81a4a123b47fd23770820 2026-03-28 18:31:30,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:31:30,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81a4a123b47fd23770820 HTTP/1.1" 200 None 2026-03-28 18:31:30,078 - lava_callback - DEBUG - Processing node 69c81a4a123b47fd23770820: ltp-smoke 2026-03-28 18:31:30,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:31:30,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:31:30,704 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c81a4a123b47fd23770820/log.txt.gz 2026-03-28 18:31:30,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:31:31,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:31:31,187 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c81a4a123b47fd23770820/lava-logs.yaml 2026-03-28 18:31:31,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:31:31,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:31:31,393 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c81a4a123b47fd23770820/lava_callback.json.gz 2026-03-28 18:31:31,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:31:31,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81a4a123b47fd23770820 HTTP/1.1" 200 None 2026-03-28 18:31:31,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:31:31,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff48123b47fd2376d751 HTTP/1.1" 200 None 2026-03-28 18:31:31,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:31:31,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81a4a123b47fd23770820 HTTP/1.1" 200 None 2026-03-28 18:31:31,744 - lava_callback - INFO - Completed processing callback for node 69c81a4a123b47fd23770820 INFO: 172.21.0.1:36666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43782 - "GET /node/6988c8b49fc35f969e1eefcc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42918 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:31:57,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:31:57,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET /node/6990095076d4b6342e9dd484%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46702 - "GET /node/693af1c1fee8383e92b69ff7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46710 - "GET /node/698eda67db401c547d573dfc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET /node/698ef1bbf0e3ffbba67d2b74%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46262 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:39:04,595 - lava_callback - INFO - Received callback for node 69c81c15123b47fd23770882 INFO: 172.21.0.1:34122 - "POST /node/69c81c15123b47fd23770882 HTTP/1.0" 202 Accepted 2026-03-28 18:39:04,601 - lava_callback - INFO - Starting async job submit for node 69c81c15123b47fd23770882 2026-03-28 18:39:04,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:39:04,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81c15123b47fd23770882 HTTP/1.1" 200 None 2026-03-28 18:39:04,670 - lava_callback - DEBUG - Processing node 69c81c15123b47fd23770882: baseline-arm 2026-03-28 18:39:05,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:39:05,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:39:05,411 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c81c15123b47fd23770882/log.txt.gz 2026-03-28 18:39:05,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:39:06,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:39:06,009 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c81c15123b47fd23770882/lava-logs.yaml 2026-03-28 18:39:06,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:39:06,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:39:06,174 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c81c15123b47fd23770882/lava_callback.json.gz DEBUG: Setup failed for 69c81c15123b47fd23770882. Transitting job node result: incomplete -> fail 2026-03-28 18:39:06,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:39:06,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81c15123b47fd23770882 HTTP/1.1" 200 None 2026-03-28 18:39:06,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:39:06,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 18:39:06,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:39:06,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81c15123b47fd23770882 HTTP/1.1" 200 None 2026-03-28 18:39:06,460 - lava_callback - INFO - Completed processing callback for node 69c81c15123b47fd23770882 INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:39:27,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:39:27,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:41:14,024 - lava_callback - INFO - Received callback for node 69c81c43123b47fd23770892 INFO: 172.21.0.1:50974 - "POST /node/69c81c43123b47fd23770892 HTTP/1.0" 202 Accepted 2026-03-28 18:41:14,073 - lava_callback - INFO - Starting async job submit for node 69c81c43123b47fd23770892 2026-03-28 18:41:14,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:41:14,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81c43123b47fd23770892 HTTP/1.1" 200 None 2026-03-28 18:41:14,138 - lava_callback - DEBUG - Processing node 69c81c43123b47fd23770892: baseline-arm-pengutronix 2026-03-28 18:41:14,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:41:14,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:41:14,399 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c81c43123b47fd23770892/log.txt.gz 2026-03-28 18:41:14,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:41:14,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:41:14,798 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c81c43123b47fd23770892/lava-logs.yaml 2026-03-28 18:41:14,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:41:15,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:41:15,088 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c81c43123b47fd23770892/lava_callback.json.gz DEBUG: Setup failed for 69c81c43123b47fd23770892. Transitting job node result: incomplete -> fail 2026-03-28 18:41:15,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:41:15,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81c43123b47fd23770892 HTTP/1.1" 200 None 2026-03-28 18:41:15,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:41:15,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-28 18:41:15,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:50988 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-28 18:41:15,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81c43123b47fd23770892 HTTP/1.1" 200 None 2026-03-28 18:41:15,250 - lava_callback - INFO - Completed processing callback for node 69c81c43123b47fd23770892 INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET /node/6985f9a671989fb14149da48%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:41:27,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:41:27,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37694 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:42:18,637 - lava_callback - INFO - Received callback for node 69c81c64123b47fd237708a1 INFO: 172.21.0.1:37704 - "POST /node/69c81c64123b47fd237708a1 HTTP/1.0" 202 Accepted 2026-03-28 18:42:18,645 - lava_callback - INFO - Starting async job submit for node 69c81c64123b47fd237708a1 2026-03-28 18:42:18,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:42:18,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81c64123b47fd237708a1 HTTP/1.1" 200 None 2026-03-28 18:42:18,720 - lava_callback - DEBUG - Processing node 69c81c64123b47fd237708a1: baseline-nfs-arm64 2026-03-28 18:42:19,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:42:20,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:42:20,051 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c81c64123b47fd237708a1/log.txt.gz 2026-03-28 18:42:20,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:42:20,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:42:20,925 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c81c64123b47fd237708a1/lava-logs.yaml 2026-03-28 18:42:20,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-28 18:42:21,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-28 18:42:21,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c81c64123b47fd237708a1/lava_callback.json.gz DEBUG: Setup failed for 69c81c64123b47fd237708a1. Transitting job node result: incomplete -> fail 2026-03-28 18:42:21,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:42:21,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81c64123b47fd237708a1 HTTP/1.1" 200 None 2026-03-28 18:42:21,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:42:21,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-28 18:42:21,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:42:21,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81c64123b47fd237708a1 HTTP/1.1" 200 None 2026-03-28 18:42:21,349 - lava_callback - INFO - Completed processing callback for node 69c81c64123b47fd237708a1 INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:42:27,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:42:27,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34054 - "GET /node/698c18331e517752bab8eabb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34056 - "GET /node/699c161322d3e3c838d85d3c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50796 - "GET /node/6984614b3a8748f282086537%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52676 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:53:29,172 - lava_callback - INFO - Received callback for node 69c58094abf66a8f4d9bc547 INFO: 172.21.0.1:52678 - "POST /node/69c58094abf66a8f4d9bc547 HTTP/1.0" 202 Accepted 2026-03-28 18:53:29,178 - lava_callback - INFO - Starting async job submit for node 69c58094abf66a8f4d9bc547 2026-03-28 18:53:29,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:53:29,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58094abf66a8f4d9bc547 HTTP/1.1" 200 None 2026-03-28 18:53:29,194 - lava_callback - DEBUG - Processing node 69c58094abf66a8f4d9bc547: baseline-arm-clabbe 2026-03-28 18:53:29,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c58094abf66a8f4d9bc547 2026-03-28 18:53:29,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:53:29,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58094abf66a8f4d9bc547 HTTP/1.1" 200 None 2026-03-28 18:53:29,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:53:29,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47b3b590270ad7b6d698b HTTP/1.1" 200 None 2026-03-28 18:53:29,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:53:29,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c58094abf66a8f4d9bc547 HTTP/1.1" 200 None 2026-03-28 18:53:29,258 - lava_callback - ERROR - Error processing callback for node 69c58094abf66a8f4d9bc547: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38666 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:54:09,163 - lava_callback - INFO - Received callback for node 69c580bfabf66a8f4d9bc551 INFO: 172.21.0.1:38672 - "POST /node/69c580bfabf66a8f4d9bc551 HTTP/1.0" 202 Accepted 2026-03-28 18:54:09,169 - lava_callback - INFO - Starting async job submit for node 69c580bfabf66a8f4d9bc551 2026-03-28 18:54:09,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:54:09,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c580bfabf66a8f4d9bc551 HTTP/1.1" 200 None 2026-03-28 18:54:09,193 - lava_callback - DEBUG - Processing node 69c580bfabf66a8f4d9bc551: baseline-arm-clabbe 2026-03-28 18:54:09,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c580bfabf66a8f4d9bc551 2026-03-28 18:54:09,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:54:09,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c580bfabf66a8f4d9bc551 HTTP/1.1" 200 None 2026-03-28 18:54:09,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:54:09,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47b3b590270ad7b6d698b HTTP/1.1" 200 None 2026-03-28 18:54:09,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:54:09,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c580bfabf66a8f4d9bc551 HTTP/1.1" 200 None 2026-03-28 18:54:09,259 - lava_callback - ERROR - Error processing callback for node 69c580bfabf66a8f4d9bc551: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57692 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:55:09,123 - lava_callback - INFO - Received callback for node 69c580fcabf66a8f4d9bc561 INFO: 172.21.0.1:57702 - "POST /node/69c580fcabf66a8f4d9bc561 HTTP/1.0" 202 Accepted 2026-03-28 18:55:09,129 - lava_callback - INFO - Starting async job submit for node 69c580fcabf66a8f4d9bc561 2026-03-28 18:55:09,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:55:09,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c580fcabf66a8f4d9bc561 HTTP/1.1" 200 None 2026-03-28 18:55:09,145 - lava_callback - DEBUG - Processing node 69c580fcabf66a8f4d9bc561: baseline-arm-clabbe 2026-03-28 18:55:09,145 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c580fcabf66a8f4d9bc561 2026-03-28 18:55:09,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:55:09,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c580fcabf66a8f4d9bc561 HTTP/1.1" 200 None 2026-03-28 18:55:09,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:55:09,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47b3b590270ad7b6d698b HTTP/1.1" 200 None 2026-03-28 18:55:09,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:55:09,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c580fcabf66a8f4d9bc561 HTTP/1.1" 200 None 2026-03-28 18:55:09,217 - lava_callback - ERROR - Error processing callback for node 69c580fcabf66a8f4d9bc561: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:56:09,296 - lava_callback - INFO - Received callback for node 69c58138abf66a8f4d9bc572 INFO: 172.21.0.1:43734 - "POST /node/69c58138abf66a8f4d9bc572 HTTP/1.0" 202 Accepted 2026-03-28 18:56:09,301 - lava_callback - INFO - Starting async job submit for node 69c58138abf66a8f4d9bc572 2026-03-28 18:56:09,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:56:09,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58138abf66a8f4d9bc572 HTTP/1.1" 200 None 2026-03-28 18:56:09,317 - lava_callback - DEBUG - Processing node 69c58138abf66a8f4d9bc572: baseline-arm-clabbe 2026-03-28 18:56:09,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c58138abf66a8f4d9bc572 2026-03-28 18:56:09,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:56:09,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58138abf66a8f4d9bc572 HTTP/1.1" 200 None 2026-03-28 18:56:09,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:56:09,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47b3b590270ad7b6d698b HTTP/1.1" 200 None 2026-03-28 18:56:09,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:56:09,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c58138abf66a8f4d9bc572 HTTP/1.1" 200 None 2026-03-28 18:56:09,369 - lava_callback - ERROR - Error processing callback for node 69c58138abf66a8f4d9bc572: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59744 - "GET / HTTP/1.0" 200 OK 2026-03-28 18:56:49,300 - lava_callback - INFO - Received callback for node 69c58160abf66a8f4d9bc580 INFO: 172.21.0.1:59752 - "POST /node/69c58160abf66a8f4d9bc580 HTTP/1.0" 202 Accepted 2026-03-28 18:56:49,306 - lava_callback - INFO - Starting async job submit for node 69c58160abf66a8f4d9bc580 2026-03-28 18:56:49,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:56:49,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58160abf66a8f4d9bc580 HTTP/1.1" 200 None 2026-03-28 18:56:49,327 - lava_callback - DEBUG - Processing node 69c58160abf66a8f4d9bc580: baseline-arm-clabbe 2026-03-28 18:56:49,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c58160abf66a8f4d9bc580 2026-03-28 18:56:49,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:56:49,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58160abf66a8f4d9bc580 HTTP/1.1" 200 None 2026-03-28 18:56:49,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:56:49,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47b3b590270ad7b6d698b HTTP/1.1" 200 None 2026-03-28 18:56:49,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 18:56:49,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c58160abf66a8f4d9bc580 HTTP/1.1" 200 None 2026-03-28 18:56:49,391 - lava_callback - ERROR - Error processing callback for node 69c58160abf66a8f4d9bc580: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET /node/69885205e408e9ea60fadedf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET /node/698a41d622b4cc0f227b069a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45630 - "GET /node/694cfc4c1b4c04ddf7248c89%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45636 - "GET /node/6949aca9d45a0a86fbe269bd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET /node/6985ea7971989fb14149cbc8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET /node/694bd568c19e09af58d48c93%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET /node/6993d8bb3e9ba49307715be0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET /node/69876b97e31b58f834f19826%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40664 - "GET /node/693fdc41575bc060ce14dfc0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55216 - "GET /node/693ae824fee8383e92b65686%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET / HTTP/1.0" 200 OK 2026-03-28 19:37:07,881 - lava_callback - INFO - Received callback for node 69c58ae1abf66a8f4d9bc618 INFO: 172.21.0.1:59074 - "POST /node/69c58ae1abf66a8f4d9bc618 HTTP/1.0" 202 Accepted 2026-03-28 19:37:07,886 - lava_callback - INFO - Starting async job submit for node 69c58ae1abf66a8f4d9bc618 2026-03-28 19:37:07,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:37:07,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58ae1abf66a8f4d9bc618 HTTP/1.1" 200 None 2026-03-28 19:37:07,903 - lava_callback - DEBUG - Processing node 69c58ae1abf66a8f4d9bc618: baseline-arm64-baylibre 2026-03-28 19:37:07,903 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c58ae1abf66a8f4d9bc618 2026-03-28 19:37:07,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:37:07,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58ae1abf66a8f4d9bc618 HTTP/1.1" 200 None 2026-03-28 19:37:07,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:37:07,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47b4a590270ad7b6d699d HTTP/1.1" 200 None 2026-03-28 19:37:07,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:37:07,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c58ae1abf66a8f4d9bc618 HTTP/1.1" 200 None 2026-03-28 19:37:07,959 - lava_callback - ERROR - Error processing callback for node 69c58ae1abf66a8f4d9bc618: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK 2026-03-28 19:38:51,253 - lava_callback - INFO - Received callback for node 69c58b3aabf66a8f4d9bc623 INFO: 172.21.0.1:32908 - "POST /node/69c58b3aabf66a8f4d9bc623 HTTP/1.0" 202 Accepted 2026-03-28 19:38:51,259 - lava_callback - INFO - Starting async job submit for node 69c58b3aabf66a8f4d9bc623 2026-03-28 19:38:51,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:38:51,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58b3aabf66a8f4d9bc623 HTTP/1.1" 200 None 2026-03-28 19:38:51,275 - lava_callback - DEBUG - Processing node 69c58b3aabf66a8f4d9bc623: baseline-arm64-clabbe 2026-03-28 19:38:51,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c58b3aabf66a8f4d9bc623 2026-03-28 19:38:51,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:38:51,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58b3aabf66a8f4d9bc623 HTTP/1.1" 200 None 2026-03-28 19:38:51,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:38:51,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47b4a590270ad7b6d699d HTTP/1.1" 200 None 2026-03-28 19:38:51,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:38:51,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c58b3aabf66a8f4d9bc623 HTTP/1.1" 200 None 2026-03-28 19:38:51,339 - lava_callback - ERROR - Error processing callback for node 69c58b3aabf66a8f4d9bc623: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49386 - "GET / HTTP/1.0" 200 OK 2026-03-28 19:41:31,312 - lava_callback - INFO - Received callback for node 69c58bd7abf66a8f4d9bc634 INFO: 172.21.0.1:58298 - "POST /node/69c58bd7abf66a8f4d9bc634 HTTP/1.0" 202 Accepted 2026-03-28 19:41:31,317 - lava_callback - INFO - Starting async job submit for node 69c58bd7abf66a8f4d9bc634 2026-03-28 19:41:31,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:41:31,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58bd7abf66a8f4d9bc634 HTTP/1.1" 200 None 2026-03-28 19:41:31,353 - lava_callback - DEBUG - Processing node 69c58bd7abf66a8f4d9bc634: baseline-arm64-clabbe 2026-03-28 19:41:31,354 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c58bd7abf66a8f4d9bc634 2026-03-28 19:41:31,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:41:31,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58bd7abf66a8f4d9bc634 HTTP/1.1" 200 None 2026-03-28 19:41:31,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:41:31,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47b4a590270ad7b6d699d HTTP/1.1" 200 None 2026-03-28 19:41:31,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:41:31,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c58bd7abf66a8f4d9bc634 HTTP/1.1" 200 None 2026-03-28 19:41:31,441 - lava_callback - ERROR - Error processing callback for node 69c58bd7abf66a8f4d9bc634: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK 2026-03-28 19:42:51,335 - lava_callback - INFO - Received callback for node 69c58c2babf66a8f4d9bc63d INFO: 172.21.0.1:50250 - "POST /node/69c58c2babf66a8f4d9bc63d HTTP/1.0" 202 Accepted 2026-03-28 19:42:51,340 - lava_callback - INFO - Starting async job submit for node 69c58c2babf66a8f4d9bc63d 2026-03-28 19:42:51,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:42:51,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58c2babf66a8f4d9bc63d HTTP/1.1" 200 None 2026-03-28 19:42:51,357 - lava_callback - DEBUG - Processing node 69c58c2babf66a8f4d9bc63d: baseline-arm64-clabbe 2026-03-28 19:42:51,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c58c2babf66a8f4d9bc63d 2026-03-28 19:42:51,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:42:51,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58c2babf66a8f4d9bc63d HTTP/1.1" 200 None 2026-03-28 19:42:51,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:42:51,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47b4a590270ad7b6d699d HTTP/1.1" 200 None 2026-03-28 19:42:51,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:42:51,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c58c2babf66a8f4d9bc63d HTTP/1.1" 200 None 2026-03-28 19:42:51,437 - lava_callback - ERROR - Error processing callback for node 69c58c2babf66a8f4d9bc63d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK 2026-03-28 19:45:31,544 - lava_callback - INFO - Received callback for node 69c58cc7abf66a8f4d9bc64e INFO: 172.21.0.1:49446 - "POST /node/69c58cc7abf66a8f4d9bc64e HTTP/1.0" 202 Accepted 2026-03-28 19:45:31,550 - lava_callback - INFO - Starting async job submit for node 69c58cc7abf66a8f4d9bc64e 2026-03-28 19:45:31,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:45:31,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58cc7abf66a8f4d9bc64e HTTP/1.1" 200 None 2026-03-28 19:45:31,566 - lava_callback - DEBUG - Processing node 69c58cc7abf66a8f4d9bc64e: baseline-arm64-clabbe 2026-03-28 19:45:31,566 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c58cc7abf66a8f4d9bc64e 2026-03-28 19:45:31,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:45:31,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58cc7abf66a8f4d9bc64e HTTP/1.1" 200 None 2026-03-28 19:45:31,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:45:31,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47b4a590270ad7b6d699d HTTP/1.1" 200 None 2026-03-28 19:45:31,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:45:31,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c58cc7abf66a8f4d9bc64e HTTP/1.1" 200 None 2026-03-28 19:45:31,622 - lava_callback - ERROR - Error processing callback for node 69c58cc7abf66a8f4d9bc64e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET / HTTP/1.0" 200 OK 2026-03-28 19:47:31,528 - lava_callback - INFO - Received callback for node 69c58d40abf66a8f4d9bc65b INFO: 172.21.0.1:43450 - "POST /node/69c58d40abf66a8f4d9bc65b HTTP/1.0" 202 Accepted 2026-03-28 19:47:31,533 - lava_callback - INFO - Starting async job submit for node 69c58d40abf66a8f4d9bc65b 2026-03-28 19:47:31,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:47:31,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58d40abf66a8f4d9bc65b HTTP/1.1" 200 None 2026-03-28 19:47:31,551 - lava_callback - DEBUG - Processing node 69c58d40abf66a8f4d9bc65b: baseline-arm64-clabbe 2026-03-28 19:47:31,551 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c58d40abf66a8f4d9bc65b 2026-03-28 19:47:31,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:47:31,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58d40abf66a8f4d9bc65b HTTP/1.1" 200 None 2026-03-28 19:47:31,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:47:31,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47b4a590270ad7b6d699d HTTP/1.1" 200 None 2026-03-28 19:47:31,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:47:31,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c58d40abf66a8f4d9bc65b HTTP/1.1" 200 None 2026-03-28 19:47:31,626 - lava_callback - ERROR - Error processing callback for node 69c58d40abf66a8f4d9bc65b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45856 - "GET / HTTP/1.0" 200 OK 2026-03-28 19:48:51,620 - lava_callback - INFO - Received callback for node 69c58d92abf66a8f4d9bc663 INFO: 172.21.0.1:39914 - "POST /node/69c58d92abf66a8f4d9bc663 HTTP/1.0" 202 Accepted 2026-03-28 19:48:51,626 - lava_callback - INFO - Starting async job submit for node 69c58d92abf66a8f4d9bc663 2026-03-28 19:48:51,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:48:51,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58d92abf66a8f4d9bc663 HTTP/1.1" 200 None 2026-03-28 19:48:51,654 - lava_callback - DEBUG - Processing node 69c58d92abf66a8f4d9bc663: baseline-arm64-clabbe 2026-03-28 19:48:51,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c58d92abf66a8f4d9bc663 2026-03-28 19:48:51,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:48:51,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c58d92abf66a8f4d9bc663 HTTP/1.1" 200 None 2026-03-28 19:48:51,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:48:51,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47b4a590270ad7b6d699d HTTP/1.1" 200 None 2026-03-28 19:48:51,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 19:48:51,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c58d92abf66a8f4d9bc663 HTTP/1.1" 200 None 2026-03-28 19:48:51,705 - lava_callback - ERROR - Error processing callback for node 69c58d92abf66a8f4d9bc663: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET /node/69c16cc52b2b51e9ad97a0ec%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51404 - "GET /node/698b62b00a16aea5a0dc6d44%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET /node/694bd895c19e09af58d497e3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET /node/694c4fb52f7ca341fdeb47b3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39698 - "GET /node/69877842e31b58f834f1ad9e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET /node/69a3220114c84a8c43f97e6f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET /node/6985c7fa71989fb141498a70%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39688 - "GET /node/69402dea575bc060ce155dd5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46652 - "GET /node/69870f9e6e077e4126a7edd4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38370 - "GET /node/69a62d0a7da105ad098359ec%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33788 - "GET /node/694bc95cc19e09af58d46e81%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48456 - "GET /node/6940c37a1e3c24e95681d000%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44498 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:45:54,061 - lava_callback - INFO - Received callback for node 69c59af5abf66a8f4d9bc6e2 INFO: 172.21.0.1:44512 - "POST /node/69c59af5abf66a8f4d9bc6e2 HTTP/1.0" 202 Accepted 2026-03-28 20:45:54,067 - lava_callback - INFO - Starting async job submit for node 69c59af5abf66a8f4d9bc6e2 2026-03-28 20:45:54,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:45:54,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59af5abf66a8f4d9bc6e2 HTTP/1.1" 200 None 2026-03-28 20:45:54,084 - lava_callback - DEBUG - Processing node 69c59af5abf66a8f4d9bc6e2: baseline-arm-clabbe 2026-03-28 20:45:54,084 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59af5abf66a8f4d9bc6e2 2026-03-28 20:45:54,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:45:54,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59af5abf66a8f4d9bc6e2 HTTP/1.1" 200 None 2026-03-28 20:45:54,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:45:54,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-28 20:45:54,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:45:54,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59af5abf66a8f4d9bc6e2 HTTP/1.1" 200 None 2026-03-28 20:45:54,145 - lava_callback - ERROR - Error processing callback for node 69c59af5abf66a8f4d9bc6e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:46:34,030 - lava_callback - INFO - Received callback for node 69c59b1dabf66a8f4d9bc6ef INFO: 172.21.0.1:49214 - "POST /node/69c59b1dabf66a8f4d9bc6ef HTTP/1.0" 202 Accepted 2026-03-28 20:46:34,035 - lava_callback - INFO - Starting async job submit for node 69c59b1dabf66a8f4d9bc6ef 2026-03-28 20:46:34,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:46:34,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59b1dabf66a8f4d9bc6ef HTTP/1.1" 200 None 2026-03-28 20:46:34,079 - lava_callback - DEBUG - Processing node 69c59b1dabf66a8f4d9bc6ef: baseline-arm-clabbe 2026-03-28 20:46:34,079 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59b1dabf66a8f4d9bc6ef 2026-03-28 20:46:34,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:46:34,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59b1dabf66a8f4d9bc6ef HTTP/1.1" 200 None 2026-03-28 20:46:34,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:46:34,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-28 20:46:34,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:46:34,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59b1dabf66a8f4d9bc6ef HTTP/1.1" 200 None 2026-03-28 20:46:34,130 - lava_callback - ERROR - Error processing callback for node 69c59b1dabf66a8f4d9bc6ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:47:11,734 - lava_callback - INFO - Received callback for node 69c59b3fabf66a8f4d9bc6fe INFO: 172.21.0.1:38534 - "POST /node/69c59b3fabf66a8f4d9bc6fe HTTP/1.0" 202 Accepted 2026-03-28 20:47:11,740 - lava_callback - INFO - Starting async job submit for node 69c59b3fabf66a8f4d9bc6fe 2026-03-28 20:47:11,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:47:11,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59b3fabf66a8f4d9bc6fe HTTP/1.1" 200 None 2026-03-28 20:47:11,756 - lava_callback - DEBUG - Processing node 69c59b3fabf66a8f4d9bc6fe: baseline-arm-baylibre 2026-03-28 20:47:11,756 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59b3fabf66a8f4d9bc6fe 2026-03-28 20:47:11,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:47:11,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59b3fabf66a8f4d9bc6fe HTTP/1.1" 200 None 2026-03-28 20:47:11,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:47:11,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:47:11,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:47:11,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59b3fabf66a8f4d9bc6fe HTTP/1.1" 200 None 2026-03-28 20:47:11,814 - lava_callback - ERROR - Error processing callback for node 69c59b3fabf66a8f4d9bc6fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46902 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:47:51,696 - lava_callback - INFO - Received callback for node 69c59b67abf66a8f4d9bc70b INFO: 172.21.0.1:33520 - "POST /node/69c59b67abf66a8f4d9bc70b HTTP/1.0" 202 Accepted 2026-03-28 20:47:51,701 - lava_callback - INFO - Starting async job submit for node 69c59b67abf66a8f4d9bc70b 2026-03-28 20:47:51,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:47:51,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59b67abf66a8f4d9bc70b HTTP/1.1" 200 None 2026-03-28 20:47:51,717 - lava_callback - DEBUG - Processing node 69c59b67abf66a8f4d9bc70b: baseline-arm-baylibre 2026-03-28 20:47:51,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59b67abf66a8f4d9bc70b 2026-03-28 20:47:51,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:47:51,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59b67abf66a8f4d9bc70b HTTP/1.1" 200 None 2026-03-28 20:47:51,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:47:51,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:47:51,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:47:51,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59b67abf66a8f4d9bc70b HTTP/1.1" 200 None 2026-03-28 20:47:51,779 - lava_callback - ERROR - Error processing callback for node 69c59b67abf66a8f4d9bc70b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:48:34,168 - lava_callback - INFO - Received callback for node 69c59b98abf66a8f4d9bc71d INFO: 172.21.0.1:46620 - "POST /node/69c59b98abf66a8f4d9bc71d HTTP/1.0" 202 Accepted 2026-03-28 20:48:34,173 - lava_callback - INFO - Starting async job submit for node 69c59b98abf66a8f4d9bc71d 2026-03-28 20:48:34,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:48:34,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59b98abf66a8f4d9bc71d HTTP/1.1" 200 None 2026-03-28 20:48:34,190 - lava_callback - DEBUG - Processing node 69c59b98abf66a8f4d9bc71d: baseline-arm-clabbe 2026-03-28 20:48:34,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59b98abf66a8f4d9bc71d 2026-03-28 20:48:34,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:48:34,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59b98abf66a8f4d9bc71d HTTP/1.1" 200 None 2026-03-28 20:48:34,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:48:34,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-28 20:48:34,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:48:34,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59b98abf66a8f4d9bc71d HTTP/1.1" 200 None 2026-03-28 20:48:34,248 - lava_callback - ERROR - Error processing callback for node 69c59b98abf66a8f4d9bc71d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET /node/6990b18dc45febfe44523004%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:49:11,814 - lava_callback - INFO - Received callback for node 69c59bbcabf66a8f4d9bc734 INFO: 172.21.0.1:60962 - "POST /node/69c59bbcabf66a8f4d9bc734 HTTP/1.0" 202 Accepted 2026-03-28 20:49:11,820 - lava_callback - INFO - Starting async job submit for node 69c59bbcabf66a8f4d9bc734 2026-03-28 20:49:11,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:49:11,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59bbcabf66a8f4d9bc734 HTTP/1.1" 200 None 2026-03-28 20:49:11,836 - lava_callback - DEBUG - Processing node 69c59bbcabf66a8f4d9bc734: baseline-arm-baylibre 2026-03-28 20:49:11,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59bbcabf66a8f4d9bc734 2026-03-28 20:49:11,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:49:11,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59bbcabf66a8f4d9bc734 HTTP/1.1" 200 None 2026-03-28 20:49:11,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:49:11,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:49:11,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:49:11,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59bbcabf66a8f4d9bc734 HTTP/1.1" 200 None 2026-03-28 20:49:11,897 - lava_callback - ERROR - Error processing callback for node 69c59bbcabf66a8f4d9bc734: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42990 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:49:54,235 - lava_callback - INFO - Received callback for node 69c59be8abf66a8f4d9bc741 INFO: 172.21.0.1:43000 - "POST /node/69c59be8abf66a8f4d9bc741 HTTP/1.0" 202 Accepted 2026-03-28 20:49:54,241 - lava_callback - INFO - Starting async job submit for node 69c59be8abf66a8f4d9bc741 2026-03-28 20:49:54,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:49:54,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59be8abf66a8f4d9bc741 HTTP/1.1" 200 None 2026-03-28 20:49:54,256 - lava_callback - DEBUG - Processing node 69c59be8abf66a8f4d9bc741: baseline-arm-clabbe 2026-03-28 20:49:54,257 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59be8abf66a8f4d9bc741 2026-03-28 20:49:54,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:49:54,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59be8abf66a8f4d9bc741 HTTP/1.1" 200 None 2026-03-28 20:49:54,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:49:54,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-28 20:49:54,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:49:54,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59be8abf66a8f4d9bc741 HTTP/1.1" 200 None 2026-03-28 20:49:54,321 - lava_callback - ERROR - Error processing callback for node 69c59be8abf66a8f4d9bc741: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33398 - "GET /node/69936465cebe99dd8e0644d6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41322 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:50:34,185 - lava_callback - INFO - Received callback for node 69c59c0fabf66a8f4d9bc753 INFO: 172.21.0.1:46168 - "POST /node/69c59c0fabf66a8f4d9bc753 HTTP/1.0" 202 Accepted 2026-03-28 20:50:34,191 - lava_callback - INFO - Starting async job submit for node 69c59c0fabf66a8f4d9bc753 2026-03-28 20:50:34,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:50:34,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59c0fabf66a8f4d9bc753 HTTP/1.1" 200 None 2026-03-28 20:50:34,207 - lava_callback - DEBUG - Processing node 69c59c0fabf66a8f4d9bc753: baseline-arm-clabbe 2026-03-28 20:50:34,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59c0fabf66a8f4d9bc753 2026-03-28 20:50:34,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:50:34,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59c0fabf66a8f4d9bc753 HTTP/1.1" 200 None 2026-03-28 20:50:34,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:50:34,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-28 20:50:34,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:50:34,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59c0fabf66a8f4d9bc753 HTTP/1.1" 200 None 2026-03-28 20:50:34,264 - lava_callback - ERROR - Error processing callback for node 69c59c0fabf66a8f4d9bc753: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50912 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:51:11,904 - lava_callback - INFO - Received callback for node 69c59c33abf66a8f4d9bc761 INFO: 172.21.0.1:35616 - "POST /node/69c59c33abf66a8f4d9bc761 HTTP/1.0" 202 Accepted 2026-03-28 20:51:11,910 - lava_callback - INFO - Starting async job submit for node 69c59c33abf66a8f4d9bc761 2026-03-28 20:51:11,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:51:11,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59c33abf66a8f4d9bc761 HTTP/1.1" 200 None 2026-03-28 20:51:11,930 - lava_callback - DEBUG - Processing node 69c59c33abf66a8f4d9bc761: baseline-arm-baylibre 2026-03-28 20:51:11,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59c33abf66a8f4d9bc761 2026-03-28 20:51:11,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:51:11,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59c33abf66a8f4d9bc761 HTTP/1.1" 200 None 2026-03-28 20:51:11,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:51:11,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:51:11,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:51:11,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59c33abf66a8f4d9bc761 HTTP/1.1" 200 None 2026-03-28 20:51:11,988 - lava_callback - ERROR - Error processing callback for node 69c59c33abf66a8f4d9bc761: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50726 - "GET /node/698af6a83b3beb19e76171e4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:51:51,927 - lava_callback - INFO - Received callback for node 69c59c5dabf66a8f4d9bc772 INFO: 172.21.0.1:48938 - "POST /node/69c59c5dabf66a8f4d9bc772 HTTP/1.0" 202 Accepted 2026-03-28 20:51:51,932 - lava_callback - INFO - Starting async job submit for node 69c59c5dabf66a8f4d9bc772 2026-03-28 20:51:51,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:51:51,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59c5dabf66a8f4d9bc772 HTTP/1.1" 200 None 2026-03-28 20:51:51,955 - lava_callback - DEBUG - Processing node 69c59c5dabf66a8f4d9bc772: baseline-arm-baylibre 2026-03-28 20:51:51,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59c5dabf66a8f4d9bc772 2026-03-28 20:51:51,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:51:51,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59c5dabf66a8f4d9bc772 HTTP/1.1" 200 None 2026-03-28 20:51:51,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:51:51,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:51:51,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:51:52,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59c5dabf66a8f4d9bc772 HTTP/1.1" 200 None 2026-03-28 20:51:52,027 - lava_callback - ERROR - Error processing callback for node 69c59c5dabf66a8f4d9bc772: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:53:12,056 - lava_callback - INFO - Received callback for node 69c59ca9abf66a8f4d9bc793 INFO: 172.21.0.1:33446 - "POST /node/69c59ca9abf66a8f4d9bc793 HTTP/1.0" 202 Accepted 2026-03-28 20:53:12,062 - lava_callback - INFO - Starting async job submit for node 69c59ca9abf66a8f4d9bc793 2026-03-28 20:53:12,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:53:12,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59ca9abf66a8f4d9bc793 HTTP/1.1" 200 None 2026-03-28 20:53:12,078 - lava_callback - DEBUG - Processing node 69c59ca9abf66a8f4d9bc793: baseline-arm-baylibre 2026-03-28 20:53:12,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59ca9abf66a8f4d9bc793 2026-03-28 20:53:12,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:53:12,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59ca9abf66a8f4d9bc793 HTTP/1.1" 200 None 2026-03-28 20:53:12,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:53:12,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:53:12,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:53:12,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59ca9abf66a8f4d9bc793 HTTP/1.1" 200 None 2026-03-28 20:53:12,138 - lava_callback - ERROR - Error processing callback for node 69c59ca9abf66a8f4d9bc793: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44944 - "GET /node/6981b6eef633e773758f9ef1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:54:52,156 - lava_callback - INFO - Received callback for node 69c59d18abf66a8f4d9bc7b6 INFO: 172.21.0.1:58984 - "POST /node/69c59d18abf66a8f4d9bc7b6 HTTP/1.0" 202 Accepted 2026-03-28 20:54:52,162 - lava_callback - INFO - Starting async job submit for node 69c59d18abf66a8f4d9bc7b6 2026-03-28 20:54:52,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:54:52,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59d18abf66a8f4d9bc7b6 HTTP/1.1" 200 None 2026-03-28 20:54:52,181 - lava_callback - DEBUG - Processing node 69c59d18abf66a8f4d9bc7b6: baseline-arm-baylibre 2026-03-28 20:54:52,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59d18abf66a8f4d9bc7b6 2026-03-28 20:54:52,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:54:52,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59d18abf66a8f4d9bc7b6 HTTP/1.1" 200 None 2026-03-28 20:54:52,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:54:52,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:54:52,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:54:52,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59d18abf66a8f4d9bc7b6 HTTP/1.1" 200 None 2026-03-28 20:54:52,239 - lava_callback - ERROR - Error processing callback for node 69c59d18abf66a8f4d9bc7b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46398 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:55:34,485 - lava_callback - INFO - Received callback for node 69c59d43abf66a8f4d9bc7c2 INFO: 172.21.0.1:45230 - "POST /node/69c59d43abf66a8f4d9bc7c2 HTTP/1.0" 202 Accepted 2026-03-28 20:55:34,490 - lava_callback - INFO - Starting async job submit for node 69c59d43abf66a8f4d9bc7c2 2026-03-28 20:55:34,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:55:34,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59d43abf66a8f4d9bc7c2 HTTP/1.1" 200 None 2026-03-28 20:55:34,505 - lava_callback - DEBUG - Processing node 69c59d43abf66a8f4d9bc7c2: baseline-arm-clabbe 2026-03-28 20:55:34,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59d43abf66a8f4d9bc7c2 2026-03-28 20:55:34,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:55:34,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59d43abf66a8f4d9bc7c2 HTTP/1.1" 200 None 2026-03-28 20:55:34,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:55:34,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:55:34,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:55:34,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59d43abf66a8f4d9bc7c2 HTTP/1.1" 200 None 2026-03-28 20:55:34,564 - lava_callback - ERROR - Error processing callback for node 69c59d43abf66a8f4d9bc7c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50186 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:56:14,462 - lava_callback - INFO - Received callback for node 69c59d6aabf66a8f4d9bc7d9 INFO: 172.21.0.1:49628 - "POST /node/69c59d6aabf66a8f4d9bc7d9 HTTP/1.0" 202 Accepted 2026-03-28 20:56:14,468 - lava_callback - INFO - Starting async job submit for node 69c59d6aabf66a8f4d9bc7d9 2026-03-28 20:56:14,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:56:14,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59d6aabf66a8f4d9bc7d9 HTTP/1.1" 200 None 2026-03-28 20:56:14,484 - lava_callback - DEBUG - Processing node 69c59d6aabf66a8f4d9bc7d9: baseline-arm-clabbe 2026-03-28 20:56:14,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59d6aabf66a8f4d9bc7d9 2026-03-28 20:56:14,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:56:14,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59d6aabf66a8f4d9bc7d9 HTTP/1.1" 200 None 2026-03-28 20:56:14,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:56:14,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:56:14,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:56:14,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59d6aabf66a8f4d9bc7d9 HTTP/1.1" 200 None 2026-03-28 20:56:14,542 - lava_callback - ERROR - Error processing callback for node 69c59d6aabf66a8f4d9bc7d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53796 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:56:52,284 - lava_callback - INFO - Received callback for node 69c59d8eabf66a8f4d9bc7e0 INFO: 172.21.0.1:39416 - "POST /node/69c59d8eabf66a8f4d9bc7e0 HTTP/1.0" 202 Accepted 2026-03-28 20:56:52,289 - lava_callback - INFO - Starting async job submit for node 69c59d8eabf66a8f4d9bc7e0 2026-03-28 20:56:52,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:56:52,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59d8eabf66a8f4d9bc7e0 HTTP/1.1" 200 None 2026-03-28 20:56:52,310 - lava_callback - DEBUG - Processing node 69c59d8eabf66a8f4d9bc7e0: baseline-arm-baylibre 2026-03-28 20:56:52,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59d8eabf66a8f4d9bc7e0 2026-03-28 20:56:52,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:56:52,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59d8eabf66a8f4d9bc7e0 HTTP/1.1" 200 None 2026-03-28 20:56:52,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:56:52,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:56:52,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:56:52,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59d8eabf66a8f4d9bc7e0 HTTP/1.1" 200 None 2026-03-28 20:56:52,375 - lava_callback - ERROR - Error processing callback for node 69c59d8eabf66a8f4d9bc7e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51142 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:57:32,246 - lava_callback - INFO - Received callback for node 69c59db5abf66a8f4d9bc7ef INFO: 172.21.0.1:33428 - "POST /node/69c59db5abf66a8f4d9bc7ef HTTP/1.0" 202 Accepted 2026-03-28 20:57:32,251 - lava_callback - INFO - Starting async job submit for node 69c59db5abf66a8f4d9bc7ef 2026-03-28 20:57:32,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:57:32,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59db5abf66a8f4d9bc7ef HTTP/1.1" 200 None 2026-03-28 20:57:32,269 - lava_callback - DEBUG - Processing node 69c59db5abf66a8f4d9bc7ef: baseline-arm-baylibre 2026-03-28 20:57:32,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59db5abf66a8f4d9bc7ef 2026-03-28 20:57:32,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:57:32,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59db5abf66a8f4d9bc7ef HTTP/1.1" 200 None 2026-03-28 20:57:32,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:57:32,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:57:32,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:57:32,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59db5abf66a8f4d9bc7ef HTTP/1.1" 200 None 2026-03-28 20:57:32,326 - lava_callback - ERROR - Error processing callback for node 69c59db5abf66a8f4d9bc7ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52194 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:58:14,583 - lava_callback - INFO - Received callback for node 69c59ddeabf66a8f4d9bc803 INFO: 172.21.0.1:60490 - "POST /node/69c59ddeabf66a8f4d9bc803 HTTP/1.0" 202 Accepted 2026-03-28 20:58:14,590 - lava_callback - INFO - Starting async job submit for node 69c59ddeabf66a8f4d9bc803 2026-03-28 20:58:14,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:58:14,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59ddeabf66a8f4d9bc803 HTTP/1.1" 200 None 2026-03-28 20:58:14,609 - lava_callback - DEBUG - Processing node 69c59ddeabf66a8f4d9bc803: baseline-arm-clabbe 2026-03-28 20:58:14,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59ddeabf66a8f4d9bc803 2026-03-28 20:58:14,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:58:14,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59ddeabf66a8f4d9bc803 HTTP/1.1" 200 None 2026-03-28 20:58:14,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:58:14,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:58:14,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:58:14,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59ddeabf66a8f4d9bc803 HTTP/1.1" 200 None 2026-03-28 20:58:14,673 - lava_callback - ERROR - Error processing callback for node 69c59ddeabf66a8f4d9bc803: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37956 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:58:54,569 - lava_callback - INFO - Received callback for node 69c59e06abf66a8f4d9bc80a INFO: 172.21.0.1:37972 - "POST /node/69c59e06abf66a8f4d9bc80a HTTP/1.0" 202 Accepted 2026-03-28 20:58:54,575 - lava_callback - INFO - Starting async job submit for node 69c59e06abf66a8f4d9bc80a 2026-03-28 20:58:54,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:58:54,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59e06abf66a8f4d9bc80a HTTP/1.1" 200 None 2026-03-28 20:58:54,591 - lava_callback - DEBUG - Processing node 69c59e06abf66a8f4d9bc80a: baseline-arm-clabbe 2026-03-28 20:58:54,591 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59e06abf66a8f4d9bc80a 2026-03-28 20:58:54,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:58:54,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59e06abf66a8f4d9bc80a HTTP/1.1" 200 None 2026-03-28 20:58:54,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:58:54,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:58:54,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:58:54,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59e06abf66a8f4d9bc80a HTTP/1.1" 200 None 2026-03-28 20:58:54,642 - lava_callback - ERROR - Error processing callback for node 69c59e06abf66a8f4d9bc80a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK 2026-03-28 20:59:34,606 - lava_callback - INFO - Received callback for node 69c59e2eabf66a8f4d9bc819 INFO: 172.21.0.1:41962 - "POST /node/69c59e2eabf66a8f4d9bc819 HTTP/1.0" 202 Accepted 2026-03-28 20:59:34,612 - lava_callback - INFO - Starting async job submit for node 69c59e2eabf66a8f4d9bc819 2026-03-28 20:59:34,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:59:34,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59e2eabf66a8f4d9bc819 HTTP/1.1" 200 None 2026-03-28 20:59:34,636 - lava_callback - DEBUG - Processing node 69c59e2eabf66a8f4d9bc819: baseline-arm-clabbe 2026-03-28 20:59:34,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59e2eabf66a8f4d9bc819 2026-03-28 20:59:34,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:59:34,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59e2eabf66a8f4d9bc819 HTTP/1.1" 200 None 2026-03-28 20:59:34,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:59:34,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 20:59:34,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 20:59:34,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59e2eabf66a8f4d9bc819 HTTP/1.1" 200 None 2026-03-28 20:59:34,709 - lava_callback - ERROR - Error processing callback for node 69c59e2eabf66a8f4d9bc819: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:00:14,719 - lava_callback - INFO - Received callback for node 69c59e55abf66a8f4d9bc82b INFO: 172.21.0.1:44094 - "POST /node/69c59e55abf66a8f4d9bc82b HTTP/1.0" 202 Accepted 2026-03-28 21:00:14,725 - lava_callback - INFO - Starting async job submit for node 69c59e55abf66a8f4d9bc82b 2026-03-28 21:00:14,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:00:14,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59e55abf66a8f4d9bc82b HTTP/1.1" 200 None 2026-03-28 21:00:14,759 - lava_callback - DEBUG - Processing node 69c59e55abf66a8f4d9bc82b: baseline-arm-clabbe 2026-03-28 21:00:14,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59e55abf66a8f4d9bc82b 2026-03-28 21:00:14,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:00:14,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59e55abf66a8f4d9bc82b HTTP/1.1" 200 None 2026-03-28 21:00:14,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:00:14,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 21:00:14,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:00:14,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59e55abf66a8f4d9bc82b HTTP/1.1" 200 None 2026-03-28 21:00:14,822 - lava_callback - ERROR - Error processing callback for node 69c59e55abf66a8f4d9bc82b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:00:54,702 - lava_callback - INFO - Received callback for node 69c59e7fabf66a8f4d9bc837 INFO: 172.21.0.1:47678 - "POST /node/69c59e7fabf66a8f4d9bc837 HTTP/1.0" 202 Accepted 2026-03-28 21:00:54,708 - lava_callback - INFO - Starting async job submit for node 69c59e7fabf66a8f4d9bc837 2026-03-28 21:00:54,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:00:54,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59e7fabf66a8f4d9bc837 HTTP/1.1" 200 None 2026-03-28 21:00:54,722 - lava_callback - DEBUG - Processing node 69c59e7fabf66a8f4d9bc837: baseline-arm-clabbe 2026-03-28 21:00:54,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59e7fabf66a8f4d9bc837 2026-03-28 21:00:54,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:00:54,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59e7fabf66a8f4d9bc837 HTTP/1.1" 200 None 2026-03-28 21:00:54,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:00:54,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 21:00:54,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:00:54,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59e7fabf66a8f4d9bc837 HTTP/1.1" 200 None 2026-03-28 21:00:54,774 - lava_callback - ERROR - Error processing callback for node 69c59e7fabf66a8f4d9bc837: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45426 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:01:34,658 - lava_callback - INFO - Received callback for node 69c59ea6abf66a8f4d9bc846 INFO: 172.21.0.1:54922 - "POST /node/69c59ea6abf66a8f4d9bc846 HTTP/1.0" 202 Accepted 2026-03-28 21:01:34,663 - lava_callback - INFO - Starting async job submit for node 69c59ea6abf66a8f4d9bc846 2026-03-28 21:01:34,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:01:34,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59ea6abf66a8f4d9bc846 HTTP/1.1" 200 None 2026-03-28 21:01:34,680 - lava_callback - DEBUG - Processing node 69c59ea6abf66a8f4d9bc846: baseline-arm-clabbe 2026-03-28 21:01:34,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59ea6abf66a8f4d9bc846 2026-03-28 21:01:34,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:01:34,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59ea6abf66a8f4d9bc846 HTTP/1.1" 200 None 2026-03-28 21:01:34,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:01:34,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 21:01:34,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:01:34,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59ea6abf66a8f4d9bc846 HTTP/1.1" 200 None 2026-03-28 21:01:34,741 - lava_callback - ERROR - Error processing callback for node 69c59ea6abf66a8f4d9bc846: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:02:12,814 - lava_callback - INFO - Received callback for node 69c59ec8abf66a8f4d9bc856 INFO: 172.21.0.1:56174 - "POST /node/69c59ec8abf66a8f4d9bc856 HTTP/1.0" 202 Accepted 2026-03-28 21:02:12,819 - lava_callback - INFO - Starting async job submit for node 69c59ec8abf66a8f4d9bc856 2026-03-28 21:02:12,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:02:12,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59ec8abf66a8f4d9bc856 HTTP/1.1" 200 None 2026-03-28 21:02:12,835 - lava_callback - DEBUG - Processing node 69c59ec8abf66a8f4d9bc856: baseline-arm-baylibre 2026-03-28 21:02:12,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59ec8abf66a8f4d9bc856 2026-03-28 21:02:12,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:02:12,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59ec8abf66a8f4d9bc856 HTTP/1.1" 200 None 2026-03-28 21:02:12,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:02:12,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 21:02:12,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:02:12,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59ec8abf66a8f4d9bc856 HTTP/1.1" 200 None 2026-03-28 21:02:12,900 - lava_callback - ERROR - Error processing callback for node 69c59ec8abf66a8f4d9bc856: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:02:54,697 - lava_callback - INFO - Received callback for node 69c59ef3abf66a8f4d9bc866 INFO: 172.21.0.1:38798 - "POST /node/69c59ef3abf66a8f4d9bc866 HTTP/1.0" 202 Accepted 2026-03-28 21:02:54,703 - lava_callback - INFO - Starting async job submit for node 69c59ef3abf66a8f4d9bc866 2026-03-28 21:02:54,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:02:54,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59ef3abf66a8f4d9bc866 HTTP/1.1" 200 None 2026-03-28 21:02:54,724 - lava_callback - DEBUG - Processing node 69c59ef3abf66a8f4d9bc866: baseline-arm-clabbe 2026-03-28 21:02:54,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59ef3abf66a8f4d9bc866 2026-03-28 21:02:54,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:02:54,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59ef3abf66a8f4d9bc866 HTTP/1.1" 200 None 2026-03-28 21:02:54,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:02:54,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 21:02:54,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:02:54,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59ef3abf66a8f4d9bc866 HTTP/1.1" 200 None 2026-03-28 21:02:54,786 - lava_callback - ERROR - Error processing callback for node 69c59ef3abf66a8f4d9bc866: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46372 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:03:32,603 - lava_callback - INFO - Received callback for node 69c59f18abf66a8f4d9bc874 INFO: 172.21.0.1:34248 - "POST /node/69c59f18abf66a8f4d9bc874 HTTP/1.0" 202 Accepted 2026-03-28 21:03:32,609 - lava_callback - INFO - Starting async job submit for node 69c59f18abf66a8f4d9bc874 2026-03-28 21:03:32,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:03:32,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59f18abf66a8f4d9bc874 HTTP/1.1" 200 None 2026-03-28 21:03:32,625 - lava_callback - DEBUG - Processing node 69c59f18abf66a8f4d9bc874: baseline-arm-baylibre 2026-03-28 21:03:32,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59f18abf66a8f4d9bc874 2026-03-28 21:03:32,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:03:32,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59f18abf66a8f4d9bc874 HTTP/1.1" 200 None 2026-03-28 21:03:32,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:03:32,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 21:03:32,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:03:32,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59f18abf66a8f4d9bc874 HTTP/1.1" 200 None 2026-03-28 21:03:32,689 - lava_callback - ERROR - Error processing callback for node 69c59f18abf66a8f4d9bc874: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49370 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:04:14,749 - lava_callback - INFO - Received callback for node 69c59f40abf66a8f4d9bc883 INFO: 172.21.0.1:39690 - "POST /node/69c59f40abf66a8f4d9bc883 HTTP/1.0" 202 Accepted 2026-03-28 21:04:14,754 - lava_callback - INFO - Starting async job submit for node 69c59f40abf66a8f4d9bc883 2026-03-28 21:04:14,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:04:14,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59f40abf66a8f4d9bc883 HTTP/1.1" 200 None 2026-03-28 21:04:14,769 - lava_callback - DEBUG - Processing node 69c59f40abf66a8f4d9bc883: baseline-arm-clabbe 2026-03-28 21:04:14,770 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59f40abf66a8f4d9bc883 2026-03-28 21:04:14,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:04:14,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59f40abf66a8f4d9bc883 HTTP/1.1" 200 None 2026-03-28 21:04:14,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:04:14,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 21:04:14,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:04:14,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59f40abf66a8f4d9bc883 HTTP/1.1" 200 None 2026-03-28 21:04:14,827 - lava_callback - ERROR - Error processing callback for node 69c59f40abf66a8f4d9bc883: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59712 - "GET /node/69876d85e31b58f834f19d42%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:04:54,780 - lava_callback - INFO - Received callback for node 69c59f66abf66a8f4d9bc897 INFO: 172.21.0.1:46672 - "POST /node/69c59f66abf66a8f4d9bc897 HTTP/1.0" 202 Accepted 2026-03-28 21:04:54,785 - lava_callback - INFO - Starting async job submit for node 69c59f66abf66a8f4d9bc897 2026-03-28 21:04:54,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:04:54,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59f66abf66a8f4d9bc897 HTTP/1.1" 200 None 2026-03-28 21:04:54,813 - lava_callback - DEBUG - Processing node 69c59f66abf66a8f4d9bc897: baseline-arm-clabbe 2026-03-28 21:04:54,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59f66abf66a8f4d9bc897 2026-03-28 21:04:54,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:04:54,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59f66abf66a8f4d9bc897 HTTP/1.1" 200 None 2026-03-28 21:04:54,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:04:54,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 21:04:54,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:04:54,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59f66abf66a8f4d9bc897 HTTP/1.1" 200 None 2026-03-28 21:04:54,922 - lava_callback - ERROR - Error processing callback for node 69c59f66abf66a8f4d9bc897: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:05:35,130 - lava_callback - INFO - Received callback for node 69c59f8cabf66a8f4d9bc8a2 INFO: 172.21.0.1:59172 - "POST /node/69c59f8cabf66a8f4d9bc8a2 HTTP/1.0" 202 Accepted 2026-03-28 21:05:35,135 - lava_callback - INFO - Starting async job submit for node 69c59f8cabf66a8f4d9bc8a2 2026-03-28 21:05:35,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:05:35,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59f8cabf66a8f4d9bc8a2 HTTP/1.1" 200 None 2026-03-28 21:05:35,151 - lava_callback - DEBUG - Processing node 69c59f8cabf66a8f4d9bc8a2: baseline-arm-clabbe 2026-03-28 21:05:35,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59f8cabf66a8f4d9bc8a2 2026-03-28 21:05:35,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:05:35,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59f8cabf66a8f4d9bc8a2 HTTP/1.1" 200 None 2026-03-28 21:05:35,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:05:35,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 21:05:35,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:05:35,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59f8cabf66a8f4d9bc8a2 HTTP/1.1" 200 None 2026-03-28 21:05:35,210 - lava_callback - ERROR - Error processing callback for node 69c59f8cabf66a8f4d9bc8a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43480 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:06:14,806 - lava_callback - INFO - Received callback for node 69c59fb3abf66a8f4d9bc8af INFO: 172.21.0.1:46510 - "POST /node/69c59fb3abf66a8f4d9bc8af HTTP/1.0" 202 Accepted 2026-03-28 21:06:14,812 - lava_callback - INFO - Starting async job submit for node 69c59fb3abf66a8f4d9bc8af 2026-03-28 21:06:14,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:06:14,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59fb3abf66a8f4d9bc8af HTTP/1.1" 200 None 2026-03-28 21:06:14,827 - lava_callback - DEBUG - Processing node 69c59fb3abf66a8f4d9bc8af: baseline-arm-clabbe 2026-03-28 21:06:14,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59fb3abf66a8f4d9bc8af 2026-03-28 21:06:14,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:06:14,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59fb3abf66a8f4d9bc8af HTTP/1.1" 200 None 2026-03-28 21:06:14,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:06:14,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 21:06:14,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:06:14,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59fb3abf66a8f4d9bc8af HTTP/1.1" 200 None 2026-03-28 21:06:14,891 - lava_callback - ERROR - Error processing callback for node 69c59fb3abf66a8f4d9bc8af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:06:54,925 - lava_callback - INFO - Received callback for node 69c59fdbabf66a8f4d9bc8bf INFO: 172.21.0.1:40524 - "POST /node/69c59fdbabf66a8f4d9bc8bf HTTP/1.0" 202 Accepted 2026-03-28 21:06:54,930 - lava_callback - INFO - Starting async job submit for node 69c59fdbabf66a8f4d9bc8bf 2026-03-28 21:06:54,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:06:54,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59fdbabf66a8f4d9bc8bf HTTP/1.1" 200 None 2026-03-28 21:06:54,952 - lava_callback - DEBUG - Processing node 69c59fdbabf66a8f4d9bc8bf: baseline-arm-clabbe 2026-03-28 21:06:54,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c59fdbabf66a8f4d9bc8bf 2026-03-28 21:06:54,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:06:54,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c59fdbabf66a8f4d9bc8bf HTTP/1.1" 200 None 2026-03-28 21:06:54,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:06:54,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 21:06:54,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:06:55,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c59fdbabf66a8f4d9bc8bf HTTP/1.1" 200 None 2026-03-28 21:06:55,016 - lava_callback - ERROR - Error processing callback for node 69c59fdbabf66a8f4d9bc8bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60914 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:07:34,866 - lava_callback - INFO - Received callback for node 69c5a003abf66a8f4d9bc8cd INFO: 172.21.0.1:50522 - "POST /node/69c5a003abf66a8f4d9bc8cd HTTP/1.0" 202 Accepted 2026-03-28 21:07:34,871 - lava_callback - INFO - Starting async job submit for node 69c5a003abf66a8f4d9bc8cd 2026-03-28 21:07:34,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:07:34,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a003abf66a8f4d9bc8cd HTTP/1.1" 200 None 2026-03-28 21:07:34,888 - lava_callback - DEBUG - Processing node 69c5a003abf66a8f4d9bc8cd: baseline-arm-clabbe 2026-03-28 21:07:34,888 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a003abf66a8f4d9bc8cd 2026-03-28 21:07:34,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:07:34,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a003abf66a8f4d9bc8cd HTTP/1.1" 200 None 2026-03-28 21:07:34,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:07:34,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-03-28 21:07:34,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:07:34,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a003abf66a8f4d9bc8cd HTTP/1.1" 200 None 2026-03-28 21:07:34,943 - lava_callback - ERROR - Error processing callback for node 69c5a003abf66a8f4d9bc8cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33222 - "GET /node/699432775ae459b9df3d302b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36334 - "GET /node/6919902d40db568ee36c3fee%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60300 - "GET /node/694bc7dec19e09af58d46ae2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59014 - "GET /node/69870d806e077e4126a7ec65%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33276 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:17:53,642 - lava_callback - INFO - Received callback for node 69c5a275abf66a8f4d9bc92f INFO: 172.21.0.1:33280 - "POST /node/69c5a275abf66a8f4d9bc92f HTTP/1.0" 202 Accepted 2026-03-28 21:17:53,648 - lava_callback - INFO - Starting async job submit for node 69c5a275abf66a8f4d9bc92f 2026-03-28 21:17:53,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:17:53,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a275abf66a8f4d9bc92f HTTP/1.1" 200 None 2026-03-28 21:17:53,664 - lava_callback - DEBUG - Processing node 69c5a275abf66a8f4d9bc92f: baseline-arm64-baylibre 2026-03-28 21:17:53,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a275abf66a8f4d9bc92f 2026-03-28 21:17:53,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:17:53,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a275abf66a8f4d9bc92f HTTP/1.1" 200 None 2026-03-28 21:17:53,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:17:53,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-28 21:17:53,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:17:53,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a275abf66a8f4d9bc92f HTTP/1.1" 200 None 2026-03-28 21:17:53,913 - lava_callback - ERROR - Error processing callback for node 69c5a275abf66a8f4d9bc92f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:19:13,388 - lava_callback - INFO - Received callback for node 69c5a2cbabf66a8f4d9bc93f INFO: 172.21.0.1:46672 - "POST /node/69c5a2cbabf66a8f4d9bc93f HTTP/1.0" 202 Accepted 2026-03-28 21:19:13,394 - lava_callback - INFO - Starting async job submit for node 69c5a2cbabf66a8f4d9bc93f 2026-03-28 21:19:13,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:19:13,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a2cbabf66a8f4d9bc93f HTTP/1.1" 200 None 2026-03-28 21:19:13,410 - lava_callback - DEBUG - Processing node 69c5a2cbabf66a8f4d9bc93f: baseline-arm64-baylibre 2026-03-28 21:19:13,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a2cbabf66a8f4d9bc93f 2026-03-28 21:19:13,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:19:13,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a2cbabf66a8f4d9bc93f HTTP/1.1" 200 None 2026-03-28 21:19:13,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:19:13,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-28 21:19:13,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:19:13,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a2cbabf66a8f4d9bc93f HTTP/1.1" 200 None 2026-03-28 21:19:13,490 - lava_callback - ERROR - Error processing callback for node 69c5a2cbabf66a8f4d9bc93f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:20:33,445 - lava_callback - INFO - Received callback for node 69c5a31fabf66a8f4d9bc944 INFO: 172.21.0.1:36526 - "POST /node/69c5a31fabf66a8f4d9bc944 HTTP/1.0" 202 Accepted 2026-03-28 21:20:33,453 - lava_callback - INFO - Starting async job submit for node 69c5a31fabf66a8f4d9bc944 2026-03-28 21:20:33,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:20:33,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a31fabf66a8f4d9bc944 HTTP/1.1" 200 None 2026-03-28 21:20:33,470 - lava_callback - DEBUG - Processing node 69c5a31fabf66a8f4d9bc944: baseline-arm64-baylibre 2026-03-28 21:20:33,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a31fabf66a8f4d9bc944 2026-03-28 21:20:33,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:20:33,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a31fabf66a8f4d9bc944 HTTP/1.1" 200 None 2026-03-28 21:20:33,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:20:33,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:20:33,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:20:33,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a31fabf66a8f4d9bc944 HTTP/1.1" 200 None 2026-03-28 21:20:33,525 - lava_callback - ERROR - Error processing callback for node 69c5a31fabf66a8f4d9bc944: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:22:13,516 - lava_callback - INFO - Received callback for node 69c5a377abf66a8f4d9bc953 INFO: 172.21.0.1:40264 - "POST /node/69c5a377abf66a8f4d9bc953 HTTP/1.0" 202 Accepted 2026-03-28 21:22:13,522 - lava_callback - INFO - Starting async job submit for node 69c5a377abf66a8f4d9bc953 2026-03-28 21:22:13,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:22:13,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a377abf66a8f4d9bc953 HTTP/1.1" 200 None 2026-03-28 21:22:13,538 - lava_callback - DEBUG - Processing node 69c5a377abf66a8f4d9bc953: baseline-arm64-baylibre 2026-03-28 21:22:13,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a377abf66a8f4d9bc953 2026-03-28 21:22:13,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:22:13,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a377abf66a8f4d9bc953 HTTP/1.1" 200 None 2026-03-28 21:22:13,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:22:13,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:22:13,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:22:13,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a377abf66a8f4d9bc953 HTTP/1.1" 200 None 2026-03-28 21:22:13,591 - lava_callback - ERROR - Error processing callback for node 69c5a377abf66a8f4d9bc953: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39352 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:23:33,652 - lava_callback - INFO - Received callback for node 69c5a3ccabf66a8f4d9bc95f INFO: 172.21.0.1:53538 - "POST /node/69c5a3ccabf66a8f4d9bc95f HTTP/1.0" 202 Accepted 2026-03-28 21:23:33,658 - lava_callback - INFO - Starting async job submit for node 69c5a3ccabf66a8f4d9bc95f 2026-03-28 21:23:33,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:23:33,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a3ccabf66a8f4d9bc95f HTTP/1.1" 200 None 2026-03-28 21:23:33,684 - lava_callback - DEBUG - Processing node 69c5a3ccabf66a8f4d9bc95f: baseline-arm64-baylibre 2026-03-28 21:23:33,684 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a3ccabf66a8f4d9bc95f 2026-03-28 21:23:33,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:23:33,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a3ccabf66a8f4d9bc95f HTTP/1.1" 200 None 2026-03-28 21:23:33,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:23:33,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-28 21:23:33,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:23:33,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a3ccabf66a8f4d9bc95f HTTP/1.1" 200 None 2026-03-28 21:23:33,767 - lava_callback - ERROR - Error processing callback for node 69c5a3ccabf66a8f4d9bc95f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:24:53,687 - lava_callback - INFO - Received callback for node 69c5a422abf66a8f4d9bc96d INFO: 172.21.0.1:51654 - "POST /node/69c5a422abf66a8f4d9bc96d HTTP/1.0" 202 Accepted 2026-03-28 21:24:53,692 - lava_callback - INFO - Starting async job submit for node 69c5a422abf66a8f4d9bc96d 2026-03-28 21:24:53,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:24:53,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a422abf66a8f4d9bc96d HTTP/1.1" 200 None 2026-03-28 21:24:53,709 - lava_callback - DEBUG - Processing node 69c5a422abf66a8f4d9bc96d: baseline-arm64-baylibre 2026-03-28 21:24:53,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a422abf66a8f4d9bc96d 2026-03-28 21:24:53,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:24:53,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a422abf66a8f4d9bc96d HTTP/1.1" 200 None 2026-03-28 21:24:53,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:24:53,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-28 21:24:53,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:24:53,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a422abf66a8f4d9bc96d HTTP/1.1" 200 None 2026-03-28 21:24:53,783 - lava_callback - ERROR - Error processing callback for node 69c5a422abf66a8f4d9bc96d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58558 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:26:33,732 - lava_callback - INFO - Received callback for node 69c5a476abf66a8f4d9bc97c INFO: 172.21.0.1:57330 - "POST /node/69c5a476abf66a8f4d9bc97c HTTP/1.0" 202 Accepted 2026-03-28 21:26:33,738 - lava_callback - INFO - Starting async job submit for node 69c5a476abf66a8f4d9bc97c 2026-03-28 21:26:33,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:26:33,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a476abf66a8f4d9bc97c HTTP/1.1" 200 None 2026-03-28 21:26:33,754 - lava_callback - DEBUG - Processing node 69c5a476abf66a8f4d9bc97c: baseline-arm64-baylibre 2026-03-28 21:26:33,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a476abf66a8f4d9bc97c 2026-03-28 21:26:33,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:26:33,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a476abf66a8f4d9bc97c HTTP/1.1" 200 None 2026-03-28 21:26:33,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:26:33,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-28 21:26:33,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:26:33,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a476abf66a8f4d9bc97c HTTP/1.1" 200 None 2026-03-28 21:26:33,835 - lava_callback - ERROR - Error processing callback for node 69c5a476abf66a8f4d9bc97c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46342 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:27:53,838 - lava_callback - INFO - Received callback for node 69c5a4cbabf66a8f4d9bc98a INFO: 172.21.0.1:46346 - "POST /node/69c5a4cbabf66a8f4d9bc98a HTTP/1.0" 202 Accepted 2026-03-28 21:27:53,843 - lava_callback - INFO - Starting async job submit for node 69c5a4cbabf66a8f4d9bc98a 2026-03-28 21:27:53,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:27:53,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a4cbabf66a8f4d9bc98a HTTP/1.1" 200 None 2026-03-28 21:27:53,858 - lava_callback - DEBUG - Processing node 69c5a4cbabf66a8f4d9bc98a: baseline-arm64-baylibre 2026-03-28 21:27:53,858 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a4cbabf66a8f4d9bc98a 2026-03-28 21:27:53,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:27:53,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a4cbabf66a8f4d9bc98a HTTP/1.1" 200 None 2026-03-28 21:27:53,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:27:53,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-28 21:27:53,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:27:53,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a4cbabf66a8f4d9bc98a HTTP/1.1" 200 None 2026-03-28 21:27:53,920 - lava_callback - ERROR - Error processing callback for node 69c5a4cbabf66a8f4d9bc98a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38828 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-28 21:29:15,820 - lava_callback - INFO - Received callback for node 69c5a525abf66a8f4d9bc997 INFO: 172.21.0.1:38842 - "POST /node/69c5a525abf66a8f4d9bc997 HTTP/1.0" 202 Accepted 2026-03-28 21:29:15,826 - lava_callback - INFO - Starting async job submit for node 69c5a525abf66a8f4d9bc997 2026-03-28 21:29:15,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:29:15,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a525abf66a8f4d9bc997 HTTP/1.1" 200 None 2026-03-28 21:29:15,842 - lava_callback - DEBUG - Processing node 69c5a525abf66a8f4d9bc997: baseline-arm64-clabbe 2026-03-28 21:29:15,842 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a525abf66a8f4d9bc997 2026-03-28 21:29:15,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:29:15,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a525abf66a8f4d9bc997 HTTP/1.1" 200 None 2026-03-28 21:29:15,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:29:15,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-28 21:29:15,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:29:15,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a525abf66a8f4d9bc997 HTTP/1.1" 200 None 2026-03-28 21:29:15,923 - lava_callback - ERROR - Error processing callback for node 69c5a525abf66a8f4d9bc997: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59158 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:30:55,852 - lava_callback - INFO - Received callback for node 69c5a57aabf66a8f4d9bc99e INFO: 172.21.0.1:59172 - "POST /node/69c5a57aabf66a8f4d9bc99e HTTP/1.0" 202 Accepted 2026-03-28 21:30:55,857 - lava_callback - INFO - Starting async job submit for node 69c5a57aabf66a8f4d9bc99e 2026-03-28 21:30:55,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:30:55,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a57aabf66a8f4d9bc99e HTTP/1.1" 200 None 2026-03-28 21:30:55,874 - lava_callback - DEBUG - Processing node 69c5a57aabf66a8f4d9bc99e: baseline-arm64-clabbe 2026-03-28 21:30:55,874 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a57aabf66a8f4d9bc99e 2026-03-28 21:30:55,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:30:55,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a57aabf66a8f4d9bc99e HTTP/1.1" 200 None 2026-03-28 21:30:55,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:30:55,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-28 21:30:55,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:30:55,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a57aabf66a8f4d9bc99e HTTP/1.1" 200 None 2026-03-28 21:30:55,943 - lava_callback - ERROR - Error processing callback for node 69c5a57aabf66a8f4d9bc99e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37012 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:31:54,024 - lava_callback - INFO - Received callback for node 69c5a5c7abf66a8f4d9bc9a9 INFO: 172.21.0.1:37014 - "POST /node/69c5a5c7abf66a8f4d9bc9a9 HTTP/1.0" 202 Accepted 2026-03-28 21:31:54,030 - lava_callback - INFO - Starting async job submit for node 69c5a5c7abf66a8f4d9bc9a9 2026-03-28 21:31:54,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:31:54,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a5c7abf66a8f4d9bc9a9 HTTP/1.1" 200 None 2026-03-28 21:31:54,045 - lava_callback - DEBUG - Processing node 69c5a5c7abf66a8f4d9bc9a9: baseline-arm64-baylibre 2026-03-28 21:31:54,046 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a5c7abf66a8f4d9bc9a9 2026-03-28 21:31:54,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:31:54,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a5c7abf66a8f4d9bc9a9 HTTP/1.1" 200 None 2026-03-28 21:31:54,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:31:54,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:31:54,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:31:54,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a5c7abf66a8f4d9bc9a9 HTTP/1.1" 200 None 2026-03-28 21:31:54,119 - lava_callback - ERROR - Error processing callback for node 69c5a5c7abf66a8f4d9bc9a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:33:34,057 - lava_callback - INFO - Received callback for node 69c5a61cabf66a8f4d9bc9b7 INFO: 172.21.0.1:47802 - "POST /node/69c5a61cabf66a8f4d9bc9b7 HTTP/1.0" 202 Accepted 2026-03-28 21:33:34,063 - lava_callback - INFO - Starting async job submit for node 69c5a61cabf66a8f4d9bc9b7 2026-03-28 21:33:34,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:33:34,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a61cabf66a8f4d9bc9b7 HTTP/1.1" 200 None 2026-03-28 21:33:34,079 - lava_callback - DEBUG - Processing node 69c5a61cabf66a8f4d9bc9b7: baseline-arm64-baylibre 2026-03-28 21:33:34,080 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a61cabf66a8f4d9bc9b7 2026-03-28 21:33:34,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:33:34,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a61cabf66a8f4d9bc9b7 HTTP/1.1" 200 None 2026-03-28 21:33:34,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:33:34,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:33:34,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:33:34,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a61cabf66a8f4d9bc9b7 HTTP/1.1" 200 None 2026-03-28 21:33:34,135 - lava_callback - ERROR - Error processing callback for node 69c5a61cabf66a8f4d9bc9b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53300 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:34:55,972 - lava_callback - INFO - Received callback for node 69c5a679abf66a8f4d9bc9c6 INFO: 172.21.0.1:53314 - "POST /node/69c5a679abf66a8f4d9bc9c6 HTTP/1.0" 202 Accepted 2026-03-28 21:34:55,978 - lava_callback - INFO - Starting async job submit for node 69c5a679abf66a8f4d9bc9c6 2026-03-28 21:34:55,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:34:55,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a679abf66a8f4d9bc9c6 HTTP/1.1" 200 None 2026-03-28 21:34:55,996 - lava_callback - DEBUG - Processing node 69c5a679abf66a8f4d9bc9c6: baseline-arm64-clabbe 2026-03-28 21:34:55,996 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a679abf66a8f4d9bc9c6 2026-03-28 21:34:55,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:34:56,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a679abf66a8f4d9bc9c6 HTTP/1.1" 200 None 2026-03-28 21:34:56,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:34:56,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-28 21:34:56,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:34:56,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a679abf66a8f4d9bc9c6 HTTP/1.1" 200 None 2026-03-28 21:34:56,054 - lava_callback - ERROR - Error processing callback for node 69c5a679abf66a8f4d9bc9c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:36:36,018 - lava_callback - INFO - Received callback for node 69c5a6d0abf66a8f4d9bc9d3 INFO: 172.21.0.1:57212 - "POST /node/69c5a6d0abf66a8f4d9bc9d3 HTTP/1.0" 202 Accepted 2026-03-28 21:36:36,024 - lava_callback - INFO - Starting async job submit for node 69c5a6d0abf66a8f4d9bc9d3 2026-03-28 21:36:36,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:36:36,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a6d0abf66a8f4d9bc9d3 HTTP/1.1" 200 None 2026-03-28 21:36:36,040 - lava_callback - DEBUG - Processing node 69c5a6d0abf66a8f4d9bc9d3: baseline-arm64-clabbe 2026-03-28 21:36:36,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a6d0abf66a8f4d9bc9d3 2026-03-28 21:36:36,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:36:36,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a6d0abf66a8f4d9bc9d3 HTTP/1.1" 200 None 2026-03-28 21:36:36,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:36:36,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-28 21:36:36,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:36:36,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a6d0abf66a8f4d9bc9d3 HTTP/1.1" 200 None 2026-03-28 21:36:36,100 - lava_callback - ERROR - Error processing callback for node 69c5a6d0abf66a8f4d9bc9d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35702 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:37:56,023 - lava_callback - INFO - Received callback for node 69c5a725abf66a8f4d9bc9dc INFO: 172.21.0.1:35706 - "POST /node/69c5a725abf66a8f4d9bc9dc HTTP/1.0" 202 Accepted 2026-03-28 21:37:56,029 - lava_callback - INFO - Starting async job submit for node 69c5a725abf66a8f4d9bc9dc 2026-03-28 21:37:56,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:37:56,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a725abf66a8f4d9bc9dc HTTP/1.1" 200 None 2026-03-28 21:37:56,044 - lava_callback - DEBUG - Processing node 69c5a725abf66a8f4d9bc9dc: baseline-arm64-clabbe 2026-03-28 21:37:56,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a725abf66a8f4d9bc9dc 2026-03-28 21:37:56,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:37:56,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a725abf66a8f4d9bc9dc HTTP/1.1" 200 None 2026-03-28 21:37:56,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:37:56,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-28 21:37:56,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:37:56,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a725abf66a8f4d9bc9dc HTTP/1.1" 200 None 2026-03-28 21:37:56,100 - lava_callback - ERROR - Error processing callback for node 69c5a725abf66a8f4d9bc9dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39006 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-28 21:39:16,122 - lava_callback - INFO - Received callback for node 69c5a77cabf66a8f4d9bc9e8 INFO: 172.21.0.1:39018 - "POST /node/69c5a77cabf66a8f4d9bc9e8 HTTP/1.0" 202 Accepted 2026-03-28 21:39:16,128 - lava_callback - INFO - Starting async job submit for node 69c5a77cabf66a8f4d9bc9e8 2026-03-28 21:39:16,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:39:16,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a77cabf66a8f4d9bc9e8 HTTP/1.1" 200 None 2026-03-28 21:39:16,144 - lava_callback - DEBUG - Processing node 69c5a77cabf66a8f4d9bc9e8: baseline-arm64-clabbe 2026-03-28 21:39:16,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a77cabf66a8f4d9bc9e8 2026-03-28 21:39:16,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:39:16,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a77cabf66a8f4d9bc9e8 HTTP/1.1" 200 None 2026-03-28 21:39:16,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:39:16,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:39:16,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:39:16,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a77cabf66a8f4d9bc9e8 HTTP/1.1" 200 None 2026-03-28 21:39:16,239 - lava_callback - ERROR - Error processing callback for node 69c5a77cabf66a8f4d9bc9e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:40:36,187 - lava_callback - INFO - Received callback for node 69c5a7d0abf66a8f4d9bc9f2 INFO: 172.21.0.1:57712 - "POST /node/69c5a7d0abf66a8f4d9bc9f2 HTTP/1.0" 202 Accepted 2026-03-28 21:40:36,192 - lava_callback - INFO - Starting async job submit for node 69c5a7d0abf66a8f4d9bc9f2 2026-03-28 21:40:36,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:40:36,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a7d0abf66a8f4d9bc9f2 HTTP/1.1" 200 None 2026-03-28 21:40:36,211 - lava_callback - DEBUG - Processing node 69c5a7d0abf66a8f4d9bc9f2: baseline-arm64-clabbe 2026-03-28 21:40:36,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a7d0abf66a8f4d9bc9f2 2026-03-28 21:40:36,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:40:36,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a7d0abf66a8f4d9bc9f2 HTTP/1.1" 200 None 2026-03-28 21:40:36,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:40:36,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-28 21:40:36,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:40:36,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a7d0abf66a8f4d9bc9f2 HTTP/1.1" 200 None 2026-03-28 21:40:36,292 - lava_callback - ERROR - Error processing callback for node 69c5a7d0abf66a8f4d9bc9f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33592 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-28 21:42:16,283 - lava_callback - INFO - Received callback for node 69c5a825abf66a8f4d9bc9fc INFO: 172.21.0.1:33602 - "POST /node/69c5a825abf66a8f4d9bc9fc HTTP/1.0" 202 Accepted 2026-03-28 21:42:16,288 - lava_callback - INFO - Starting async job submit for node 69c5a825abf66a8f4d9bc9fc 2026-03-28 21:42:16,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:42:16,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a825abf66a8f4d9bc9fc HTTP/1.1" 200 None 2026-03-28 21:42:16,304 - lava_callback - DEBUG - Processing node 69c5a825abf66a8f4d9bc9fc: baseline-arm64-clabbe 2026-03-28 21:42:16,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a825abf66a8f4d9bc9fc 2026-03-28 21:42:16,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:42:16,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a825abf66a8f4d9bc9fc HTTP/1.1" 200 None 2026-03-28 21:42:16,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:42:16,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:42:16,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:42:16,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a825abf66a8f4d9bc9fc HTTP/1.1" 200 None 2026-03-28 21:42:16,363 - lava_callback - ERROR - Error processing callback for node 69c5a825abf66a8f4d9bc9fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:43:34,661 - lava_callback - INFO - Received callback for node 69c5a871abf66a8f4d9bca0d INFO: 172.21.0.1:57450 - "POST /node/69c5a871abf66a8f4d9bca0d HTTP/1.0" 202 Accepted 2026-03-28 21:43:34,666 - lava_callback - INFO - Starting async job submit for node 69c5a871abf66a8f4d9bca0d 2026-03-28 21:43:34,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:43:34,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a871abf66a8f4d9bca0d HTTP/1.1" 200 None 2026-03-28 21:43:34,703 - lava_callback - DEBUG - Processing node 69c5a871abf66a8f4d9bca0d: baseline-arm64-baylibre 2026-03-28 21:43:34,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a871abf66a8f4d9bca0d 2026-03-28 21:43:34,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:43:34,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a871abf66a8f4d9bca0d HTTP/1.1" 200 None 2026-03-28 21:43:34,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:43:34,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:43:34,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:43:34,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a871abf66a8f4d9bca0d HTTP/1.1" 200 None 2026-03-28 21:43:34,772 - lava_callback - ERROR - Error processing callback for node 69c5a871abf66a8f4d9bca0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:44:56,432 - lava_callback - INFO - Received callback for node 69c5a8d0abf66a8f4d9bca1a INFO: 172.21.0.1:38442 - "POST /node/69c5a8d0abf66a8f4d9bca1a HTTP/1.0" 202 Accepted 2026-03-28 21:44:56,438 - lava_callback - INFO - Starting async job submit for node 69c5a8d0abf66a8f4d9bca1a 2026-03-28 21:44:56,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:44:56,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a8d0abf66a8f4d9bca1a HTTP/1.1" 200 None 2026-03-28 21:44:56,454 - lava_callback - DEBUG - Processing node 69c5a8d0abf66a8f4d9bca1a: baseline-arm64-clabbe 2026-03-28 21:44:56,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a8d0abf66a8f4d9bca1a 2026-03-28 21:44:56,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:44:56,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a8d0abf66a8f4d9bca1a HTTP/1.1" 200 None 2026-03-28 21:44:56,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:44:56,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:44:56,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:44:56,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a8d0abf66a8f4d9bca1a HTTP/1.1" 200 None 2026-03-28 21:44:56,519 - lava_callback - ERROR - Error processing callback for node 69c5a8d0abf66a8f4d9bca1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:46:36,475 - lava_callback - INFO - Received callback for node 69c5a928abf66a8f4d9bca29 INFO: 172.21.0.1:48502 - "POST /node/69c5a928abf66a8f4d9bca29 HTTP/1.0" 202 Accepted 2026-03-28 21:46:36,480 - lava_callback - INFO - Starting async job submit for node 69c5a928abf66a8f4d9bca29 2026-03-28 21:46:36,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:46:36,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a928abf66a8f4d9bca29 HTTP/1.1" 200 None 2026-03-28 21:46:36,521 - lava_callback - DEBUG - Processing node 69c5a928abf66a8f4d9bca29: baseline-arm64-clabbe 2026-03-28 21:46:36,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a928abf66a8f4d9bca29 2026-03-28 21:46:36,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:46:36,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a928abf66a8f4d9bca29 HTTP/1.1" 200 None 2026-03-28 21:46:36,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:46:36,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:46:36,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:46:36,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a928abf66a8f4d9bca29 HTTP/1.1" 200 None 2026-03-28 21:46:36,573 - lava_callback - ERROR - Error processing callback for node 69c5a928abf66a8f4d9bca29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57050 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:49:16,614 - lava_callback - INFO - Received callback for node 69c5a9d7abf66a8f4d9bca43 INFO: 172.21.0.1:57064 - "POST /node/69c5a9d7abf66a8f4d9bca43 HTTP/1.0" 202 Accepted 2026-03-28 21:49:16,620 - lava_callback - INFO - Starting async job submit for node 69c5a9d7abf66a8f4d9bca43 2026-03-28 21:49:16,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:49:16,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a9d7abf66a8f4d9bca43 HTTP/1.1" 200 None 2026-03-28 21:49:16,636 - lava_callback - DEBUG - Processing node 69c5a9d7abf66a8f4d9bca43: baseline-arm64-clabbe 2026-03-28 21:49:16,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5a9d7abf66a8f4d9bca43 2026-03-28 21:49:16,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:49:16,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5a9d7abf66a8f4d9bca43 HTTP/1.1" 200 None 2026-03-28 21:49:16,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:49:16,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:49:16,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:49:16,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5a9d7abf66a8f4d9bca43 HTTP/1.1" 200 None 2026-03-28 21:49:16,871 - lava_callback - ERROR - Error processing callback for node 69c5a9d7abf66a8f4d9bca43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:50:55,067 - lava_callback - INFO - Received callback for node 69c5aa2aabf66a8f4d9bca4a INFO: 172.21.0.1:47304 - "POST /node/69c5aa2aabf66a8f4d9bca4a HTTP/1.0" 202 Accepted 2026-03-28 21:50:55,072 - lava_callback - INFO - Starting async job submit for node 69c5aa2aabf66a8f4d9bca4a 2026-03-28 21:50:55,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:50:55,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5aa2aabf66a8f4d9bca4a HTTP/1.1" 200 None 2026-03-28 21:50:55,089 - lava_callback - DEBUG - Processing node 69c5aa2aabf66a8f4d9bca4a: baseline-arm64-baylibre 2026-03-28 21:50:55,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5aa2aabf66a8f4d9bca4a 2026-03-28 21:50:55,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:50:55,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5aa2aabf66a8f4d9bca4a HTTP/1.1" 200 None 2026-03-28 21:50:55,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:50:55,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:50:55,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:50:55,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5aa2aabf66a8f4d9bca4a HTTP/1.1" 200 None 2026-03-28 21:50:55,141 - lava_callback - ERROR - Error processing callback for node 69c5aa2aabf66a8f4d9bca4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38896 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:52:16,764 - lava_callback - INFO - Received callback for node 69c5aa88abf66a8f4d9bca5a INFO: 172.21.0.1:38906 - "POST /node/69c5aa88abf66a8f4d9bca5a HTTP/1.0" 202 Accepted 2026-03-28 21:52:16,770 - lava_callback - INFO - Starting async job submit for node 69c5aa88abf66a8f4d9bca5a 2026-03-28 21:52:16,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:52:16,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5aa88abf66a8f4d9bca5a HTTP/1.1" 200 None 2026-03-28 21:52:16,793 - lava_callback - DEBUG - Processing node 69c5aa88abf66a8f4d9bca5a: baseline-arm64-clabbe 2026-03-28 21:52:16,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5aa88abf66a8f4d9bca5a 2026-03-28 21:52:16,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:52:16,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5aa88abf66a8f4d9bca5a HTTP/1.1" 200 None 2026-03-28 21:52:16,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:52:16,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:52:16,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:52:16,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5aa88abf66a8f4d9bca5a HTTP/1.1" 200 None 2026-03-28 21:52:16,845 - lava_callback - ERROR - Error processing callback for node 69c5aa88abf66a8f4d9bca5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58304 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:53:35,163 - lava_callback - INFO - Received callback for node 69c5aad7abf66a8f4d9bca68 INFO: 172.21.0.1:36788 - "POST /node/69c5aad7abf66a8f4d9bca68 HTTP/1.0" 202 Accepted 2026-03-28 21:53:35,169 - lava_callback - INFO - Starting async job submit for node 69c5aad7abf66a8f4d9bca68 2026-03-28 21:53:35,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:53:35,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5aad7abf66a8f4d9bca68 HTTP/1.1" 200 None 2026-03-28 21:53:35,185 - lava_callback - DEBUG - Processing node 69c5aad7abf66a8f4d9bca68: baseline-arm64-baylibre 2026-03-28 21:53:35,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5aad7abf66a8f4d9bca68 2026-03-28 21:53:35,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:53:35,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5aad7abf66a8f4d9bca68 HTTP/1.1" 200 None 2026-03-28 21:53:35,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:53:35,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:53:35,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:53:35,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5aad7abf66a8f4d9bca68 HTTP/1.1" 200 None 2026-03-28 21:53:35,245 - lava_callback - ERROR - Error processing callback for node 69c5aad7abf66a8f4d9bca68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60818 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:56:37,003 - lava_callback - INFO - Received callback for node 69c5ab8babf66a8f4d9bca82 INFO: 172.21.0.1:60820 - "POST /node/69c5ab8babf66a8f4d9bca82 HTTP/1.0" 202 Accepted 2026-03-28 21:56:37,010 - lava_callback - INFO - Starting async job submit for node 69c5ab8babf66a8f4d9bca82 2026-03-28 21:56:37,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:56:37,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ab8babf66a8f4d9bca82 HTTP/1.1" 200 None 2026-03-28 21:56:37,045 - lava_callback - DEBUG - Processing node 69c5ab8babf66a8f4d9bca82: baseline-arm64-clabbe 2026-03-28 21:56:37,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ab8babf66a8f4d9bca82 2026-03-28 21:56:37,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:56:37,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ab8babf66a8f4d9bca82 HTTP/1.1" 200 None 2026-03-28 21:56:37,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:56:37,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:56:37,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:56:37,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ab8babf66a8f4d9bca82 HTTP/1.1" 200 None 2026-03-28 21:56:37,106 - lava_callback - ERROR - Error processing callback for node 69c5ab8babf66a8f4d9bca82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35598 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:58:17,087 - lava_callback - INFO - Received callback for node 69c5abe4abf66a8f4d9bca8f INFO: 172.21.0.1:35602 - "POST /node/69c5abe4abf66a8f4d9bca8f HTTP/1.0" 202 Accepted 2026-03-28 21:58:17,093 - lava_callback - INFO - Starting async job submit for node 69c5abe4abf66a8f4d9bca8f 2026-03-28 21:58:17,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:58:17,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5abe4abf66a8f4d9bca8f HTTP/1.1" 200 None 2026-03-28 21:58:17,110 - lava_callback - DEBUG - Processing node 69c5abe4abf66a8f4d9bca8f: baseline-arm64-clabbe 2026-03-28 21:58:17,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5abe4abf66a8f4d9bca8f 2026-03-28 21:58:17,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:58:17,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5abe4abf66a8f4d9bca8f HTTP/1.1" 200 None 2026-03-28 21:58:17,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:58:17,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:58:17,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:58:17,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5abe4abf66a8f4d9bca8f HTTP/1.1" 200 None 2026-03-28 21:58:17,164 - lava_callback - ERROR - Error processing callback for node 69c5abe4abf66a8f4d9bca8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK 2026-03-28 21:59:35,662 - lava_callback - INFO - Received callback for node 69c5ac35abf66a8f4d9bca9c INFO: 172.21.0.1:47146 - "POST /node/69c5ac35abf66a8f4d9bca9c HTTP/1.0" 202 Accepted 2026-03-28 21:59:35,667 - lava_callback - INFO - Starting async job submit for node 69c5ac35abf66a8f4d9bca9c 2026-03-28 21:59:35,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:59:35,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ac35abf66a8f4d9bca9c HTTP/1.1" 200 None 2026-03-28 21:59:35,682 - lava_callback - DEBUG - Processing node 69c5ac35abf66a8f4d9bca9c: baseline-arm64-baylibre 2026-03-28 21:59:35,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ac35abf66a8f4d9bca9c 2026-03-28 21:59:35,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:59:35,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ac35abf66a8f4d9bca9c HTTP/1.1" 200 None 2026-03-28 21:59:35,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:59:35,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 21:59:35,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 21:59:35,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ac35abf66a8f4d9bca9c HTTP/1.1" 200 None 2026-03-28 21:59:35,741 - lava_callback - ERROR - Error processing callback for node 69c5ac35abf66a8f4d9bca9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:00:57,275 - lava_callback - INFO - Received callback for node 69c5ac91abf66a8f4d9bcaab INFO: 172.21.0.1:44202 - "POST /node/69c5ac91abf66a8f4d9bcaab HTTP/1.0" 202 Accepted 2026-03-28 22:00:57,280 - lava_callback - INFO - Starting async job submit for node 69c5ac91abf66a8f4d9bcaab 2026-03-28 22:00:57,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:00:57,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ac91abf66a8f4d9bcaab HTTP/1.1" 200 None 2026-03-28 22:00:57,303 - lava_callback - DEBUG - Processing node 69c5ac91abf66a8f4d9bcaab: baseline-arm64-clabbe 2026-03-28 22:00:57,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ac91abf66a8f4d9bcaab 2026-03-28 22:00:57,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:00:57,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ac91abf66a8f4d9bcaab HTTP/1.1" 200 None 2026-03-28 22:00:57,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:00:57,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 22:00:57,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:00:57,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ac91abf66a8f4d9bcaab HTTP/1.1" 200 None 2026-03-28 22:00:57,360 - lava_callback - ERROR - Error processing callback for node 69c5ac91abf66a8f4d9bcaab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:02:37,308 - lava_callback - INFO - Received callback for node 69c5ace9abf66a8f4d9bcabc INFO: 172.21.0.1:49792 - "POST /node/69c5ace9abf66a8f4d9bcabc HTTP/1.0" 202 Accepted 2026-03-28 22:02:37,314 - lava_callback - INFO - Starting async job submit for node 69c5ace9abf66a8f4d9bcabc 2026-03-28 22:02:37,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:02:37,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ace9abf66a8f4d9bcabc HTTP/1.1" 200 None 2026-03-28 22:02:37,329 - lava_callback - DEBUG - Processing node 69c5ace9abf66a8f4d9bcabc: baseline-arm64-clabbe 2026-03-28 22:02:37,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ace9abf66a8f4d9bcabc 2026-03-28 22:02:37,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:02:37,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ace9abf66a8f4d9bcabc HTTP/1.1" 200 None 2026-03-28 22:02:37,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:02:37,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 22:02:37,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:02:37,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ace9abf66a8f4d9bcabc HTTP/1.1" 200 None 2026-03-28 22:02:37,388 - lava_callback - ERROR - Error processing callback for node 69c5ace9abf66a8f4d9bcabc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:03:57,286 - lava_callback - INFO - Received callback for node 69c5ad3fabf66a8f4d9bcac9 INFO: 172.21.0.1:40624 - "POST /node/69c5ad3fabf66a8f4d9bcac9 HTTP/1.0" 202 Accepted 2026-03-28 22:03:57,292 - lava_callback - INFO - Starting async job submit for node 69c5ad3fabf66a8f4d9bcac9 2026-03-28 22:03:57,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:03:57,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ad3fabf66a8f4d9bcac9 HTTP/1.1" 200 None 2026-03-28 22:03:57,308 - lava_callback - DEBUG - Processing node 69c5ad3fabf66a8f4d9bcac9: baseline-arm64-clabbe 2026-03-28 22:03:57,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ad3fabf66a8f4d9bcac9 2026-03-28 22:03:57,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:03:57,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ad3fabf66a8f4d9bcac9 HTTP/1.1" 200 None 2026-03-28 22:03:57,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:03:57,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 22:03:57,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:03:57,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ad3fabf66a8f4d9bcac9 HTTP/1.1" 200 None 2026-03-28 22:03:57,392 - lava_callback - ERROR - Error processing callback for node 69c5ad3fabf66a8f4d9bcac9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:05:17,389 - lava_callback - INFO - Received callback for node 69c5ad96abf66a8f4d9bcad9 INFO: 172.21.0.1:39414 - "POST /node/69c5ad96abf66a8f4d9bcad9 HTTP/1.0" 202 Accepted 2026-03-28 22:05:17,395 - lava_callback - INFO - Starting async job submit for node 69c5ad96abf66a8f4d9bcad9 2026-03-28 22:05:17,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:05:17,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ad96abf66a8f4d9bcad9 HTTP/1.1" 200 None 2026-03-28 22:05:17,411 - lava_callback - DEBUG - Processing node 69c5ad96abf66a8f4d9bcad9: baseline-arm64-clabbe 2026-03-28 22:05:17,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ad96abf66a8f4d9bcad9 2026-03-28 22:05:17,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:05:17,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ad96abf66a8f4d9bcad9 HTTP/1.1" 200 None 2026-03-28 22:05:17,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:05:17,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 22:05:17,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:05:17,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ad96abf66a8f4d9bcad9 HTTP/1.1" 200 None 2026-03-28 22:05:17,471 - lava_callback - ERROR - Error processing callback for node 69c5ad96abf66a8f4d9bcad9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33782 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:06:57,413 - lava_callback - INFO - Received callback for node 69c5adebabf66a8f4d9bcae3 INFO: 172.21.0.1:33788 - "POST /node/69c5adebabf66a8f4d9bcae3 HTTP/1.0" 202 Accepted 2026-03-28 22:06:57,418 - lava_callback - INFO - Starting async job submit for node 69c5adebabf66a8f4d9bcae3 2026-03-28 22:06:57,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:06:57,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5adebabf66a8f4d9bcae3 HTTP/1.1" 200 None 2026-03-28 22:06:57,436 - lava_callback - DEBUG - Processing node 69c5adebabf66a8f4d9bcae3: baseline-arm64-clabbe 2026-03-28 22:06:57,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5adebabf66a8f4d9bcae3 2026-03-28 22:06:57,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:06:57,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5adebabf66a8f4d9bcae3 HTTP/1.1" 200 None 2026-03-28 22:06:57,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:06:57,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 22:06:57,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:06:57,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5adebabf66a8f4d9bcae3 HTTP/1.1" 200 None 2026-03-28 22:06:57,501 - lava_callback - ERROR - Error processing callback for node 69c5adebabf66a8f4d9bcae3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36036 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:08:17,455 - lava_callback - INFO - Received callback for node 69c5ae40abf66a8f4d9bcaf2 INFO: 172.21.0.1:36046 - "POST /node/69c5ae40abf66a8f4d9bcaf2 HTTP/1.0" 202 Accepted 2026-03-28 22:08:17,461 - lava_callback - INFO - Starting async job submit for node 69c5ae40abf66a8f4d9bcaf2 2026-03-28 22:08:17,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:08:17,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ae40abf66a8f4d9bcaf2 HTTP/1.1" 200 None 2026-03-28 22:08:17,498 - lava_callback - DEBUG - Processing node 69c5ae40abf66a8f4d9bcaf2: baseline-arm64-clabbe 2026-03-28 22:08:17,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ae40abf66a8f4d9bcaf2 2026-03-28 22:08:17,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:08:17,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ae40abf66a8f4d9bcaf2 HTTP/1.1" 200 None 2026-03-28 22:08:17,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:08:17,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 22:08:17,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:08:17,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ae40abf66a8f4d9bcaf2 HTTP/1.1" 200 None 2026-03-28 22:08:17,741 - lava_callback - ERROR - Error processing callback for node 69c5ae40abf66a8f4d9bcaf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59400 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:09:37,525 - lava_callback - INFO - Received callback for node 69c5ae94abf66a8f4d9bcb01 INFO: 172.21.0.1:59404 - "POST /node/69c5ae94abf66a8f4d9bcb01 HTTP/1.0" 202 Accepted 2026-03-28 22:09:37,531 - lava_callback - INFO - Starting async job submit for node 69c5ae94abf66a8f4d9bcb01 2026-03-28 22:09:37,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:09:37,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ae94abf66a8f4d9bcb01 HTTP/1.1" 200 None 2026-03-28 22:09:37,548 - lava_callback - DEBUG - Processing node 69c5ae94abf66a8f4d9bcb01: baseline-arm64-clabbe 2026-03-28 22:09:37,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ae94abf66a8f4d9bcb01 2026-03-28 22:09:37,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:09:37,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ae94abf66a8f4d9bcb01 HTTP/1.1" 200 None 2026-03-28 22:09:37,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:09:37,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 22:09:37,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:09:37,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ae94abf66a8f4d9bcb01 HTTP/1.1" 200 None 2026-03-28 22:09:37,610 - lava_callback - ERROR - Error processing callback for node 69c5ae94abf66a8f4d9bcb01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42160 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:10:57,700 - lava_callback - INFO - Received callback for node 69c5aee8abf66a8f4d9bcb11 INFO: 172.21.0.1:42164 - "POST /node/69c5aee8abf66a8f4d9bcb11 HTTP/1.0" 202 Accepted 2026-03-28 22:10:57,705 - lava_callback - INFO - Starting async job submit for node 69c5aee8abf66a8f4d9bcb11 2026-03-28 22:10:57,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:10:57,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5aee8abf66a8f4d9bcb11 HTTP/1.1" 200 None 2026-03-28 22:10:57,747 - lava_callback - DEBUG - Processing node 69c5aee8abf66a8f4d9bcb11: baseline-arm64-clabbe 2026-03-28 22:10:57,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5aee8abf66a8f4d9bcb11 2026-03-28 22:10:57,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:10:57,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5aee8abf66a8f4d9bcb11 HTTP/1.1" 200 None 2026-03-28 22:10:57,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:10:57,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 22:10:57,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:10:57,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5aee8abf66a8f4d9bcb11 HTTP/1.1" 200 None 2026-03-28 22:10:57,830 - lava_callback - ERROR - Error processing callback for node 69c5aee8abf66a8f4d9bcb11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:12:17,659 - lava_callback - INFO - Received callback for node 69c5af3dabf66a8f4d9bcb1e INFO: 172.21.0.1:44092 - "POST /node/69c5af3dabf66a8f4d9bcb1e HTTP/1.0" 202 Accepted 2026-03-28 22:12:17,665 - lava_callback - INFO - Starting async job submit for node 69c5af3dabf66a8f4d9bcb1e 2026-03-28 22:12:17,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:12:17,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5af3dabf66a8f4d9bcb1e HTTP/1.1" 200 None 2026-03-28 22:12:17,692 - lava_callback - DEBUG - Processing node 69c5af3dabf66a8f4d9bcb1e: baseline-arm64-clabbe 2026-03-28 22:12:17,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5af3dabf66a8f4d9bcb1e 2026-03-28 22:12:17,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:12:17,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5af3dabf66a8f4d9bcb1e HTTP/1.1" 200 None 2026-03-28 22:12:17,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:12:17,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 22:12:17,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:12:17,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5af3dabf66a8f4d9bcb1e HTTP/1.1" 200 None 2026-03-28 22:12:17,789 - lava_callback - ERROR - Error processing callback for node 69c5af3dabf66a8f4d9bcb1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56322 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:13:57,745 - lava_callback - INFO - Received callback for node 69c5af93abf66a8f4d9bcb2a INFO: 172.21.0.1:56324 - "POST /node/69c5af93abf66a8f4d9bcb2a HTTP/1.0" 202 Accepted 2026-03-28 22:13:57,751 - lava_callback - INFO - Starting async job submit for node 69c5af93abf66a8f4d9bcb2a 2026-03-28 22:13:57,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:13:57,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5af93abf66a8f4d9bcb2a HTTP/1.1" 200 None 2026-03-28 22:13:57,767 - lava_callback - DEBUG - Processing node 69c5af93abf66a8f4d9bcb2a: baseline-arm64-clabbe 2026-03-28 22:13:57,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5af93abf66a8f4d9bcb2a 2026-03-28 22:13:57,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:13:57,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5af93abf66a8f4d9bcb2a HTTP/1.1" 200 None 2026-03-28 22:13:57,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:13:57,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-03-28 22:13:57,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:13:57,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5af93abf66a8f4d9bcb2a HTTP/1.1" 200 None 2026-03-28 22:13:57,826 - lava_callback - ERROR - Error processing callback for node 69c5af93abf66a8f4d9bcb2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:43:18,038 - lava_callback - INFO - Received callback for node 69c5b678abf66a8f4d9bcb4b INFO: 172.21.0.1:60536 - "POST /node/69c5b678abf66a8f4d9bcb4b HTTP/1.0" 202 Accepted 2026-03-28 22:43:18,044 - lava_callback - INFO - Starting async job submit for node 69c5b678abf66a8f4d9bcb4b 2026-03-28 22:43:18,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:43:18,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b678abf66a8f4d9bcb4b HTTP/1.1" 200 None 2026-03-28 22:43:18,063 - lava_callback - DEBUG - Processing node 69c5b678abf66a8f4d9bcb4b: baseline-arm-baylibre 2026-03-28 22:43:18,063 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b678abf66a8f4d9bcb4b 2026-03-28 22:43:18,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:43:18,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b678abf66a8f4d9bcb4b HTTP/1.1" 200 None 2026-03-28 22:43:18,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:43:18,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 22:43:18,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:43:18,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b678abf66a8f4d9bcb4b HTTP/1.1" 200 None 2026-03-28 22:43:18,125 - lava_callback - ERROR - Error processing callback for node 69c5b678abf66a8f4d9bcb4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:43:57,933 - lava_callback - INFO - Received callback for node 69c5b69dabf66a8f4d9bcb5f INFO: 172.21.0.1:44460 - "POST /node/69c5b69dabf66a8f4d9bcb5f HTTP/1.0" 202 Accepted 2026-03-28 22:43:57,938 - lava_callback - INFO - Starting async job submit for node 69c5b69dabf66a8f4d9bcb5f 2026-03-28 22:43:57,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:43:57,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b69dabf66a8f4d9bcb5f HTTP/1.1" 200 None 2026-03-28 22:43:57,955 - lava_callback - DEBUG - Processing node 69c5b69dabf66a8f4d9bcb5f: baseline-arm-baylibre 2026-03-28 22:43:57,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b69dabf66a8f4d9bcb5f 2026-03-28 22:43:57,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:43:57,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b69dabf66a8f4d9bcb5f HTTP/1.1" 200 None 2026-03-28 22:43:57,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:43:57,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 22:43:57,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:43:58,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b69dabf66a8f4d9bcb5f HTTP/1.1" 200 None 2026-03-28 22:43:58,009 - lava_callback - ERROR - Error processing callback for node 69c5b69dabf66a8f4d9bcb5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37960 - "GET /node/69935169523507f3806a6fa2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET /node/69209900cf5990f5a4b73b11%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:45:38,061 - lava_callback - INFO - Received callback for node 69c5b708abf66a8f4d9bcb86 INFO: 172.21.0.1:39864 - "POST /node/69c5b708abf66a8f4d9bcb86 HTTP/1.0" 202 Accepted 2026-03-28 22:45:38,067 - lava_callback - INFO - Starting async job submit for node 69c5b708abf66a8f4d9bcb86 2026-03-28 22:45:38,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:45:38,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b708abf66a8f4d9bcb86 HTTP/1.1" 200 None 2026-03-28 22:45:38,083 - lava_callback - DEBUG - Processing node 69c5b708abf66a8f4d9bcb86: baseline-arm-baylibre 2026-03-28 22:45:38,083 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b708abf66a8f4d9bcb86 2026-03-28 22:45:38,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:45:38,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b708abf66a8f4d9bcb86 HTTP/1.1" 200 None 2026-03-28 22:45:38,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:45:38,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 22:45:38,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:45:38,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b708abf66a8f4d9bcb86 HTTP/1.1" 200 None 2026-03-28 22:45:38,139 - lava_callback - ERROR - Error processing callback for node 69c5b708abf66a8f4d9bcb86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET /node/698694692de8e2dea3665f69%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55780 - "GET /node/699280f298a8bdb31c395805%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:47:18,165 - lava_callback - INFO - Received callback for node 69c5b76aabf66a8f4d9bcba8 INFO: 172.21.0.1:55806 - "POST /node/69c5b76aabf66a8f4d9bcba8 HTTP/1.0" 202 Accepted 2026-03-28 22:47:18,170 - lava_callback - INFO - Starting async job submit for node 69c5b76aabf66a8f4d9bcba8 2026-03-28 22:47:18,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:47:18,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b76aabf66a8f4d9bcba8 HTTP/1.1" 200 None 2026-03-28 22:47:18,186 - lava_callback - DEBUG - Processing node 69c5b76aabf66a8f4d9bcba8: baseline-arm-baylibre 2026-03-28 22:47:18,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b76aabf66a8f4d9bcba8 2026-03-28 22:47:18,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:47:18,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b76aabf66a8f4d9bcba8 HTTP/1.1" 200 None 2026-03-28 22:47:18,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:47:18,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 22:47:18,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:47:18,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b76aabf66a8f4d9bcba8 HTTP/1.1" 200 None 2026-03-28 22:47:18,246 - lava_callback - ERROR - Error processing callback for node 69c5b76aabf66a8f4d9bcba8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60194 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:47:58,170 - lava_callback - INFO - Received callback for node 69c5b78fabf66a8f4d9bcbe0 INFO: 172.21.0.1:60202 - "POST /node/69c5b78fabf66a8f4d9bcbe0 HTTP/1.0" 202 Accepted 2026-03-28 22:47:58,175 - lava_callback - INFO - Starting async job submit for node 69c5b78fabf66a8f4d9bcbe0 2026-03-28 22:47:58,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:47:58,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b78fabf66a8f4d9bcbe0 HTTP/1.1" 200 None 2026-03-28 22:47:58,192 - lava_callback - DEBUG - Processing node 69c5b78fabf66a8f4d9bcbe0: baseline-arm-baylibre 2026-03-28 22:47:58,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b78fabf66a8f4d9bcbe0 2026-03-28 22:47:58,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:47:58,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b78fabf66a8f4d9bcbe0 HTTP/1.1" 200 None 2026-03-28 22:47:58,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:47:58,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 22:47:58,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:47:58,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b78fabf66a8f4d9bcbe0 HTTP/1.1" 200 None 2026-03-28 22:47:58,255 - lava_callback - ERROR - Error processing callback for node 69c5b78fabf66a8f4d9bcbe0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51374 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:48:38,257 - lava_callback - INFO - Received callback for node 69c5b7b4abf66a8f4d9bcbf2 INFO: 172.21.0.1:51378 - "POST /node/69c5b7b4abf66a8f4d9bcbf2 HTTP/1.0" 202 Accepted 2026-03-28 22:48:38,263 - lava_callback - INFO - Starting async job submit for node 69c5b7b4abf66a8f4d9bcbf2 2026-03-28 22:48:38,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:48:38,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b7b4abf66a8f4d9bcbf2 HTTP/1.1" 200 None 2026-03-28 22:48:38,279 - lava_callback - DEBUG - Processing node 69c5b7b4abf66a8f4d9bcbf2: baseline-arm-baylibre 2026-03-28 22:48:38,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b7b4abf66a8f4d9bcbf2 2026-03-28 22:48:38,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:48:38,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b7b4abf66a8f4d9bcbf2 HTTP/1.1" 200 None 2026-03-28 22:48:38,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:48:38,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 22:48:38,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:48:38,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b7b4abf66a8f4d9bcbf2 HTTP/1.1" 200 None 2026-03-28 22:48:38,345 - lava_callback - ERROR - Error processing callback for node 69c5b7b4abf66a8f4d9bcbf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58724 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:49:18,228 - lava_callback - INFO - Received callback for node 69c5b7d9abf66a8f4d9bcc02 INFO: 172.21.0.1:58730 - "POST /node/69c5b7d9abf66a8f4d9bcc02 HTTP/1.0" 202 Accepted 2026-03-28 22:49:18,233 - lava_callback - INFO - Starting async job submit for node 69c5b7d9abf66a8f4d9bcc02 2026-03-28 22:49:18,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:49:18,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b7d9abf66a8f4d9bcc02 HTTP/1.1" 200 None 2026-03-28 22:49:18,254 - lava_callback - DEBUG - Processing node 69c5b7d9abf66a8f4d9bcc02: baseline-arm-baylibre 2026-03-28 22:49:18,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b7d9abf66a8f4d9bcc02 2026-03-28 22:49:18,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:49:18,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b7d9abf66a8f4d9bcc02 HTTP/1.1" 200 None 2026-03-28 22:49:18,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:49:18,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 22:49:18,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:49:18,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b7d9abf66a8f4d9bcc02 HTTP/1.1" 200 None 2026-03-28 22:49:18,306 - lava_callback - ERROR - Error processing callback for node 69c5b7d9abf66a8f4d9bcc02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37268 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:49:38,246 - lava_callback - INFO - Received callback for node 69c5b7fdabf66a8f4d9bcc0e INFO: 172.21.0.1:37276 - "POST /node/69c5b7fdabf66a8f4d9bcc0e HTTP/1.0" 202 Accepted 2026-03-28 22:49:38,251 - lava_callback - INFO - Starting async job submit for node 69c5b7fdabf66a8f4d9bcc0e 2026-03-28 22:49:38,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:49:38,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b7fdabf66a8f4d9bcc0e HTTP/1.1" 200 None 2026-03-28 22:49:38,267 - lava_callback - DEBUG - Processing node 69c5b7fdabf66a8f4d9bcc0e: baseline-arm-baylibre 2026-03-28 22:49:38,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b7fdabf66a8f4d9bcc0e 2026-03-28 22:49:38,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:49:38,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b7fdabf66a8f4d9bcc0e HTTP/1.1" 200 None 2026-03-28 22:49:38,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:49:38,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 22:49:38,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:49:38,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b7fdabf66a8f4d9bcc0e HTTP/1.1" 200 None 2026-03-28 22:49:38,323 - lava_callback - ERROR - Error processing callback for node 69c5b7fdabf66a8f4d9bcc0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:50:18,330 - lava_callback - INFO - Received callback for node 69c5b822abf66a8f4d9bcc21 INFO: 172.21.0.1:51568 - "POST /node/69c5b822abf66a8f4d9bcc21 HTTP/1.0" 202 Accepted 2026-03-28 22:50:18,335 - lava_callback - INFO - Starting async job submit for node 69c5b822abf66a8f4d9bcc21 2026-03-28 22:50:18,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:50:18,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b822abf66a8f4d9bcc21 HTTP/1.1" 200 None 2026-03-28 22:50:18,360 - lava_callback - DEBUG - Processing node 69c5b822abf66a8f4d9bcc21: baseline-arm-baylibre 2026-03-28 22:50:18,360 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b822abf66a8f4d9bcc21 2026-03-28 22:50:18,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:50:18,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b822abf66a8f4d9bcc21 HTTP/1.1" 200 None 2026-03-28 22:50:18,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:50:18,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 22:50:18,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:50:18,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b822abf66a8f4d9bcc21 HTTP/1.1" 200 None 2026-03-28 22:50:18,420 - lava_callback - ERROR - Error processing callback for node 69c5b822abf66a8f4d9bcc21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:50:59,326 - lava_callback - INFO - Received callback for node 69c5b84aabf66a8f4d9bcc2a INFO: 172.21.0.1:59254 - "POST /node/69c5b84aabf66a8f4d9bcc2a HTTP/1.0" 202 Accepted 2026-03-28 22:50:59,331 - lava_callback - INFO - Starting async job submit for node 69c5b84aabf66a8f4d9bcc2a 2026-03-28 22:50:59,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:50:59,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b84aabf66a8f4d9bcc2a HTTP/1.1" 200 None 2026-03-28 22:50:59,347 - lava_callback - DEBUG - Processing node 69c5b84aabf66a8f4d9bcc2a: baseline-arm-clabbe 2026-03-28 22:50:59,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b84aabf66a8f4d9bcc2a 2026-03-28 22:50:59,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:50:59,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b84aabf66a8f4d9bcc2a HTTP/1.1" 200 None 2026-03-28 22:50:59,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:50:59,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 22:50:59,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:50:59,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b84aabf66a8f4d9bcc2a HTTP/1.1" 200 None 2026-03-28 22:50:59,405 - lava_callback - ERROR - Error processing callback for node 69c5b84aabf66a8f4d9bcc2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50088 - "GET /node/694a589a83c67c43d1ed9d2d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:51:39,217 - lava_callback - INFO - Received callback for node 69c5b870abf66a8f4d9bcc66 INFO: 172.21.0.1:39286 - "POST /node/69c5b870abf66a8f4d9bcc66 HTTP/1.0" 202 Accepted 2026-03-28 22:51:39,226 - lava_callback - INFO - Starting async job submit for node 69c5b870abf66a8f4d9bcc66 2026-03-28 22:51:39,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:51:39,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b870abf66a8f4d9bcc66 HTTP/1.1" 200 None 2026-03-28 22:51:39,242 - lava_callback - DEBUG - Processing node 69c5b870abf66a8f4d9bcc66: baseline-arm-clabbe 2026-03-28 22:51:39,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b870abf66a8f4d9bcc66 2026-03-28 22:51:39,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:51:39,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b870abf66a8f4d9bcc66 HTTP/1.1" 200 None 2026-03-28 22:51:39,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:51:39,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 22:51:39,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:51:39,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b870abf66a8f4d9bcc66 HTTP/1.1" 200 None 2026-03-28 22:51:39,298 - lava_callback - ERROR - Error processing callback for node 69c5b870abf66a8f4d9bcc66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:51:58,433 - lava_callback - INFO - Received callback for node 69c5b88cabf66a8f4d9bccd2 INFO: 172.21.0.1:35200 - "POST /node/69c5b88cabf66a8f4d9bccd2 HTTP/1.0" 202 Accepted 2026-03-28 22:51:58,438 - lava_callback - INFO - Starting async job submit for node 69c5b88cabf66a8f4d9bccd2 2026-03-28 22:51:58,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:51:58,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b88cabf66a8f4d9bccd2 HTTP/1.1" 200 None 2026-03-28 22:51:58,458 - lava_callback - DEBUG - Processing node 69c5b88cabf66a8f4d9bccd2: baseline-arm64-baylibre 2026-03-28 22:51:58,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b88cabf66a8f4d9bccd2 2026-03-28 22:51:58,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:51:58,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b88cabf66a8f4d9bccd2 HTTP/1.1" 200 None 2026-03-28 22:51:58,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:51:58,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-28 22:51:58,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:51:58,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b88cabf66a8f4d9bccd2 HTTP/1.1" 200 None 2026-03-28 22:51:58,509 - lava_callback - ERROR - Error processing callback for node 69c5b88cabf66a8f4d9bccd2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 22:51:59,118 - lava_callback - INFO - Received callback for node 69c5b88aabf66a8f4d9bcccd INFO: 172.21.0.1:35206 - "POST /node/69c5b88aabf66a8f4d9bcccd HTTP/1.0" 202 Accepted 2026-03-28 22:51:59,123 - lava_callback - INFO - Starting async job submit for node 69c5b88aabf66a8f4d9bcccd 2026-03-28 22:51:59,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:51:59,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b88aabf66a8f4d9bcccd HTTP/1.1" 200 None 2026-03-28 22:51:59,144 - lava_callback - DEBUG - Processing node 69c5b88aabf66a8f4d9bcccd: baseline-arm64-baylibre 2026-03-28 22:51:59,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b88aabf66a8f4d9bcccd 2026-03-28 22:51:59,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:51:59,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b88aabf66a8f4d9bcccd HTTP/1.1" 200 None 2026-03-28 22:51:59,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:51:59,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-28 22:51:59,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:51:59,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b88aabf66a8f4d9bcccd HTTP/1.1" 200 None 2026-03-28 22:51:59,200 - lava_callback - ERROR - Error processing callback for node 69c5b88aabf66a8f4d9bcccd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:52:18,406 - lava_callback - INFO - Received callback for node 69c5b891abf66a8f4d9bccdf INFO: 172.21.0.1:45920 - "POST /node/69c5b891abf66a8f4d9bccdf HTTP/1.0" 202 Accepted 2026-03-28 22:52:18,412 - lava_callback - INFO - Starting async job submit for node 69c5b891abf66a8f4d9bccdf 2026-03-28 22:52:18,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:18,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b891abf66a8f4d9bccdf HTTP/1.1" 200 None 2026-03-28 22:52:18,433 - lava_callback - DEBUG - Processing node 69c5b891abf66a8f4d9bccdf: baseline-arm64-baylibre 2026-03-28 22:52:18,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b891abf66a8f4d9bccdf 2026-03-28 22:52:18,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:18,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b891abf66a8f4d9bccdf HTTP/1.1" 200 None 2026-03-28 22:52:18,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:18,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-28 22:52:18,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:18,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b891abf66a8f4d9bccdf HTTP/1.1" 200 None 2026-03-28 22:52:18,522 - lava_callback - ERROR - Error processing callback for node 69c5b891abf66a8f4d9bccdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 22:52:19,064 - lava_callback - INFO - Received callback for node 69c5b88fabf66a8f4d9bccdc INFO: 172.21.0.1:45932 - "POST /node/69c5b88fabf66a8f4d9bccdc HTTP/1.0" 202 Accepted 2026-03-28 22:52:19,069 - lava_callback - INFO - Starting async job submit for node 69c5b88fabf66a8f4d9bccdc 2026-03-28 22:52:19,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:19,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b88fabf66a8f4d9bccdc HTTP/1.1" 200 None 2026-03-28 22:52:19,086 - lava_callback - DEBUG - Processing node 69c5b88fabf66a8f4d9bccdc: baseline-arm64-baylibre 2026-03-28 22:52:19,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b88fabf66a8f4d9bccdc 2026-03-28 22:52:19,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:19,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b88fabf66a8f4d9bccdc HTTP/1.1" 200 None 2026-03-28 22:52:19,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:19,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-28 22:52:19,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:19,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b88fabf66a8f4d9bccdc HTTP/1.1" 200 None 2026-03-28 22:52:19,156 - lava_callback - ERROR - Error processing callback for node 69c5b88fabf66a8f4d9bccdc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:52:39,314 - lava_callback - INFO - Received callback for node 69c5b8a2abf66a8f4d9bcd24 INFO: 172.21.0.1:54704 - "POST /node/69c5b8a2abf66a8f4d9bcd24 HTTP/1.0" 202 Accepted 2026-03-28 22:52:39,320 - lava_callback - INFO - Starting async job submit for node 69c5b8a2abf66a8f4d9bcd24 2026-03-28 22:52:39,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:39,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8a2abf66a8f4d9bcd24 HTTP/1.1" 200 None 2026-03-28 22:52:39,336 - lava_callback - DEBUG - Processing node 69c5b8a2abf66a8f4d9bcd24: baseline-arm64-clabbe 2026-03-28 22:52:39,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b8a2abf66a8f4d9bcd24 2026-03-28 22:52:39,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:39,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8a2abf66a8f4d9bcd24 HTTP/1.1" 200 None 2026-03-28 22:52:39,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:39,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-28 22:52:39,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:39,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b8a2abf66a8f4d9bcd24 HTTP/1.1" 200 None 2026-03-28 22:52:39,394 - lava_callback - ERROR - Error processing callback for node 69c5b8a2abf66a8f4d9bcd24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 22:52:39,987 - lava_callback - INFO - Received callback for node 69c5b8a4abf66a8f4d9bcd27 INFO: 172.21.0.1:47250 - "POST /node/69c5b8a4abf66a8f4d9bcd27 HTTP/1.0" 202 Accepted 2026-03-28 22:52:39,993 - lava_callback - INFO - Starting async job submit for node 69c5b8a4abf66a8f4d9bcd27 2026-03-28 22:52:39,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:40,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8a4abf66a8f4d9bcd27 HTTP/1.1" 200 None 2026-03-28 22:52:40,009 - lava_callback - DEBUG - Processing node 69c5b8a4abf66a8f4d9bcd27: baseline-arm64-clabbe 2026-03-28 22:52:40,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b8a4abf66a8f4d9bcd27 2026-03-28 22:52:40,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:40,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8a4abf66a8f4d9bcd27 HTTP/1.1" 200 None 2026-03-28 22:52:40,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:40,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-28 22:52:40,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:40,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b8a4abf66a8f4d9bcd27 HTTP/1.1" 200 None 2026-03-28 22:52:40,068 - lava_callback - ERROR - Error processing callback for node 69c5b8a4abf66a8f4d9bcd27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 22:52:40,681 - lava_callback - INFO - Received callback for node 69c5b8a5abf66a8f4d9bcd2a INFO: 172.21.0.1:47264 - "POST /node/69c5b8a5abf66a8f4d9bcd2a HTTP/1.0" 202 Accepted 2026-03-28 22:52:40,687 - lava_callback - INFO - Starting async job submit for node 69c5b8a5abf66a8f4d9bcd2a 2026-03-28 22:52:40,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:40,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8a5abf66a8f4d9bcd2a HTTP/1.1" 200 None 2026-03-28 22:52:40,704 - lava_callback - DEBUG - Processing node 69c5b8a5abf66a8f4d9bcd2a: baseline-arm64-clabbe 2026-03-28 22:52:40,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b8a5abf66a8f4d9bcd2a 2026-03-28 22:52:40,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:40,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8a5abf66a8f4d9bcd2a HTTP/1.1" 200 None 2026-03-28 22:52:40,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:40,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-28 22:52:40,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:40,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b8a5abf66a8f4d9bcd2a HTTP/1.1" 200 None 2026-03-28 22:52:40,756 - lava_callback - ERROR - Error processing callback for node 69c5b8a5abf66a8f4d9bcd2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 22:52:41,382 - lava_callback - INFO - Received callback for node 69c5b8a6abf66a8f4d9bcd2f INFO: 172.21.0.1:47278 - "POST /node/69c5b8a6abf66a8f4d9bcd2f HTTP/1.0" 202 Accepted 2026-03-28 22:52:41,388 - lava_callback - INFO - Starting async job submit for node 69c5b8a6abf66a8f4d9bcd2f 2026-03-28 22:52:41,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:41,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8a6abf66a8f4d9bcd2f HTTP/1.1" 200 None 2026-03-28 22:52:41,404 - lava_callback - DEBUG - Processing node 69c5b8a6abf66a8f4d9bcd2f: baseline-arm64-clabbe 2026-03-28 22:52:41,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b8a6abf66a8f4d9bcd2f 2026-03-28 22:52:41,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:41,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8a6abf66a8f4d9bcd2f HTTP/1.1" 200 None 2026-03-28 22:52:41,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:41,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-28 22:52:41,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:41,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b8a6abf66a8f4d9bcd2f HTTP/1.1" 200 None 2026-03-28 22:52:41,461 - lava_callback - ERROR - Error processing callback for node 69c5b8a6abf66a8f4d9bcd2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 22:52:42,069 - lava_callback - INFO - Received callback for node 69c5b8a7abf66a8f4d9bcd35 INFO: 172.21.0.1:47288 - "POST /node/69c5b8a7abf66a8f4d9bcd35 HTTP/1.0" 202 Accepted 2026-03-28 22:52:42,075 - lava_callback - INFO - Starting async job submit for node 69c5b8a7abf66a8f4d9bcd35 2026-03-28 22:52:42,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:42,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8a7abf66a8f4d9bcd35 HTTP/1.1" 200 None 2026-03-28 22:52:42,092 - lava_callback - DEBUG - Processing node 69c5b8a7abf66a8f4d9bcd35: baseline-arm64-clabbe 2026-03-28 22:52:42,092 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b8a7abf66a8f4d9bcd35 2026-03-28 22:52:42,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:42,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8a7abf66a8f4d9bcd35 HTTP/1.1" 200 None 2026-03-28 22:52:42,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:42,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-28 22:52:42,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:42,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b8a7abf66a8f4d9bcd35 HTTP/1.1" 200 None 2026-03-28 22:52:42,148 - lava_callback - ERROR - Error processing callback for node 69c5b8a7abf66a8f4d9bcd35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-28 22:52:42,754 - lava_callback - INFO - Received callback for node 69c5b8a8abf66a8f4d9bcd38 INFO: 172.21.0.1:47298 - "POST /node/69c5b8a8abf66a8f4d9bcd38 HTTP/1.0" 202 Accepted 2026-03-28 22:52:42,760 - lava_callback - INFO - Starting async job submit for node 69c5b8a8abf66a8f4d9bcd38 2026-03-28 22:52:42,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:42,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8a8abf66a8f4d9bcd38 HTTP/1.1" 200 None 2026-03-28 22:52:42,775 - lava_callback - DEBUG - Processing node 69c5b8a8abf66a8f4d9bcd38: baseline-arm64-clabbe 2026-03-28 22:52:42,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b8a8abf66a8f4d9bcd38 2026-03-28 22:52:42,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:42,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8a8abf66a8f4d9bcd38 HTTP/1.1" 200 None 2026-03-28 22:52:42,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:42,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-28 22:52:42,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:52:42,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b8a8abf66a8f4d9bcd38 HTTP/1.1" 200 None 2026-03-28 22:52:42,828 - lava_callback - ERROR - Error processing callback for node 69c5b8a8abf66a8f4d9bcd38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:53:18,461 - lava_callback - INFO - Received callback for node 69c5b8d8abf66a8f4d9bcd9c INFO: 172.21.0.1:42392 - "POST /node/69c5b8d8abf66a8f4d9bcd9c HTTP/1.0" 202 Accepted 2026-03-28 22:53:18,467 - lava_callback - INFO - Starting async job submit for node 69c5b8d8abf66a8f4d9bcd9c 2026-03-28 22:53:18,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:53:18,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8d8abf66a8f4d9bcd9c HTTP/1.1" 200 None 2026-03-28 22:53:18,483 - lava_callback - DEBUG - Processing node 69c5b8d8abf66a8f4d9bcd9c: baseline-arm-baylibre 2026-03-28 22:53:18,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b8d8abf66a8f4d9bcd9c 2026-03-28 22:53:18,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:53:18,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8d8abf66a8f4d9bcd9c HTTP/1.1" 200 None 2026-03-28 22:53:18,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:53:18,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 22:53:18,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:53:18,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b8d8abf66a8f4d9bcd9c HTTP/1.1" 200 None 2026-03-28 22:53:18,556 - lava_callback - ERROR - Error processing callback for node 69c5b8d8abf66a8f4d9bcd9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:53:58,503 - lava_callback - INFO - Received callback for node 69c5b8fdabf66a8f4d9bcdef INFO: 172.21.0.1:54688 - "POST /node/69c5b8fdabf66a8f4d9bcdef HTTP/1.0" 202 Accepted 2026-03-28 22:53:58,508 - lava_callback - INFO - Starting async job submit for node 69c5b8fdabf66a8f4d9bcdef 2026-03-28 22:53:58,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:53:58,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8fdabf66a8f4d9bcdef HTTP/1.1" 200 None 2026-03-28 22:53:58,523 - lava_callback - DEBUG - Processing node 69c5b8fdabf66a8f4d9bcdef: baseline-arm-baylibre 2026-03-28 22:53:58,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b8fdabf66a8f4d9bcdef 2026-03-28 22:53:58,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:53:58,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b8fdabf66a8f4d9bcdef HTTP/1.1" 200 None 2026-03-28 22:53:58,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:53:58,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 22:53:58,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:53:58,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b8fdabf66a8f4d9bcdef HTTP/1.1" 200 None 2026-03-28 22:53:58,606 - lava_callback - ERROR - Error processing callback for node 69c5b8fdabf66a8f4d9bcdef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:54:38,585 - lava_callback - INFO - Received callback for node 69c5b920abf66a8f4d9bce27 INFO: 172.21.0.1:51946 - "POST /node/69c5b920abf66a8f4d9bce27 HTTP/1.0" 202 Accepted 2026-03-28 22:54:38,590 - lava_callback - INFO - Starting async job submit for node 69c5b920abf66a8f4d9bce27 2026-03-28 22:54:38,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:54:38,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b920abf66a8f4d9bce27 HTTP/1.1" 200 None 2026-03-28 22:54:38,611 - lava_callback - DEBUG - Processing node 69c5b920abf66a8f4d9bce27: baseline-arm-baylibre 2026-03-28 22:54:38,611 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b920abf66a8f4d9bce27 2026-03-28 22:54:38,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:54:38,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b920abf66a8f4d9bce27 HTTP/1.1" 200 None 2026-03-28 22:54:38,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:54:38,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 22:54:38,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:54:38,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b920abf66a8f4d9bce27 HTTP/1.1" 200 None 2026-03-28 22:54:38,670 - lava_callback - ERROR - Error processing callback for node 69c5b920abf66a8f4d9bce27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52138 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:55:18,564 - lava_callback - INFO - Received callback for node 69c5b944abf66a8f4d9bce3e INFO: 172.21.0.1:52154 - "POST /node/69c5b944abf66a8f4d9bce3e HTTP/1.0" 202 Accepted 2026-03-28 22:55:18,570 - lava_callback - INFO - Starting async job submit for node 69c5b944abf66a8f4d9bce3e 2026-03-28 22:55:18,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:55:18,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b944abf66a8f4d9bce3e HTTP/1.1" 200 None 2026-03-28 22:55:18,585 - lava_callback - DEBUG - Processing node 69c5b944abf66a8f4d9bce3e: baseline-arm-baylibre 2026-03-28 22:55:18,586 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b944abf66a8f4d9bce3e 2026-03-28 22:55:18,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:55:18,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b944abf66a8f4d9bce3e HTTP/1.1" 200 None 2026-03-28 22:55:18,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:55:18,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 22:55:18,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:55:18,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b944abf66a8f4d9bce3e HTTP/1.1" 200 None 2026-03-28 22:55:18,648 - lava_callback - ERROR - Error processing callback for node 69c5b944abf66a8f4d9bce3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:55:58,628 - lava_callback - INFO - Received callback for node 69c5b969abf66a8f4d9bce53 INFO: 172.21.0.1:46984 - "POST /node/69c5b969abf66a8f4d9bce53 HTTP/1.0" 202 Accepted 2026-03-28 22:55:58,634 - lava_callback - INFO - Starting async job submit for node 69c5b969abf66a8f4d9bce53 2026-03-28 22:55:58,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:55:58,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b969abf66a8f4d9bce53 HTTP/1.1" 200 None 2026-03-28 22:55:58,649 - lava_callback - DEBUG - Processing node 69c5b969abf66a8f4d9bce53: baseline-arm-baylibre 2026-03-28 22:55:58,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b969abf66a8f4d9bce53 2026-03-28 22:55:58,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:55:58,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b969abf66a8f4d9bce53 HTTP/1.1" 200 None 2026-03-28 22:55:58,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:55:58,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 22:55:58,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:55:58,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b969abf66a8f4d9bce53 HTTP/1.1" 200 None 2026-03-28 22:55:58,723 - lava_callback - ERROR - Error processing callback for node 69c5b969abf66a8f4d9bce53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:56:18,609 - lava_callback - INFO - Received callback for node 69c5b98dabf66a8f4d9bce6a INFO: 172.21.0.1:57998 - "POST /node/69c5b98dabf66a8f4d9bce6a HTTP/1.0" 202 Accepted 2026-03-28 22:56:18,618 - lava_callback - INFO - Starting async job submit for node 69c5b98dabf66a8f4d9bce6a 2026-03-28 22:56:18,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:56:18,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b98dabf66a8f4d9bce6a HTTP/1.1" 200 None 2026-03-28 22:56:18,635 - lava_callback - DEBUG - Processing node 69c5b98dabf66a8f4d9bce6a: baseline-arm-baylibre 2026-03-28 22:56:18,635 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b98dabf66a8f4d9bce6a 2026-03-28 22:56:18,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:56:18,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b98dabf66a8f4d9bce6a HTTP/1.1" 200 None 2026-03-28 22:56:18,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:56:18,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 22:56:18,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:56:18,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b98dabf66a8f4d9bce6a HTTP/1.1" 200 None 2026-03-28 22:56:18,687 - lava_callback - ERROR - Error processing callback for node 69c5b98dabf66a8f4d9bce6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56244 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:58:19,484 - lava_callback - INFO - Received callback for node 69c5b9f8abf66a8f4d9bce91 INFO: 172.21.0.1:56258 - "POST /node/69c5b9f8abf66a8f4d9bce91 HTTP/1.0" 202 Accepted 2026-03-28 22:58:19,490 - lava_callback - INFO - Starting async job submit for node 69c5b9f8abf66a8f4d9bce91 2026-03-28 22:58:19,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:58:19,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b9f8abf66a8f4d9bce91 HTTP/1.1" 200 None 2026-03-28 22:58:19,509 - lava_callback - DEBUG - Processing node 69c5b9f8abf66a8f4d9bce91: baseline-arm-clabbe 2026-03-28 22:58:19,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5b9f8abf66a8f4d9bce91 2026-03-28 22:58:19,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:58:19,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b9f8abf66a8f4d9bce91 HTTP/1.1" 200 None 2026-03-28 22:58:19,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:58:19,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 22:58:19,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:58:19,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5b9f8abf66a8f4d9bce91 HTTP/1.1" 200 None 2026-03-28 22:58:19,596 - lava_callback - ERROR - Error processing callback for node 69c5b9f8abf66a8f4d9bce91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:58:39,533 - lava_callback - INFO - Received callback for node 69c5ba1cabf66a8f4d9bce9e INFO: 172.21.0.1:39774 - "POST /node/69c5ba1cabf66a8f4d9bce9e HTTP/1.0" 202 Accepted 2026-03-28 22:58:39,539 - lava_callback - INFO - Starting async job submit for node 69c5ba1cabf66a8f4d9bce9e 2026-03-28 22:58:39,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:58:39,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ba1cabf66a8f4d9bce9e HTTP/1.1" 200 None 2026-03-28 22:58:39,557 - lava_callback - DEBUG - Processing node 69c5ba1cabf66a8f4d9bce9e: baseline-arm-clabbe 2026-03-28 22:58:39,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ba1cabf66a8f4d9bce9e 2026-03-28 22:58:39,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:58:39,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ba1cabf66a8f4d9bce9e HTTP/1.1" 200 None 2026-03-28 22:58:39,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:58:39,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 22:58:39,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:58:39,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ba1cabf66a8f4d9bce9e HTTP/1.1" 200 None 2026-03-28 22:58:39,624 - lava_callback - ERROR - Error processing callback for node 69c5ba1cabf66a8f4d9bce9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:59:19,559 - lava_callback - INFO - Received callback for node 69c5ba40abf66a8f4d9bceb3 INFO: 172.21.0.1:41850 - "POST /node/69c5ba40abf66a8f4d9bceb3 HTTP/1.0" 202 Accepted 2026-03-28 22:59:19,565 - lava_callback - INFO - Starting async job submit for node 69c5ba40abf66a8f4d9bceb3 2026-03-28 22:59:19,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:59:19,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ba40abf66a8f4d9bceb3 HTTP/1.1" 200 None 2026-03-28 22:59:19,580 - lava_callback - DEBUG - Processing node 69c5ba40abf66a8f4d9bceb3: baseline-arm-clabbe 2026-03-28 22:59:19,581 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ba40abf66a8f4d9bceb3 2026-03-28 22:59:19,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:59:19,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ba40abf66a8f4d9bceb3 HTTP/1.1" 200 None 2026-03-28 22:59:19,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:59:19,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 22:59:19,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:59:19,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ba40abf66a8f4d9bceb3 HTTP/1.1" 200 None 2026-03-28 22:59:19,633 - lava_callback - ERROR - Error processing callback for node 69c5ba40abf66a8f4d9bceb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK 2026-03-28 22:59:59,587 - lava_callback - INFO - Received callback for node 69c5ba64abf66a8f4d9bcebe INFO: 172.21.0.1:38306 - "POST /node/69c5ba64abf66a8f4d9bcebe HTTP/1.0" 202 Accepted 2026-03-28 22:59:59,592 - lava_callback - INFO - Starting async job submit for node 69c5ba64abf66a8f4d9bcebe 2026-03-28 22:59:59,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:59:59,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ba64abf66a8f4d9bcebe HTTP/1.1" 200 None 2026-03-28 22:59:59,608 - lava_callback - DEBUG - Processing node 69c5ba64abf66a8f4d9bcebe: baseline-arm-clabbe 2026-03-28 22:59:59,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ba64abf66a8f4d9bcebe 2026-03-28 22:59:59,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:59:59,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ba64abf66a8f4d9bcebe HTTP/1.1" 200 None 2026-03-28 22:59:59,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:59:59,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 22:59:59,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 22:59:59,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ba64abf66a8f4d9bcebe HTTP/1.1" 200 None 2026-03-28 22:59:59,673 - lava_callback - ERROR - Error processing callback for node 69c5ba64abf66a8f4d9bcebe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:00:39,632 - lava_callback - INFO - Received callback for node 69c5ba89abf66a8f4d9bcece INFO: 172.21.0.1:58004 - "POST /node/69c5ba89abf66a8f4d9bcece HTTP/1.0" 202 Accepted 2026-03-28 23:00:39,638 - lava_callback - INFO - Starting async job submit for node 69c5ba89abf66a8f4d9bcece 2026-03-28 23:00:39,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:00:39,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ba89abf66a8f4d9bcece HTTP/1.1" 200 None 2026-03-28 23:00:39,667 - lava_callback - DEBUG - Processing node 69c5ba89abf66a8f4d9bcece: baseline-arm-clabbe 2026-03-28 23:00:39,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ba89abf66a8f4d9bcece 2026-03-28 23:00:39,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:00:39,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ba89abf66a8f4d9bcece HTTP/1.1" 200 None 2026-03-28 23:00:39,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:00:39,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-28 23:00:39,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:00:39,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ba89abf66a8f4d9bcece HTTP/1.1" 200 None 2026-03-28 23:00:39,723 - lava_callback - ERROR - Error processing callback for node 69c5ba89abf66a8f4d9bcece: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:01:19,608 - lava_callback - INFO - Received callback for node 69c5baadabf66a8f4d9bcedb INFO: 172.21.0.1:46574 - "POST /node/69c5baadabf66a8f4d9bcedb HTTP/1.0" 202 Accepted 2026-03-28 23:01:19,614 - lava_callback - INFO - Starting async job submit for node 69c5baadabf66a8f4d9bcedb 2026-03-28 23:01:19,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:01:19,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5baadabf66a8f4d9bcedb HTTP/1.1" 200 None 2026-03-28 23:01:19,629 - lava_callback - DEBUG - Processing node 69c5baadabf66a8f4d9bcedb: baseline-arm-clabbe 2026-03-28 23:01:19,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5baadabf66a8f4d9bcedb 2026-03-28 23:01:19,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:01:19,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5baadabf66a8f4d9bcedb HTTP/1.1" 200 None 2026-03-28 23:01:19,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:01:19,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 23:01:19,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:01:19,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5baadabf66a8f4d9bcedb HTTP/1.1" 200 None 2026-03-28 23:01:19,684 - lava_callback - ERROR - Error processing callback for node 69c5baadabf66a8f4d9bcedb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36864 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:01:59,688 - lava_callback - INFO - Received callback for node 69c5bad1abf66a8f4d9bceeb INFO: 172.21.0.1:36872 - "POST /node/69c5bad1abf66a8f4d9bceeb HTTP/1.0" 202 Accepted 2026-03-28 23:01:59,694 - lava_callback - INFO - Starting async job submit for node 69c5bad1abf66a8f4d9bceeb 2026-03-28 23:01:59,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:01:59,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bad1abf66a8f4d9bceeb HTTP/1.1" 200 None 2026-03-28 23:01:59,710 - lava_callback - DEBUG - Processing node 69c5bad1abf66a8f4d9bceeb: baseline-arm-clabbe 2026-03-28 23:01:59,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5bad1abf66a8f4d9bceeb 2026-03-28 23:01:59,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:01:59,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bad1abf66a8f4d9bceeb HTTP/1.1" 200 None 2026-03-28 23:01:59,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:01:59,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 23:01:59,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:01:59,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5bad1abf66a8f4d9bceeb HTTP/1.1" 200 None 2026-03-28 23:01:59,768 - lava_callback - ERROR - Error processing callback for node 69c5bad1abf66a8f4d9bceeb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54734 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:02:19,693 - lava_callback - INFO - Received callback for node 69c5baf6abf66a8f4d9bcefa INFO: 172.21.0.1:54738 - "POST /node/69c5baf6abf66a8f4d9bcefa HTTP/1.0" 202 Accepted 2026-03-28 23:02:19,699 - lava_callback - INFO - Starting async job submit for node 69c5baf6abf66a8f4d9bcefa 2026-03-28 23:02:19,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:02:19,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5baf6abf66a8f4d9bcefa HTTP/1.1" 200 None 2026-03-28 23:02:19,715 - lava_callback - DEBUG - Processing node 69c5baf6abf66a8f4d9bcefa: baseline-arm-clabbe 2026-03-28 23:02:19,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5baf6abf66a8f4d9bcefa 2026-03-28 23:02:19,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:02:19,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5baf6abf66a8f4d9bcefa HTTP/1.1" 200 None 2026-03-28 23:02:19,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:02:19,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 23:02:19,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:02:19,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5baf6abf66a8f4d9bcefa HTTP/1.1" 200 None 2026-03-28 23:02:19,776 - lava_callback - ERROR - Error processing callback for node 69c5baf6abf66a8f4d9bcefa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43072 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:02:59,742 - lava_callback - INFO - Received callback for node 69c5bb19abf66a8f4d9bcf06 INFO: 172.21.0.1:45660 - "POST /node/69c5bb19abf66a8f4d9bcf06 HTTP/1.0" 202 Accepted 2026-03-28 23:02:59,747 - lava_callback - INFO - Starting async job submit for node 69c5bb19abf66a8f4d9bcf06 2026-03-28 23:02:59,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:02:59,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bb19abf66a8f4d9bcf06 HTTP/1.1" 200 None 2026-03-28 23:02:59,765 - lava_callback - DEBUG - Processing node 69c5bb19abf66a8f4d9bcf06: baseline-arm-clabbe 2026-03-28 23:02:59,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5bb19abf66a8f4d9bcf06 2026-03-28 23:02:59,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:02:59,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bb19abf66a8f4d9bcf06 HTTP/1.1" 200 None 2026-03-28 23:02:59,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:02:59,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 23:02:59,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:02:59,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5bb19abf66a8f4d9bcf06 HTTP/1.1" 200 None 2026-03-28 23:02:59,825 - lava_callback - ERROR - Error processing callback for node 69c5bb19abf66a8f4d9bcf06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:03:39,732 - lava_callback - INFO - Received callback for node 69c5bb3dabf66a8f4d9bcf11 INFO: 172.21.0.1:50504 - "POST /node/69c5bb3dabf66a8f4d9bcf11 HTTP/1.0" 202 Accepted 2026-03-28 23:03:39,737 - lava_callback - INFO - Starting async job submit for node 69c5bb3dabf66a8f4d9bcf11 2026-03-28 23:03:39,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:03:39,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bb3dabf66a8f4d9bcf11 HTTP/1.1" 200 None 2026-03-28 23:03:39,753 - lava_callback - DEBUG - Processing node 69c5bb3dabf66a8f4d9bcf11: baseline-arm-clabbe 2026-03-28 23:03:39,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5bb3dabf66a8f4d9bcf11 2026-03-28 23:03:39,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:03:39,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bb3dabf66a8f4d9bcf11 HTTP/1.1" 200 None 2026-03-28 23:03:39,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:03:39,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 23:03:39,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:03:39,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5bb3dabf66a8f4d9bcf11 HTTP/1.1" 200 None 2026-03-28 23:03:39,805 - lava_callback - ERROR - Error processing callback for node 69c5bb3dabf66a8f4d9bcf11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59782 - "GET /node/698456f33a8748f28208493f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:04:19,791 - lava_callback - INFO - Received callback for node 69c5bb60abf66a8f4d9bcf1a INFO: 172.21.0.1:47466 - "POST /node/69c5bb60abf66a8f4d9bcf1a HTTP/1.0" 202 Accepted 2026-03-28 23:04:19,799 - lava_callback - INFO - Starting async job submit for node 69c5bb60abf66a8f4d9bcf1a 2026-03-28 23:04:19,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:04:19,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bb60abf66a8f4d9bcf1a HTTP/1.1" 200 None 2026-03-28 23:04:19,824 - lava_callback - DEBUG - Processing node 69c5bb60abf66a8f4d9bcf1a: baseline-arm-clabbe 2026-03-28 23:04:19,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5bb60abf66a8f4d9bcf1a 2026-03-28 23:04:19,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:04:19,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bb60abf66a8f4d9bcf1a HTTP/1.1" 200 None 2026-03-28 23:04:19,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:04:19,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 23:04:19,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:04:19,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5bb60abf66a8f4d9bcf1a HTTP/1.1" 200 None 2026-03-28 23:04:19,877 - lava_callback - ERROR - Error processing callback for node 69c5bb60abf66a8f4d9bcf1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59192 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:04:39,787 - lava_callback - INFO - Received callback for node 69c5bb85abf66a8f4d9bcf26 INFO: 172.21.0.1:53302 - "POST /node/69c5bb85abf66a8f4d9bcf26 HTTP/1.0" 202 Accepted 2026-03-28 23:04:39,793 - lava_callback - INFO - Starting async job submit for node 69c5bb85abf66a8f4d9bcf26 2026-03-28 23:04:39,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:04:39,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bb85abf66a8f4d9bcf26 HTTP/1.1" 200 None 2026-03-28 23:04:39,809 - lava_callback - DEBUG - Processing node 69c5bb85abf66a8f4d9bcf26: baseline-arm-clabbe 2026-03-28 23:04:39,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5bb85abf66a8f4d9bcf26 2026-03-28 23:04:39,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:04:39,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bb85abf66a8f4d9bcf26 HTTP/1.1" 200 None 2026-03-28 23:04:39,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:04:39,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 23:04:39,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:04:39,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5bb85abf66a8f4d9bcf26 HTTP/1.1" 200 None 2026-03-28 23:04:39,866 - lava_callback - ERROR - Error processing callback for node 69c5bb85abf66a8f4d9bcf26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:05:19,761 - lava_callback - INFO - Received callback for node 69c5bba8abf66a8f4d9bcf33 INFO: 172.21.0.1:54120 - "POST /node/69c5bba8abf66a8f4d9bcf33 HTTP/1.0" 202 Accepted 2026-03-28 23:05:19,767 - lava_callback - INFO - Starting async job submit for node 69c5bba8abf66a8f4d9bcf33 2026-03-28 23:05:19,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:05:19,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bba8abf66a8f4d9bcf33 HTTP/1.1" 200 None 2026-03-28 23:05:19,783 - lava_callback - DEBUG - Processing node 69c5bba8abf66a8f4d9bcf33: baseline-arm-clabbe 2026-03-28 23:05:19,784 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5bba8abf66a8f4d9bcf33 2026-03-28 23:05:19,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:05:19,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bba8abf66a8f4d9bcf33 HTTP/1.1" 200 None 2026-03-28 23:05:19,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:05:19,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-28 23:05:19,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:05:19,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5bba8abf66a8f4d9bcf33 HTTP/1.1" 200 None 2026-03-28 23:05:19,868 - lava_callback - ERROR - Error processing callback for node 69c5bba8abf66a8f4d9bcf33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55176 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:08:59,344 - lava_callback - INFO - Received callback for node 69c5bc76abf66a8f4d9bcf89 INFO: 172.21.0.1:55192 - "POST /node/69c5bc76abf66a8f4d9bcf89 HTTP/1.0" 202 Accepted 2026-03-28 23:08:59,350 - lava_callback - INFO - Starting async job submit for node 69c5bc76abf66a8f4d9bcf89 2026-03-28 23:08:59,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:08:59,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bc76abf66a8f4d9bcf89 HTTP/1.1" 200 None 2026-03-28 23:08:59,366 - lava_callback - DEBUG - Processing node 69c5bc76abf66a8f4d9bcf89: baseline-arm-baylibre 2026-03-28 23:08:59,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5bc76abf66a8f4d9bcf89 2026-03-28 23:08:59,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:08:59,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bc76abf66a8f4d9bcf89 HTTP/1.1" 200 None 2026-03-28 23:08:59,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:08:59,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:08:59,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:08:59,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5bc76abf66a8f4d9bcf89 HTTP/1.1" 200 None 2026-03-28 23:08:59,418 - lava_callback - ERROR - Error processing callback for node 69c5bc76abf66a8f4d9bcf89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:12:19,480 - lava_callback - INFO - Received callback for node 69c5bd45abf66a8f4d9bcfba INFO: 172.21.0.1:42212 - "POST /node/69c5bd45abf66a8f4d9bcfba HTTP/1.0" 202 Accepted 2026-03-28 23:12:19,486 - lava_callback - INFO - Starting async job submit for node 69c5bd45abf66a8f4d9bcfba 2026-03-28 23:12:19,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:12:19,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bd45abf66a8f4d9bcfba HTTP/1.1" 200 None 2026-03-28 23:12:19,502 - lava_callback - DEBUG - Processing node 69c5bd45abf66a8f4d9bcfba: baseline-arm-baylibre 2026-03-28 23:12:19,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5bd45abf66a8f4d9bcfba 2026-03-28 23:12:19,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:12:19,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bd45abf66a8f4d9bcfba HTTP/1.1" 200 None 2026-03-28 23:12:19,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:12:19,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:12:19,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:12:19,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5bd45abf66a8f4d9bcfba HTTP/1.1" 200 None 2026-03-28 23:12:19,584 - lava_callback - ERROR - Error processing callback for node 69c5bd45abf66a8f4d9bcfba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35480 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:15:39,698 - lava_callback - INFO - Received callback for node 69c5be10abf66a8f4d9bcff0 INFO: 172.21.0.1:32872 - "POST /node/69c5be10abf66a8f4d9bcff0 HTTP/1.0" 202 Accepted 2026-03-28 23:15:39,703 - lava_callback - INFO - Starting async job submit for node 69c5be10abf66a8f4d9bcff0 2026-03-28 23:15:39,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:15:39,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5be10abf66a8f4d9bcff0 HTTP/1.1" 200 None 2026-03-28 23:15:39,719 - lava_callback - DEBUG - Processing node 69c5be10abf66a8f4d9bcff0: baseline-arm-baylibre 2026-03-28 23:15:39,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5be10abf66a8f4d9bcff0 2026-03-28 23:15:39,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:15:39,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5be10abf66a8f4d9bcff0 HTTP/1.1" 200 None 2026-03-28 23:15:39,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:15:39,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:15:39,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:15:39,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5be10abf66a8f4d9bcff0 HTTP/1.1" 200 None 2026-03-28 23:15:39,821 - lava_callback - ERROR - Error processing callback for node 69c5be10abf66a8f4d9bcff0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41750 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:17:39,804 - lava_callback - INFO - Received callback for node 69c5be8aabf66a8f4d9bd014 INFO: 172.21.0.1:60548 - "POST /node/69c5be8aabf66a8f4d9bd014 HTTP/1.0" 202 Accepted 2026-03-28 23:17:39,810 - lava_callback - INFO - Starting async job submit for node 69c5be8aabf66a8f4d9bd014 2026-03-28 23:17:39,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:17:39,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5be8aabf66a8f4d9bd014 HTTP/1.1" 200 None 2026-03-28 23:17:39,825 - lava_callback - DEBUG - Processing node 69c5be8aabf66a8f4d9bd014: baseline-arm-baylibre 2026-03-28 23:17:39,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5be8aabf66a8f4d9bd014 2026-03-28 23:17:39,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:17:39,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5be8aabf66a8f4d9bd014 HTTP/1.1" 200 None 2026-03-28 23:17:39,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:17:39,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:17:39,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:17:39,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5be8aabf66a8f4d9bd014 HTTP/1.1" 200 None 2026-03-28 23:17:39,910 - lava_callback - ERROR - Error processing callback for node 69c5be8aabf66a8f4d9bd014: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:18:19,790 - lava_callback - INFO - Received callback for node 69c5beb1abf66a8f4d9bd022 INFO: 172.21.0.1:57220 - "POST /node/69c5beb1abf66a8f4d9bd022 HTTP/1.0" 202 Accepted 2026-03-28 23:18:19,796 - lava_callback - INFO - Starting async job submit for node 69c5beb1abf66a8f4d9bd022 2026-03-28 23:18:19,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:18:19,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5beb1abf66a8f4d9bd022 HTTP/1.1" 200 None 2026-03-28 23:18:19,811 - lava_callback - DEBUG - Processing node 69c5beb1abf66a8f4d9bd022: baseline-arm-baylibre 2026-03-28 23:18:19,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5beb1abf66a8f4d9bd022 2026-03-28 23:18:19,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:18:19,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5beb1abf66a8f4d9bd022 HTTP/1.1" 200 None 2026-03-28 23:18:19,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:18:19,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:18:19,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:18:19,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5beb1abf66a8f4d9bd022 HTTP/1.1" 200 None 2026-03-28 23:18:19,863 - lava_callback - ERROR - Error processing callback for node 69c5beb1abf66a8f4d9bd022: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53622 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:18:59,864 - lava_callback - INFO - Received callback for node 69c5bed7abf66a8f4d9bd033 INFO: 172.21.0.1:34562 - "POST /node/69c5bed7abf66a8f4d9bd033 HTTP/1.0" 202 Accepted 2026-03-28 23:18:59,869 - lava_callback - INFO - Starting async job submit for node 69c5bed7abf66a8f4d9bd033 2026-03-28 23:18:59,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:18:59,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bed7abf66a8f4d9bd033 HTTP/1.1" 200 None 2026-03-28 23:18:59,886 - lava_callback - DEBUG - Processing node 69c5bed7abf66a8f4d9bd033: baseline-arm-baylibre 2026-03-28 23:18:59,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5bed7abf66a8f4d9bd033 2026-03-28 23:18:59,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:18:59,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bed7abf66a8f4d9bd033 HTTP/1.1" 200 None 2026-03-28 23:18:59,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:18:59,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:18:59,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:18:59,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5bed7abf66a8f4d9bd033 HTTP/1.1" 200 None 2026-03-28 23:18:59,969 - lava_callback - ERROR - Error processing callback for node 69c5bed7abf66a8f4d9bd033: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:20:20,456 - lava_callback - INFO - Received callback for node 69c5bf25abf66a8f4d9bd04a INFO: 172.21.0.1:51852 - "POST /node/69c5bf25abf66a8f4d9bd04a HTTP/1.0" 202 Accepted 2026-03-28 23:20:20,461 - lava_callback - INFO - Starting async job submit for node 69c5bf25abf66a8f4d9bd04a 2026-03-28 23:20:20,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:20:20,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bf25abf66a8f4d9bd04a HTTP/1.1" 200 None 2026-03-28 23:20:20,478 - lava_callback - DEBUG - Processing node 69c5bf25abf66a8f4d9bd04a: baseline-arm-clabbe 2026-03-28 23:20:20,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5bf25abf66a8f4d9bd04a 2026-03-28 23:20:20,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:20:20,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bf25abf66a8f4d9bd04a HTTP/1.1" 200 None 2026-03-28 23:20:20,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:20:20,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:20:20,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:20:20,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5bf25abf66a8f4d9bd04a HTTP/1.1" 200 None 2026-03-28 23:20:20,557 - lava_callback - ERROR - Error processing callback for node 69c5bf25abf66a8f4d9bd04a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:23:40,574 - lava_callback - INFO - Received callback for node 69c5bfe6abf66a8f4d9bd098 INFO: 172.21.0.1:52208 - "POST /node/69c5bfe6abf66a8f4d9bd098 HTTP/1.0" 202 Accepted 2026-03-28 23:23:40,580 - lava_callback - INFO - Starting async job submit for node 69c5bfe6abf66a8f4d9bd098 2026-03-28 23:23:40,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:23:40,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bfe6abf66a8f4d9bd098 HTTP/1.1" 200 None 2026-03-28 23:23:40,603 - lava_callback - DEBUG - Processing node 69c5bfe6abf66a8f4d9bd098: baseline-arm-clabbe 2026-03-28 23:23:40,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5bfe6abf66a8f4d9bd098 2026-03-28 23:23:40,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:23:40,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5bfe6abf66a8f4d9bd098 HTTP/1.1" 200 None 2026-03-28 23:23:40,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:23:40,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:23:40,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:23:40,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5bfe6abf66a8f4d9bd098 HTTP/1.1" 200 None 2026-03-28 23:23:40,658 - lava_callback - ERROR - Error processing callback for node 69c5bfe6abf66a8f4d9bd098: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:26:20,625 - lava_callback - INFO - Received callback for node 69c5c08aabf66a8f4d9bd0dc INFO: 172.21.0.1:59548 - "POST /node/69c5c08aabf66a8f4d9bd0dc HTTP/1.0" 202 Accepted 2026-03-28 23:26:20,630 - lava_callback - INFO - Starting async job submit for node 69c5c08aabf66a8f4d9bd0dc 2026-03-28 23:26:20,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:26:20,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c08aabf66a8f4d9bd0dc HTTP/1.1" 200 None 2026-03-28 23:26:20,646 - lava_callback - DEBUG - Processing node 69c5c08aabf66a8f4d9bd0dc: baseline-arm-clabbe 2026-03-28 23:26:20,647 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c08aabf66a8f4d9bd0dc 2026-03-28 23:26:20,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:26:20,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c08aabf66a8f4d9bd0dc HTTP/1.1" 200 None 2026-03-28 23:26:20,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:26:20,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:26:20,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:26:20,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c08aabf66a8f4d9bd0dc HTTP/1.1" 200 None 2026-03-28 23:26:20,716 - lava_callback - ERROR - Error processing callback for node 69c5c08aabf66a8f4d9bd0dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:27:00,615 - lava_callback - INFO - Received callback for node 69c5c0b0abf66a8f4d9bd0eb INFO: 172.21.0.1:54274 - "POST /node/69c5c0b0abf66a8f4d9bd0eb HTTP/1.0" 202 Accepted 2026-03-28 23:27:00,620 - lava_callback - INFO - Starting async job submit for node 69c5c0b0abf66a8f4d9bd0eb 2026-03-28 23:27:00,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:27:00,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c0b0abf66a8f4d9bd0eb HTTP/1.1" 200 None 2026-03-28 23:27:00,636 - lava_callback - DEBUG - Processing node 69c5c0b0abf66a8f4d9bd0eb: baseline-arm-clabbe 2026-03-28 23:27:00,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c0b0abf66a8f4d9bd0eb 2026-03-28 23:27:00,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:27:00,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c0b0abf66a8f4d9bd0eb HTTP/1.1" 200 None 2026-03-28 23:27:00,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:27:00,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:27:00,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:27:00,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c0b0abf66a8f4d9bd0eb HTTP/1.1" 200 None 2026-03-28 23:27:00,701 - lava_callback - ERROR - Error processing callback for node 69c5c0b0abf66a8f4d9bd0eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:28:00,502 - lava_callback - INFO - Received callback for node 69c5c0f8abf66a8f4d9bd104 INFO: 172.21.0.1:35024 - "POST /node/69c5c0f8abf66a8f4d9bd104 HTTP/1.0" 202 Accepted 2026-03-28 23:28:00,508 - lava_callback - INFO - Starting async job submit for node 69c5c0f8abf66a8f4d9bd104 2026-03-28 23:28:00,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:28:00,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c0f8abf66a8f4d9bd104 HTTP/1.1" 200 None 2026-03-28 23:28:00,525 - lava_callback - DEBUG - Processing node 69c5c0f8abf66a8f4d9bd104: baseline-arm-baylibre 2026-03-28 23:28:00,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c0f8abf66a8f4d9bd104 2026-03-28 23:28:00,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:28:00,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c0f8abf66a8f4d9bd104 HTTP/1.1" 200 None 2026-03-28 23:28:00,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:28:00,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:28:00,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:28:00,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c0f8abf66a8f4d9bd104 HTTP/1.1" 200 None 2026-03-28 23:28:00,607 - lava_callback - ERROR - Error processing callback for node 69c5c0f8abf66a8f4d9bd104: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:30:40,820 - lava_callback - INFO - Received callback for node 69c5c19babf66a8f4d9bd140 INFO: 172.21.0.1:56872 - "POST /node/69c5c19babf66a8f4d9bd140 HTTP/1.0" 202 Accepted 2026-03-28 23:30:40,825 - lava_callback - INFO - Starting async job submit for node 69c5c19babf66a8f4d9bd140 2026-03-28 23:30:40,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:30:40,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c19babf66a8f4d9bd140 HTTP/1.1" 200 None 2026-03-28 23:30:40,852 - lava_callback - DEBUG - Processing node 69c5c19babf66a8f4d9bd140: baseline-arm-clabbe 2026-03-28 23:30:40,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c19babf66a8f4d9bd140 2026-03-28 23:30:40,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:30:40,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c19babf66a8f4d9bd140 HTTP/1.1" 200 None 2026-03-28 23:30:40,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:30:40,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:30:40,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:30:40,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c19babf66a8f4d9bd140 HTTP/1.1" 200 None 2026-03-28 23:30:40,917 - lava_callback - ERROR - Error processing callback for node 69c5c19babf66a8f4d9bd140: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:31:20,544 - lava_callback - INFO - Received callback for node 69c5c1bfabf66a8f4d9bd155 INFO: 172.21.0.1:35982 - "POST /node/69c5c1bfabf66a8f4d9bd155 HTTP/1.0" 202 Accepted 2026-03-28 23:31:20,550 - lava_callback - INFO - Starting async job submit for node 69c5c1bfabf66a8f4d9bd155 2026-03-28 23:31:20,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:31:20,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c1bfabf66a8f4d9bd155 HTTP/1.1" 200 None 2026-03-28 23:31:20,566 - lava_callback - DEBUG - Processing node 69c5c1bfabf66a8f4d9bd155: baseline-arm-baylibre 2026-03-28 23:31:20,566 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c1bfabf66a8f4d9bd155 2026-03-28 23:31:20,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:31:20,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c1bfabf66a8f4d9bd155 HTTP/1.1" 200 None 2026-03-28 23:31:20,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:31:20,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:31:20,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:31:20,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c1bfabf66a8f4d9bd155 HTTP/1.1" 200 None 2026-03-28 23:31:20,623 - lava_callback - ERROR - Error processing callback for node 69c5c1bfabf66a8f4d9bd155: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:32:00,884 - lava_callback - INFO - Received callback for node 69c5c1e7abf66a8f4d9bd15f INFO: 172.21.0.1:37988 - "POST /node/69c5c1e7abf66a8f4d9bd15f HTTP/1.0" 202 Accepted 2026-03-28 23:32:00,892 - lava_callback - INFO - Starting async job submit for node 69c5c1e7abf66a8f4d9bd15f 2026-03-28 23:32:00,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:32:00,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c1e7abf66a8f4d9bd15f HTTP/1.1" 200 None 2026-03-28 23:32:00,910 - lava_callback - DEBUG - Processing node 69c5c1e7abf66a8f4d9bd15f: baseline-arm-clabbe 2026-03-28 23:32:00,910 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c1e7abf66a8f4d9bd15f 2026-03-28 23:32:00,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:32:00,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c1e7abf66a8f4d9bd15f HTTP/1.1" 200 None 2026-03-28 23:32:00,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:32:00,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:32:00,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:32:00,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c1e7abf66a8f4d9bd15f HTTP/1.1" 200 None 2026-03-28 23:32:00,975 - lava_callback - ERROR - Error processing callback for node 69c5c1e7abf66a8f4d9bd15f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:32:40,667 - lava_callback - INFO - Received callback for node 69c5c20aabf66a8f4d9bd16f INFO: 172.21.0.1:53530 - "POST /node/69c5c20aabf66a8f4d9bd16f HTTP/1.0" 202 Accepted 2026-03-28 23:32:40,673 - lava_callback - INFO - Starting async job submit for node 69c5c20aabf66a8f4d9bd16f 2026-03-28 23:32:40,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:32:40,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c20aabf66a8f4d9bd16f HTTP/1.1" 200 None 2026-03-28 23:32:40,688 - lava_callback - DEBUG - Processing node 69c5c20aabf66a8f4d9bd16f: baseline-arm-baylibre 2026-03-28 23:32:40,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c20aabf66a8f4d9bd16f 2026-03-28 23:32:40,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:32:40,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c20aabf66a8f4d9bd16f HTTP/1.1" 200 None 2026-03-28 23:32:40,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:32:40,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:32:40,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:32:40,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c20aabf66a8f4d9bd16f HTTP/1.1" 200 None 2026-03-28 23:32:40,757 - lava_callback - ERROR - Error processing callback for node 69c5c20aabf66a8f4d9bd16f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:33:20,629 - lava_callback - INFO - Received callback for node 69c5c22fabf66a8f4d9bd17c INFO: 172.21.0.1:40374 - "POST /node/69c5c22fabf66a8f4d9bd17c HTTP/1.0" 202 Accepted 2026-03-28 23:33:20,634 - lava_callback - INFO - Starting async job submit for node 69c5c22fabf66a8f4d9bd17c 2026-03-28 23:33:20,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:33:20,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c22fabf66a8f4d9bd17c HTTP/1.1" 200 None 2026-03-28 23:33:20,658 - lava_callback - DEBUG - Processing node 69c5c22fabf66a8f4d9bd17c: baseline-arm-baylibre 2026-03-28 23:33:20,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c22fabf66a8f4d9bd17c 2026-03-28 23:33:20,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:33:20,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c22fabf66a8f4d9bd17c HTTP/1.1" 200 None 2026-03-28 23:33:20,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:33:20,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:33:20,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:33:20,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c22fabf66a8f4d9bd17c HTTP/1.1" 200 None 2026-03-28 23:33:20,718 - lava_callback - ERROR - Error processing callback for node 69c5c22fabf66a8f4d9bd17c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37070 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:35:20,948 - lava_callback - INFO - Received callback for node 69c5c2afabf66a8f4d9bd1b5 INFO: 172.21.0.1:54996 - "POST /node/69c5c2afabf66a8f4d9bd1b5 HTTP/1.0" 202 Accepted 2026-03-28 23:35:20,954 - lava_callback - INFO - Starting async job submit for node 69c5c2afabf66a8f4d9bd1b5 2026-03-28 23:35:20,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:35:20,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c2afabf66a8f4d9bd1b5 HTTP/1.1" 200 None 2026-03-28 23:35:20,970 - lava_callback - DEBUG - Processing node 69c5c2afabf66a8f4d9bd1b5: baseline-arm-baylibre 2026-03-28 23:35:20,970 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c2afabf66a8f4d9bd1b5 2026-03-28 23:35:20,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:35:20,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c2afabf66a8f4d9bd1b5 HTTP/1.1" 200 None 2026-03-28 23:35:20,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:35:20,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:35:21,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:35:21,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c2afabf66a8f4d9bd1b5 HTTP/1.1" 200 None 2026-03-28 23:35:21,027 - lava_callback - ERROR - Error processing callback for node 69c5c2afabf66a8f4d9bd1b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59152 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:40:21,224 - lava_callback - INFO - Received callback for node 69c5c3d6abf66a8f4d9bd1e4 INFO: 172.21.0.1:60252 - "POST /node/69c5c3d6abf66a8f4d9bd1e4 HTTP/1.0" 202 Accepted 2026-03-28 23:40:21,230 - lava_callback - INFO - Starting async job submit for node 69c5c3d6abf66a8f4d9bd1e4 2026-03-28 23:40:21,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:40:21,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c3d6abf66a8f4d9bd1e4 HTTP/1.1" 200 None 2026-03-28 23:40:21,249 - lava_callback - DEBUG - Processing node 69c5c3d6abf66a8f4d9bd1e4: baseline-arm-clabbe 2026-03-28 23:40:21,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c3d6abf66a8f4d9bd1e4 2026-03-28 23:40:21,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:40:21,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c3d6abf66a8f4d9bd1e4 HTTP/1.1" 200 None 2026-03-28 23:40:21,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:40:21,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:40:21,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:40:21,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c3d6abf66a8f4d9bd1e4 HTTP/1.1" 200 None 2026-03-28 23:40:21,333 - lava_callback - ERROR - Error processing callback for node 69c5c3d6abf66a8f4d9bd1e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:42:21,327 - lava_callback - INFO - Received callback for node 69c5c44fabf66a8f4d9bd203 INFO: 172.21.0.1:33872 - "POST /node/69c5c44fabf66a8f4d9bd203 HTTP/1.0" 202 Accepted 2026-03-28 23:42:21,333 - lava_callback - INFO - Starting async job submit for node 69c5c44fabf66a8f4d9bd203 2026-03-28 23:42:21,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:42:21,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c44fabf66a8f4d9bd203 HTTP/1.1" 200 None 2026-03-28 23:42:21,349 - lava_callback - DEBUG - Processing node 69c5c44fabf66a8f4d9bd203: baseline-arm-clabbe 2026-03-28 23:42:21,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c44fabf66a8f4d9bd203 2026-03-28 23:42:21,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:42:21,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c44fabf66a8f4d9bd203 HTTP/1.1" 200 None 2026-03-28 23:42:21,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:42:21,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:42:21,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:42:21,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c44fabf66a8f4d9bd203 HTTP/1.1" 200 None 2026-03-28 23:42:21,406 - lava_callback - ERROR - Error processing callback for node 69c5c44fabf66a8f4d9bd203: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59032 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:43:01,281 - lava_callback - INFO - Received callback for node 69c5c474abf66a8f4d9bd217 INFO: 172.21.0.1:49004 - "POST /node/69c5c474abf66a8f4d9bd217 HTTP/1.0" 202 Accepted 2026-03-28 23:43:01,288 - lava_callback - INFO - Starting async job submit for node 69c5c474abf66a8f4d9bd217 2026-03-28 23:43:01,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:43:01,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c474abf66a8f4d9bd217 HTTP/1.1" 200 None 2026-03-28 23:43:01,307 - lava_callback - DEBUG - Processing node 69c5c474abf66a8f4d9bd217: baseline-arm-clabbe 2026-03-28 23:43:01,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c474abf66a8f4d9bd217 2026-03-28 23:43:01,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:43:01,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c474abf66a8f4d9bd217 HTTP/1.1" 200 None 2026-03-28 23:43:01,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:43:01,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-28 23:43:01,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:43:01,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c474abf66a8f4d9bd217 HTTP/1.1" 200 None 2026-03-28 23:43:01,373 - lava_callback - ERROR - Error processing callback for node 69c5c474abf66a8f4d9bd217: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40842 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:43:41,690 - lava_callback - INFO - Received callback for node 69c5c49fabf66a8f4d9bd220 INFO: 172.21.0.1:37948 - "POST /node/69c5c49fabf66a8f4d9bd220 HTTP/1.0" 202 Accepted 2026-03-28 23:43:41,695 - lava_callback - INFO - Starting async job submit for node 69c5c49fabf66a8f4d9bd220 2026-03-28 23:43:41,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:43:41,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c49fabf66a8f4d9bd220 HTTP/1.1" 200 None 2026-03-28 23:43:41,712 - lava_callback - DEBUG - Processing node 69c5c49fabf66a8f4d9bd220: baseline-arm64-baylibre 2026-03-28 23:43:41,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c49fabf66a8f4d9bd220 2026-03-28 23:43:41,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:43:41,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c49fabf66a8f4d9bd220 HTTP/1.1" 200 None 2026-03-28 23:43:41,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:43:41,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 23:43:41,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:43:41,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c49fabf66a8f4d9bd220 HTTP/1.1" 200 None 2026-03-28 23:43:41,765 - lava_callback - ERROR - Error processing callback for node 69c5c49fabf66a8f4d9bd220: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:45:01,294 - lava_callback - INFO - Received callback for node 69c5c4f4abf66a8f4d9bd236 INFO: 172.21.0.1:49900 - "POST /node/69c5c4f4abf66a8f4d9bd236 HTTP/1.0" 202 Accepted 2026-03-28 23:45:01,300 - lava_callback - INFO - Starting async job submit for node 69c5c4f4abf66a8f4d9bd236 2026-03-28 23:45:01,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:45:01,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c4f4abf66a8f4d9bd236 HTTP/1.1" 200 None 2026-03-28 23:45:01,326 - lava_callback - DEBUG - Processing node 69c5c4f4abf66a8f4d9bd236: baseline-arm64-baylibre 2026-03-28 23:45:01,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c4f4abf66a8f4d9bd236 2026-03-28 23:45:01,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:45:01,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c4f4abf66a8f4d9bd236 HTTP/1.1" 200 None 2026-03-28 23:45:01,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:45:01,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 23:45:01,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:45:01,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c4f4abf66a8f4d9bd236 HTTP/1.1" 200 None 2026-03-28 23:45:01,387 - lava_callback - ERROR - Error processing callback for node 69c5c4f4abf66a8f4d9bd236: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42000 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:49:21,671 - lava_callback - INFO - Received callback for node 69c5c5f0abf66a8f4d9bd275 INFO: 172.21.0.1:52404 - "POST /node/69c5c5f0abf66a8f4d9bd275 HTTP/1.0" 202 Accepted 2026-03-28 23:49:21,677 - lava_callback - INFO - Starting async job submit for node 69c5c5f0abf66a8f4d9bd275 2026-03-28 23:49:21,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:49:21,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c5f0abf66a8f4d9bd275 HTTP/1.1" 200 None 2026-03-28 23:49:21,693 - lava_callback - DEBUG - Processing node 69c5c5f0abf66a8f4d9bd275: baseline-arm64-baylibre 2026-03-28 23:49:21,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c5f0abf66a8f4d9bd275 2026-03-28 23:49:21,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:49:21,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c5f0abf66a8f4d9bd275 HTTP/1.1" 200 None 2026-03-28 23:49:21,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:49:21,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 23:49:21,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:49:21,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c5f0abf66a8f4d9bd275 HTTP/1.1" 200 None 2026-03-28 23:49:21,743 - lava_callback - ERROR - Error processing callback for node 69c5c5f0abf66a8f4d9bd275: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:52:01,687 - lava_callback - INFO - Received callback for node 69c5c697abf66a8f4d9bd2aa INFO: 172.21.0.1:50470 - "POST /node/69c5c697abf66a8f4d9bd2aa HTTP/1.0" 202 Accepted 2026-03-28 23:52:01,693 - lava_callback - INFO - Starting async job submit for node 69c5c697abf66a8f4d9bd2aa 2026-03-28 23:52:01,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:52:01,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c697abf66a8f4d9bd2aa HTTP/1.1" 200 None 2026-03-28 23:52:01,709 - lava_callback - DEBUG - Processing node 69c5c697abf66a8f4d9bd2aa: baseline-arm64-baylibre 2026-03-28 23:52:01,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c697abf66a8f4d9bd2aa 2026-03-28 23:52:01,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:52:01,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c697abf66a8f4d9bd2aa HTTP/1.1" 200 None 2026-03-28 23:52:01,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:52:01,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 23:52:01,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:52:01,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c697abf66a8f4d9bd2aa HTTP/1.1" 200 None 2026-03-28 23:52:01,769 - lava_callback - ERROR - Error processing callback for node 69c5c697abf66a8f4d9bd2aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44950 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:56:21,901 - lava_callback - INFO - Received callback for node 69c5c791abf66a8f4d9bd2db INFO: 172.21.0.1:56814 - "POST /node/69c5c791abf66a8f4d9bd2db HTTP/1.0" 202 Accepted 2026-03-28 23:56:21,907 - lava_callback - INFO - Starting async job submit for node 69c5c791abf66a8f4d9bd2db 2026-03-28 23:56:21,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:56:21,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c791abf66a8f4d9bd2db HTTP/1.1" 200 None 2026-03-28 23:56:21,922 - lava_callback - DEBUG - Processing node 69c5c791abf66a8f4d9bd2db: baseline-arm64-baylibre 2026-03-28 23:56:21,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c791abf66a8f4d9bd2db 2026-03-28 23:56:21,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:56:21,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c791abf66a8f4d9bd2db HTTP/1.1" 200 None 2026-03-28 23:56:21,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:56:21,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 23:56:21,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:56:22,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c791abf66a8f4d9bd2db HTTP/1.1" 200 None 2026-03-28 23:56:22,020 - lava_callback - ERROR - Error processing callback for node 69c5c791abf66a8f4d9bd2db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK 2026-03-28 23:59:02,060 - lava_callback - INFO - Received callback for node 69c5c83dabf66a8f4d9bd2fd INFO: 172.21.0.1:59792 - "POST /node/69c5c83dabf66a8f4d9bd2fd HTTP/1.0" 202 Accepted 2026-03-28 23:59:02,066 - lava_callback - INFO - Starting async job submit for node 69c5c83dabf66a8f4d9bd2fd 2026-03-28 23:59:02,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:59:02,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c83dabf66a8f4d9bd2fd HTTP/1.1" 200 None 2026-03-28 23:59:02,081 - lava_callback - DEBUG - Processing node 69c5c83dabf66a8f4d9bd2fd: baseline-arm64-baylibre 2026-03-28 23:59:02,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c83dabf66a8f4d9bd2fd 2026-03-28 23:59:02,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:59:02,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c83dabf66a8f4d9bd2fd HTTP/1.1" 200 None 2026-03-28 23:59:02,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:59:02,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-28 23:59:02,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-28 23:59:02,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c83dabf66a8f4d9bd2fd HTTP/1.1" 200 None 2026-03-28 23:59:02,138 - lava_callback - ERROR - Error processing callback for node 69c5c83dabf66a8f4d9bd2fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK 2026-03-29 00:00:42,107 - lava_callback - INFO - Received callback for node 69c5c898abf66a8f4d9bd313 INFO: 172.21.0.1:47512 - "POST /node/69c5c898abf66a8f4d9bd313 HTTP/1.0" 202 Accepted 2026-03-29 00:00:42,115 - lava_callback - INFO - Starting async job submit for node 69c5c898abf66a8f4d9bd313 2026-03-29 00:00:42,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:00:43,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c898abf66a8f4d9bd313 HTTP/1.1" 200 None 2026-03-29 00:00:43,137 - lava_callback - DEBUG - Processing node 69c5c898abf66a8f4d9bd313: baseline-arm64-baylibre 2026-03-29 00:00:43,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c898abf66a8f4d9bd313 2026-03-29 00:00:43,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:00:43,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c898abf66a8f4d9bd313 HTTP/1.1" 200 None 2026-03-29 00:00:43,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:00:43,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-29 00:00:43,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:00:43,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c898abf66a8f4d9bd313 HTTP/1.1" 200 None 2026-03-29 00:00:43,217 - lava_callback - ERROR - Error processing callback for node 69c5c898abf66a8f4d9bd313: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET /node/699385fccebe99dd8e070275%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK 2026-03-29 00:03:42,080 - lava_callback - INFO - Received callback for node 69c5c94dabf66a8f4d9bd334 INFO: 172.21.0.1:44268 - "POST /node/69c5c94dabf66a8f4d9bd334 HTTP/1.0" 202 Accepted 2026-03-29 00:03:42,086 - lava_callback - INFO - Starting async job submit for node 69c5c94dabf66a8f4d9bd334 2026-03-29 00:03:42,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:03:42,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c94dabf66a8f4d9bd334 HTTP/1.1" 200 None 2026-03-29 00:03:42,102 - lava_callback - DEBUG - Processing node 69c5c94dabf66a8f4d9bd334: baseline-arm64-clabbe 2026-03-29 00:03:42,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c94dabf66a8f4d9bd334 2026-03-29 00:03:42,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:03:42,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c94dabf66a8f4d9bd334 HTTP/1.1" 200 None 2026-03-29 00:03:42,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:03:42,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-29 00:03:42,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:03:42,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c94dabf66a8f4d9bd334 HTTP/1.1" 200 None 2026-03-29 00:03:42,160 - lava_callback - ERROR - Error processing callback for node 69c5c94dabf66a8f4d9bd334: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK 2026-03-29 00:04:42,142 - lava_callback - INFO - Received callback for node 69c5c993abf66a8f4d9bd340 INFO: 172.21.0.1:56626 - "POST /node/69c5c993abf66a8f4d9bd340 HTTP/1.0" 202 Accepted 2026-03-29 00:04:42,148 - lava_callback - INFO - Starting async job submit for node 69c5c993abf66a8f4d9bd340 2026-03-29 00:04:42,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:04:42,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c993abf66a8f4d9bd340 HTTP/1.1" 200 None 2026-03-29 00:04:42,164 - lava_callback - DEBUG - Processing node 69c5c993abf66a8f4d9bd340: baseline-arm-clabbe 2026-03-29 00:04:42,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c993abf66a8f4d9bd340 2026-03-29 00:04:42,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:04:42,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c993abf66a8f4d9bd340 HTTP/1.1" 200 None 2026-03-29 00:04:42,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:04:42,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-29 00:04:42,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:04:42,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c993abf66a8f4d9bd340 HTTP/1.1" 200 None 2026-03-29 00:04:42,223 - lava_callback - ERROR - Error processing callback for node 69c5c993abf66a8f4d9bd340: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK 2026-03-29 00:05:42,203 - lava_callback - INFO - Received callback for node 69c5c9caabf66a8f4d9bd350 INFO: 172.21.0.1:53552 - "POST /node/69c5c9caabf66a8f4d9bd350 HTTP/1.0" 202 Accepted 2026-03-29 00:05:42,209 - lava_callback - INFO - Starting async job submit for node 69c5c9caabf66a8f4d9bd350 2026-03-29 00:05:42,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:05:42,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c9caabf66a8f4d9bd350 HTTP/1.1" 200 None 2026-03-29 00:05:42,225 - lava_callback - DEBUG - Processing node 69c5c9caabf66a8f4d9bd350: baseline-arm64-clabbe 2026-03-29 00:05:42,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5c9caabf66a8f4d9bd350 2026-03-29 00:05:42,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:05:42,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5c9caabf66a8f4d9bd350 HTTP/1.1" 200 None 2026-03-29 00:05:42,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:05:42,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-29 00:05:42,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:05:42,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5c9caabf66a8f4d9bd350 HTTP/1.1" 200 None 2026-03-29 00:05:42,288 - lava_callback - ERROR - Error processing callback for node 69c5c9caabf66a8f4d9bd350: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37818 - "GET / HTTP/1.0" 200 OK 2026-03-29 00:07:02,228 - lava_callback - INFO - Received callback for node 69c5ca22abf66a8f4d9bd367 INFO: 172.21.0.1:59902 - "POST /node/69c5ca22abf66a8f4d9bd367 HTTP/1.0" 202 Accepted 2026-03-29 00:07:02,236 - lava_callback - INFO - Starting async job submit for node 69c5ca22abf66a8f4d9bd367 2026-03-29 00:07:02,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:07:02,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ca22abf66a8f4d9bd367 HTTP/1.1" 200 None 2026-03-29 00:07:02,255 - lava_callback - DEBUG - Processing node 69c5ca22abf66a8f4d9bd367: baseline-arm64-clabbe 2026-03-29 00:07:02,256 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ca22abf66a8f4d9bd367 2026-03-29 00:07:02,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:07:02,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ca22abf66a8f4d9bd367 HTTP/1.1" 200 None 2026-03-29 00:07:02,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:07:02,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-29 00:07:02,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:07:02,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ca22abf66a8f4d9bd367 HTTP/1.1" 200 None 2026-03-29 00:07:02,311 - lava_callback - ERROR - Error processing callback for node 69c5ca22abf66a8f4d9bd367: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK 2026-03-29 00:08:22,232 - lava_callback - INFO - Received callback for node 69c5ca69abf66a8f4d9bd374 INFO: 172.21.0.1:45524 - "POST /node/69c5ca69abf66a8f4d9bd374 HTTP/1.0" 202 Accepted 2026-03-29 00:08:22,238 - lava_callback - INFO - Starting async job submit for node 69c5ca69abf66a8f4d9bd374 2026-03-29 00:08:22,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:08:22,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ca69abf66a8f4d9bd374 HTTP/1.1" 200 None 2026-03-29 00:08:22,254 - lava_callback - DEBUG - Processing node 69c5ca69abf66a8f4d9bd374: baseline-arm-clabbe 2026-03-29 00:08:22,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ca69abf66a8f4d9bd374 2026-03-29 00:08:22,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:08:22,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ca69abf66a8f4d9bd374 HTTP/1.1" 200 None 2026-03-29 00:08:22,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:08:22,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-29 00:08:22,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:08:22,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ca69abf66a8f4d9bd374 HTTP/1.1" 200 None 2026-03-29 00:08:22,308 - lava_callback - ERROR - Error processing callback for node 69c5ca69abf66a8f4d9bd374: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK 2026-03-29 00:09:22,316 - lava_callback - INFO - Received callback for node 69c5ca9eabf66a8f4d9bd386 INFO: 172.21.0.1:54882 - "POST /node/69c5ca9eabf66a8f4d9bd386 HTTP/1.0" 202 Accepted 2026-03-29 00:09:22,322 - lava_callback - INFO - Starting async job submit for node 69c5ca9eabf66a8f4d9bd386 2026-03-29 00:09:22,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:09:22,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ca9eabf66a8f4d9bd386 HTTP/1.1" 200 None 2026-03-29 00:09:22,340 - lava_callback - DEBUG - Processing node 69c5ca9eabf66a8f4d9bd386: baseline-arm64-clabbe 2026-03-29 00:09:22,340 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5ca9eabf66a8f4d9bd386 2026-03-29 00:09:22,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:09:22,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5ca9eabf66a8f4d9bd386 HTTP/1.1" 200 None 2026-03-29 00:09:22,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:09:22,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-29 00:09:22,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:09:22,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5ca9eabf66a8f4d9bd386 HTTP/1.1" 200 None 2026-03-29 00:09:22,396 - lava_callback - ERROR - Error processing callback for node 69c5ca9eabf66a8f4d9bd386: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40306 - "GET / HTTP/1.0" 200 OK 2026-03-29 00:10:42,383 - lava_callback - INFO - Received callback for node 69c5caf5abf66a8f4d9bd399 INFO: 172.21.0.1:43980 - "POST /node/69c5caf5abf66a8f4d9bd399 HTTP/1.0" 202 Accepted 2026-03-29 00:10:42,389 - lava_callback - INFO - Starting async job submit for node 69c5caf5abf66a8f4d9bd399 2026-03-29 00:10:42,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:10:42,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5caf5abf66a8f4d9bd399 HTTP/1.1" 200 None 2026-03-29 00:10:42,406 - lava_callback - DEBUG - Processing node 69c5caf5abf66a8f4d9bd399: baseline-arm64-clabbe 2026-03-29 00:10:42,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c5caf5abf66a8f4d9bd399 2026-03-29 00:10:42,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:10:42,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5caf5abf66a8f4d9bd399 HTTP/1.1" 200 None 2026-03-29 00:10:42,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:10:42,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-29 00:10:42,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-29 00:10:42,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c5caf5abf66a8f4d9bd399 HTTP/1.1" 200 None 2026-03-29 00:10:42,462 - lava_callback - ERROR - Error processing callback for node 69c5caf5abf66a8f4d9bd399: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53798 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]