INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:33264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58476 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:27:19,644 - lava_callback - INFO - Received callback for node 69b880360b8ad4124cec677c 2026-03-17 00:27:19,695 - lava_callback - INFO - Starting async job submit for node 69b880360b8ad4124cec677c INFO: 172.21.0.1:58484 - "POST /node/69b880360b8ad4124cec677c HTTP/1.0" 202 Accepted 2026-03-17 00:27:19,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:27:19,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b880360b8ad4124cec677c HTTP/1.1" 200 None 2026-03-17 00:27:19,760 - lava_callback - DEBUG - Processing node 69b880360b8ad4124cec677c: baseline-arm-pengutronix 2026-03-17 00:27:19,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:27:20,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:27:20,052 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b880360b8ad4124cec677c/log.txt.gz 2026-03-17 00:27:20,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:27:20,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:27:20,315 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b880360b8ad4124cec677c/lava-logs.yaml 2026-03-17 00:27:20,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:27:20,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:27:20,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b880360b8ad4124cec677c/lava_callback.json.gz DEBUG: Setup failed for 69b880360b8ad4124cec677c. Transitting job node result: incomplete -> fail 2026-03-17 00:27:20,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:27:20,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b880360b8ad4124cec677c HTTP/1.1" 200 None 2026-03-17 00:27:20,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:27:20,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-17 00:27:20,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:27:20,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b880360b8ad4124cec677c HTTP/1.1" 200 None 2026-03-17 00:27:20,683 - lava_callback - INFO - Completed processing callback for node 69b880360b8ad4124cec677c INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50780 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:27:50,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:27:50,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:32:01,682 - lava_callback - INFO - Received callback for node 69b8a080fbe29c53ae85cd3b INFO: 172.21.0.1:48070 - "POST /node/69b8a080fbe29c53ae85cd3b HTTP/1.0" 202 Accepted 2026-03-17 00:32:01,693 - lava_callback - INFO - Starting async job submit for node 69b8a080fbe29c53ae85cd3b 2026-03-17 00:32:01,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:32:01,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a080fbe29c53ae85cd3b HTTP/1.1" 200 None 2026-03-17 00:32:01,744 - lava_callback - DEBUG - Processing node 69b8a080fbe29c53ae85cd3b: baseline-arm 2026-03-17 00:32:01,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:32:02,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:32:02,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a080fbe29c53ae85cd3b/log.txt.gz 2026-03-17 00:32:02,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:32:02,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:32:02,430 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a080fbe29c53ae85cd3b/lava-logs.yaml 2026-03-17 00:32:02,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:32:02,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:32:02,622 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a080fbe29c53ae85cd3b/lava_callback.json.gz 2026-03-17 00:32:02,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:32:02,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a080fbe29c53ae85cd3b HTTP/1.1" 200 None 2026-03-17 00:32:02,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:32:02,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89dadfbe29c53ae85cceb HTTP/1.1" 200 None 2026-03-17 00:32:02,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:32:02,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a080fbe29c53ae85cd3b HTTP/1.1" 200 None 2026-03-17 00:32:02,711 - lava_callback - INFO - Completed processing callback for node 69b8a080fbe29c53ae85cd3b INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:32:20,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:32:20,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36704 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:33:08,055 - lava_callback - INFO - Received callback for node 69b8a129fbe29c53ae85f2e4 INFO: 172.21.0.1:36710 - "POST /node/69b8a129fbe29c53ae85f2e4 HTTP/1.0" 202 Accepted 2026-03-17 00:33:08,061 - lava_callback - INFO - Starting async job submit for node 69b8a129fbe29c53ae85f2e4 2026-03-17 00:33:08,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:33:08,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a129fbe29c53ae85f2e4 HTTP/1.1" 200 None 2026-03-17 00:33:08,103 - lava_callback - DEBUG - Processing node 69b8a129fbe29c53ae85f2e4: baseline-x86 2026-03-17 00:33:08,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:33:08,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:33:08,498 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a129fbe29c53ae85f2e4/log.txt.gz 2026-03-17 00:33:08,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:33:08,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:33:08,885 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a129fbe29c53ae85f2e4/lava-logs.yaml 2026-03-17 00:33:08,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:33:09,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:33:09,086 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a129fbe29c53ae85f2e4/lava_callback.json.gz 2026-03-17 00:33:09,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:33:09,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a129fbe29c53ae85f2e4 HTTP/1.1" 200 None 2026-03-17 00:33:09,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:33:09,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89dd1fbe29c53ae85cd0e HTTP/1.1" 200 None 2026-03-17 00:33:09,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:33:09,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a129fbe29c53ae85f2e4 HTTP/1.1" 200 None 2026-03-17 00:33:09,180 - lava_callback - INFO - Completed processing callback for node 69b8a129fbe29c53ae85f2e4 INFO: 172.21.0.1:34222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34224 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:33:18,903 - lava_callback - INFO - Received callback for node 69b8a12bfbe29c53ae85f2f0 INFO: 172.21.0.1:34232 - "POST /node/69b8a12bfbe29c53ae85f2f0 HTTP/1.0" 202 Accepted 2026-03-17 00:33:18,912 - lava_callback - INFO - Starting async job submit for node 69b8a12bfbe29c53ae85f2f0 2026-03-17 00:33:18,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:33:18,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a12bfbe29c53ae85f2f0 HTTP/1.1" 200 None 2026-03-17 00:33:18,950 - lava_callback - DEBUG - Processing node 69b8a12bfbe29c53ae85f2f0: baseline-x86 2026-03-17 00:33:19,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:33:19,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:33:19,364 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a12bfbe29c53ae85f2f0/log.txt.gz 2026-03-17 00:33:19,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:33:19,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:33:19,733 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a12bfbe29c53ae85f2f0/lava-logs.yaml 2026-03-17 00:33:19,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:33:19,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:33:19,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a12bfbe29c53ae85f2f0/lava_callback.json.gz 2026-03-17 00:33:19,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:33:19,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a12bfbe29c53ae85f2f0 HTTP/1.1" 200 None 2026-03-17 00:33:19,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:33:19,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89dd1fbe29c53ae85cd0e HTTP/1.1" 200 None 2026-03-17 00:33:19,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:33:20,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a12bfbe29c53ae85f2f0 HTTP/1.1" 200 None 2026-03-17 00:33:20,005 - lava_callback - INFO - Completed processing callback for node 69b8a12bfbe29c53ae85f2f0 2026-03-17 00:33:20,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:33:20,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49918 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:34:26,609 - lava_callback - INFO - Received callback for node 69b8a12afbe29c53ae85f2e7 INFO: 172.21.0.1:49934 - "POST /node/69b8a12afbe29c53ae85f2e7 HTTP/1.0" 202 Accepted 2026-03-17 00:34:26,615 - lava_callback - INFO - Starting async job submit for node 69b8a12afbe29c53ae85f2e7 2026-03-17 00:34:26,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:34:26,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a12afbe29c53ae85f2e7 HTTP/1.1" 200 None 2026-03-17 00:34:26,649 - lava_callback - DEBUG - Processing node 69b8a12afbe29c53ae85f2e7: baseline-x86 2026-03-17 00:34:26,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:34:27,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:34:27,071 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a12afbe29c53ae85f2e7/log.txt.gz 2026-03-17 00:34:27,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:34:27,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:34:27,451 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a12afbe29c53ae85f2e7/lava-logs.yaml 2026-03-17 00:34:27,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:34:27,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:34:27,615 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a12afbe29c53ae85f2e7/lava_callback.json.gz 2026-03-17 00:34:27,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:34:27,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a12afbe29c53ae85f2e7 HTTP/1.1" 200 None 2026-03-17 00:34:27,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:34:27,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89dd1fbe29c53ae85cd0e HTTP/1.1" 200 None 2026-03-17 00:34:27,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:34:27,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a12afbe29c53ae85f2e7 HTTP/1.1" 200 None 2026-03-17 00:34:27,709 - lava_callback - INFO - Completed processing callback for node 69b8a12afbe29c53ae85f2e7 INFO: 172.21.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:34:50,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:34:50,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33368 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:40:40,832 - lava_callback - INFO - Received callback for node 69b5fffb1727ff69d6f26b9a INFO: 172.21.0.1:42368 - "POST /node/69b5fffb1727ff69d6f26b9a HTTP/1.0" 202 Accepted 2026-03-17 00:40:40,837 - lava_callback - INFO - Starting async job submit for node 69b5fffb1727ff69d6f26b9a 2026-03-17 00:40:40,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:40:40,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5fffb1727ff69d6f26b9a HTTP/1.1" 200 None 2026-03-17 00:40:40,854 - lava_callback - DEBUG - Processing node 69b5fffb1727ff69d6f26b9a: baseline-arm-baylibre 2026-03-17 00:40:40,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5fffb1727ff69d6f26b9a 2026-03-17 00:40:40,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:40:40,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5fffb1727ff69d6f26b9a HTTP/1.1" 200 None 2026-03-17 00:40:40,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:40:40,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 00:40:40,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:40:40,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5fffb1727ff69d6f26b9a HTTP/1.1" 200 None 2026-03-17 00:40:40,927 - lava_callback - ERROR - Error processing callback for node 69b5fffb1727ff69d6f26b9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60970 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:41:32,620 - lava_callback - INFO - Received callback for node 69b6002c1727ff69d6f26ba5 INFO: 172.21.0.1:45108 - "POST /node/69b6002c1727ff69d6f26ba5 HTTP/1.0" 202 Accepted 2026-03-17 00:41:32,630 - lava_callback - INFO - Starting async job submit for node 69b6002c1727ff69d6f26ba5 2026-03-17 00:41:32,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:41:32,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6002c1727ff69d6f26ba5 HTTP/1.1" 200 None 2026-03-17 00:41:32,671 - lava_callback - DEBUG - Processing node 69b6002c1727ff69d6f26ba5: baseline-arm-clabbe 2026-03-17 00:41:32,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6002c1727ff69d6f26ba5 2026-03-17 00:41:32,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:41:32,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6002c1727ff69d6f26ba5 HTTP/1.1" 200 None 2026-03-17 00:41:32,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:41:32,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 00:41:32,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:41:32,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6002c1727ff69d6f26ba5 HTTP/1.1" 200 None 2026-03-17 00:41:32,774 - lava_callback - ERROR - Error processing callback for node 69b6002c1727ff69d6f26ba5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:42:12,567 - lava_callback - INFO - Received callback for node 69b600541727ff69d6f26bb0 INFO: 172.21.0.1:51054 - "POST /node/69b600541727ff69d6f26bb0 HTTP/1.0" 202 Accepted 2026-03-17 00:42:12,573 - lava_callback - INFO - Starting async job submit for node 69b600541727ff69d6f26bb0 2026-03-17 00:42:12,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:42:12,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b600541727ff69d6f26bb0 HTTP/1.1" 200 None 2026-03-17 00:42:12,595 - lava_callback - DEBUG - Processing node 69b600541727ff69d6f26bb0: baseline-arm-clabbe 2026-03-17 00:42:12,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b600541727ff69d6f26bb0 2026-03-17 00:42:12,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:42:12,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b600541727ff69d6f26bb0 HTTP/1.1" 200 None 2026-03-17 00:42:12,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:42:12,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 00:42:12,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:42:12,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b600541727ff69d6f26bb0 HTTP/1.1" 200 None 2026-03-17 00:42:12,674 - lava_callback - ERROR - Error processing callback for node 69b600541727ff69d6f26bb0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:42:52,569 - lava_callback - INFO - Received callback for node 69b6007c1727ff69d6f26bbd INFO: 172.21.0.1:33262 - "POST /node/69b6007c1727ff69d6f26bbd HTTP/1.0" 202 Accepted 2026-03-17 00:42:52,574 - lava_callback - INFO - Starting async job submit for node 69b6007c1727ff69d6f26bbd 2026-03-17 00:42:52,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:42:52,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6007c1727ff69d6f26bbd HTTP/1.1" 200 None 2026-03-17 00:42:52,590 - lava_callback - DEBUG - Processing node 69b6007c1727ff69d6f26bbd: baseline-arm-clabbe 2026-03-17 00:42:52,590 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6007c1727ff69d6f26bbd 2026-03-17 00:42:52,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:42:52,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6007c1727ff69d6f26bbd HTTP/1.1" 200 None 2026-03-17 00:42:52,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:42:52,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 00:42:52,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:42:52,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6007c1727ff69d6f26bbd HTTP/1.1" 200 None 2026-03-17 00:42:52,665 - lava_callback - ERROR - Error processing callback for node 69b6007c1727ff69d6f26bbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:43:32,695 - lava_callback - INFO - Received callback for node 69b600a01727ff69d6f26bc6 INFO: 172.21.0.1:53680 - "POST /node/69b600a01727ff69d6f26bc6 HTTP/1.0" 202 Accepted 2026-03-17 00:43:32,701 - lava_callback - INFO - Starting async job submit for node 69b600a01727ff69d6f26bc6 2026-03-17 00:43:32,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:43:32,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b600a01727ff69d6f26bc6 HTTP/1.1" 200 None 2026-03-17 00:43:32,719 - lava_callback - DEBUG - Processing node 69b600a01727ff69d6f26bc6: baseline-arm-clabbe 2026-03-17 00:43:32,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b600a01727ff69d6f26bc6 2026-03-17 00:43:32,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:43:32,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b600a01727ff69d6f26bc6 HTTP/1.1" 200 None 2026-03-17 00:43:32,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:43:32,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 00:43:32,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:43:32,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b600a01727ff69d6f26bc6 HTTP/1.1" 200 None 2026-03-17 00:43:32,786 - lava_callback - ERROR - Error processing callback for node 69b600a01727ff69d6f26bc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:43:52,610 - lava_callback - INFO - Received callback for node 69b600c41727ff69d6f26bd1 INFO: 172.21.0.1:33336 - "POST /node/69b600c41727ff69d6f26bd1 HTTP/1.0" 202 Accepted 2026-03-17 00:43:52,615 - lava_callback - INFO - Starting async job submit for node 69b600c41727ff69d6f26bd1 2026-03-17 00:43:52,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:43:52,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b600c41727ff69d6f26bd1 HTTP/1.1" 200 None 2026-03-17 00:43:52,632 - lava_callback - DEBUG - Processing node 69b600c41727ff69d6f26bd1: baseline-arm-clabbe 2026-03-17 00:43:52,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b600c41727ff69d6f26bd1 2026-03-17 00:43:52,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:43:52,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b600c41727ff69d6f26bd1 HTTP/1.1" 200 None 2026-03-17 00:43:52,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:43:52,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 00:43:52,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:43:52,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b600c41727ff69d6f26bd1 HTTP/1.1" 200 None 2026-03-17 00:43:52,684 - lava_callback - ERROR - Error processing callback for node 69b600c41727ff69d6f26bd1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:46:39,865 - lava_callback - INFO - Received callback for node 69b889700b8ad4124cec68f6 INFO: 172.21.0.1:39152 - "POST /node/69b889700b8ad4124cec68f6 HTTP/1.0" 202 Accepted 2026-03-17 00:46:39,917 - lava_callback - INFO - Starting async job submit for node 69b889700b8ad4124cec68f6 2026-03-17 00:46:39,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:46:39,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b889700b8ad4124cec68f6 HTTP/1.1" 200 None 2026-03-17 00:46:39,969 - lava_callback - DEBUG - Processing node 69b889700b8ad4124cec68f6: baseline-arm-pengutronix 2026-03-17 00:46:40,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:46:40,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:46:40,253 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b889700b8ad4124cec68f6/log.txt.gz 2026-03-17 00:46:40,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:46:40,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:46:40,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b889700b8ad4124cec68f6/lava-logs.yaml 2026-03-17 00:46:40,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:46:40,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:46:40,640 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b889700b8ad4124cec68f6/lava_callback.json.gz DEBUG: Setup failed for 69b889700b8ad4124cec68f6. Transitting job node result: incomplete -> fail 2026-03-17 00:46:40,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:46:40,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b889700b8ad4124cec68f6 HTTP/1.1" 200 None 2026-03-17 00:46:40,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:46:40,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-17 00:46:40,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:46:40,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b889700b8ad4124cec68f6 HTTP/1.1" 200 None 2026-03-17 00:46:40,799 - lava_callback - INFO - Completed processing callback for node 69b889700b8ad4124cec68f6 INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:46:50,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:46:50,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:47:41,144 - lava_callback - INFO - Received callback for node 69b6019f1727ff69d6f26bde INFO: 172.21.0.1:52556 - "POST /node/69b6019f1727ff69d6f26bde HTTP/1.0" 202 Accepted 2026-03-17 00:47:41,149 - lava_callback - INFO - Starting async job submit for node 69b6019f1727ff69d6f26bde 2026-03-17 00:47:41,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:47:41,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6019f1727ff69d6f26bde HTTP/1.1" 200 None 2026-03-17 00:47:41,188 - lava_callback - DEBUG - Processing node 69b6019f1727ff69d6f26bde: baseline-arm-baylibre 2026-03-17 00:47:41,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6019f1727ff69d6f26bde 2026-03-17 00:47:41,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:47:41,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6019f1727ff69d6f26bde HTTP/1.1" 200 None 2026-03-17 00:47:41,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:47:41,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-17 00:47:41,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:47:41,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6019f1727ff69d6f26bde HTTP/1.1" 200 None 2026-03-17 00:47:41,300 - lava_callback - ERROR - Error processing callback for node 69b6019f1727ff69d6f26bde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44318 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:48:21,135 - lava_callback - INFO - Received callback for node 69b601c41727ff69d6f26bf1 INFO: 172.21.0.1:55108 - "POST /node/69b601c41727ff69d6f26bf1 HTTP/1.0" 202 Accepted 2026-03-17 00:48:21,142 - lava_callback - INFO - Starting async job submit for node 69b601c41727ff69d6f26bf1 2026-03-17 00:48:21,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:48:21,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b601c41727ff69d6f26bf1 HTTP/1.1" 200 None 2026-03-17 00:48:21,161 - lava_callback - DEBUG - Processing node 69b601c41727ff69d6f26bf1: baseline-arm-baylibre 2026-03-17 00:48:21,161 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b601c41727ff69d6f26bf1 2026-03-17 00:48:21,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:48:21,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b601c41727ff69d6f26bf1 HTTP/1.1" 200 None 2026-03-17 00:48:21,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:48:21,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 00:48:21,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:48:21,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b601c41727ff69d6f26bf1 HTTP/1.1" 200 None 2026-03-17 00:48:21,244 - lava_callback - ERROR - Error processing callback for node 69b601c41727ff69d6f26bf1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:48:40,182 - lava_callback - INFO - Received callback for node 69b8a12bfbe29c53ae85f2ea INFO: 172.21.0.1:34934 - "POST /node/69b8a12bfbe29c53ae85f2ea HTTP/1.0" 202 Accepted 2026-03-17 00:48:40,190 - lava_callback - INFO - Starting async job submit for node 69b8a12bfbe29c53ae85f2ea 2026-03-17 00:48:40,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:48:40,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a12bfbe29c53ae85f2ea HTTP/1.1" 200 None 2026-03-17 00:48:40,252 - lava_callback - DEBUG - Processing node 69b8a12bfbe29c53ae85f2ea: baseline-x86 2026-03-17 00:48:41,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:48:41,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:48:41,578 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a12bfbe29c53ae85f2ea/log.txt.gz 2026-03-17 00:48:42,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:48:42,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:48:42,855 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a12bfbe29c53ae85f2ea/lava-logs.yaml 2026-03-17 00:48:42,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:48:43,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:48:43,057 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a12bfbe29c53ae85f2ea/lava_callback.json.gz DEBUG: Setup failed for 69b8a12bfbe29c53ae85f2ea. Transitting job node result: incomplete -> fail 2026-03-17 00:48:43,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:48:43,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a12bfbe29c53ae85f2ea HTTP/1.1" 200 None 2026-03-17 00:48:43,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:48:43,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89dd1fbe29c53ae85cd0e HTTP/1.1" 200 None 2026-03-17 00:48:43,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:48:43,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a12bfbe29c53ae85f2ea HTTP/1.1" 200 None 2026-03-17 00:48:43,457 - lava_callback - INFO - Completed processing callback for node 69b8a12bfbe29c53ae85f2ea INFO: 172.21.0.1:34946 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:48:50,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:48:50,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 00:48:52,887 - lava_callback - INFO - Received callback for node 69b601ec1727ff69d6f26bfa INFO: 172.21.0.1:40614 - "POST /node/69b601ec1727ff69d6f26bfa HTTP/1.0" 202 Accepted 2026-03-17 00:48:52,897 - lava_callback - INFO - Starting async job submit for node 69b601ec1727ff69d6f26bfa 2026-03-17 00:48:52,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:48:52,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b601ec1727ff69d6f26bfa HTTP/1.1" 200 None 2026-03-17 00:48:52,925 - lava_callback - DEBUG - Processing node 69b601ec1727ff69d6f26bfa: baseline-arm-clabbe 2026-03-17 00:48:52,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b601ec1727ff69d6f26bfa 2026-03-17 00:48:52,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:48:52,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b601ec1727ff69d6f26bfa HTTP/1.1" 200 None 2026-03-17 00:48:52,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:48:53,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 00:48:53,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:48:53,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b601ec1727ff69d6f26bfa HTTP/1.1" 200 None 2026-03-17 00:48:53,043 - lava_callback - ERROR - Error processing callback for node 69b601ec1727ff69d6f26bfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34616 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:49:32,886 - lava_callback - INFO - Received callback for node 69b6020f1727ff69d6f26c03 INFO: 172.21.0.1:34786 - "POST /node/69b6020f1727ff69d6f26c03 HTTP/1.0" 202 Accepted 2026-03-17 00:49:32,891 - lava_callback - INFO - Starting async job submit for node 69b6020f1727ff69d6f26c03 2026-03-17 00:49:32,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:49:32,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6020f1727ff69d6f26c03 HTTP/1.1" 200 None 2026-03-17 00:49:32,910 - lava_callback - DEBUG - Processing node 69b6020f1727ff69d6f26c03: baseline-arm-clabbe 2026-03-17 00:49:32,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6020f1727ff69d6f26c03 2026-03-17 00:49:32,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:49:32,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6020f1727ff69d6f26c03 HTTP/1.1" 200 None 2026-03-17 00:49:32,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:49:32,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 00:49:32,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:49:32,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6020f1727ff69d6f26c03 HTTP/1.1" 200 None 2026-03-17 00:49:32,970 - lava_callback - ERROR - Error processing callback for node 69b6020f1727ff69d6f26c03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34810 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:49:42,564 - lava_callback - INFO - Received callback for node 69b8a082fbe29c53ae85cd3e INFO: 172.21.0.1:38910 - "POST /node/69b8a082fbe29c53ae85cd3e HTTP/1.0" 202 Accepted 2026-03-17 00:49:42,578 - lava_callback - INFO - Starting async job submit for node 69b8a082fbe29c53ae85cd3e 2026-03-17 00:49:42,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:49:42,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a082fbe29c53ae85cd3e HTTP/1.1" 200 None 2026-03-17 00:49:42,712 - lava_callback - DEBUG - Processing node 69b8a082fbe29c53ae85cd3e: ltp-smoke 2026-03-17 00:49:43,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:49:43,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:49:43,558 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8a082fbe29c53ae85cd3e/log.txt.gz 2026-03-17 00:49:43,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:49:44,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:49:44,279 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8a082fbe29c53ae85cd3e/lava-logs.yaml 2026-03-17 00:49:44,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:49:44,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:49:44,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8a082fbe29c53ae85cd3e/lava_callback.json.gz 2026-03-17 00:49:44,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:49:44,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a082fbe29c53ae85cd3e HTTP/1.1" 200 None 2026-03-17 00:49:44,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:49:44,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89dadfbe29c53ae85cceb HTTP/1.1" 200 None 2026-03-17 00:49:44,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:49:44,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a082fbe29c53ae85cd3e HTTP/1.1" 200 None 2026-03-17 00:49:44,984 - lava_callback - INFO - Completed processing callback for node 69b8a082fbe29c53ae85cd3e INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:49:50,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:49:50,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:49:57,427 - lava_callback - INFO - Received callback for node 69b8a52dfbe29c53ae85f3b0 INFO: 172.21.0.1:56890 - "POST /node/69b8a52dfbe29c53ae85f3b0 HTTP/1.0" 202 Accepted 2026-03-17 00:49:57,433 - lava_callback - INFO - Starting async job submit for node 69b8a52dfbe29c53ae85f3b0 2026-03-17 00:49:57,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:49:57,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a52dfbe29c53ae85f3b0 HTTP/1.1" 200 None 2026-03-17 00:49:57,452 - lava_callback - DEBUG - Processing node 69b8a52dfbe29c53ae85f3b0: baseline-arm 2026-03-17 00:49:57,457 - lava_callback - WARNING - Failed to upload log 2026-03-17 00:49:57,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:49:57,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:49:57,578 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a52dfbe29c53ae85f3b0/lava-logs.yaml 2026-03-17 00:49:57,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:49:57,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:49:57,696 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a52dfbe29c53ae85f3b0/lava_callback.json.gz 2026-03-17 00:49:57,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:49:57,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a52dfbe29c53ae85f3b0 HTTP/1.1" 200 None 2026-03-17 00:49:57,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:49:57,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:49:57,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:49:57,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a52dfbe29c53ae85f3b0 HTTP/1.1" 200 None 2026-03-17 00:49:57,805 - lava_callback - INFO - Completed processing callback for node 69b8a52dfbe29c53ae85f3b0 INFO: 172.21.0.1:36680 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:50:12,952 - lava_callback - INFO - Received callback for node 69b602331727ff69d6f26c0c INFO: 172.21.0.1:54410 - "POST /node/69b602331727ff69d6f26c0c HTTP/1.0" 202 Accepted 2026-03-17 00:50:12,957 - lava_callback - INFO - Starting async job submit for node 69b602331727ff69d6f26c0c 2026-03-17 00:50:12,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:12,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b602331727ff69d6f26c0c HTTP/1.1" 200 None 2026-03-17 00:50:12,973 - lava_callback - DEBUG - Processing node 69b602331727ff69d6f26c0c: baseline-arm-clabbe 2026-03-17 00:50:12,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b602331727ff69d6f26c0c 2026-03-17 00:50:12,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:12,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b602331727ff69d6f26c0c HTTP/1.1" 200 None 2026-03-17 00:50:12,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:13,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 00:50:13,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:13,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b602331727ff69d6f26c0c HTTP/1.1" 200 None 2026-03-17 00:50:13,031 - lava_callback - ERROR - Error processing callback for node 69b602331727ff69d6f26c0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54424 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:50:20,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:20,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33650 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:50:41,281 - lava_callback - INFO - Received callback for node 69b8a52efbe29c53ae85f3b3 INFO: 172.21.0.1:60128 - "POST /node/69b8a52efbe29c53ae85f3b3 HTTP/1.0" 202 Accepted 2026-03-17 00:50:41,330 - lava_callback - INFO - Starting async job submit for node 69b8a52efbe29c53ae85f3b3 2026-03-17 00:50:41,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:41,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a52efbe29c53ae85f3b3 HTTP/1.1" 200 None 2026-03-17 00:50:41,368 - lava_callback - DEBUG - Processing node 69b8a52efbe29c53ae85f3b3: baseline-arm 2026-03-17 00:50:41,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:50:41,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:50:41,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a52efbe29c53ae85f3b3/log.txt.gz 2026-03-17 00:50:41,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:50:41,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:50:41,934 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a52efbe29c53ae85f3b3/lava-logs.yaml 2026-03-17 00:50:41,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:50:42,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:50:42,065 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a52efbe29c53ae85f3b3/lava_callback.json.gz 2026-03-17 00:50:42,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:42,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a52efbe29c53ae85f3b3 HTTP/1.1" 200 None 2026-03-17 00:50:42,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:42,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:50:42,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:42,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a52efbe29c53ae85f3b3 HTTP/1.1" 200 None 2026-03-17 00:50:42,154 - lava_callback - INFO - Completed processing callback for node 69b8a52efbe29c53ae85f3b3 INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:50:49,777 - lava_callback - INFO - Received callback for node 69b8a531fbe29c53ae85f3bf INFO: 172.21.0.1:52700 - "POST /node/69b8a531fbe29c53ae85f3bf HTTP/1.0" 202 Accepted 2026-03-17 00:50:49,825 - lava_callback - INFO - Starting async job submit for node 69b8a531fbe29c53ae85f3bf 2026-03-17 00:50:49,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:49,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a531fbe29c53ae85f3bf HTTP/1.1" 200 None 2026-03-17 00:50:49,859 - lava_callback - DEBUG - Processing node 69b8a531fbe29c53ae85f3bf: baseline-arm 2026-03-17 00:50:49,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:50:50,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:50:50,165 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a531fbe29c53ae85f3bf/log.txt.gz 2026-03-17 00:50:50,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:50:50,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:50:50,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a531fbe29c53ae85f3bf/lava-logs.yaml 2026-03-17 00:50:50,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:50:50,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:50:50,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a531fbe29c53ae85f3bf/lava_callback.json.gz 2026-03-17 00:50:50,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:50,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a531fbe29c53ae85f3bf HTTP/1.1" 200 None 2026-03-17 00:50:50,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:50,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:50:50,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:50,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a531fbe29c53ae85f3bf HTTP/1.1" 200 None 2026-03-17 00:50:50,691 - lava_callback - INFO - Completed processing callback for node 69b8a531fbe29c53ae85f3bf 2026-03-17 00:50:50,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:50,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 00:50:53,425 - lava_callback - INFO - Received callback for node 69b602571727ff69d6f26c17 INFO: 172.21.0.1:52712 - "POST /node/69b602571727ff69d6f26c17 HTTP/1.0" 202 Accepted 2026-03-17 00:50:53,434 - lava_callback - INFO - Starting async job submit for node 69b602571727ff69d6f26c17 2026-03-17 00:50:53,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:53,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b602571727ff69d6f26c17 HTTP/1.1" 200 None 2026-03-17 00:50:53,450 - lava_callback - DEBUG - Processing node 69b602571727ff69d6f26c17: baseline-arm-clabbe 2026-03-17 00:50:53,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b602571727ff69d6f26c17 2026-03-17 00:50:53,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:53,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b602571727ff69d6f26c17 HTTP/1.1" 200 None 2026-03-17 00:50:53,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:53,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 00:50:53,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:50:53,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b602571727ff69d6f26c17 HTTP/1.1" 200 None 2026-03-17 00:50:53,524 - lava_callback - ERROR - Error processing callback for node 69b602571727ff69d6f26c17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:51:12,906 - lava_callback - INFO - Received callback for node 69b6027c1727ff69d6f26c21 INFO: 172.21.0.1:41708 - "POST /node/69b6027c1727ff69d6f26c21 HTTP/1.0" 202 Accepted 2026-03-17 00:51:12,915 - lava_callback - INFO - Starting async job submit for node 69b6027c1727ff69d6f26c21 2026-03-17 00:51:12,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:12,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6027c1727ff69d6f26c21 HTTP/1.1" 200 None 2026-03-17 00:51:12,947 - lava_callback - DEBUG - Processing node 69b6027c1727ff69d6f26c21: baseline-arm-clabbe 2026-03-17 00:51:12,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6027c1727ff69d6f26c21 2026-03-17 00:51:12,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:12,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6027c1727ff69d6f26c21 HTTP/1.1" 200 None 2026-03-17 00:51:12,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:13,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 00:51:13,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:13,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6027c1727ff69d6f26c21 HTTP/1.1" 200 None 2026-03-17 00:51:13,046 - lava_callback - ERROR - Error processing callback for node 69b6027c1727ff69d6f26c21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41726 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:51:18,182 - lava_callback - INFO - Received callback for node 69b8a52cfbe29c53ae85f3ad INFO: 172.21.0.1:41740 - "POST /node/69b8a52cfbe29c53ae85f3ad HTTP/1.0" 202 Accepted 2026-03-17 00:51:18,193 - lava_callback - INFO - Starting async job submit for node 69b8a52cfbe29c53ae85f3ad 2026-03-17 00:51:18,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:18,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a52cfbe29c53ae85f3ad HTTP/1.1" 200 None 2026-03-17 00:51:18,275 - lava_callback - DEBUG - Processing node 69b8a52cfbe29c53ae85f3ad: baseline-arm 2026-03-17 00:51:18,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:18,856 - lava_callback - INFO - Received callback for node 69b8a554fbe29c53ae85f453 2026-03-17 00:51:18,905 - lava_callback - INFO - Starting async job submit for node 69b8a554fbe29c53ae85f453 INFO: 172.21.0.1:41742 - "POST /node/69b8a554fbe29c53ae85f453 HTTP/1.0" 202 Accepted 2026-03-17 00:51:18,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:18,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a554fbe29c53ae85f453 HTTP/1.1" 200 None 2026-03-17 00:51:18,987 - lava_callback - DEBUG - Processing node 69b8a554fbe29c53ae85f453: baseline-arm-pengutronix 2026-03-17 00:51:19,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:19,218 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a52cfbe29c53ae85f3ad/log.txt.gz 2026-03-17 00:51:19,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:19,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:19,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:19,788 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a554fbe29c53ae85f453/log.txt.gz 2026-03-17 00:51:19,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:20,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:20,008 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a52cfbe29c53ae85f3ad/lava-logs.yaml 2026-03-17 00:51:20,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:20,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:20,332 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a554fbe29c53ae85f453/lava-logs.yaml 2026-03-17 00:51:20,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:20,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:20,373 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a52cfbe29c53ae85f3ad/lava_callback.json.gz 2026-03-17 00:51:20,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:20,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a52cfbe29c53ae85f3ad HTTP/1.1" 200 None 2026-03-17 00:51:20,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:20,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:51:20,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:20,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a52cfbe29c53ae85f3ad HTTP/1.1" 200 None 2026-03-17 00:51:20,528 - lava_callback - INFO - Completed processing callback for node 69b8a52cfbe29c53ae85f3ad 2026-03-17 00:51:20,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:20,756 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a554fbe29c53ae85f453/lava_callback.json.gz 2026-03-17 00:51:20,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:20,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:20,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a554fbe29c53ae85f453 HTTP/1.1" 200 None 2026-03-17 00:51:20,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:20,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:51:20,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:20,866 - lava_callback - INFO - Received callback for node 69b8a530fbe29c53ae85f3bc 2026-03-17 00:51:20,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53426 - "POST /node/69b8a530fbe29c53ae85f3bc HTTP/1.0" 202 Accepted 2026-03-17 00:51:20,884 - lava_callback - INFO - Starting async job submit for node 69b8a530fbe29c53ae85f3bc 2026-03-17 00:51:20,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a554fbe29c53ae85f453 HTTP/1.1" 200 None 2026-03-17 00:51:20,959 - lava_callback - INFO - Completed processing callback for node 69b8a554fbe29c53ae85f453 2026-03-17 00:51:20,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:21,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a530fbe29c53ae85f3bc HTTP/1.1" 200 None 2026-03-17 00:51:21,031 - lava_callback - DEBUG - Processing node 69b8a530fbe29c53ae85f3bc: baseline-arm 2026-03-17 00:51:21,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:21,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:21,809 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a530fbe29c53ae85f3bc/log.txt.gz 2026-03-17 00:51:22,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:22,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:22,610 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a530fbe29c53ae85f3bc/lava-logs.yaml 2026-03-17 00:51:22,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:23,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:23,081 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a530fbe29c53ae85f3bc/lava_callback.json.gz 2026-03-17 00:51:23,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:23,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a530fbe29c53ae85f3bc HTTP/1.1" 200 None 2026-03-17 00:51:23,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:23,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:51:23,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:23,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a530fbe29c53ae85f3bc HTTP/1.1" 200 None 2026-03-17 00:51:23,262 - lava_callback - INFO - Completed processing callback for node 69b8a530fbe29c53ae85f3bc 2026-03-17 00:51:25,184 - lava_callback - INFO - Received callback for node 69b8a550fbe29c53ae85f44a INFO: 172.21.0.1:53436 - "POST /node/69b8a550fbe29c53ae85f44a HTTP/1.0" 202 Accepted 2026-03-17 00:51:25,205 - lava_callback - INFO - Starting async job submit for node 69b8a550fbe29c53ae85f44a 2026-03-17 00:51:25,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:25,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a550fbe29c53ae85f44a HTTP/1.1" 200 None 2026-03-17 00:51:25,279 - lava_callback - DEBUG - Processing node 69b8a550fbe29c53ae85f44a: baseline-arm-pengutronix 2026-03-17 00:51:25,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:25,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:25,900 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a550fbe29c53ae85f44a/log.txt.gz 2026-03-17 00:51:26,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:51:26,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:26,610 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a550fbe29c53ae85f44a/lava-logs.yaml 2026-03-17 00:51:26,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:27,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:27,049 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a550fbe29c53ae85f44a/lava_callback.json.gz 2026-03-17 00:51:27,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:27,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a550fbe29c53ae85f44a HTTP/1.1" 200 None 2026-03-17 00:51:27,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:27,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:51:27,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:27,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a550fbe29c53ae85f44a HTTP/1.1" 200 None 2026-03-17 00:51:27,180 - lava_callback - INFO - Completed processing callback for node 69b8a550fbe29c53ae85f44a INFO: 172.21.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:51:42,831 - lava_callback - INFO - Received callback for node 69b8a53ffbe29c53ae85f3e4 INFO: 172.21.0.1:53938 - "POST /node/69b8a53ffbe29c53ae85f3e4 HTTP/1.0" 202 Accepted 2026-03-17 00:51:42,842 - lava_callback - INFO - Starting async job submit for node 69b8a53ffbe29c53ae85f3e4 2026-03-17 00:51:42,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:42,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a53ffbe29c53ae85f3e4 HTTP/1.1" 200 None 2026-03-17 00:51:42,906 - lava_callback - DEBUG - Processing node 69b8a53ffbe29c53ae85f3e4: baseline-arm-broonie 2026-03-17 00:51:43,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:43,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:43,734 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b8a53ffbe29c53ae85f3e4/log.txt.gz 2026-03-17 00:51:43,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:44,373 - lava_callback - INFO - Received callback for node 69b8a540fbe29c53ae85f3e7 INFO: 172.21.0.1:53948 - "POST /node/69b8a540fbe29c53ae85f3e7 HTTP/1.0" 202 Accepted 2026-03-17 00:51:44,384 - lava_callback - INFO - Starting async job submit for node 69b8a540fbe29c53ae85f3e7 2026-03-17 00:51:44,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:44,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:44,444 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b8a53ffbe29c53ae85f3e4/lava-logs.yaml 2026-03-17 00:51:44,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:44,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a540fbe29c53ae85f3e7 HTTP/1.1" 200 None 2026-03-17 00:51:44,457 - lava_callback - DEBUG - Processing node 69b8a540fbe29c53ae85f3e7: baseline-arm-broonie 2026-03-17 00:51:44,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:45,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:45,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b8a53ffbe29c53ae85f3e4/lava_callback.json.gz 2026-03-17 00:51:45,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:45,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a53ffbe29c53ae85f3e4 HTTP/1.1" 200 None 2026-03-17 00:51:45,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:45,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:51:45,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:45,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:45,208 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b8a540fbe29c53ae85f3e7/log.txt.gz 2026-03-17 00:51:45,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a53ffbe29c53ae85f3e4 HTTP/1.1" 200 None 2026-03-17 00:51:45,260 - lava_callback - INFO - Completed processing callback for node 69b8a53ffbe29c53ae85f3e4 2026-03-17 00:51:45,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:46,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:46,140 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b8a540fbe29c53ae85f3e7/lava-logs.yaml 2026-03-17 00:51:46,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53956 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:51:46,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:46,630 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b8a540fbe29c53ae85f3e7/lava_callback.json.gz 2026-03-17 00:51:46,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:46,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a540fbe29c53ae85f3e7 HTTP/1.1" 200 None 2026-03-17 00:51:46,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:46,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:51:46,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:46,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a540fbe29c53ae85f3e7 HTTP/1.1" 200 None 2026-03-17 00:51:46,805 - lava_callback - INFO - Completed processing callback for node 69b8a540fbe29c53ae85f3e7 2026-03-17 00:51:50,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:50,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:49438 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:51:56,653 - lava_callback - INFO - Received callback for node 69b8a545fbe29c53ae85f3ff INFO: 172.21.0.1:49448 - "POST /node/69b8a545fbe29c53ae85f3ff HTTP/1.0" 202 Accepted 2026-03-17 00:51:56,667 - lava_callback - INFO - Starting async job submit for node 69b8a545fbe29c53ae85f3ff 2026-03-17 00:51:56,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:56,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a545fbe29c53ae85f3ff HTTP/1.1" 200 None 2026-03-17 00:51:56,733 - lava_callback - DEBUG - Processing node 69b8a545fbe29c53ae85f3ff: baseline-arm-clabbe 2026-03-17 00:51:57,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:57,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:57,455 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b8a545fbe29c53ae85f3ff/log.txt.gz 2026-03-17 00:51:57,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:58,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:58,160 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b8a545fbe29c53ae85f3ff/lava-logs.yaml 2026-03-17 00:51:58,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:51:58,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:51:58,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b8a545fbe29c53ae85f3ff/lava_callback.json.gz 2026-03-17 00:51:58,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:58,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a545fbe29c53ae85f3ff HTTP/1.1" 200 None 2026-03-17 00:51:58,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:58,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:51:58,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:58,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a545fbe29c53ae85f3ff HTTP/1.1" 200 None 2026-03-17 00:51:58,781 - lava_callback - INFO - Completed processing callback for node 69b8a545fbe29c53ae85f3ff 2026-03-17 00:51:59,468 - lava_callback - INFO - Received callback for node 69b8a541fbe29c53ae85f3ea INFO: 172.21.0.1:49464 - "POST /node/69b8a541fbe29c53ae85f3ea HTTP/1.0" 202 Accepted 2026-03-17 00:51:59,478 - lava_callback - INFO - Starting async job submit for node 69b8a541fbe29c53ae85f3ea 2026-03-17 00:51:59,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:51:59,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a541fbe29c53ae85f3ea HTTP/1.1" 200 None 2026-03-17 00:51:59,566 - lava_callback - DEBUG - Processing node 69b8a541fbe29c53ae85f3ea: baseline-arm-broonie 2026-03-17 00:52:00,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:00,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:00,273 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b8a541fbe29c53ae85f3ea/log.txt.gz 2026-03-17 00:52:00,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:00,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:00,999 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b8a541fbe29c53ae85f3ea/lava-logs.yaml 2026-03-17 00:52:01,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:01,367 - lava_callback - INFO - Received callback for node 69b6029c1727ff69d6f26c29 INFO: 172.21.0.1:59974 - "POST /node/69b6029c1727ff69d6f26c29 HTTP/1.0" 202 Accepted 2026-03-17 00:52:01,376 - lava_callback - INFO - Starting async job submit for node 69b6029c1727ff69d6f26c29 2026-03-17 00:52:01,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:01,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6029c1727ff69d6f26c29 HTTP/1.1" 200 None 2026-03-17 00:52:01,407 - lava_callback - DEBUG - Processing node 69b6029c1727ff69d6f26c29: baseline-arm-baylibre 2026-03-17 00:52:01,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6029c1727ff69d6f26c29 2026-03-17 00:52:01,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:01,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6029c1727ff69d6f26c29 HTTP/1.1" 200 None 2026-03-17 00:52:01,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:01,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:01,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-17 00:52:01,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:01,461 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b8a541fbe29c53ae85f3ea/lava_callback.json.gz 2026-03-17 00:52:01,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:01,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6029c1727ff69d6f26c29 HTTP/1.1" 200 None 2026-03-17 00:52:01,549 - lava_callback - ERROR - Error processing callback for node 69b6029c1727ff69d6f26c29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 00:52:01,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a541fbe29c53ae85f3ea HTTP/1.1" 200 None 2026-03-17 00:52:01,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:01,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:52:01,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:01,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a541fbe29c53ae85f3ea HTTP/1.1" 200 None 2026-03-17 00:52:01,658 - lava_callback - INFO - Completed processing callback for node 69b8a541fbe29c53ae85f3ea INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:52:09,798 - lava_callback - INFO - Received callback for node 69b8a54dfbe29c53ae85f43f INFO: 172.21.0.1:39576 - "POST /node/69b8a54dfbe29c53ae85f43f HTTP/1.0" 202 Accepted 2026-03-17 00:52:09,809 - lava_callback - INFO - Starting async job submit for node 69b8a54dfbe29c53ae85f43f 2026-03-17 00:52:09,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:09,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a54dfbe29c53ae85f43f HTTP/1.1" 200 None 2026-03-17 00:52:09,879 - lava_callback - DEBUG - Processing node 69b8a54dfbe29c53ae85f43f: baseline-arm-kontron 2026-03-17 00:52:10,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:10,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:10,566 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b8a54dfbe29c53ae85f43f/log.txt.gz 2026-03-17 00:52:10,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:11,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:11,284 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b8a54dfbe29c53ae85f43f/lava-logs.yaml 2026-03-17 00:52:11,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:12,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:12,207 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b8a54dfbe29c53ae85f43f/lava_callback.json.gz 2026-03-17 00:52:12,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:12,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a54dfbe29c53ae85f43f HTTP/1.1" 200 None 2026-03-17 00:52:12,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:12,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:52:12,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:12,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a54dfbe29c53ae85f43f HTTP/1.1" 200 None 2026-03-17 00:52:12,376 - lava_callback - INFO - Completed processing callback for node 69b8a54dfbe29c53ae85f43f INFO: 172.21.0.1:39584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39598 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:52:20,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:20,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 00:52:24,215 - lava_callback - INFO - Received callback for node 69b8a551fbe29c53ae85f44d INFO: 172.21.0.1:51792 - "POST /node/69b8a551fbe29c53ae85f44d HTTP/1.0" 202 Accepted 2026-03-17 00:52:24,223 - lava_callback - INFO - Starting async job submit for node 69b8a551fbe29c53ae85f44d 2026-03-17 00:52:24,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:24,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a551fbe29c53ae85f44d HTTP/1.1" 200 None 2026-03-17 00:52:24,270 - lava_callback - DEBUG - Processing node 69b8a551fbe29c53ae85f44d: baseline-arm-pengutronix 2026-03-17 00:52:24,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:24,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:24,702 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a551fbe29c53ae85f44d/log.txt.gz 2026-03-17 00:52:24,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:25,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:25,098 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a551fbe29c53ae85f44d/lava-logs.yaml 2026-03-17 00:52:25,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:25,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:25,273 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a551fbe29c53ae85f44d/lava_callback.json.gz 2026-03-17 00:52:25,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:25,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a551fbe29c53ae85f44d HTTP/1.1" 200 None 2026-03-17 00:52:25,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:25,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:52:25,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:25,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a551fbe29c53ae85f44d HTTP/1.1" 200 None 2026-03-17 00:52:25,441 - lava_callback - INFO - Completed processing callback for node 69b8a551fbe29c53ae85f44d INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:52:37,193 - lava_callback - INFO - Received callback for node 69b8a5bdfbe29c53ae85f517 INFO: 172.21.0.1:57904 - "POST /node/69b8a5bdfbe29c53ae85f517 HTTP/1.0" 202 Accepted 2026-03-17 00:52:37,199 - lava_callback - INFO - Starting async job submit for node 69b8a5bdfbe29c53ae85f517 2026-03-17 00:52:37,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:37,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a5bdfbe29c53ae85f517 HTTP/1.1" 200 None 2026-03-17 00:52:37,218 - lava_callback - DEBUG - Processing node 69b8a5bdfbe29c53ae85f517: baseline-arm 2026-03-17 00:52:37,223 - lava_callback - WARNING - Failed to upload log 2026-03-17 00:52:37,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:37,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:37,365 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a5bdfbe29c53ae85f517/lava-logs.yaml 2026-03-17 00:52:37,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:37,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:37,482 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a5bdfbe29c53ae85f517/lava_callback.json.gz 2026-03-17 00:52:37,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:37,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a5bdfbe29c53ae85f517 HTTP/1.1" 200 None 2026-03-17 00:52:37,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:37,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:52:37,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:37,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a5bdfbe29c53ae85f517 HTTP/1.1" 200 None 2026-03-17 00:52:37,564 - lava_callback - INFO - Completed processing callback for node 69b8a5bdfbe29c53ae85f517 2026-03-17 00:52:37,581 - lava_callback - INFO - Received callback for node 69b8a56dfbe29c53ae85f48f INFO: 172.21.0.1:57908 - "POST /node/69b8a56dfbe29c53ae85f48f HTTP/1.0" 202 Accepted 2026-03-17 00:52:37,618 - lava_callback - INFO - Starting async job submit for node 69b8a56dfbe29c53ae85f48f 2026-03-17 00:52:37,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:37,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a56dfbe29c53ae85f48f HTTP/1.1" 200 None 2026-03-17 00:52:37,749 - lava_callback - DEBUG - Processing node 69b8a56dfbe29c53ae85f48f: ltp-dio 2026-03-17 00:52:38,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:38,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:38,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69b8a56dfbe29c53ae85f48f/log.txt.gz 2026-03-17 00:52:38,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:39,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:39,088 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69b8a56dfbe29c53ae85f48f/lava-logs.yaml 2026-03-17 00:52:39,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:52:39,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:52:39,308 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69b8a56dfbe29c53ae85f48f/lava_callback.json.gz 2026-03-17 00:52:39,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:39,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a56dfbe29c53ae85f48f HTTP/1.1" 200 None 2026-03-17 00:52:39,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:39,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:52:39,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:39,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a56dfbe29c53ae85f48f HTTP/1.1" 200 None 2026-03-17 00:52:39,413 - lava_callback - INFO - Completed processing callback for node 69b8a56dfbe29c53ae85f48f INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:52:50,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:52:50,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49878 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:53:41,451 - lava_callback - INFO - Received callback for node 69b603071727ff69d6f26c34 INFO: 172.21.0.1:55912 - "POST /node/69b603071727ff69d6f26c34 HTTP/1.0" 202 Accepted 2026-03-17 00:53:41,457 - lava_callback - INFO - Starting async job submit for node 69b603071727ff69d6f26c34 2026-03-17 00:53:41,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:53:41,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b603071727ff69d6f26c34 HTTP/1.1" 200 None 2026-03-17 00:53:41,474 - lava_callback - DEBUG - Processing node 69b603071727ff69d6f26c34: baseline-arm-baylibre 2026-03-17 00:53:41,475 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b603071727ff69d6f26c34 2026-03-17 00:53:41,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:53:41,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b603071727ff69d6f26c34 HTTP/1.1" 200 None 2026-03-17 00:53:41,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:53:41,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-17 00:53:41,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:53:41,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b603071727ff69d6f26c34 HTTP/1.1" 200 None 2026-03-17 00:53:41,545 - lava_callback - ERROR - Error processing callback for node 69b603071727ff69d6f26c34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 00:53:43,747 - lava_callback - INFO - Received callback for node 69b8a546fbe29c53ae85f426 INFO: 172.21.0.1:55916 - "POST /node/69b8a546fbe29c53ae85f426 HTTP/1.0" 202 Accepted 2026-03-17 00:53:43,754 - lava_callback - INFO - Starting async job submit for node 69b8a546fbe29c53ae85f426 2026-03-17 00:53:43,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:53:43,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a546fbe29c53ae85f426 HTTP/1.1" 200 None 2026-03-17 00:53:43,793 - lava_callback - DEBUG - Processing node 69b8a546fbe29c53ae85f426: baseline-arm-clabbe 2026-03-17 00:53:44,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:53:44,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:53:44,184 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b8a546fbe29c53ae85f426/log.txt.gz 2026-03-17 00:53:44,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:53:44,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:53:44,594 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b8a546fbe29c53ae85f426/lava-logs.yaml 2026-03-17 00:53:44,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:53:44,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:53:44,843 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b8a546fbe29c53ae85f426/lava_callback.json.gz 2026-03-17 00:53:44,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:53:44,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a546fbe29c53ae85f426 HTTP/1.1" 200 None 2026-03-17 00:53:44,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:53:44,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:53:44,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:53:44,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a546fbe29c53ae85f426 HTTP/1.1" 200 None 2026-03-17 00:53:44,939 - lava_callback - INFO - Completed processing callback for node 69b8a546fbe29c53ae85f426 INFO: 172.21.0.1:55932 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:53:50,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:53:50,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60634 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:55:01,552 - lava_callback - INFO - Received callback for node 69b603581727ff69d6f26c3f INFO: 172.21.0.1:38708 - "POST /node/69b603581727ff69d6f26c3f HTTP/1.0" 202 Accepted 2026-03-17 00:55:01,558 - lava_callback - INFO - Starting async job submit for node 69b603581727ff69d6f26c3f 2026-03-17 00:55:01,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:55:01,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b603581727ff69d6f26c3f HTTP/1.1" 200 None 2026-03-17 00:55:01,574 - lava_callback - DEBUG - Processing node 69b603581727ff69d6f26c3f: baseline-arm-baylibre 2026-03-17 00:55:01,574 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b603581727ff69d6f26c3f 2026-03-17 00:55:01,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:55:01,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b603581727ff69d6f26c3f HTTP/1.1" 200 None 2026-03-17 00:55:01,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:55:01,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-17 00:55:01,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:55:01,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b603581727ff69d6f26c3f HTTP/1.1" 200 None 2026-03-17 00:55:01,636 - lava_callback - ERROR - Error processing callback for node 69b603581727ff69d6f26c3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:55:21,795 - lava_callback - INFO - Received callback for node 69b8a57cfbe29c53ae85f4a9 INFO: 172.21.0.1:41876 - "POST /node/69b8a57cfbe29c53ae85f4a9 HTTP/1.0" 202 Accepted 2026-03-17 00:55:21,802 - lava_callback - INFO - Starting async job submit for node 69b8a57cfbe29c53ae85f4a9 2026-03-17 00:55:21,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:55:21,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a57cfbe29c53ae85f4a9 HTTP/1.1" 200 None 2026-03-17 00:55:21,842 - lava_callback - DEBUG - Processing node 69b8a57cfbe29c53ae85f4a9: ltp-syscalls 2026-03-17 00:55:22,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:55:22,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:55:22,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b8a57cfbe29c53ae85f4a9/log.txt.gz 2026-03-17 00:55:22,903 - lava_callback - INFO - Received callback for node 69b8a54afbe29c53ae85f435 INFO: 172.21.0.1:41886 - "POST /node/69b8a54afbe29c53ae85f435 HTTP/1.0" 202 Accepted 2026-03-17 00:55:22,927 - lava_callback - INFO - Starting async job submit for node 69b8a54afbe29c53ae85f435 2026-03-17 00:55:22,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:55:23,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a54afbe29c53ae85f435 HTTP/1.1" 200 None 2026-03-17 00:55:23,068 - lava_callback - DEBUG - Processing node 69b8a54afbe29c53ae85f435: baseline-arm-clabbe 2026-03-17 00:55:23,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:55:23,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:55:23,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:55:23,548 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b8a54afbe29c53ae85f435/log.txt.gz 2026-03-17 00:55:23,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:55:23,670 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b8a57cfbe29c53ae85f4a9/lava-logs.yaml 2026-03-17 00:55:23,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:55:23,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:55:23,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:55:23,894 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b8a54afbe29c53ae85f435/lava-logs.yaml 2026-03-17 00:55:23,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:55:23,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:55:23,931 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b8a57cfbe29c53ae85f4a9/lava_callback.json.gz 2026-03-17 00:55:23,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:55:23,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a57cfbe29c53ae85f4a9 HTTP/1.1" 200 None 2026-03-17 00:55:23,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:55:23,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:55:23,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:55:24,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a57cfbe29c53ae85f4a9 HTTP/1.1" 200 None 2026-03-17 00:55:24,025 - lava_callback - INFO - Completed processing callback for node 69b8a57cfbe29c53ae85f4a9 2026-03-17 00:55:24,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:55:24,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b8a54afbe29c53ae85f435/lava_callback.json.gz 2026-03-17 00:55:24,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:55:24,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a54afbe29c53ae85f435 HTTP/1.1" 200 None 2026-03-17 00:55:24,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:55:24,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:55:24,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:55:24,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a54afbe29c53ae85f435 HTTP/1.1" 200 None 2026-03-17 00:55:24,270 - lava_callback - INFO - Completed processing callback for node 69b8a54afbe29c53ae85f435 INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53294 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:55:50,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:55:51,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:56:21,617 - lava_callback - INFO - Received callback for node 69b603a91727ff69d6f26c4a INFO: 172.21.0.1:48514 - "POST /node/69b603a91727ff69d6f26c4a HTTP/1.0" 202 Accepted 2026-03-17 00:56:21,623 - lava_callback - INFO - Starting async job submit for node 69b603a91727ff69d6f26c4a 2026-03-17 00:56:21,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:56:21,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b603a91727ff69d6f26c4a HTTP/1.1" 200 None 2026-03-17 00:56:21,640 - lava_callback - DEBUG - Processing node 69b603a91727ff69d6f26c4a: baseline-arm-baylibre 2026-03-17 00:56:21,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b603a91727ff69d6f26c4a 2026-03-17 00:56:21,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:56:21,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b603a91727ff69d6f26c4a HTTP/1.1" 200 None 2026-03-17 00:56:21,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:56:21,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-17 00:56:21,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:56:21,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b603a91727ff69d6f26c4a HTTP/1.1" 200 None 2026-03-17 00:56:21,691 - lava_callback - ERROR - Error processing callback for node 69b603a91727ff69d6f26c4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49368 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:57:01,904 - lava_callback - INFO - Received callback for node 69b8a54bfbe29c53ae85f438 INFO: 172.21.0.1:46656 - "POST /node/69b8a54bfbe29c53ae85f438 HTTP/1.0" 202 Accepted 2026-03-17 00:57:01,910 - lava_callback - INFO - Starting async job submit for node 69b8a54bfbe29c53ae85f438 2026-03-17 00:57:01,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:57:01,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a54bfbe29c53ae85f438 HTTP/1.1" 200 None 2026-03-17 00:57:01,949 - lava_callback - DEBUG - Processing node 69b8a54bfbe29c53ae85f438: baseline-arm-clabbe 2026-03-17 00:57:02,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:57:02,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:57:02,507 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b8a54bfbe29c53ae85f438/log.txt.gz 2026-03-17 00:57:02,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:57:03,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:57:03,117 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b8a54bfbe29c53ae85f438/lava-logs.yaml 2026-03-17 00:57:03,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:57:03,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:57:03,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b8a54bfbe29c53ae85f438/lava_callback.json.gz 2026-03-17 00:57:03,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:57:03,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a54bfbe29c53ae85f438 HTTP/1.1" 200 None 2026-03-17 00:57:03,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:57:03,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 00:57:03,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:57:03,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a54bfbe29c53ae85f438 HTTP/1.1" 200 None 2026-03-17 00:57:03,373 - lava_callback - INFO - Completed processing callback for node 69b8a54bfbe29c53ae85f438 INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:57:21,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:57:21,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39718 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:58:21,705 - lava_callback - INFO - Received callback for node 69b604221727ff69d6f26c55 INFO: 172.21.0.1:57402 - "POST /node/69b604221727ff69d6f26c55 HTTP/1.0" 202 Accepted 2026-03-17 00:58:21,716 - lava_callback - INFO - Starting async job submit for node 69b604221727ff69d6f26c55 2026-03-17 00:58:21,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:58:21,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b604221727ff69d6f26c55 HTTP/1.1" 200 None 2026-03-17 00:58:21,744 - lava_callback - DEBUG - Processing node 69b604221727ff69d6f26c55: baseline-arm-baylibre 2026-03-17 00:58:21,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b604221727ff69d6f26c55 2026-03-17 00:58:21,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:58:21,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b604221727ff69d6f26c55 HTTP/1.1" 200 None 2026-03-17 00:58:21,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:58:21,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-17 00:58:21,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:58:21,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b604221727ff69d6f26c55 HTTP/1.1" 200 None 2026-03-17 00:58:21,824 - lava_callback - ERROR - Error processing callback for node 69b604221727ff69d6f26c55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:58:53,423 - lava_callback - INFO - Received callback for node 69b604481727ff69d6f26c60 INFO: 172.21.0.1:59924 - "POST /node/69b604481727ff69d6f26c60 HTTP/1.0" 202 Accepted 2026-03-17 00:58:53,429 - lava_callback - INFO - Starting async job submit for node 69b604481727ff69d6f26c60 2026-03-17 00:58:53,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:58:53,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b604481727ff69d6f26c60 HTTP/1.1" 200 None 2026-03-17 00:58:53,445 - lava_callback - DEBUG - Processing node 69b604481727ff69d6f26c60: baseline-arm-clabbe 2026-03-17 00:58:53,446 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b604481727ff69d6f26c60 2026-03-17 00:58:53,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:58:53,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b604481727ff69d6f26c60 HTTP/1.1" 200 None 2026-03-17 00:58:53,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:58:53,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-17 00:58:53,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:58:53,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b604481727ff69d6f26c60 HTTP/1.1" 200 None 2026-03-17 00:58:53,501 - lava_callback - ERROR - Error processing callback for node 69b604481727ff69d6f26c60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:59:00,057 - lava_callback - INFO - Received callback for node 69b8888d0b8ad4124cec68cf INFO: 172.21.0.1:44548 - "POST /node/69b8888d0b8ad4124cec68cf HTTP/1.0" 202 Accepted 2026-03-17 00:59:00,064 - lava_callback - INFO - Starting async job submit for node 69b8888d0b8ad4124cec68cf 2026-03-17 00:59:00,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:00,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8888d0b8ad4124cec68cf HTTP/1.1" 200 None 2026-03-17 00:59:00,105 - lava_callback - DEBUG - Processing node 69b8888d0b8ad4124cec68cf: ltp-syscalls-ipc 2026-03-17 00:59:00,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:59:00,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:59:00,603 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b8888d0b8ad4124cec68cf/log.txt.gz 2026-03-17 00:59:00,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:59:01,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:59:01,021 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b8888d0b8ad4124cec68cf/lava-logs.yaml 2026-03-17 00:59:01,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:59:01,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:59:01,202 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b8888d0b8ad4124cec68cf/lava_callback.json.gz 2026-03-17 00:59:01,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:01,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8888d0b8ad4124cec68cf HTTP/1.1" 200 None 2026-03-17 00:59:01,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:01,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-17 00:59:01,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:01,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8888d0b8ad4124cec68cf HTTP/1.1" 200 None 2026-03-17 00:59:01,293 - lava_callback - INFO - Completed processing callback for node 69b8888d0b8ad4124cec68cf INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50502 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:59:19,956 - lava_callback - INFO - Received callback for node 69b888e10b8ad4124cec68e0 INFO: 172.21.0.1:42980 - "POST /node/69b888e10b8ad4124cec68e0 HTTP/1.0" 202 Accepted 2026-03-17 00:59:19,963 - lava_callback - INFO - Starting async job submit for node 69b888e10b8ad4124cec68e0 2026-03-17 00:59:19,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:20,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b888e10b8ad4124cec68e0 HTTP/1.1" 200 None 2026-03-17 00:59:20,009 - lava_callback - DEBUG - Processing node 69b888e10b8ad4124cec68e0: ltp-watchqueue 2026-03-17 00:59:20,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:59:20,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:59:20,753 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b888e10b8ad4124cec68e0/log.txt.gz 2026-03-17 00:59:21,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:21,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:59:21,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 00:59:21,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:59:21,375 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b888e10b8ad4124cec68e0/lava-logs.yaml 2026-03-17 00:59:21,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:59:21,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:59:21,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b888e10b8ad4124cec68e0/lava_callback.json.gz 2026-03-17 00:59:21,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:21,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b888e10b8ad4124cec68e0 HTTP/1.1" 200 None 2026-03-17 00:59:21,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:21,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-17 00:59:21,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:21,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b888e10b8ad4124cec68e0 HTTP/1.1" 200 None 2026-03-17 00:59:21,861 - lava_callback - INFO - Completed processing callback for node 69b888e10b8ad4124cec68e0 2026-03-17 00:59:24,241 - lava_callback - INFO - Received callback for node 69b888b70b8ad4124cec68d8 INFO: 172.21.0.1:42984 - "POST /node/69b888b70b8ad4124cec68d8 HTTP/1.0" 202 Accepted 2026-03-17 00:59:24,250 - lava_callback - INFO - Starting async job submit for node 69b888b70b8ad4124cec68d8 2026-03-17 00:59:24,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:24,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b888b70b8ad4124cec68d8 HTTP/1.1" 200 None 2026-03-17 00:59:24,317 - lava_callback - DEBUG - Processing node 69b888b70b8ad4124cec68d8: ltp-timers 2026-03-17 00:59:24,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:59:25,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:59:25,036 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69b888b70b8ad4124cec68d8/log.txt.gz 2026-03-17 00:59:25,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:59:25,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:59:25,683 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69b888b70b8ad4124cec68d8/lava-logs.yaml 2026-03-17 00:59:25,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 00:59:25,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 00:59:25,886 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69b888b70b8ad4124cec68d8/lava_callback.json.gz 2026-03-17 00:59:25,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:25,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b888b70b8ad4124cec68d8 HTTP/1.1" 200 None 2026-03-17 00:59:25,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:25,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-17 00:59:25,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:25,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b888b70b8ad4124cec68d8 HTTP/1.1" 200 None 2026-03-17 00:59:25,985 - lava_callback - INFO - Completed processing callback for node 69b888b70b8ad4124cec68d8 INFO: 172.21.0.1:42988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45584 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:59:51,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:59:51,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:00:13,529 - lava_callback - INFO - Received callback for node 69b6048d1727ff69d6f26c6b INFO: 172.21.0.1:36310 - "POST /node/69b6048d1727ff69d6f26c6b HTTP/1.0" 202 Accepted 2026-03-17 01:00:13,538 - lava_callback - INFO - Starting async job submit for node 69b6048d1727ff69d6f26c6b 2026-03-17 01:00:13,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:00:13,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6048d1727ff69d6f26c6b HTTP/1.1" 200 None 2026-03-17 01:00:13,569 - lava_callback - DEBUG - Processing node 69b6048d1727ff69d6f26c6b: baseline-arm-clabbe 2026-03-17 01:00:13,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6048d1727ff69d6f26c6b 2026-03-17 01:00:13,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:00:13,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6048d1727ff69d6f26c6b HTTP/1.1" 200 None 2026-03-17 01:00:13,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:00:13,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-17 01:00:13,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:00:13,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6048d1727ff69d6f26c6b HTTP/1.1" 200 None 2026-03-17 01:00:13,677 - lava_callback - ERROR - Error processing callback for node 69b6048d1727ff69d6f26c6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39934 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:01:33,522 - lava_callback - INFO - Received callback for node 69b604de1727ff69d6f26c76 INFO: 172.21.0.1:42670 - "POST /node/69b604de1727ff69d6f26c76 HTTP/1.0" 202 Accepted 2026-03-17 01:01:33,528 - lava_callback - INFO - Starting async job submit for node 69b604de1727ff69d6f26c76 2026-03-17 01:01:33,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:01:33,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b604de1727ff69d6f26c76 HTTP/1.1" 200 None 2026-03-17 01:01:33,544 - lava_callback - DEBUG - Processing node 69b604de1727ff69d6f26c76: baseline-arm-clabbe 2026-03-17 01:01:33,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b604de1727ff69d6f26c76 2026-03-17 01:01:33,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:01:33,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b604de1727ff69d6f26c76 HTTP/1.1" 200 None 2026-03-17 01:01:33,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:01:33,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-17 01:01:33,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:01:33,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b604de1727ff69d6f26c76 HTTP/1.1" 200 None 2026-03-17 01:01:33,613 - lava_callback - ERROR - Error processing callback for node 69b604de1727ff69d6f26c76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53736 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:02:20,545 - lava_callback - INFO - Received callback for node 69b8a80cfbe29c53ae85f625 INFO: 172.21.0.1:44632 - "POST /node/69b8a80cfbe29c53ae85f625 HTTP/1.0" 202 Accepted 2026-03-17 01:02:20,551 - lava_callback - INFO - Starting async job submit for node 69b8a80cfbe29c53ae85f625 2026-03-17 01:02:20,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:20,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a80cfbe29c53ae85f625 HTTP/1.1" 200 None 2026-03-17 01:02:20,568 - lava_callback - DEBUG - Processing node 69b8a80cfbe29c53ae85f625: baseline-arm 2026-03-17 01:02:20,573 - lava_callback - WARNING - Failed to upload log 2026-03-17 01:02:20,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:02:20,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:02:20,727 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a80cfbe29c53ae85f625/lava-logs.yaml 2026-03-17 01:02:20,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:02:20,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:02:20,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a80cfbe29c53ae85f625/lava_callback.json.gz 2026-03-17 01:02:20,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:20,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a80cfbe29c53ae85f625 HTTP/1.1" 200 None 2026-03-17 01:02:20,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:20,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:02:20,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:20,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a80cfbe29c53ae85f625 HTTP/1.1" 200 None 2026-03-17 01:02:20,926 - lava_callback - INFO - Completed processing callback for node 69b8a80cfbe29c53ae85f625 2026-03-17 01:02:21,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:21,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55996 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:02:39,281 - lava_callback - INFO - Received callback for node 69b8a7f0fbe29c53ae85f61c INFO: 172.21.0.1:56008 - "POST /node/69b8a7f0fbe29c53ae85f61c HTTP/1.0" 202 Accepted 2026-03-17 01:02:39,287 - lava_callback - INFO - Starting async job submit for node 69b8a7f0fbe29c53ae85f61c 2026-03-17 01:02:39,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:39,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a7f0fbe29c53ae85f61c HTTP/1.1" 200 None 2026-03-17 01:02:39,319 - lava_callback - DEBUG - Processing node 69b8a7f0fbe29c53ae85f61c: baseline-arm-pengutronix 2026-03-17 01:02:39,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:02:39,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:02:39,606 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a7f0fbe29c53ae85f61c/log.txt.gz 2026-03-17 01:02:39,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:02:39,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:02:39,873 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a7f0fbe29c53ae85f61c/lava-logs.yaml 2026-03-17 01:02:39,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:02:40,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:02:40,022 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a7f0fbe29c53ae85f61c/lava_callback.json.gz 2026-03-17 01:02:40,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:40,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a7f0fbe29c53ae85f61c HTTP/1.1" 200 None 2026-03-17 01:02:40,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:40,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:02:40,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:40,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a7f0fbe29c53ae85f61c HTTP/1.1" 200 None 2026-03-17 01:02:40,102 - lava_callback - INFO - Completed processing callback for node 69b8a7f0fbe29c53ae85f61c INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:02:51,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:51,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 01:02:53,575 - lava_callback - INFO - Received callback for node 69b6052c1727ff69d6f26c83 INFO: 172.21.0.1:44436 - "POST /node/69b6052c1727ff69d6f26c83 HTTP/1.0" 202 Accepted 2026-03-17 01:02:53,581 - lava_callback - INFO - Starting async job submit for node 69b6052c1727ff69d6f26c83 2026-03-17 01:02:53,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:53,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6052c1727ff69d6f26c83 HTTP/1.1" 200 None 2026-03-17 01:02:53,597 - lava_callback - DEBUG - Processing node 69b6052c1727ff69d6f26c83: baseline-arm-clabbe 2026-03-17 01:02:53,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6052c1727ff69d6f26c83 2026-03-17 01:02:53,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:53,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6052c1727ff69d6f26c83 HTTP/1.1" 200 None 2026-03-17 01:02:53,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:53,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-17 01:02:53,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:02:53,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6052c1727ff69d6f26c83 HTTP/1.1" 200 None 2026-03-17 01:02:53,649 - lava_callback - ERROR - Error processing callback for node 69b6052c1727ff69d6f26c83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34496 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:04:13,622 - lava_callback - INFO - Received callback for node 69b6057d1727ff69d6f26c8c INFO: 172.21.0.1:46900 - "POST /node/69b6057d1727ff69d6f26c8c HTTP/1.0" 202 Accepted 2026-03-17 01:04:13,631 - lava_callback - INFO - Starting async job submit for node 69b6057d1727ff69d6f26c8c 2026-03-17 01:04:13,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:04:13,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6057d1727ff69d6f26c8c HTTP/1.1" 200 None 2026-03-17 01:04:13,656 - lava_callback - DEBUG - Processing node 69b6057d1727ff69d6f26c8c: baseline-arm-clabbe 2026-03-17 01:04:13,657 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6057d1727ff69d6f26c8c 2026-03-17 01:04:13,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:04:13,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6057d1727ff69d6f26c8c HTTP/1.1" 200 None 2026-03-17 01:04:13,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:04:13,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-17 01:04:13,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:04:13,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6057d1727ff69d6f26c8c HTTP/1.1" 200 None 2026-03-17 01:04:13,734 - lava_callback - ERROR - Error processing callback for node 69b6057d1727ff69d6f26c8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52184 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:05:58,780 - lava_callback - INFO - Received callback for node 69b8a53cfbe29c53ae85f3dd INFO: 172.21.0.1:52186 - "POST /node/69b8a53cfbe29c53ae85f3dd HTTP/1.0" 202 Accepted 2026-03-17 01:05:58,788 - lava_callback - INFO - Starting async job submit for node 69b8a53cfbe29c53ae85f3dd 2026-03-17 01:05:58,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:05:58,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a53cfbe29c53ae85f3dd HTTP/1.1" 200 None 2026-03-17 01:05:58,855 - lava_callback - DEBUG - Processing node 69b8a53cfbe29c53ae85f3dd: baseline-x86 2026-03-17 01:05:59,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:05:59,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:05:59,961 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a53cfbe29c53ae85f3dd/log.txt.gz 2026-03-17 01:06:00,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:06:00,734 - lava_callback - INFO - Received callback for node 69b894200b8ad4124cec6b0b 2026-03-17 01:06:00,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:06:00,773 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a53cfbe29c53ae85f3dd/lava-logs.yaml INFO: 172.21.0.1:48954 - "POST /node/69b894200b8ad4124cec6b0b HTTP/1.0" 202 Accepted 2026-03-17 01:06:00,781 - lava_callback - INFO - Starting async job submit for node 69b894200b8ad4124cec6b0b 2026-03-17 01:06:00,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:06:00,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:06:00,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b894200b8ad4124cec6b0b HTTP/1.1" 200 None 2026-03-17 01:06:00,826 - lava_callback - DEBUG - Processing node 69b894200b8ad4124cec6b0b: baseline-arm-pengutronix 2026-03-17 01:06:00,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:06:01,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:06:01,163 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b894200b8ad4124cec6b0b/log.txt.gz 2026-03-17 01:06:01,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:06:01,211 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a53cfbe29c53ae85f3dd/lava_callback.json.gz 2026-03-17 01:06:01,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 DEBUG: Setup failed for 69b8a53cfbe29c53ae85f3dd. Transitting job node result: incomplete -> fail 2026-03-17 01:06:01,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:06:01,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a53cfbe29c53ae85f3dd HTTP/1.1" 200 None 2026-03-17 01:06:01,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:06:01,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89dd1fbe29c53ae85cd0e HTTP/1.1" 200 None 2026-03-17 01:06:01,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:06:01,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a53cfbe29c53ae85f3dd HTTP/1.1" 200 None 2026-03-17 01:06:01,592 - lava_callback - INFO - Completed processing callback for node 69b8a53cfbe29c53ae85f3dd 2026-03-17 01:06:01,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:06:01,784 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b894200b8ad4124cec6b0b/lava-logs.yaml 2026-03-17 01:06:01,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:06:01,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:06:01,919 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b894200b8ad4124cec6b0b/lava_callback.json.gz DEBUG: Setup failed for 69b894200b8ad4124cec6b0b. Transitting job node result: incomplete -> fail 2026-03-17 01:06:01,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:06:01,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b894200b8ad4124cec6b0b HTTP/1.1" 200 None 2026-03-17 01:06:01,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:06:02,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-17 01:06:02,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:06:02,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b894200b8ad4124cec6b0b HTTP/1.1" 200 None 2026-03-17 01:06:02,155 - lava_callback - INFO - Completed processing callback for node 69b894200b8ad4124cec6b0b INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44974 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:06:21,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:06:21,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45024 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:07:02,301 - lava_callback - INFO - Received callback for node 69b606321727ff69d6f26c97 INFO: 172.21.0.1:56774 - "POST /node/69b606321727ff69d6f26c97 HTTP/1.0" 202 Accepted 2026-03-17 01:07:02,307 - lava_callback - INFO - Starting async job submit for node 69b606321727ff69d6f26c97 2026-03-17 01:07:02,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:07:02,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b606321727ff69d6f26c97 HTTP/1.1" 200 None 2026-03-17 01:07:02,324 - lava_callback - DEBUG - Processing node 69b606321727ff69d6f26c97: baseline-arm64-baylibre 2026-03-17 01:07:02,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b606321727ff69d6f26c97 2026-03-17 01:07:02,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:07:02,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b606321727ff69d6f26c97 HTTP/1.1" 200 None 2026-03-17 01:07:02,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:07:02,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 01:07:02,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:07:02,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b606321727ff69d6f26c97 HTTP/1.1" 200 None 2026-03-17 01:07:02,390 - lava_callback - ERROR - Error processing callback for node 69b606321727ff69d6f26c97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:07:18,553 - lava_callback - INFO - Received callback for node 69b8a52efbe29c53ae85f3b9 INFO: 172.21.0.1:59006 - "POST /node/69b8a52efbe29c53ae85f3b9 HTTP/1.0" 202 Accepted 2026-03-17 01:07:18,562 - lava_callback - INFO - Starting async job submit for node 69b8a52efbe29c53ae85f3b9 2026-03-17 01:07:18,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:07:18,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a52efbe29c53ae85f3b9 HTTP/1.1" 200 None 2026-03-17 01:07:18,674 - lava_callback - DEBUG - Processing node 69b8a52efbe29c53ae85f3b9: baseline-arm 2026-03-17 01:07:19,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:07:19,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:07:19,588 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a52efbe29c53ae85f3b9/log.txt.gz 2026-03-17 01:07:20,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:07:20,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:07:20,291 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a52efbe29c53ae85f3b9/lava-logs.yaml 2026-03-17 01:07:20,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:07:20,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:07:20,502 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8a52efbe29c53ae85f3b9/lava_callback.json.gz DEBUG: Setup failed for 69b8a52efbe29c53ae85f3b9. Transitting job node result: incomplete -> fail 2026-03-17 01:07:20,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:07:20,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a52efbe29c53ae85f3b9 HTTP/1.1" 200 None 2026-03-17 01:07:20,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:07:20,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:07:20,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:07:20,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a52efbe29c53ae85f3b9 HTTP/1.1" 200 None 2026-03-17 01:07:20,869 - lava_callback - INFO - Completed processing callback for node 69b8a52efbe29c53ae85f3b9 2026-03-17 01:07:21,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:07:21,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:08:22,280 - lava_callback - INFO - Received callback for node 69b606821727ff69d6f26ca1 INFO: 172.21.0.1:56164 - "POST /node/69b606821727ff69d6f26ca1 HTTP/1.0" 202 Accepted 2026-03-17 01:08:22,285 - lava_callback - INFO - Starting async job submit for node 69b606821727ff69d6f26ca1 2026-03-17 01:08:22,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:08:22,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b606821727ff69d6f26ca1 HTTP/1.1" 200 None 2026-03-17 01:08:22,300 - lava_callback - DEBUG - Processing node 69b606821727ff69d6f26ca1: baseline-arm64-baylibre 2026-03-17 01:08:22,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b606821727ff69d6f26ca1 2026-03-17 01:08:22,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:08:22,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b606821727ff69d6f26ca1 HTTP/1.1" 200 None 2026-03-17 01:08:22,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:08:22,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 01:08:22,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:08:22,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b606821727ff69d6f26ca1 HTTP/1.1" 200 None 2026-03-17 01:08:22,364 - lava_callback - ERROR - Error processing callback for node 69b606821727ff69d6f26ca1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57136 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:09:42,310 - lava_callback - INFO - Received callback for node 69b606d41727ff69d6f26caf INFO: 172.21.0.1:56532 - "POST /node/69b606d41727ff69d6f26caf HTTP/1.0" 202 Accepted 2026-03-17 01:09:42,316 - lava_callback - INFO - Starting async job submit for node 69b606d41727ff69d6f26caf 2026-03-17 01:09:42,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:09:42,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b606d41727ff69d6f26caf HTTP/1.1" 200 None 2026-03-17 01:09:42,331 - lava_callback - DEBUG - Processing node 69b606d41727ff69d6f26caf: baseline-arm64-baylibre 2026-03-17 01:09:42,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b606d41727ff69d6f26caf 2026-03-17 01:09:42,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:09:42,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b606d41727ff69d6f26caf HTTP/1.1" 200 None 2026-03-17 01:09:42,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:09:42,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 01:09:42,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:09:42,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b606d41727ff69d6f26caf HTTP/1.1" 200 None 2026-03-17 01:09:42,385 - lava_callback - ERROR - Error processing callback for node 69b606d41727ff69d6f26caf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 01:09:43,425 - lava_callback - INFO - Received callback for node 69b8a5bbfbe29c53ae85f50c INFO: 172.21.0.1:56534 - "POST /node/69b8a5bbfbe29c53ae85f50c HTTP/1.0" 202 Accepted 2026-03-17 01:09:43,432 - lava_callback - INFO - Starting async job submit for node 69b8a5bbfbe29c53ae85f50c 2026-03-17 01:09:43,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:09:43,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a5bbfbe29c53ae85f50c HTTP/1.1" 200 None 2026-03-17 01:09:43,506 - lava_callback - DEBUG - Processing node 69b8a5bbfbe29c53ae85f50c: ltp-smoke 2026-03-17 01:09:43,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:09:44,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:09:44,135 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8a5bbfbe29c53ae85f50c/log.txt.gz 2026-03-17 01:09:44,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:56546 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:09:47,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:09:47,972 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8a5bbfbe29c53ae85f50c/lava-logs.yaml 2026-03-17 01:09:47,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:09:48,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:09:48,156 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8a5bbfbe29c53ae85f50c/lava_callback.json.gz 2026-03-17 01:09:48,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:09:48,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a5bbfbe29c53ae85f50c HTTP/1.1" 200 None 2026-03-17 01:09:48,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:09:48,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89dadfbe29c53ae85cceb HTTP/1.1" 200 None 2026-03-17 01:09:48,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:09:48,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a5bbfbe29c53ae85f50c HTTP/1.1" 200 None 2026-03-17 01:09:48,476 - lava_callback - INFO - Completed processing callback for node 69b8a5bbfbe29c53ae85f50c 2026-03-17 01:09:51,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:09:51,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39448 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:11:02,404 - lava_callback - INFO - Received callback for node 69b6071e1727ff69d6f26cc3 INFO: 172.21.0.1:51540 - "POST /node/69b6071e1727ff69d6f26cc3 HTTP/1.0" 202 Accepted 2026-03-17 01:11:02,409 - lava_callback - INFO - Starting async job submit for node 69b6071e1727ff69d6f26cc3 2026-03-17 01:11:02,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:11:02,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6071e1727ff69d6f26cc3 HTTP/1.1" 200 None 2026-03-17 01:11:02,430 - lava_callback - DEBUG - Processing node 69b6071e1727ff69d6f26cc3: baseline-arm64-baylibre 2026-03-17 01:11:02,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6071e1727ff69d6f26cc3 2026-03-17 01:11:02,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:11:02,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6071e1727ff69d6f26cc3 HTTP/1.1" 200 None 2026-03-17 01:11:02,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:11:02,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 01:11:02,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:11:02,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6071e1727ff69d6f26cc3 HTTP/1.1" 200 None 2026-03-17 01:11:02,505 - lava_callback - ERROR - Error processing callback for node 69b6071e1727ff69d6f26cc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:12:22,469 - lava_callback - INFO - Received callback for node 69b607691727ff69d6f26ccd INFO: 172.21.0.1:33206 - "POST /node/69b607691727ff69d6f26ccd HTTP/1.0" 202 Accepted 2026-03-17 01:12:22,474 - lava_callback - INFO - Starting async job submit for node 69b607691727ff69d6f26ccd 2026-03-17 01:12:22,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:12:22,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b607691727ff69d6f26ccd HTTP/1.1" 200 None 2026-03-17 01:12:22,491 - lava_callback - DEBUG - Processing node 69b607691727ff69d6f26ccd: baseline-arm64-baylibre 2026-03-17 01:12:22,491 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b607691727ff69d6f26ccd 2026-03-17 01:12:22,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:12:22,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b607691727ff69d6f26ccd HTTP/1.1" 200 None 2026-03-17 01:12:22,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:12:22,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 01:12:22,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:12:22,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b607691727ff69d6f26ccd HTTP/1.1" 200 None 2026-03-17 01:12:22,582 - lava_callback - ERROR - Error processing callback for node 69b607691727ff69d6f26ccd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46162 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 01:13:15,849 - lava_callback - INFO - Received callback for node 69b7d34500b80c8ffdcb8b3a INFO: 172.21.0.1:46174 - "POST /node/69b7d34500b80c8ffdcb8b3a HTTP/1.0" 202 Accepted 2026-03-17 01:13:15,855 - lava_callback - INFO - Starting async job submit for node 69b7d34500b80c8ffdcb8b3a 2026-03-17 01:13:15,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:13:15,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d34500b80c8ffdcb8b3a HTTP/1.1" 200 None 2026-03-17 01:13:15,920 - lava_callback - DEBUG - Processing node 69b7d34500b80c8ffdcb8b3a: baseline-x86 2026-03-17 01:13:16,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:46190 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:13:16,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:13:16,599 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b7d34500b80c8ffdcb8b3a/log.txt.gz 2026-03-17 01:13:16,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:13:16,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:13:16,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b7d34500b80c8ffdcb8b3a/lava-logs.yaml 2026-03-17 01:13:16,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:13:17,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:13:17,139 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b7d34500b80c8ffdcb8b3a/lava_callback.json.gz 2026-03-17 01:13:17,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:13:17,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d34500b80c8ffdcb8b3a HTTP/1.1" 200 None 2026-03-17 01:13:17,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:13:17,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd8200b80c8ffdcb82cf HTTP/1.1" 200 None 2026-03-17 01:13:17,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:13:17,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d34500b80c8ffdcb8b3a HTTP/1.1" 200 None 2026-03-17 01:13:17,254 - lava_callback - INFO - Completed processing callback for node 69b7d34500b80c8ffdcb8b3a 2026-03-17 01:13:18,193 - lava_callback - INFO - Received callback for node 69b8aaa7fbe29c53ae85f70a INFO: 172.21.0.1:46192 - "POST /node/69b8aaa7fbe29c53ae85f70a HTTP/1.0" 202 Accepted 2026-03-17 01:13:18,199 - lava_callback - INFO - Starting async job submit for node 69b8aaa7fbe29c53ae85f70a 2026-03-17 01:13:18,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:13:18,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aaa7fbe29c53ae85f70a HTTP/1.1" 200 None 2026-03-17 01:13:18,217 - lava_callback - DEBUG - Processing node 69b8aaa7fbe29c53ae85f70a: baseline-arm 2026-03-17 01:13:18,223 - lava_callback - WARNING - Failed to upload log 2026-03-17 01:13:18,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:13:18,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:13:18,340 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8aaa7fbe29c53ae85f70a/lava-logs.yaml 2026-03-17 01:13:18,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:13:18,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:13:18,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8aaa7fbe29c53ae85f70a/lava_callback.json.gz 2026-03-17 01:13:18,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:13:18,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aaa7fbe29c53ae85f70a HTTP/1.1" 200 None 2026-03-17 01:13:18,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:13:18,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:13:18,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:13:18,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8aaa7fbe29c53ae85f70a HTTP/1.1" 200 None 2026-03-17 01:13:18,545 - lava_callback - INFO - Completed processing callback for node 69b8aaa7fbe29c53ae85f70a 2026-03-17 01:13:21,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:13:21,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:13:34,009 - lava_callback - INFO - Received callback for node 69b607b81727ff69d6f26cd5 INFO: 172.21.0.1:53800 - "POST /node/69b607b81727ff69d6f26cd5 HTTP/1.0" 202 Accepted 2026-03-17 01:13:34,015 - lava_callback - INFO - Starting async job submit for node 69b607b81727ff69d6f26cd5 2026-03-17 01:13:34,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:13:34,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b607b81727ff69d6f26cd5 HTTP/1.1" 200 None 2026-03-17 01:13:34,033 - lava_callback - DEBUG - Processing node 69b607b81727ff69d6f26cd5: baseline-arm64-clabbe 2026-03-17 01:13:34,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b607b81727ff69d6f26cd5 2026-03-17 01:13:34,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:13:34,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b607b81727ff69d6f26cd5 HTTP/1.1" 200 None 2026-03-17 01:13:34,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:13:34,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 01:13:34,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:13:34,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b607b81727ff69d6f26cd5 HTTP/1.1" 200 None 2026-03-17 01:13:34,098 - lava_callback - ERROR - Error processing callback for node 69b607b81727ff69d6f26cd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:14:39,548 - lava_callback - INFO - Received callback for node 69b82b15113612b7716bcf36 INFO: 172.21.0.1:34284 - "POST /node/69b82b15113612b7716bcf36 HTTP/1.0" 202 Accepted 2026-03-17 01:14:39,554 - lava_callback - INFO - Starting async job submit for node 69b82b15113612b7716bcf36 2026-03-17 01:14:39,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:14:39,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82b15113612b7716bcf36 HTTP/1.1" 200 None 2026-03-17 01:14:39,588 - lava_callback - DEBUG - Processing node 69b82b15113612b7716bcf36: baseline-x86 2026-03-17 01:14:39,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:14:40,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:14:40,036 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b82b15113612b7716bcf36/log.txt.gz 2026-03-17 01:14:40,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:14:40,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:14:40,459 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b82b15113612b7716bcf36/lava-logs.yaml 2026-03-17 01:14:40,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:14:40,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:14:40,593 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b82b15113612b7716bcf36/lava_callback.json.gz 2026-03-17 01:14:40,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:14:40,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82b15113612b7716bcf36 HTTP/1.1" 200 None 2026-03-17 01:14:40,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:14:40,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd8200b80c8ffdcb82cf HTTP/1.1" 200 None 2026-03-17 01:14:40,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:14:40,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82b15113612b7716bcf36 HTTP/1.1" 200 None 2026-03-17 01:14:40,674 - lava_callback - INFO - Completed processing callback for node 69b82b15113612b7716bcf36 INFO: 172.21.0.1:55552 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:14:51,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:14:51,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 01:14:54,076 - lava_callback - INFO - Received callback for node 69b608031727ff69d6f26ce0 INFO: 172.21.0.1:47322 - "POST /node/69b608031727ff69d6f26ce0 HTTP/1.0" 202 Accepted 2026-03-17 01:14:54,082 - lava_callback - INFO - Starting async job submit for node 69b608031727ff69d6f26ce0 2026-03-17 01:14:54,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:14:54,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b608031727ff69d6f26ce0 HTTP/1.1" 200 None 2026-03-17 01:14:54,105 - lava_callback - DEBUG - Processing node 69b608031727ff69d6f26ce0: baseline-arm64-clabbe 2026-03-17 01:14:54,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b608031727ff69d6f26ce0 2026-03-17 01:14:54,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:14:54,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b608031727ff69d6f26ce0 HTTP/1.1" 200 None 2026-03-17 01:14:54,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:14:54,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 01:14:54,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:14:54,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b608031727ff69d6f26ce0 HTTP/1.1" 200 None 2026-03-17 01:14:54,232 - lava_callback - ERROR - Error processing callback for node 69b608031727ff69d6f26ce0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:15:12,305 - lava_callback - INFO - Received callback for node 69b8aafdfbe29c53ae85f73c INFO: 172.21.0.1:40114 - "POST /node/69b8aafdfbe29c53ae85f73c HTTP/1.0" 202 Accepted 2026-03-17 01:15:12,323 - lava_callback - INFO - Starting async job submit for node 69b8aafdfbe29c53ae85f73c 2026-03-17 01:15:12,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:12,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aafdfbe29c53ae85f73c HTTP/1.1" 200 None 2026-03-17 01:15:12,394 - lava_callback - DEBUG - Processing node 69b8aafdfbe29c53ae85f73c: baseline-arm64 2026-03-17 01:15:12,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:15:12,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:15:12,899 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aafdfbe29c53ae85f73c/log.txt.gz 2026-03-17 01:15:12,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:15:13,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:15:13,196 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aafdfbe29c53ae85f73c/lava-logs.yaml 2026-03-17 01:15:13,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:15:13,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:15:13,439 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aafdfbe29c53ae85f73c/lava_callback.json.gz 2026-03-17 01:15:13,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:13,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aafdfbe29c53ae85f73c HTTP/1.1" 200 None 2026-03-17 01:15:13,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:13,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:15:13,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:13,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8aafdfbe29c53ae85f73c HTTP/1.1" 200 None 2026-03-17 01:15:13,554 - lava_callback - INFO - Completed processing callback for node 69b8aafdfbe29c53ae85f73c INFO: 172.21.0.1:40120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:15:21,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:21,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 01:15:25,134 - lava_callback - INFO - Received callback for node 69b8ab09fbe29c53ae85f774 INFO: 172.21.0.1:53922 - "POST /node/69b8ab09fbe29c53ae85f774 HTTP/1.0" 202 Accepted 2026-03-17 01:15:25,142 - lava_callback - INFO - Starting async job submit for node 69b8ab09fbe29c53ae85f774 2026-03-17 01:15:25,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:25,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab09fbe29c53ae85f774 HTTP/1.1" 200 None 2026-03-17 01:15:25,203 - lava_callback - DEBUG - Processing node 69b8ab09fbe29c53ae85f774: baseline-arm64 2026-03-17 01:15:25,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:15:25,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:15:25,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab09fbe29c53ae85f774/log.txt.gz 2026-03-17 01:15:25,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:15:26,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:15:26,121 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab09fbe29c53ae85f774/lava-logs.yaml 2026-03-17 01:15:26,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:15:26,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:15:26,336 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab09fbe29c53ae85f774/lava_callback.json.gz 2026-03-17 01:15:26,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:26,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab09fbe29c53ae85f774 HTTP/1.1" 200 None 2026-03-17 01:15:26,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:26,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:15:26,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:26,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab09fbe29c53ae85f774 HTTP/1.1" 200 None 2026-03-17 01:15:26,469 - lava_callback - INFO - Completed processing callback for node 69b8ab09fbe29c53ae85f774 INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:15:29,008 - lava_callback - INFO - Received callback for node 69b8ab1afbe29c53ae85f7a0 INFO: 172.21.0.1:53940 - "POST /node/69b8ab1afbe29c53ae85f7a0 HTTP/1.0" 202 Accepted 2026-03-17 01:15:29,014 - lava_callback - INFO - Starting async job submit for node 69b8ab1afbe29c53ae85f7a0 2026-03-17 01:15:29,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:29,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab1afbe29c53ae85f7a0 HTTP/1.1" 200 None 2026-03-17 01:15:29,031 - lava_callback - DEBUG - Processing node 69b8ab1afbe29c53ae85f7a0: baseline-nfs-arm64 2026-03-17 01:15:29,033 - lava_callback - WARNING - Failed to upload log 2026-03-17 01:15:29,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:15:29,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:15:29,274 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab1afbe29c53ae85f7a0/lava-logs.yaml 2026-03-17 01:15:29,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:15:29,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:15:29,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab1afbe29c53ae85f7a0/lava_callback.json.gz 2026-03-17 01:15:29,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:29,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab1afbe29c53ae85f7a0 HTTP/1.1" 200 None 2026-03-17 01:15:29,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:29,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:15:29,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:29,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab1afbe29c53ae85f7a0 HTTP/1.1" 200 None 2026-03-17 01:15:29,546 - lava_callback - INFO - Completed processing callback for node 69b8ab1afbe29c53ae85f7a0 INFO: 172.21.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38050 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:15:51,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:51,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 01:15:55,933 - lava_callback - INFO - Received callback for node 69b8ab04fbe29c53ae85f755 INFO: 172.21.0.1:49822 - "POST /node/69b8ab04fbe29c53ae85f755 HTTP/1.0" 202 Accepted 2026-03-17 01:15:55,944 - lava_callback - INFO - Starting async job submit for node 69b8ab04fbe29c53ae85f755 2026-03-17 01:15:55,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:56,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab04fbe29c53ae85f755 HTTP/1.1" 200 None 2026-03-17 01:15:56,010 - lava_callback - DEBUG - Processing node 69b8ab04fbe29c53ae85f755: baseline-arm64 2026-03-17 01:15:56,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:15:56,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:15:56,619 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab04fbe29c53ae85f755/log.txt.gz 2026-03-17 01:15:56,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:15:57,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:15:57,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab04fbe29c53ae85f755/lava-logs.yaml 2026-03-17 01:15:57,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:15:57,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:15:57,293 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab04fbe29c53ae85f755/lava_callback.json.gz 2026-03-17 01:15:57,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:57,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab04fbe29c53ae85f755 HTTP/1.1" 200 None 2026-03-17 01:15:57,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:57,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:15:57,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:57,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab04fbe29c53ae85f755 HTTP/1.1" 200 None 2026-03-17 01:15:57,451 - lava_callback - INFO - Completed processing callback for node 69b8ab04fbe29c53ae85f755 2026-03-17 01:15:59,504 - lava_callback - INFO - Received callback for node 69b8ab02fbe29c53ae85f74f INFO: 172.21.0.1:49838 - "POST /node/69b8ab02fbe29c53ae85f74f HTTP/1.0" 202 Accepted 2026-03-17 01:15:59,515 - lava_callback - INFO - Starting async job submit for node 69b8ab02fbe29c53ae85f74f 2026-03-17 01:15:59,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:15:59,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab02fbe29c53ae85f74f HTTP/1.1" 200 None 2026-03-17 01:15:59,565 - lava_callback - DEBUG - Processing node 69b8ab02fbe29c53ae85f74f: baseline-arm64 2026-03-17 01:15:59,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:15:59,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:15:59,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab02fbe29c53ae85f74f/log.txt.gz 2026-03-17 01:16:00,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:00,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:00,271 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab02fbe29c53ae85f74f/lava-logs.yaml 2026-03-17 01:16:00,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:00,328 - lava_callback - INFO - Received callback for node 69b8aafffbe29c53ae85f742 INFO: 172.21.0.1:55588 - "POST /node/69b8aafffbe29c53ae85f742 HTTP/1.0" 202 Accepted 2026-03-17 01:16:00,338 - lava_callback - INFO - Starting async job submit for node 69b8aafffbe29c53ae85f742 2026-03-17 01:16:00,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:00,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aafffbe29c53ae85f742 HTTP/1.1" 200 None 2026-03-17 01:16:00,407 - lava_callback - DEBUG - Processing node 69b8aafffbe29c53ae85f742: baseline-arm64 2026-03-17 01:16:00,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:00,488 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab02fbe29c53ae85f74f/lava_callback.json.gz 2026-03-17 01:16:00,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:00,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab02fbe29c53ae85f74f HTTP/1.1" 200 None 2026-03-17 01:16:00,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:00,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:00,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:00,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:00,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab02fbe29c53ae85f74f HTTP/1.1" 200 None 2026-03-17 01:16:00,986 - lava_callback - INFO - Completed processing callback for node 69b8ab02fbe29c53ae85f74f 2026-03-17 01:16:01,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:01,247 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aafffbe29c53ae85f742/log.txt.gz 2026-03-17 01:16:01,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:01,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:01,809 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aafffbe29c53ae85f742/lava-logs.yaml 2026-03-17 01:16:01,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:02,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:02,013 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aafffbe29c53ae85f742/lava_callback.json.gz 2026-03-17 01:16:02,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:02,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aafffbe29c53ae85f742 HTTP/1.1" 200 None 2026-03-17 01:16:02,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:02,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:02,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:02,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8aafffbe29c53ae85f742 HTTP/1.1" 200 None 2026-03-17 01:16:02,147 - lava_callback - INFO - Completed processing callback for node 69b8aafffbe29c53ae85f742 2026-03-17 01:16:03,088 - lava_callback - INFO - Received callback for node 69b8ab01fbe29c53ae85f74c INFO: 172.21.0.1:55604 - "POST /node/69b8ab01fbe29c53ae85f74c HTTP/1.0" 202 Accepted 2026-03-17 01:16:03,096 - lava_callback - INFO - Starting async job submit for node 69b8ab01fbe29c53ae85f74c 2026-03-17 01:16:03,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:03,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab01fbe29c53ae85f74c HTTP/1.1" 200 None 2026-03-17 01:16:03,144 - lava_callback - DEBUG - Processing node 69b8ab01fbe29c53ae85f74c: baseline-arm64 2026-03-17 01:16:03,289 - lava_callback - WARNING - Failed to upload log 2026-03-17 01:16:03,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:03,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:03,782 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab01fbe29c53ae85f74c/lava-logs.yaml 2026-03-17 01:16:03,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:03,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:03,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab01fbe29c53ae85f74c/lava_callback.json.gz 2026-03-17 01:16:04,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:04,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab01fbe29c53ae85f74c HTTP/1.1" 200 None 2026-03-17 01:16:04,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:04,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:04,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:04,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab01fbe29c53ae85f74c HTTP/1.1" 200 None 2026-03-17 01:16:04,172 - lava_callback - INFO - Completed processing callback for node 69b8ab01fbe29c53ae85f74c INFO: 172.21.0.1:55616 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:16:11,443 - lava_callback - INFO - Received callback for node 69b8ab06fbe29c53ae85f76b INFO: 172.21.0.1:42994 - "POST /node/69b8ab06fbe29c53ae85f76b HTTP/1.0" 202 Accepted 2026-03-17 01:16:11,450 - lava_callback - INFO - Starting async job submit for node 69b8ab06fbe29c53ae85f76b 2026-03-17 01:16:11,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:11,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab06fbe29c53ae85f76b HTTP/1.1" 200 None 2026-03-17 01:16:11,507 - lava_callback - DEBUG - Processing node 69b8ab06fbe29c53ae85f76b: baseline-arm64 2026-03-17 01:16:11,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:12,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:12,086 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab06fbe29c53ae85f76b/log.txt.gz 2026-03-17 01:16:12,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:12,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:12,625 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab06fbe29c53ae85f76b/lava-logs.yaml 2026-03-17 01:16:12,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:12,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:12,796 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab06fbe29c53ae85f76b/lava_callback.json.gz 2026-03-17 01:16:12,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:12,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab06fbe29c53ae85f76b HTTP/1.1" 200 None 2026-03-17 01:16:12,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:12,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:12,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:12,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab06fbe29c53ae85f76b HTTP/1.1" 200 None 2026-03-17 01:16:12,892 - lava_callback - INFO - Completed processing callback for node 69b8ab06fbe29c53ae85f76b 2026-03-17 01:16:15,093 - lava_callback - INFO - Received callback for node 69b8ab00fbe29c53ae85f745 INFO: 172.21.0.1:43002 - "POST /node/69b8ab00fbe29c53ae85f745 HTTP/1.0" 202 Accepted 2026-03-17 01:16:15,103 - lava_callback - INFO - Starting async job submit for node 69b8ab00fbe29c53ae85f745 2026-03-17 01:16:15,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:15,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab00fbe29c53ae85f745 HTTP/1.1" 200 None 2026-03-17 01:16:15,149 - lava_callback - DEBUG - Processing node 69b8ab00fbe29c53ae85f745: baseline-arm64 INFO: 172.21.0.1:43016 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 01:16:15,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:15,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:15,562 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab00fbe29c53ae85f745/log.txt.gz 2026-03-17 01:16:15,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:15,984 - lava_callback - INFO - Received callback for node 69b8aafefbe29c53ae85f73f INFO: 172.21.0.1:43030 - "POST /node/69b8aafefbe29c53ae85f73f HTTP/1.0" 202 Accepted 2026-03-17 01:16:15,993 - lava_callback - INFO - Starting async job submit for node 69b8aafefbe29c53ae85f73f 2026-03-17 01:16:16,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:16,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:16,027 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab00fbe29c53ae85f745/lava-logs.yaml 2026-03-17 01:16:16,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:16,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aafefbe29c53ae85f73f HTTP/1.1" 200 None 2026-03-17 01:16:16,047 - lava_callback - DEBUG - Processing node 69b8aafefbe29c53ae85f73f: baseline-arm64 2026-03-17 01:16:16,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:16,283 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab00fbe29c53ae85f745/lava_callback.json.gz 2026-03-17 01:16:16,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:16,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:16,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab00fbe29c53ae85f745 HTTP/1.1" 200 None 2026-03-17 01:16:16,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:16,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:16,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:16,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab00fbe29c53ae85f745 HTTP/1.1" 200 None 2026-03-17 01:16:16,469 - lava_callback - INFO - Completed processing callback for node 69b8ab00fbe29c53ae85f745 INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:16:16,803 - lava_callback - INFO - Received callback for node 69b6084e1727ff69d6f26ce7 INFO: 172.21.0.1:43040 - "POST /node/69b6084e1727ff69d6f26ce7 HTTP/1.0" 202 Accepted 2026-03-17 01:16:16,809 - lava_callback - INFO - Starting async job submit for node 69b6084e1727ff69d6f26ce7 2026-03-17 01:16:16,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:16,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6084e1727ff69d6f26ce7 HTTP/1.1" 200 None 2026-03-17 01:16:16,826 - lava_callback - DEBUG - Processing node 69b6084e1727ff69d6f26ce7: baseline-arm64-clabbe 2026-03-17 01:16:16,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6084e1727ff69d6f26ce7 2026-03-17 01:16:16,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:16,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:16,830 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aafefbe29c53ae85f73f/log.txt.gz 2026-03-17 01:16:16,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6084e1727ff69d6f26ce7 HTTP/1.1" 200 None 2026-03-17 01:16:16,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:17,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 01:16:17,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:17,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:17,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6084e1727ff69d6f26ce7 HTTP/1.1" 200 None 2026-03-17 01:16:17,096 - lava_callback - ERROR - Error processing callback for node 69b6084e1727ff69d6f26ce7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 01:16:17,274 - lava_callback - INFO - Received callback for node 69b8ab0efbe29c53ae85f785 INFO: 172.21.0.1:43048 - "POST /node/69b8ab0efbe29c53ae85f785 HTTP/1.0" 202 Accepted 2026-03-17 01:16:17,284 - lava_callback - INFO - Starting async job submit for node 69b8ab0efbe29c53ae85f785 2026-03-17 01:16:17,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:17,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab0efbe29c53ae85f785 HTTP/1.1" 200 None 2026-03-17 01:16:17,350 - lava_callback - DEBUG - Processing node 69b8ab0efbe29c53ae85f785: baseline-arm64 2026-03-17 01:16:17,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:17,441 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aafefbe29c53ae85f73f/lava-logs.yaml 2026-03-17 01:16:17,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:17,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:17,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:17,732 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aafefbe29c53ae85f73f/lava_callback.json.gz 2026-03-17 01:16:17,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:17,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aafefbe29c53ae85f73f HTTP/1.1" 200 None 2026-03-17 01:16:17,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:17,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:17,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:17,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8aafefbe29c53ae85f73f HTTP/1.1" 200 None 2026-03-17 01:16:17,864 - lava_callback - INFO - Completed processing callback for node 69b8aafefbe29c53ae85f73f 2026-03-17 01:16:17,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:17,934 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab0efbe29c53ae85f785/log.txt.gz 2026-03-17 01:16:18,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:18,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:18,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab0efbe29c53ae85f785/lava-logs.yaml 2026-03-17 01:16:18,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:18,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:18,558 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab0efbe29c53ae85f785/lava_callback.json.gz 2026-03-17 01:16:18,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:18,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab0efbe29c53ae85f785 HTTP/1.1" 200 None 2026-03-17 01:16:18,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:18,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:18,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:18,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab0efbe29c53ae85f785 HTTP/1.1" 200 None 2026-03-17 01:16:18,676 - lava_callback - INFO - Completed processing callback for node 69b8ab0efbe29c53ae85f785 2026-03-17 01:16:21,061 - lava_callback - INFO - Received callback for node 69b8ab10fbe29c53ae85f788 INFO: 172.21.0.1:59802 - "POST /node/69b8ab10fbe29c53ae85f788 HTTP/1.0" 202 Accepted 2026-03-17 01:16:21,075 - lava_callback - INFO - Starting async job submit for node 69b8ab10fbe29c53ae85f788 2026-03-17 01:16:21,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:21,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab10fbe29c53ae85f788 HTTP/1.1" 200 None 2026-03-17 01:16:21,218 - lava_callback - DEBUG - Processing node 69b8ab10fbe29c53ae85f788: baseline-arm64 2026-03-17 01:16:21,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:21,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-17 01:16:21,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:22,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:22,070 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab10fbe29c53ae85f788/log.txt.gz 2026-03-17 01:16:22,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:22,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:22,506 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab10fbe29c53ae85f788/lava-logs.yaml 2026-03-17 01:16:22,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:22,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:22,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab10fbe29c53ae85f788/lava_callback.json.gz 2026-03-17 01:16:22,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:22,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab10fbe29c53ae85f788 HTTP/1.1" 200 None 2026-03-17 01:16:22,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:22,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:22,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:22,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab10fbe29c53ae85f788 HTTP/1.1" 200 None 2026-03-17 01:16:22,789 - lava_callback - INFO - Completed processing callback for node 69b8ab10fbe29c53ae85f788 INFO: 172.21.0.1:59808 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:16:27,045 - lava_callback - INFO - Received callback for node 69b8ab0bfbe29c53ae85f777 INFO: 172.21.0.1:59822 - "POST /node/69b8ab0bfbe29c53ae85f777 HTTP/1.0" 202 Accepted 2026-03-17 01:16:27,054 - lava_callback - INFO - Starting async job submit for node 69b8ab0bfbe29c53ae85f777 2026-03-17 01:16:27,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:27,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab0bfbe29c53ae85f777 HTTP/1.1" 200 None 2026-03-17 01:16:27,112 - lava_callback - DEBUG - Processing node 69b8ab0bfbe29c53ae85f777: baseline-arm64 2026-03-17 01:16:27,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:27,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:27,564 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab0bfbe29c53ae85f777/log.txt.gz 2026-03-17 01:16:27,723 - lava_callback - INFO - Received callback for node 69b8ab0dfbe29c53ae85f780 INFO: 172.21.0.1:59830 - "POST /node/69b8ab0dfbe29c53ae85f780 HTTP/1.0" 202 Accepted 2026-03-17 01:16:27,750 - lava_callback - INFO - Starting async job submit for node 69b8ab0dfbe29c53ae85f780 2026-03-17 01:16:27,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:27,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:27,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab0dfbe29c53ae85f780 HTTP/1.1" 200 None 2026-03-17 01:16:27,842 - lava_callback - DEBUG - Processing node 69b8ab0dfbe29c53ae85f780: baseline-arm64 2026-03-17 01:16:28,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:28,087 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab0bfbe29c53ae85f777/lava-logs.yaml 2026-03-17 01:16:28,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:28,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:28,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:28,479 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab0bfbe29c53ae85f777/lava_callback.json.gz 2026-03-17 01:16:28,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:28,503 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab0dfbe29c53ae85f780/log.txt.gz 2026-03-17 01:16:28,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:28,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab0bfbe29c53ae85f777 HTTP/1.1" 200 None 2026-03-17 01:16:28,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:28,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:28,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:28,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:28,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab0bfbe29c53ae85f777 HTTP/1.1" 200 None 2026-03-17 01:16:28,772 - lava_callback - INFO - Completed processing callback for node 69b8ab0bfbe29c53ae85f777 2026-03-17 01:16:29,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:29,115 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab0dfbe29c53ae85f780/lava-logs.yaml 2026-03-17 01:16:29,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:29,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:29,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab0dfbe29c53ae85f780/lava_callback.json.gz 2026-03-17 01:16:29,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:29,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab0dfbe29c53ae85f780 HTTP/1.1" 200 None 2026-03-17 01:16:29,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:29,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:29,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:29,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab0dfbe29c53ae85f780 HTTP/1.1" 200 None 2026-03-17 01:16:29,428 - lava_callback - INFO - Completed processing callback for node 69b8ab0dfbe29c53ae85f780 2026-03-17 01:16:29,498 - lava_callback - INFO - Received callback for node 69b8ab15fbe29c53ae85f794 INFO: 172.21.0.1:59834 - "POST /node/69b8ab15fbe29c53ae85f794 HTTP/1.0" 202 Accepted 2026-03-17 01:16:29,511 - lava_callback - INFO - Starting async job submit for node 69b8ab15fbe29c53ae85f794 2026-03-17 01:16:29,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:29,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab15fbe29c53ae85f794 HTTP/1.1" 200 None 2026-03-17 01:16:29,578 - lava_callback - DEBUG - Processing node 69b8ab15fbe29c53ae85f794: baseline-nfs-arm64 2026-03-17 01:16:29,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:30,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:30,113 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab15fbe29c53ae85f794/log.txt.gz 2026-03-17 01:16:30,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:30,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:30,655 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab15fbe29c53ae85f794/lava-logs.yaml 2026-03-17 01:16:30,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:30,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:30,835 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab15fbe29c53ae85f794/lava_callback.json.gz 2026-03-17 01:16:30,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:30,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab15fbe29c53ae85f794 HTTP/1.1" 200 None 2026-03-17 01:16:30,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:30,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:30,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:30,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab15fbe29c53ae85f794 HTTP/1.1" 200 None 2026-03-17 01:16:30,957 - lava_callback - INFO - Completed processing callback for node 69b8ab15fbe29c53ae85f794 INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52020 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:16:43,741 - lava_callback - INFO - Received callback for node 69b8ab20fbe29c53ae85f7ac INFO: 172.21.0.1:55948 - "POST /node/69b8ab20fbe29c53ae85f7ac HTTP/1.0" 202 Accepted 2026-03-17 01:16:43,749 - lava_callback - INFO - Starting async job submit for node 69b8ab20fbe29c53ae85f7ac 2026-03-17 01:16:43,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:43,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab20fbe29c53ae85f7ac HTTP/1.1" 200 None 2026-03-17 01:16:43,808 - lava_callback - DEBUG - Processing node 69b8ab20fbe29c53ae85f7ac: baseline-nfs-arm64 2026-03-17 01:16:44,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:44,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:44,548 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab20fbe29c53ae85f7ac/log.txt.gz 2026-03-17 01:16:44,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:44,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:44,976 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab20fbe29c53ae85f7ac/lava-logs.yaml 2026-03-17 01:16:44,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:45,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:45,140 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab20fbe29c53ae85f7ac/lava_callback.json.gz 2026-03-17 01:16:45,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:45,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab20fbe29c53ae85f7ac HTTP/1.1" 200 None 2026-03-17 01:16:45,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:45,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:45,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:45,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab20fbe29c53ae85f7ac HTTP/1.1" 200 None 2026-03-17 01:16:45,268 - lava_callback - INFO - Completed processing callback for node 69b8ab20fbe29c53ae85f7ac 2026-03-17 01:16:45,822 - lava_callback - INFO - Received callback for node 69b8ab12fbe29c53ae85f78e INFO: 172.21.0.1:55952 - "POST /node/69b8ab12fbe29c53ae85f78e HTTP/1.0" 202 Accepted 2026-03-17 01:16:45,829 - lava_callback - INFO - Starting async job submit for node 69b8ab12fbe29c53ae85f78e 2026-03-17 01:16:45,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:45,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab12fbe29c53ae85f78e HTTP/1.1" 200 None 2026-03-17 01:16:45,873 - lava_callback - DEBUG - Processing node 69b8ab12fbe29c53ae85f78e: baseline-nfs-arm64 2026-03-17 01:16:46,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:46,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:46,383 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab12fbe29c53ae85f78e/log.txt.gz INFO: 172.21.0.1:55964 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:16:46,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:46,927 - lava_callback - INFO - Received callback for node 69b8ab1efbe29c53ae85f7a9 INFO: 172.21.0.1:55974 - "POST /node/69b8ab1efbe29c53ae85f7a9 HTTP/1.0" 202 Accepted 2026-03-17 01:16:46,935 - lava_callback - INFO - Starting async job submit for node 69b8ab1efbe29c53ae85f7a9 2026-03-17 01:16:46,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:46,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:46,962 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab12fbe29c53ae85f78e/lava-logs.yaml 2026-03-17 01:16:46,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:46,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab1efbe29c53ae85f7a9 HTTP/1.1" 200 None 2026-03-17 01:16:46,984 - lava_callback - DEBUG - Processing node 69b8ab1efbe29c53ae85f7a9: baseline-nfs-arm64 2026-03-17 01:16:47,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:47,228 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab12fbe29c53ae85f78e/lava_callback.json.gz 2026-03-17 01:16:47,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:47,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab12fbe29c53ae85f78e HTTP/1.1" 200 None 2026-03-17 01:16:47,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:47,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:47,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:47,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:47,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab12fbe29c53ae85f78e HTTP/1.1" 200 None 2026-03-17 01:16:47,517 - lava_callback - INFO - Completed processing callback for node 69b8ab12fbe29c53ae85f78e 2026-03-17 01:16:47,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:47,679 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab1efbe29c53ae85f7a9/log.txt.gz 2026-03-17 01:16:48,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:48,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:48,353 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab1efbe29c53ae85f7a9/lava-logs.yaml 2026-03-17 01:16:48,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:48,456 - lava_callback - INFO - Received callback for node 69b8ab08fbe29c53ae85f771 INFO: 172.21.0.1:55990 - "POST /node/69b8ab08fbe29c53ae85f771 HTTP/1.0" 202 Accepted 2026-03-17 01:16:48,463 - lava_callback - INFO - Starting async job submit for node 69b8ab08fbe29c53ae85f771 2026-03-17 01:16:48,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:48,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab08fbe29c53ae85f771 HTTP/1.1" 200 None 2026-03-17 01:16:48,515 - lava_callback - DEBUG - Processing node 69b8ab08fbe29c53ae85f771: baseline-arm64 2026-03-17 01:16:48,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:48,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab1efbe29c53ae85f7a9/lava_callback.json.gz 2026-03-17 01:16:48,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:48,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab1efbe29c53ae85f7a9 HTTP/1.1" 200 None 2026-03-17 01:16:48,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:48,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:48,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:48,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab1efbe29c53ae85f7a9 HTTP/1.1" 200 None 2026-03-17 01:16:48,986 - lava_callback - INFO - Completed processing callback for node 69b8ab1efbe29c53ae85f7a9 2026-03-17 01:16:49,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:49,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:49,467 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab08fbe29c53ae85f771/log.txt.gz 2026-03-17 01:16:49,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:50,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:50,170 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab08fbe29c53ae85f771/lava-logs.yaml 2026-03-17 01:16:50,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:50,240 - lava_callback - INFO - Received callback for node 69b8ab4bfbe29c53ae85f83c INFO: 172.21.0.1:57034 - "POST /node/69b8ab4bfbe29c53ae85f83c HTTP/1.0" 202 Accepted 2026-03-17 01:16:50,251 - lava_callback - INFO - Starting async job submit for node 69b8ab4bfbe29c53ae85f83c 2026-03-17 01:16:50,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:50,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab4bfbe29c53ae85f83c HTTP/1.1" 200 None 2026-03-17 01:16:50,311 - lava_callback - DEBUG - Processing node 69b8ab4bfbe29c53ae85f83c: baseline-arm64-foundriesio 2026-03-17 01:16:50,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:50,452 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab08fbe29c53ae85f771/lava_callback.json.gz 2026-03-17 01:16:50,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:50,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:50,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab08fbe29c53ae85f771 HTTP/1.1" 200 None 2026-03-17 01:16:50,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:50,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:50,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:50,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab08fbe29c53ae85f771 HTTP/1.1" 200 None 2026-03-17 01:16:50,856 - lava_callback - INFO - Completed processing callback for node 69b8ab08fbe29c53ae85f771 2026-03-17 01:16:51,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:51,032 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8ab4bfbe29c53ae85f83c/log.txt.gz 2026-03-17 01:16:51,102 - lava_callback - INFO - Received callback for node 69b8ab19fbe29c53ae85f79d INFO: 172.21.0.1:57036 - "POST /node/69b8ab19fbe29c53ae85f79d HTTP/1.0" 202 Accepted 2026-03-17 01:16:51,136 - lava_callback - INFO - Starting async job submit for node 69b8ab19fbe29c53ae85f79d 2026-03-17 01:16:51,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:51,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab19fbe29c53ae85f79d HTTP/1.1" 200 None 2026-03-17 01:16:51,294 - lava_callback - DEBUG - Processing node 69b8ab19fbe29c53ae85f79d: baseline-nfs-arm64 2026-03-17 01:16:51,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:51,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:51,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:51,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-17 01:16:51,660 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8ab4bfbe29c53ae85f83c/lava-logs.yaml 2026-03-17 01:16:51,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:51,985 - lava_callback - INFO - Received callback for node 69b8ab1bfbe29c53ae85f7a3 2026-03-17 01:16:51,994 - lava_callback - INFO - Starting async job submit for node 69b8ab1bfbe29c53ae85f7a3 INFO: 172.21.0.1:57048 - "POST /node/69b8ab1bfbe29c53ae85f7a3 HTTP/1.0" 202 Accepted 2026-03-17 01:16:52,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:52,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8ab4bfbe29c53ae85f83c/lava_callback.json.gz 2026-03-17 01:16:52,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:52,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:52,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:52,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab1bfbe29c53ae85f7a3 HTTP/1.1" 200 None 2026-03-17 01:16:52,141 - lava_callback - DEBUG - Processing node 69b8ab1bfbe29c53ae85f7a3: baseline-nfs-arm64 2026-03-17 01:16:52,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab4bfbe29c53ae85f83c HTTP/1.1" 200 None 2026-03-17 01:16:52,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:52,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:52,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:52,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:52,401 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab19fbe29c53ae85f79d/log.txt.gz 2026-03-17 01:16:52,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab4bfbe29c53ae85f83c HTTP/1.1" 200 None 2026-03-17 01:16:52,498 - lava_callback - INFO - Completed processing callback for node 69b8ab4bfbe29c53ae85f83c 2026-03-17 01:16:53,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:53,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:53,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:53,423 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab1bfbe29c53ae85f7a3/log.txt.gz 2026-03-17 01:16:53,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:53,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab19fbe29c53ae85f79d/lava-logs.yaml 2026-03-17 01:16:53,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:53,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:53,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:53,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab19fbe29c53ae85f79d/lava_callback.json.gz 2026-03-17 01:16:53,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:53,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab19fbe29c53ae85f79d HTTP/1.1" 200 None 2026-03-17 01:16:53,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:54,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:54,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:54,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:54,015 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab1bfbe29c53ae85f7a3/lava-logs.yaml 2026-03-17 01:16:54,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:54,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab19fbe29c53ae85f79d HTTP/1.1" 200 None 2026-03-17 01:16:54,054 - lava_callback - INFO - Completed processing callback for node 69b8ab19fbe29c53ae85f79d 2026-03-17 01:16:54,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:54,290 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab1bfbe29c53ae85f7a3/lava_callback.json.gz 2026-03-17 01:16:54,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:54,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab1bfbe29c53ae85f7a3 HTTP/1.1" 200 None 2026-03-17 01:16:54,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:54,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:16:54,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:54,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab1bfbe29c53ae85f7a3 HTTP/1.1" 200 None 2026-03-17 01:16:54,444 - lava_callback - INFO - Completed processing callback for node 69b8ab1bfbe29c53ae85f7a3 INFO: 172.21.0.1:57050 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:16:58,289 - lava_callback - INFO - Received callback for node 69b8ab21fbe29c53ae85f7b3 INFO: 172.21.0.1:57060 - "POST /node/69b8ab21fbe29c53ae85f7b3 HTTP/1.0" 202 Accepted 2026-03-17 01:16:58,296 - lava_callback - INFO - Starting async job submit for node 69b8ab21fbe29c53ae85f7b3 2026-03-17 01:16:58,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:58,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab21fbe29c53ae85f7b3 HTTP/1.1" 200 None 2026-03-17 01:16:58,341 - lava_callback - DEBUG - Processing node 69b8ab21fbe29c53ae85f7b3: baseline-nfs-arm64 2026-03-17 01:16:58,482 - lava_callback - INFO - Received callback for node 69b8ab48fbe29c53ae85f836 INFO: 172.21.0.1:57070 - "POST /node/69b8ab48fbe29c53ae85f836 HTTP/1.0" 202 Accepted 2026-03-17 01:16:58,512 - lava_callback - INFO - Starting async job submit for node 69b8ab48fbe29c53ae85f836 2026-03-17 01:16:58,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:58,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab48fbe29c53ae85f836 HTTP/1.1" 200 None 2026-03-17 01:16:58,637 - lava_callback - DEBUG - Processing node 69b8ab48fbe29c53ae85f836: baseline-arm64-pengutronix 2026-03-17 01:16:59,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:59,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:16:59,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:59,331 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b8ab48fbe29c53ae85f836/log.txt.gz 2026-03-17 01:16:59,362 - lava_callback - INFO - Received callback for node 69b8ab07fbe29c53ae85f76e INFO: 172.21.0.1:57080 - "POST /node/69b8ab07fbe29c53ae85f76e HTTP/1.0" 202 Accepted 2026-03-17 01:16:59,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:16:59,383 - lava_callback - INFO - Starting async job submit for node 69b8ab07fbe29c53ae85f76e 2026-03-17 01:16:59,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:16:59,443 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab21fbe29c53ae85f7b3/log.txt.gz 2026-03-17 01:16:59,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab07fbe29c53ae85f76e HTTP/1.1" 200 None 2026-03-17 01:16:59,585 - lava_callback - DEBUG - Processing node 69b8ab07fbe29c53ae85f76e: baseline-arm64 2026-03-17 01:16:59,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:00,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:00,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b8ab48fbe29c53ae85f836/lava-logs.yaml 2026-03-17 01:17:00,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:00,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:00,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:00,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:00,618 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b8ab48fbe29c53ae85f836/lava_callback.json.gz 2026-03-17 01:17:00,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:00,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:00,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:00,648 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab21fbe29c53ae85f7b3/lava-logs.yaml 2026-03-17 01:17:00,648 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab07fbe29c53ae85f76e/log.txt.gz 2026-03-17 01:17:00,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab48fbe29c53ae85f836 HTTP/1.1" 200 None 2026-03-17 01:17:00,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:00,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:00,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:17:00,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:00,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab48fbe29c53ae85f836 HTTP/1.1" 200 None 2026-03-17 01:17:00,954 - lava_callback - INFO - Completed processing callback for node 69b8ab48fbe29c53ae85f836 2026-03-17 01:17:01,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:01,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:01,269 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab21fbe29c53ae85f7b3/lava_callback.json.gz 2026-03-17 01:17:01,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:01,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab21fbe29c53ae85f7b3 HTTP/1.1" 200 None 2026-03-17 01:17:01,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:01,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:17:01,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:01,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab21fbe29c53ae85f7b3 HTTP/1.1" 200 None 2026-03-17 01:17:01,397 - lava_callback - INFO - Completed processing callback for node 69b8ab21fbe29c53ae85f7b3 2026-03-17 01:17:01,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:01,469 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab07fbe29c53ae85f76e/lava-logs.yaml 2026-03-17 01:17:01,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:01,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:01,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab07fbe29c53ae85f76e/lava_callback.json.gz 2026-03-17 01:17:01,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:01,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab07fbe29c53ae85f76e HTTP/1.1" 200 None 2026-03-17 01:17:01,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:01,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:17:01,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:02,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab07fbe29c53ae85f76e HTTP/1.1" 200 None 2026-03-17 01:17:02,036 - lava_callback - INFO - Completed processing callback for node 69b8ab07fbe29c53ae85f76e 2026-03-17 01:17:03,624 - lava_callback - INFO - Received callback for node 69b8ab38fbe29c53ae85f800 INFO: 172.21.0.1:56914 - "POST /node/69b8ab38fbe29c53ae85f800 HTTP/1.0" 202 Accepted 2026-03-17 01:17:03,631 - lava_callback - INFO - Starting async job submit for node 69b8ab38fbe29c53ae85f800 2026-03-17 01:17:03,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:03,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab38fbe29c53ae85f800 HTTP/1.1" 200 None 2026-03-17 01:17:03,672 - lava_callback - DEBUG - Processing node 69b8ab38fbe29c53ae85f800: baseline-arm64-broonie 2026-03-17 01:17:03,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:04,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:04,094 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab38fbe29c53ae85f800/log.txt.gz 2026-03-17 01:17:04,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:04,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:04,508 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab38fbe29c53ae85f800/lava-logs.yaml 2026-03-17 01:17:04,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:04,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:04,937 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab38fbe29c53ae85f800/lava_callback.json.gz 2026-03-17 01:17:04,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:05,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab38fbe29c53ae85f800 HTTP/1.1" 200 None 2026-03-17 01:17:05,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:05,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:17:05,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:05,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab38fbe29c53ae85f800 HTTP/1.1" 200 None 2026-03-17 01:17:05,080 - lava_callback - INFO - Completed processing callback for node 69b8ab38fbe29c53ae85f800 2026-03-17 01:17:05,788 - lava_callback - INFO - Received callback for node 69b8ab4afbe29c53ae85f839 INFO: 172.21.0.1:56918 - "POST /node/69b8ab4afbe29c53ae85f839 HTTP/1.0" 202 Accepted 2026-03-17 01:17:05,796 - lava_callback - INFO - Starting async job submit for node 69b8ab4afbe29c53ae85f839 2026-03-17 01:17:05,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:05,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab4afbe29c53ae85f839 HTTP/1.1" 200 None 2026-03-17 01:17:05,835 - lava_callback - DEBUG - Processing node 69b8ab4afbe29c53ae85f839: baseline-arm64-pengutronix 2026-03-17 01:17:06,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:06,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:06,265 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b8ab4afbe29c53ae85f839/log.txt.gz 2026-03-17 01:17:06,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:56934 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:17:06,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:06,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b8ab4afbe29c53ae85f839/lava-logs.yaml 2026-03-17 01:17:06,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:06,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:06,882 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b8ab4afbe29c53ae85f839/lava_callback.json.gz 2026-03-17 01:17:06,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:06,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab4afbe29c53ae85f839 HTTP/1.1" 200 None 2026-03-17 01:17:06,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:06,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:17:06,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:06,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab4afbe29c53ae85f839 HTTP/1.1" 200 None 2026-03-17 01:17:06,997 - lava_callback - INFO - Completed processing callback for node 69b8ab4afbe29c53ae85f839 INFO: 172.21.0.1:33844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:17:16,539 - lava_callback - INFO - Received callback for node 69b832f80b8ad4124cec37dc INFO: 172.21.0.1:33872 - "POST /node/69b832f80b8ad4124cec37dc HTTP/1.0" 202 Accepted 2026-03-17 01:17:16,547 - lava_callback - INFO - Starting async job submit for node 69b832f80b8ad4124cec37dc 2026-03-17 01:17:16,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:16,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b832f80b8ad4124cec37dc HTTP/1.1" 200 None 2026-03-17 01:17:16,583 - lava_callback - DEBUG - Processing node 69b832f80b8ad4124cec37dc: baseline-x86 2026-03-17 01:17:16,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:17,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:17,123 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f80b8ad4124cec37dc/log.txt.gz 2026-03-17 01:17:17,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:17,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:17,543 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f80b8ad4124cec37dc/lava-logs.yaml 2026-03-17 01:17:17,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:17,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:17,708 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f80b8ad4124cec37dc/lava_callback.json.gz 2026-03-17 01:17:17,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:17,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b832f80b8ad4124cec37dc HTTP/1.1" 200 None 2026-03-17 01:17:17,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:17,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d700b8ad4124cec3582 HTTP/1.1" 200 None 2026-03-17 01:17:17,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:17,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b832f80b8ad4124cec37dc HTTP/1.1" 200 None 2026-03-17 01:17:17,791 - lava_callback - INFO - Completed processing callback for node 69b832f80b8ad4124cec37dc 2026-03-17 01:17:20,428 - lava_callback - INFO - Received callback for node 69b8ab3dfbe29c53ae85f806 INFO: 172.21.0.1:34056 - "POST /node/69b8ab3dfbe29c53ae85f806 HTTP/1.0" 202 Accepted 2026-03-17 01:17:20,435 - lava_callback - INFO - Starting async job submit for node 69b8ab3dfbe29c53ae85f806 2026-03-17 01:17:20,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:20,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab3dfbe29c53ae85f806 HTTP/1.1" 200 None 2026-03-17 01:17:20,472 - lava_callback - DEBUG - Processing node 69b8ab3dfbe29c53ae85f806: baseline-arm64-broonie 2026-03-17 01:17:20,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:20,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:20,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab3dfbe29c53ae85f806/log.txt.gz 2026-03-17 01:17:21,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:21,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:21,382 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab3dfbe29c53ae85f806/lava-logs.yaml 2026-03-17 01:17:21,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:21,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:21,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab3dfbe29c53ae85f806/lava_callback.json.gz 2026-03-17 01:17:21,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:21,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab3dfbe29c53ae85f806 HTTP/1.1" 200 None 2026-03-17 01:17:21,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:21,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:17:21,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:21,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab3dfbe29c53ae85f806 HTTP/1.1" 200 None 2026-03-17 01:17:21,617 - lava_callback - INFO - Completed processing callback for node 69b8ab3dfbe29c53ae85f806 2026-03-17 01:17:21,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:21,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:34066 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:17:34,152 - lava_callback - INFO - Received callback for node 69b608991727ff69d6f26cf4 INFO: 172.21.0.1:48340 - "POST /node/69b608991727ff69d6f26cf4 HTTP/1.0" 202 Accepted 2026-03-17 01:17:34,158 - lava_callback - INFO - Starting async job submit for node 69b608991727ff69d6f26cf4 2026-03-17 01:17:34,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:34,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b608991727ff69d6f26cf4 HTTP/1.1" 200 None 2026-03-17 01:17:34,175 - lava_callback - DEBUG - Processing node 69b608991727ff69d6f26cf4: baseline-arm64-clabbe 2026-03-17 01:17:34,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b608991727ff69d6f26cf4 2026-03-17 01:17:34,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:34,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b608991727ff69d6f26cf4 HTTP/1.1" 200 None 2026-03-17 01:17:34,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:34,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 01:17:34,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:34,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b608991727ff69d6f26cf4 HTTP/1.1" 200 None 2026-03-17 01:17:34,246 - lava_callback - ERROR - Error processing callback for node 69b608991727ff69d6f26cf4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48360 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:17:40,773 - lava_callback - INFO - Received callback for node 69b8ab35fbe29c53ae85f7fa INFO: 172.21.0.1:36806 - "POST /node/69b8ab35fbe29c53ae85f7fa HTTP/1.0" 202 Accepted 2026-03-17 01:17:40,779 - lava_callback - INFO - Starting async job submit for node 69b8ab35fbe29c53ae85f7fa 2026-03-17 01:17:40,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:40,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab35fbe29c53ae85f7fa HTTP/1.1" 200 None 2026-03-17 01:17:40,837 - lava_callback - DEBUG - Processing node 69b8ab35fbe29c53ae85f7fa: baseline-arm64-broonie 2026-03-17 01:17:41,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:41,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:41,355 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab35fbe29c53ae85f7fa/log.txt.gz 2026-03-17 01:17:41,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:41,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:41,746 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab35fbe29c53ae85f7fa/lava-logs.yaml 2026-03-17 01:17:41,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:41,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:42,000 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab35fbe29c53ae85f7fa/lava_callback.json.gz 2026-03-17 01:17:42,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:42,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab35fbe29c53ae85f7fa HTTP/1.1" 200 None 2026-03-17 01:17:42,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:42,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:17:42,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:42,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab35fbe29c53ae85f7fa HTTP/1.1" 200 None 2026-03-17 01:17:42,122 - lava_callback - INFO - Completed processing callback for node 69b8ab35fbe29c53ae85f7fa 2026-03-17 01:17:42,246 - lava_callback - INFO - Received callback for node 69b8ab3ffbe29c53ae85f809 INFO: 172.21.0.1:36810 - "POST /node/69b8ab3ffbe29c53ae85f809 HTTP/1.0" 202 Accepted 2026-03-17 01:17:42,256 - lava_callback - INFO - Starting async job submit for node 69b8ab3ffbe29c53ae85f809 2026-03-17 01:17:42,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:42,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab3ffbe29c53ae85f809 HTTP/1.1" 200 None 2026-03-17 01:17:42,337 - lava_callback - DEBUG - Processing node 69b8ab3ffbe29c53ae85f809: baseline-arm64-broonie 2026-03-17 01:17:42,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:42,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:42,815 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab3ffbe29c53ae85f809/log.txt.gz 2026-03-17 01:17:43,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:43,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:43,288 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab3ffbe29c53ae85f809/lava-logs.yaml 2026-03-17 01:17:43,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:43,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:43,457 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab3ffbe29c53ae85f809/lava_callback.json.gz 2026-03-17 01:17:43,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:43,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab3ffbe29c53ae85f809 HTTP/1.1" 200 None 2026-03-17 01:17:43,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:43,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:17:43,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:43,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab3ffbe29c53ae85f809 HTTP/1.1" 200 None 2026-03-17 01:17:43,542 - lava_callback - INFO - Completed processing callback for node 69b8ab3ffbe29c53ae85f809 INFO: 172.21.0.1:36814 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:17:48,431 - lava_callback - INFO - Received callback for node 69b8ab59fbe29c53ae85f84e INFO: 172.21.0.1:36824 - "POST /node/69b8ab59fbe29c53ae85f84e HTTP/1.0" 202 Accepted 2026-03-17 01:17:48,437 - lava_callback - INFO - Starting async job submit for node 69b8ab59fbe29c53ae85f84e 2026-03-17 01:17:48,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:48,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab59fbe29c53ae85f84e HTTP/1.1" 200 None 2026-03-17 01:17:48,493 - lava_callback - DEBUG - Processing node 69b8ab59fbe29c53ae85f84e: baseline-x86 2026-03-17 01:17:48,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:48,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:48,875 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b8ab59fbe29c53ae85f84e/log.txt.gz 2026-03-17 01:17:49,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:49,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:49,224 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b8ab59fbe29c53ae85f84e/lava-logs.yaml 2026-03-17 01:17:49,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:17:49,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:17:49,355 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b8ab59fbe29c53ae85f84e/lava_callback.json.gz 2026-03-17 01:17:49,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:49,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab59fbe29c53ae85f84e HTTP/1.1" 200 None 2026-03-17 01:17:49,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:49,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89dd1fbe29c53ae85cd0e HTTP/1.1" 200 None 2026-03-17 01:17:49,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:49,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab59fbe29c53ae85f84e HTTP/1.1" 200 None 2026-03-17 01:17:49,438 - lava_callback - INFO - Completed processing callback for node 69b8ab59fbe29c53ae85f84e 2026-03-17 01:17:51,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:17:51,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:18:24,323 - lava_callback - INFO - Received callback for node 69b8ab03fbe29c53ae85f752 INFO: 172.21.0.1:51884 - "POST /node/69b8ab03fbe29c53ae85f752 HTTP/1.0" 202 Accepted 2026-03-17 01:18:24,329 - lava_callback - INFO - Starting async job submit for node 69b8ab03fbe29c53ae85f752 2026-03-17 01:18:24,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:18:24,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab03fbe29c53ae85f752 HTTP/1.1" 200 None 2026-03-17 01:18:24,374 - lava_callback - DEBUG - Processing node 69b8ab03fbe29c53ae85f752: baseline-arm64 2026-03-17 01:18:24,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:18:24,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:18:24,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab03fbe29c53ae85f752/log.txt.gz 2026-03-17 01:18:25,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:18:25,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:18:25,244 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab03fbe29c53ae85f752/lava-logs.yaml 2026-03-17 01:18:25,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:18:25,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:18:25,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab03fbe29c53ae85f752/lava_callback.json.gz 2026-03-17 01:18:25,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:18:25,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab03fbe29c53ae85f752 HTTP/1.1" 200 None 2026-03-17 01:18:25,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:18:25,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:18:25,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:18:25,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab03fbe29c53ae85f752 HTTP/1.1" 200 None 2026-03-17 01:18:25,509 - lava_callback - INFO - Completed processing callback for node 69b8ab03fbe29c53ae85f752 INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:18:34,181 - lava_callback - INFO - Received callback for node 69b608e31727ff69d6f26cfb INFO: 172.21.0.1:35716 - "POST /node/69b608e31727ff69d6f26cfb HTTP/1.0" 202 Accepted 2026-03-17 01:18:34,187 - lava_callback - INFO - Starting async job submit for node 69b608e31727ff69d6f26cfb 2026-03-17 01:18:34,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:18:34,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b608e31727ff69d6f26cfb HTTP/1.1" 200 None 2026-03-17 01:18:34,223 - lava_callback - DEBUG - Processing node 69b608e31727ff69d6f26cfb: baseline-arm64-clabbe 2026-03-17 01:18:34,223 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b608e31727ff69d6f26cfb 2026-03-17 01:18:34,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:18:34,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b608e31727ff69d6f26cfb HTTP/1.1" 200 None 2026-03-17 01:18:34,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:18:34,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 01:18:34,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:18:34,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b608e31727ff69d6f26cfb HTTP/1.1" 200 None 2026-03-17 01:18:34,280 - lava_callback - ERROR - Error processing callback for node 69b608e31727ff69d6f26cfb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:18:51,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:18:51,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:19:25,369 - lava_callback - INFO - Received callback for node 69b8ab37fbe29c53ae85f7fd INFO: 172.21.0.1:47948 - "POST /node/69b8ab37fbe29c53ae85f7fd HTTP/1.0" 202 Accepted 2026-03-17 01:19:25,375 - lava_callback - INFO - Starting async job submit for node 69b8ab37fbe29c53ae85f7fd 2026-03-17 01:19:25,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:19:25,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab37fbe29c53ae85f7fd HTTP/1.1" 200 None 2026-03-17 01:19:25,417 - lava_callback - DEBUG - Processing node 69b8ab37fbe29c53ae85f7fd: baseline-arm64-broonie 2026-03-17 01:19:25,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:19:25,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:19:25,841 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab37fbe29c53ae85f7fd/log.txt.gz 2026-03-17 01:19:25,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:19:26,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:19:26,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab37fbe29c53ae85f7fd/lava-logs.yaml 2026-03-17 01:19:26,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:19:26,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:19:26,393 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab37fbe29c53ae85f7fd/lava_callback.json.gz 2026-03-17 01:19:26,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:19:26,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab37fbe29c53ae85f7fd HTTP/1.1" 200 None 2026-03-17 01:19:26,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:19:26,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:19:26,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:19:26,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab37fbe29c53ae85f7fd HTTP/1.1" 200 None 2026-03-17 01:19:26,471 - lava_callback - INFO - Completed processing callback for node 69b8ab37fbe29c53ae85f7fd INFO: 172.21.0.1:47960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:19:41,859 - lava_callback - INFO - Received callback for node 69b8ab18fbe29c53ae85f79a INFO: 172.21.0.1:59858 - "POST /node/69b8ab18fbe29c53ae85f79a HTTP/1.0" 202 Accepted 2026-03-17 01:19:41,865 - lava_callback - INFO - Starting async job submit for node 69b8ab18fbe29c53ae85f79a 2026-03-17 01:19:41,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:19:41,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab18fbe29c53ae85f79a HTTP/1.1" 200 None 2026-03-17 01:19:41,911 - lava_callback - DEBUG - Processing node 69b8ab18fbe29c53ae85f79a: baseline-nfs-arm64 2026-03-17 01:19:42,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:19:42,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:19:42,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab18fbe29c53ae85f79a/log.txt.gz 2026-03-17 01:19:43,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:19:43,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:19:43,227 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab18fbe29c53ae85f79a/lava-logs.yaml 2026-03-17 01:19:43,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:19:43,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:19:43,419 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab18fbe29c53ae85f79a/lava_callback.json.gz 2026-03-17 01:19:43,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:19:43,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab18fbe29c53ae85f79a HTTP/1.1" 200 None 2026-03-17 01:19:43,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:19:43,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:19:43,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:19:43,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab18fbe29c53ae85f79a HTTP/1.1" 200 None 2026-03-17 01:19:43,508 - lava_callback - INFO - Completed processing callback for node 69b8ab18fbe29c53ae85f79a INFO: 172.21.0.1:59860 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:19:51,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:19:51,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 01:19:54,243 - lava_callback - INFO - Received callback for node 69b6092d1727ff69d6f26d08 INFO: 172.21.0.1:56612 - "POST /node/69b6092d1727ff69d6f26d08 HTTP/1.0" 202 Accepted 2026-03-17 01:19:54,249 - lava_callback - INFO - Starting async job submit for node 69b6092d1727ff69d6f26d08 2026-03-17 01:19:54,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:19:54,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6092d1727ff69d6f26d08 HTTP/1.1" 200 None 2026-03-17 01:19:54,264 - lava_callback - DEBUG - Processing node 69b6092d1727ff69d6f26d08: baseline-arm64-clabbe 2026-03-17 01:19:54,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6092d1727ff69d6f26d08 2026-03-17 01:19:54,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:19:54,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6092d1727ff69d6f26d08 HTTP/1.1" 200 None 2026-03-17 01:19:54,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:19:54,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 01:19:54,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:19:54,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6092d1727ff69d6f26d08 HTTP/1.1" 200 None 2026-03-17 01:19:54,332 - lava_callback - ERROR - Error processing callback for node 69b6092d1727ff69d6f26d08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:20:40,419 - lava_callback - INFO - Received callback for node 69b87fdc0b8ad4124cec676e INFO: 172.21.0.1:33796 - "POST /node/69b87fdc0b8ad4124cec676e HTTP/1.0" 202 Accepted 2026-03-17 01:20:40,425 - lava_callback - INFO - Starting async job submit for node 69b87fdc0b8ad4124cec676e 2026-03-17 01:20:40,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:20:40,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b87fdc0b8ad4124cec676e HTTP/1.1" 200 None 2026-03-17 01:20:40,457 - lava_callback - DEBUG - Processing node 69b87fdc0b8ad4124cec676e: baseline-x86 2026-03-17 01:20:40,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:20:40,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:20:40,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b87fdc0b8ad4124cec676e/log.txt.gz 2026-03-17 01:20:41,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:20:41,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:20:41,310 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b87fdc0b8ad4124cec676e/lava-logs.yaml 2026-03-17 01:20:41,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:20:41,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:20:41,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b87fdc0b8ad4124cec676e/lava_callback.json.gz 2026-03-17 01:20:41,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:20:41,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b87fdc0b8ad4124cec676e HTTP/1.1" 200 None 2026-03-17 01:20:41,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:20:41,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd8200b80c8ffdcb82cf HTTP/1.1" 200 None 2026-03-17 01:20:41,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:20:41,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b87fdc0b8ad4124cec676e HTTP/1.1" 200 None 2026-03-17 01:20:41,557 - lava_callback - INFO - Completed processing callback for node 69b87fdc0b8ad4124cec676e INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:20:51,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:20:51,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:21:01,732 - lava_callback - INFO - Received callback for node 69b8ab11fbe29c53ae85f78b INFO: 172.21.0.1:43594 - "POST /node/69b8ab11fbe29c53ae85f78b HTTP/1.0" 202 Accepted 2026-03-17 01:21:01,740 - lava_callback - INFO - Starting async job submit for node 69b8ab11fbe29c53ae85f78b 2026-03-17 01:21:01,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:21:01,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab11fbe29c53ae85f78b HTTP/1.1" 200 None 2026-03-17 01:21:01,791 - lava_callback - DEBUG - Processing node 69b8ab11fbe29c53ae85f78b: baseline-arm64 2026-03-17 01:21:02,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:21:02,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:21:02,353 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab11fbe29c53ae85f78b/log.txt.gz 2026-03-17 01:21:02,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:21:02,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:21:02,781 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab11fbe29c53ae85f78b/lava-logs.yaml 2026-03-17 01:21:02,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:21:02,913 - lava_callback - INFO - Received callback for node 69b609711727ff69d6f26d0d INFO: 172.21.0.1:43610 - "POST /node/69b609711727ff69d6f26d0d HTTP/1.0" 202 Accepted 2026-03-17 01:21:02,919 - lava_callback - INFO - Starting async job submit for node 69b609711727ff69d6f26d0d 2026-03-17 01:21:02,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:21:02,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b609711727ff69d6f26d0d HTTP/1.1" 200 None 2026-03-17 01:21:02,937 - lava_callback - DEBUG - Processing node 69b609711727ff69d6f26d0d: baseline-arm64-baylibre 2026-03-17 01:21:02,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b609711727ff69d6f26d0d 2026-03-17 01:21:02,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:21:02,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:21:02,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b609711727ff69d6f26d0d HTTP/1.1" 200 None 2026-03-17 01:21:02,958 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab11fbe29c53ae85f78b/lava_callback.json.gz 2026-03-17 01:21:02,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 DEBUG: Setup failed for 69b8ab11fbe29c53ae85f78b. Transitting job node result: incomplete -> fail 2026-03-17 01:21:03,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:21:03,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 01:21:03,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:21:03,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab11fbe29c53ae85f78b HTTP/1.1" 200 None 2026-03-17 01:21:03,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:21:03,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b609711727ff69d6f26d0d HTTP/1.1" 200 None 2026-03-17 01:21:03,069 - lava_callback - ERROR - Error processing callback for node 69b609711727ff69d6f26d0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 01:21:03,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:21:03,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:21:03,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab11fbe29c53ae85f78b HTTP/1.1" 200 None 2026-03-17 01:21:03,279 - lava_callback - INFO - Completed processing callback for node 69b8ab11fbe29c53ae85f78b INFO: 172.21.0.1:43616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44602 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:21:21,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:21:21,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:21:41,354 - lava_callback - INFO - Received callback for node 69b8ab4cfbe29c53ae85f83f INFO: 172.21.0.1:53362 - "POST /node/69b8ab4cfbe29c53ae85f83f HTTP/1.0" 202 Accepted 2026-03-17 01:21:41,364 - lava_callback - INFO - Starting async job submit for node 69b8ab4cfbe29c53ae85f83f 2026-03-17 01:21:41,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:21:41,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab4cfbe29c53ae85f83f HTTP/1.1" 200 None 2026-03-17 01:21:41,433 - lava_callback - DEBUG - Processing node 69b8ab4cfbe29c53ae85f83f: baseline-arm64-foundriesio 2026-03-17 01:21:42,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:21:42,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:21:42,818 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8ab4cfbe29c53ae85f83f/log.txt.gz 2026-03-17 01:21:43,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:21:43,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:21:43,790 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8ab4cfbe29c53ae85f83f/lava-logs.yaml 2026-03-17 01:21:43,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:21:44,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:21:44,091 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8ab4cfbe29c53ae85f83f/lava_callback.json.gz DEBUG: Setup failed for 69b8ab4cfbe29c53ae85f83f. Transitting job node result: incomplete -> fail 2026-03-17 01:21:44,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:21:44,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab4cfbe29c53ae85f83f HTTP/1.1" 200 None 2026-03-17 01:21:44,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:21:44,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:21:44,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:21:44,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab4cfbe29c53ae85f83f HTTP/1.1" 200 None 2026-03-17 01:21:44,413 - lava_callback - INFO - Completed processing callback for node 69b8ab4cfbe29c53ae85f83f INFO: 172.21.0.1:53376 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:21:51,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:21:51,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:22:11,942 - lava_callback - INFO - Received callback for node 69b889600b8ad4124cec68f3 INFO: 172.21.0.1:55128 - "POST /node/69b889600b8ad4124cec68f3 HTTP/1.0" 202 Accepted 2026-03-17 01:22:11,948 - lava_callback - INFO - Starting async job submit for node 69b889600b8ad4124cec68f3 2026-03-17 01:22:11,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:22:11,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b889600b8ad4124cec68f3 HTTP/1.1" 200 None 2026-03-17 01:22:11,981 - lava_callback - DEBUG - Processing node 69b889600b8ad4124cec68f3: baseline-x86 2026-03-17 01:22:12,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:22:12,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:22:12,454 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b889600b8ad4124cec68f3/log.txt.gz 2026-03-17 01:22:12,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:22:12,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:22:12,838 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b889600b8ad4124cec68f3/lava-logs.yaml 2026-03-17 01:22:12,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:22:13,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:22:13,009 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b889600b8ad4124cec68f3/lava_callback.json.gz 2026-03-17 01:22:13,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:22:13,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b889600b8ad4124cec68f3 HTTP/1.1" 200 None 2026-03-17 01:22:13,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:22:13,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d700b8ad4124cec3582 HTTP/1.1" 200 None 2026-03-17 01:22:13,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:22:13,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b889600b8ad4124cec68f3 HTTP/1.1" 200 None 2026-03-17 01:22:13,085 - lava_callback - INFO - Completed processing callback for node 69b889600b8ad4124cec68f3 2026-03-17 01:22:13,277 - lava_callback - INFO - Received callback for node 69b8ab13fbe29c53ae85f791 INFO: 172.21.0.1:55140 - "POST /node/69b8ab13fbe29c53ae85f791 HTTP/1.0" 202 Accepted 2026-03-17 01:22:13,283 - lava_callback - INFO - Starting async job submit for node 69b8ab13fbe29c53ae85f791 2026-03-17 01:22:13,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:22:13,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab13fbe29c53ae85f791 HTTP/1.1" 200 None 2026-03-17 01:22:13,330 - lava_callback - DEBUG - Processing node 69b8ab13fbe29c53ae85f791: baseline-nfs-arm64 2026-03-17 01:22:13,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:22:13,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:22:13,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab13fbe29c53ae85f791/log.txt.gz 2026-03-17 01:22:14,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:22:14,314 - lava_callback - INFO - Received callback for node 69b609c01727ff69d6f26d1a INFO: 172.21.0.1:55150 - "POST /node/69b609c01727ff69d6f26d1a HTTP/1.0" 202 Accepted 2026-03-17 01:22:14,320 - lava_callback - INFO - Starting async job submit for node 69b609c01727ff69d6f26d1a 2026-03-17 01:22:14,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:22:14,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:22:14,342 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab13fbe29c53ae85f791/lava-logs.yaml 2026-03-17 01:22:14,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b609c01727ff69d6f26d1a HTTP/1.1" 200 None 2026-03-17 01:22:14,344 - lava_callback - DEBUG - Processing node 69b609c01727ff69d6f26d1a: baseline-arm64-clabbe 2026-03-17 01:22:14,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b609c01727ff69d6f26d1a 2026-03-17 01:22:14,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:22:14,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:22:14,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b609c01727ff69d6f26d1a HTTP/1.1" 200 None 2026-03-17 01:22:14,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:22:14,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 01:22:14,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:22:14,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b609c01727ff69d6f26d1a HTTP/1.1" 200 None 2026-03-17 01:22:14,427 - lava_callback - ERROR - Error processing callback for node 69b609c01727ff69d6f26d1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 01:22:14,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:22:14,564 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab13fbe29c53ae85f791/lava_callback.json.gz 2026-03-17 01:22:14,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:22:14,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab13fbe29c53ae85f791 HTTP/1.1" 200 None 2026-03-17 01:22:14,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:22:14,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:22:14,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:22:14,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab13fbe29c53ae85f791 HTTP/1.1" 200 None 2026-03-17 01:22:14,648 - lava_callback - INFO - Completed processing callback for node 69b8ab13fbe29c53ae85f791 INFO: 172.21.0.1:55162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55178 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:22:21,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:22:21,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42058 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:23:34,244 - lava_callback - INFO - Received callback for node 69b60a0a1727ff69d6f26d22 INFO: 172.21.0.1:52618 - "POST /node/69b60a0a1727ff69d6f26d22 HTTP/1.0" 202 Accepted 2026-03-17 01:23:34,250 - lava_callback - INFO - Starting async job submit for node 69b60a0a1727ff69d6f26d22 2026-03-17 01:23:34,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:23:34,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60a0a1727ff69d6f26d22 HTTP/1.1" 200 None 2026-03-17 01:23:34,266 - lava_callback - DEBUG - Processing node 69b60a0a1727ff69d6f26d22: baseline-arm64-clabbe 2026-03-17 01:23:34,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b60a0a1727ff69d6f26d22 2026-03-17 01:23:34,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:23:34,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60a0a1727ff69d6f26d22 HTTP/1.1" 200 None 2026-03-17 01:23:34,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:23:34,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 01:23:34,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:23:34,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b60a0a1727ff69d6f26d22 HTTP/1.1" 200 None 2026-03-17 01:23:34,335 - lava_callback - ERROR - Error processing callback for node 69b60a0a1727ff69d6f26d22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59086 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:23:49,617 - lava_callback - INFO - Received callback for node 69b8a12dfbe29c53ae85f2f3 INFO: 172.21.0.1:59090 - "POST /node/69b8a12dfbe29c53ae85f2f3 HTTP/1.0" 202 Accepted 2026-03-17 01:23:49,625 - lava_callback - INFO - Starting async job submit for node 69b8a12dfbe29c53ae85f2f3 2026-03-17 01:23:49,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:23:49,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a12dfbe29c53ae85f2f3 HTTP/1.1" 200 None 2026-03-17 01:23:49,659 - lava_callback - DEBUG - Processing node 69b8a12dfbe29c53ae85f2f3: baseline-x86 2026-03-17 01:23:49,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:23:50,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:23:50,136 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a12dfbe29c53ae85f2f3/log.txt.gz 2026-03-17 01:23:50,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:23:50,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:23:50,575 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a12dfbe29c53ae85f2f3/lava-logs.yaml 2026-03-17 01:23:50,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:23:50,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:23:50,736 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b8a12dfbe29c53ae85f2f3/lava_callback.json.gz 2026-03-17 01:23:50,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:23:50,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a12dfbe29c53ae85f2f3 HTTP/1.1" 200 None 2026-03-17 01:23:50,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:23:50,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89dd1fbe29c53ae85cd0e HTTP/1.1" 200 None 2026-03-17 01:23:50,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:23:50,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a12dfbe29c53ae85f2f3 HTTP/1.1" 200 None 2026-03-17 01:23:50,825 - lava_callback - INFO - Completed processing callback for node 69b8a12dfbe29c53ae85f2f3 2026-03-17 01:23:51,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:23:51,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44114 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:24:54,301 - lava_callback - INFO - Received callback for node 69b60a541727ff69d6f26d2e INFO: 172.21.0.1:45344 - "POST /node/69b60a541727ff69d6f26d2e HTTP/1.0" 202 Accepted 2026-03-17 01:24:54,306 - lava_callback - INFO - Starting async job submit for node 69b60a541727ff69d6f26d2e 2026-03-17 01:24:54,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:24:54,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60a541727ff69d6f26d2e HTTP/1.1" 200 None 2026-03-17 01:24:54,328 - lava_callback - DEBUG - Processing node 69b60a541727ff69d6f26d2e: baseline-arm64-clabbe 2026-03-17 01:24:54,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b60a541727ff69d6f26d2e 2026-03-17 01:24:54,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:24:54,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60a541727ff69d6f26d2e HTTP/1.1" 200 None 2026-03-17 01:24:54,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:24:54,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 01:24:54,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:24:54,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b60a541727ff69d6f26d2e HTTP/1.1" 200 None 2026-03-17 01:24:54,390 - lava_callback - ERROR - Error processing callback for node 69b60a541727ff69d6f26d2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:25:21,963 - lava_callback - INFO - Received callback for node 69b89ff6fbe29c53ae85cd28 INFO: 172.21.0.1:54360 - "POST /node/69b89ff6fbe29c53ae85cd28 HTTP/1.0" 202 Accepted 2026-03-17 01:25:22,009 - lava_callback - INFO - Starting async job submit for node 69b89ff6fbe29c53ae85cd28 2026-03-17 01:25:22,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:25:22,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89ff6fbe29c53ae85cd28 HTTP/1.1" 200 None 2026-03-17 01:25:22,048 - lava_callback - DEBUG - Processing node 69b89ff6fbe29c53ae85cd28: baseline-arm-pengutronix 2026-03-17 01:25:22,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:25:22,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:25:22,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b89ff6fbe29c53ae85cd28/log.txt.gz 2026-03-17 01:25:22,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:25:22,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:25:22,564 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b89ff6fbe29c53ae85cd28/lava-logs.yaml 2026-03-17 01:25:22,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:25:22,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:25:22,703 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b89ff6fbe29c53ae85cd28/lava_callback.json.gz DEBUG: Setup failed for 69b89ff6fbe29c53ae85cd28. Transitting job node result: incomplete -> fail 2026-03-17 01:25:22,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:25:22,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89ff6fbe29c53ae85cd28 HTTP/1.1" 200 None 2026-03-17 01:25:22,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:25:22,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-17 01:25:22,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:25:22,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b89ff6fbe29c53ae85cd28 HTTP/1.1" 200 None 2026-03-17 01:25:22,865 - lava_callback - INFO - Completed processing callback for node 69b89ff6fbe29c53ae85cd28 INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57216 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:25:51,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:25:51,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:26:02,996 - lava_callback - INFO - Received callback for node 69b8ab1dfbe29c53ae85f7a6 INFO: 172.21.0.1:50632 - "POST /node/69b8ab1dfbe29c53ae85f7a6 HTTP/1.0" 202 Accepted 2026-03-17 01:26:03,003 - lava_callback - INFO - Starting async job submit for node 69b8ab1dfbe29c53ae85f7a6 2026-03-17 01:26:03,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:26:03,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab1dfbe29c53ae85f7a6 HTTP/1.1" 200 None 2026-03-17 01:26:03,044 - lava_callback - DEBUG - Processing node 69b8ab1dfbe29c53ae85f7a6: baseline-nfs-arm64 2026-03-17 01:26:03,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:26:03,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:26:03,696 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab1dfbe29c53ae85f7a6/log.txt.gz 2026-03-17 01:26:03,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:26:04,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:26:04,154 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab1dfbe29c53ae85f7a6/lava-logs.yaml 2026-03-17 01:26:04,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:26:04,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:26:04,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab1dfbe29c53ae85f7a6/lava_callback.json.gz 2026-03-17 01:26:04,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:26:04,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab1dfbe29c53ae85f7a6 HTTP/1.1" 200 None 2026-03-17 01:26:04,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:26:04,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:26:04,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:26:04,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab1dfbe29c53ae85f7a6 HTTP/1.1" 200 None 2026-03-17 01:26:04,513 - lava_callback - INFO - Completed processing callback for node 69b8ab1dfbe29c53ae85f7a6 2026-03-17 01:26:05,172 - lava_callback - INFO - Received callback for node 69b8ab0cfbe29c53ae85f77d INFO: 172.21.0.1:50644 - "POST /node/69b8ab0cfbe29c53ae85f77d HTTP/1.0" 202 Accepted 2026-03-17 01:26:05,178 - lava_callback - INFO - Starting async job submit for node 69b8ab0cfbe29c53ae85f77d 2026-03-17 01:26:05,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:26:05,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab0cfbe29c53ae85f77d HTTP/1.1" 200 None 2026-03-17 01:26:05,217 - lava_callback - DEBUG - Processing node 69b8ab0cfbe29c53ae85f77d: baseline-arm64 2026-03-17 01:26:05,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:26:05,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:26:05,910 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab0cfbe29c53ae85f77d/log.txt.gz 2026-03-17 01:26:06,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:26:06,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:26:06,397 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab0cfbe29c53ae85f77d/lava-logs.yaml 2026-03-17 01:26:06,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:26:06,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:26:06,577 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ab0cfbe29c53ae85f77d/lava_callback.json.gz 2026-03-17 01:26:06,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:26:06,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab0cfbe29c53ae85f77d HTTP/1.1" 200 None 2026-03-17 01:26:06,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:26:06,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:26:06,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:26:06,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab0cfbe29c53ae85f77d HTTP/1.1" 200 None 2026-03-17 01:26:06,737 - lava_callback - INFO - Completed processing callback for node 69b8ab0cfbe29c53ae85f77d 2026-03-17 01:26:14,484 - lava_callback - INFO - Received callback for node 69b60aa21727ff69d6f26d34 INFO: 172.21.0.1:39830 - "POST /node/69b60aa21727ff69d6f26d34 HTTP/1.0" 202 Accepted 2026-03-17 01:26:14,489 - lava_callback - INFO - Starting async job submit for node 69b60aa21727ff69d6f26d34 2026-03-17 01:26:14,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:26:14,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60aa21727ff69d6f26d34 HTTP/1.1" 200 None 2026-03-17 01:26:14,519 - lava_callback - DEBUG - Processing node 69b60aa21727ff69d6f26d34: baseline-arm64-clabbe 2026-03-17 01:26:14,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b60aa21727ff69d6f26d34 2026-03-17 01:26:14,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:26:14,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60aa21727ff69d6f26d34 HTTP/1.1" 200 None 2026-03-17 01:26:14,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:26:14,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 01:26:14,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:26:14,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b60aa21727ff69d6f26d34 HTTP/1.1" 200 None 2026-03-17 01:26:14,572 - lava_callback - ERROR - Error processing callback for node 69b60aa21727ff69d6f26d34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39856 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:26:21,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:26:21,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:27:14,567 - lava_callback - INFO - Received callback for node 69b60aec1727ff69d6f26d40 INFO: 172.21.0.1:50114 - "POST /node/69b60aec1727ff69d6f26d40 HTTP/1.0" 202 Accepted 2026-03-17 01:27:14,572 - lava_callback - INFO - Starting async job submit for node 69b60aec1727ff69d6f26d40 2026-03-17 01:27:14,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:27:14,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60aec1727ff69d6f26d40 HTTP/1.1" 200 None 2026-03-17 01:27:14,588 - lava_callback - DEBUG - Processing node 69b60aec1727ff69d6f26d40: baseline-arm64-clabbe 2026-03-17 01:27:14,588 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b60aec1727ff69d6f26d40 2026-03-17 01:27:14,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:27:14,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60aec1727ff69d6f26d40 HTTP/1.1" 200 None 2026-03-17 01:27:14,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:27:14,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 01:27:14,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:27:14,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b60aec1727ff69d6f26d40 HTTP/1.1" 200 None 2026-03-17 01:27:14,647 - lava_callback - ERROR - Error processing callback for node 69b60aec1727ff69d6f26d40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52026 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:28:34,652 - lava_callback - INFO - Received callback for node 69b60b351727ff69d6f26d47 INFO: 172.21.0.1:50622 - "POST /node/69b60b351727ff69d6f26d47 HTTP/1.0" 202 Accepted 2026-03-17 01:28:34,658 - lava_callback - INFO - Starting async job submit for node 69b60b351727ff69d6f26d47 2026-03-17 01:28:34,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:28:34,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60b351727ff69d6f26d47 HTTP/1.1" 200 None 2026-03-17 01:28:34,673 - lava_callback - DEBUG - Processing node 69b60b351727ff69d6f26d47: baseline-arm64-clabbe 2026-03-17 01:28:34,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b60b351727ff69d6f26d47 2026-03-17 01:28:34,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:28:34,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60b351727ff69d6f26d47 HTTP/1.1" 200 None 2026-03-17 01:28:34,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:28:34,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 01:28:34,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:28:34,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b60b351727ff69d6f26d47 HTTP/1.1" 200 None 2026-03-17 01:28:34,725 - lava_callback - ERROR - Error processing callback for node 69b60b351727ff69d6f26d47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:30:49,853 - lava_callback - INFO - Received callback for node 69b8aeaefbe29c53ae85f9f6 INFO: 172.21.0.1:43030 - "POST /node/69b8aeaefbe29c53ae85f9f6 HTTP/1.0" 202 Accepted 2026-03-17 01:30:49,859 - lava_callback - INFO - Starting async job submit for node 69b8aeaefbe29c53ae85f9f6 2026-03-17 01:30:49,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:30:49,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aeaefbe29c53ae85f9f6 HTTP/1.1" 200 None 2026-03-17 01:30:49,876 - lava_callback - DEBUG - Processing node 69b8aeaefbe29c53ae85f9f6: baseline-nfs-arm64 2026-03-17 01:30:49,877 - lava_callback - WARNING - Failed to upload log 2026-03-17 01:30:49,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:30:50,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:30:50,019 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8aeaefbe29c53ae85f9f6/lava-logs.yaml 2026-03-17 01:30:50,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:30:50,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:30:50,153 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8aeaefbe29c53ae85f9f6/lava_callback.json.gz 2026-03-17 01:30:50,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:30:50,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aeaefbe29c53ae85f9f6 HTTP/1.1" 200 None 2026-03-17 01:30:50,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:30:50,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:30:50,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:30:50,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8aeaefbe29c53ae85f9f6 HTTP/1.1" 200 None 2026-03-17 01:30:50,214 - lava_callback - INFO - Completed processing callback for node 69b8aeaefbe29c53ae85f9f6 2026-03-17 01:30:51,271 - lava_callback - INFO - Received callback for node 69b8ab44fbe29c53ae85f829 INFO: 172.21.0.1:43038 - "POST /node/69b8ab44fbe29c53ae85f829 HTTP/1.0" 202 Accepted 2026-03-17 01:30:51,278 - lava_callback - INFO - Starting async job submit for node 69b8ab44fbe29c53ae85f829 2026-03-17 01:30:51,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:30:51,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab44fbe29c53ae85f829 HTTP/1.1" 200 None 2026-03-17 01:30:51,345 - lava_callback - DEBUG - Processing node 69b8ab44fbe29c53ae85f829: baseline-arm64-clabbe 2026-03-17 01:30:51,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:30:51,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:30:51,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 01:30:52,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:30:52,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b8ab44fbe29c53ae85f829/log.txt.gz 2026-03-17 01:30:52,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:30:52,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:30:52,661 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b8ab44fbe29c53ae85f829/lava-logs.yaml 2026-03-17 01:30:52,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:30:52,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:30:52,844 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b8ab44fbe29c53ae85f829/lava_callback.json.gz 2026-03-17 01:30:52,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:30:52,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab44fbe29c53ae85f829 HTTP/1.1" 200 None 2026-03-17 01:30:52,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:30:52,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:30:52,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:30:52,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab44fbe29c53ae85f829 HTTP/1.1" 200 None 2026-03-17 01:30:52,957 - lava_callback - INFO - Completed processing callback for node 69b8ab44fbe29c53ae85f829 INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53082 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:31:21,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:31:21,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35142 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:32:56,160 - lava_callback - INFO - Received callback for node 69b8aef8fbe29c53ae85fa06 INFO: 172.21.0.1:42800 - "POST /node/69b8aef8fbe29c53ae85fa06 HTTP/1.0" 202 Accepted 2026-03-17 01:32:56,167 - lava_callback - INFO - Starting async job submit for node 69b8aef8fbe29c53ae85fa06 2026-03-17 01:32:56,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:32:56,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aef8fbe29c53ae85fa06 HTTP/1.1" 200 None 2026-03-17 01:32:56,211 - lava_callback - DEBUG - Processing node 69b8aef8fbe29c53ae85fa06: baseline-arm64 2026-03-17 01:32:56,413 - lava_callback - WARNING - Failed to upload log 2026-03-17 01:32:56,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42802 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:32:56,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:32:56,748 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aef8fbe29c53ae85fa06/lava-logs.yaml 2026-03-17 01:32:56,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:32:56,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:32:56,918 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aef8fbe29c53ae85fa06/lava_callback.json.gz 2026-03-17 01:32:56,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:32:56,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aef8fbe29c53ae85fa06 HTTP/1.1" 200 None 2026-03-17 01:32:56,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:32:56,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:32:56,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:32:57,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8aef8fbe29c53ae85fa06 HTTP/1.1" 200 None 2026-03-17 01:32:57,068 - lava_callback - INFO - Completed processing callback for node 69b8aef8fbe29c53ae85fa06 INFO: 172.21.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48638 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:33:21,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:33:22,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:34:08,432 - lava_callback - INFO - Received callback for node 69b8af4afbe29c53ae85fa10 INFO: 172.21.0.1:48266 - "POST /node/69b8af4afbe29c53ae85fa10 HTTP/1.0" 202 Accepted 2026-03-17 01:34:08,439 - lava_callback - INFO - Starting async job submit for node 69b8af4afbe29c53ae85fa10 2026-03-17 01:34:08,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:34:08,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8af4afbe29c53ae85fa10 HTTP/1.1" 200 None 2026-03-17 01:34:08,485 - lava_callback - DEBUG - Processing node 69b8af4afbe29c53ae85fa10: baseline-arm64 2026-03-17 01:34:08,636 - lava_callback - WARNING - Failed to upload log 2026-03-17 01:34:08,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:34:08,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:34:08,919 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8af4afbe29c53ae85fa10/lava-logs.yaml 2026-03-17 01:34:08,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:34:09,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:34:09,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8af4afbe29c53ae85fa10/lava_callback.json.gz 2026-03-17 01:34:09,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:34:09,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8af4afbe29c53ae85fa10 HTTP/1.1" 200 None 2026-03-17 01:34:09,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:34:09,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:34:09,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:34:09,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8af4afbe29c53ae85fa10 HTTP/1.1" 200 None 2026-03-17 01:34:09,239 - lava_callback - INFO - Completed processing callback for node 69b8af4afbe29c53ae85fa10 INFO: 172.21.0.1:41648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41658 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:34:22,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:34:22,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51516 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:35:16,768 - lava_callback - INFO - Received callback for node 69b8ab16fbe29c53ae85f797 INFO: 172.21.0.1:51522 - "POST /node/69b8ab16fbe29c53ae85f797 HTTP/1.0" 202 Accepted 2026-03-17 01:35:16,777 - lava_callback - INFO - Starting async job submit for node 69b8ab16fbe29c53ae85f797 2026-03-17 01:35:16,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:35:16,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab16fbe29c53ae85f797 HTTP/1.1" 200 None 2026-03-17 01:35:16,845 - lava_callback - DEBUG - Processing node 69b8ab16fbe29c53ae85f797: baseline-nfs-arm64 2026-03-17 01:35:17,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:35:18,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:35:18,154 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab16fbe29c53ae85f797/log.txt.gz 2026-03-17 01:35:18,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:35:19,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:35:19,093 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab16fbe29c53ae85f797/lava-logs.yaml 2026-03-17 01:35:19,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:35:19,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:35:19,300 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8ab16fbe29c53ae85f797/lava_callback.json.gz DEBUG: Setup failed for 69b8ab16fbe29c53ae85f797. Transitting job node result: incomplete -> fail 2026-03-17 01:35:19,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:35:19,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab16fbe29c53ae85f797 HTTP/1.1" 200 None 2026-03-17 01:35:19,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:35:19,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:35:19,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:35:19,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab16fbe29c53ae85f797 HTTP/1.1" 200 None 2026-03-17 01:35:19,548 - lava_callback - INFO - Completed processing callback for node 69b8ab16fbe29c53ae85f797 2026-03-17 01:35:22,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:35:22,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37202 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:36:26,653 - lava_callback - INFO - Received callback for node 69b8abd5fbe29c53ae85f931 INFO: 172.21.0.1:37208 - "POST /node/69b8abd5fbe29c53ae85f931 HTTP/1.0" 202 Accepted 2026-03-17 01:36:26,661 - lava_callback - INFO - Starting async job submit for node 69b8abd5fbe29c53ae85f931 2026-03-17 01:36:26,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:36:26,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8abd5fbe29c53ae85f931 HTTP/1.1" 200 None 2026-03-17 01:36:26,736 - lava_callback - DEBUG - Processing node 69b8abd5fbe29c53ae85f931: baseline-arm 2026-03-17 01:36:27,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:36:27,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:36:27,515 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b8abd5fbe29c53ae85f931/log.txt.gz 2026-03-17 01:36:27,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:36:28,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:36:28,099 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8abd5fbe29c53ae85f931/lava-logs.yaml 2026-03-17 01:36:28,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:36:28,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:36:28,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8abd5fbe29c53ae85f931/lava_callback.json.gz DEBUG: Setup failed for 69b8abd5fbe29c53ae85f931. Transitting job node result: incomplete -> fail 2026-03-17 01:36:28,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:36:28,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8abd5fbe29c53ae85f931 HTTP/1.1" 200 None 2026-03-17 01:36:28,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:36:28,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:36:28,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:36:28,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8abd5fbe29c53ae85f931 HTTP/1.1" 200 None 2026-03-17 01:36:28,578 - lava_callback - INFO - Completed processing callback for node 69b8abd5fbe29c53ae85f931 INFO: 172.21.0.1:35680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43236 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:36:52,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:36:52,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36724 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:37:54,578 - lava_callback - INFO - Received callback for node 69b8aff2fbe29c53ae85fa2c INFO: 172.21.0.1:48630 - "POST /node/69b8aff2fbe29c53ae85fa2c HTTP/1.0" 202 Accepted 2026-03-17 01:37:54,585 - lava_callback - INFO - Starting async job submit for node 69b8aff2fbe29c53ae85fa2c 2026-03-17 01:37:54,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:37:54,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aff2fbe29c53ae85fa2c HTTP/1.1" 200 None 2026-03-17 01:37:54,626 - lava_callback - DEBUG - Processing node 69b8aff2fbe29c53ae85fa2c: baseline-arm64 2026-03-17 01:37:55,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:37:55,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:37:55,241 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aff2fbe29c53ae85fa2c/log.txt.gz 2026-03-17 01:37:55,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:37:55,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:37:55,742 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aff2fbe29c53ae85fa2c/lava-logs.yaml 2026-03-17 01:37:55,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:37:55,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:37:55,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8aff2fbe29c53ae85fa2c/lava_callback.json.gz 2026-03-17 01:37:55,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:37:55,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8aff2fbe29c53ae85fa2c HTTP/1.1" 200 None 2026-03-17 01:37:55,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:37:55,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:37:55,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:37:56,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8aff2fbe29c53ae85fa2c HTTP/1.1" 200 None 2026-03-17 01:37:56,062 - lava_callback - INFO - Completed processing callback for node 69b8aff2fbe29c53ae85fa2c INFO: 172.21.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:38:22,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:38:22,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55430 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:40:24,718 - lava_callback - INFO - Received callback for node 69b8ace9fbe29c53ae85f99f INFO: 172.21.0.1:35084 - "POST /node/69b8ace9fbe29c53ae85f99f HTTP/1.0" 202 Accepted 2026-03-17 01:40:24,725 - lava_callback - INFO - Starting async job submit for node 69b8ace9fbe29c53ae85f99f 2026-03-17 01:40:24,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:40:24,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ace9fbe29c53ae85f99f HTTP/1.1" 200 None 2026-03-17 01:40:24,798 - lava_callback - DEBUG - Processing node 69b8ace9fbe29c53ae85f99f: ltp-smoke 2026-03-17 01:40:25,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:40:25,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:40:25,419 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8ace9fbe29c53ae85f99f/log.txt.gz 2026-03-17 01:40:25,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:40:25,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:40:25,917 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8ace9fbe29c53ae85f99f/lava-logs.yaml 2026-03-17 01:40:25,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:40:26,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:40:26,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8ace9fbe29c53ae85f99f/lava_callback.json.gz 2026-03-17 01:40:26,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:40:26,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ace9fbe29c53ae85f99f HTTP/1.1" 200 None 2026-03-17 01:40:26,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:40:26,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89dadfbe29c53ae85cceb HTTP/1.1" 200 None 2026-03-17 01:40:26,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:40:26,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ace9fbe29c53ae85f99f HTTP/1.1" 200 None 2026-03-17 01:40:26,417 - lava_callback - INFO - Completed processing callback for node 69b8ace9fbe29c53ae85f99f INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:40:52,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:40:52,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41644 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:41:24,747 - lava_callback - INFO - Received callback for node 69b8a53dfbe29c53ae85f3e1 INFO: 172.21.0.1:53794 - "POST /node/69b8a53dfbe29c53ae85f3e1 HTTP/1.0" 202 Accepted 2026-03-17 01:41:24,753 - lava_callback - INFO - Starting async job submit for node 69b8a53dfbe29c53ae85f3e1 2026-03-17 01:41:24,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:41:24,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a53dfbe29c53ae85f3e1 HTTP/1.1" 200 None 2026-03-17 01:41:24,791 - lava_callback - DEBUG - Processing node 69b8a53dfbe29c53ae85f3e1: baseline-arm-broonie 2026-03-17 01:41:24,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:41:25,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:41:25,130 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b8a53dfbe29c53ae85f3e1/log.txt.gz 2026-03-17 01:41:25,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:41:25,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:41:25,428 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b8a53dfbe29c53ae85f3e1/lava-logs.yaml 2026-03-17 01:41:25,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:41:25,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:41:25,604 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b8a53dfbe29c53ae85f3e1/lava_callback.json.gz 2026-03-17 01:41:25,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:41:25,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a53dfbe29c53ae85f3e1 HTTP/1.1" 200 None 2026-03-17 01:41:25,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:41:25,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:41:25,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:41:25,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a53dfbe29c53ae85f3e1 HTTP/1.1" 200 None 2026-03-17 01:41:25,690 - lava_callback - INFO - Completed processing callback for node 69b8a53dfbe29c53ae85f3e1 INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52744 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:41:52,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:41:52,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52530 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:43:22,700 - lava_callback - INFO - Received callback for node 69b8a566fbe29c53ae85f476 INFO: 172.21.0.1:35322 - "POST /node/69b8a566fbe29c53ae85f476 HTTP/1.0" 202 Accepted 2026-03-17 01:43:22,707 - lava_callback - INFO - Starting async job submit for node 69b8a566fbe29c53ae85f476 2026-03-17 01:43:22,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:43:22,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a566fbe29c53ae85f476 HTTP/1.1" 200 None 2026-03-17 01:43:22,746 - lava_callback - DEBUG - Processing node 69b8a566fbe29c53ae85f476: ltp-cap_bounds 2026-03-17 01:43:23,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:43:23,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:43:23,259 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b8a566fbe29c53ae85f476/log.txt.gz 2026-03-17 01:43:23,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:43:23,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:43:23,703 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b8a566fbe29c53ae85f476/lava-logs.yaml 2026-03-17 01:43:23,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:43:23,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:43:23,897 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b8a566fbe29c53ae85f476/lava_callback.json.gz 2026-03-17 01:43:23,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:43:23,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a566fbe29c53ae85f476 HTTP/1.1" 200 None 2026-03-17 01:43:23,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:43:23,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:43:23,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:43:23,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a566fbe29c53ae85f476 HTTP/1.1" 200 None 2026-03-17 01:43:23,986 - lava_callback - INFO - Completed processing callback for node 69b8a566fbe29c53ae85f476 INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:43:44,281 - lava_callback - INFO - Received callback for node 69b60ecc1727ff69d6f26d55 INFO: 172.21.0.1:38768 - "POST /node/69b60ecc1727ff69d6f26d55 HTTP/1.0" 202 Accepted 2026-03-17 01:43:44,287 - lava_callback - INFO - Starting async job submit for node 69b60ecc1727ff69d6f26d55 2026-03-17 01:43:44,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:43:44,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60ecc1727ff69d6f26d55 HTTP/1.1" 200 None 2026-03-17 01:43:44,303 - lava_callback - DEBUG - Processing node 69b60ecc1727ff69d6f26d55: baseline-arm64-baylibre 2026-03-17 01:43:44,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b60ecc1727ff69d6f26d55 2026-03-17 01:43:44,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:43:44,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60ecc1727ff69d6f26d55 HTTP/1.1" 200 None 2026-03-17 01:43:44,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:43:44,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-17 01:43:44,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:43:44,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b60ecc1727ff69d6f26d55 HTTP/1.1" 200 None 2026-03-17 01:43:44,364 - lava_callback - ERROR - Error processing callback for node 69b60ecc1727ff69d6f26d55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:43:52,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:43:52,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:44:42,337 - lava_callback - INFO - Received callback for node 69b8a552fbe29c53ae85f450 INFO: 172.21.0.1:42646 - "POST /node/69b8a552fbe29c53ae85f450 HTTP/1.0" 202 Accepted 2026-03-17 01:44:42,385 - lava_callback - INFO - Starting async job submit for node 69b8a552fbe29c53ae85f450 2026-03-17 01:44:42,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:44:42,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a552fbe29c53ae85f450 HTTP/1.1" 200 None 2026-03-17 01:44:42,424 - lava_callback - DEBUG - Processing node 69b8a552fbe29c53ae85f450: baseline-arm-pengutronix 2026-03-17 01:44:42,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:44:42,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:44:42,679 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a552fbe29c53ae85f450/log.txt.gz 2026-03-17 01:44:42,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:44:42,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:44:42,921 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a552fbe29c53ae85f450/lava-logs.yaml 2026-03-17 01:44:42,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:44:43,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:44:43,058 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8a552fbe29c53ae85f450/lava_callback.json.gz DEBUG: Setup failed for 69b8a552fbe29c53ae85f450. Transitting job node result: incomplete -> fail 2026-03-17 01:44:43,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:44:43,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a552fbe29c53ae85f450 HTTP/1.1" 200 None 2026-03-17 01:44:43,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:44:43,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:44:43,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:44:43,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a552fbe29c53ae85f450 HTTP/1.1" 200 None 2026-03-17 01:44:43,224 - lava_callback - INFO - Completed processing callback for node 69b8a552fbe29c53ae85f450 INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:44:52,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:44:52,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57050 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:45:24,697 - lava_callback - INFO - Received callback for node 69b8a567fbe29c53ae85f479 INFO: 172.21.0.1:42176 - "POST /node/69b8a567fbe29c53ae85f479 HTTP/1.0" 202 Accepted 2026-03-17 01:45:24,704 - lava_callback - INFO - Starting async job submit for node 69b8a567fbe29c53ae85f479 2026-03-17 01:45:24,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:45:24,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a567fbe29c53ae85f479 HTTP/1.1" 200 None 2026-03-17 01:45:24,744 - lava_callback - DEBUG - Processing node 69b8a567fbe29c53ae85f479: ltp-containers 2026-03-17 01:45:25,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:45:25,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:45:25,271 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69b8a567fbe29c53ae85f479/log.txt.gz 2026-03-17 01:45:25,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:45:25,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:45:25,704 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69b8a567fbe29c53ae85f479/lava-logs.yaml 2026-03-17 01:45:25,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:45:25,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:45:25,869 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69b8a567fbe29c53ae85f479/lava_callback.json.gz 2026-03-17 01:45:25,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:45:25,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a567fbe29c53ae85f479 HTTP/1.1" 200 None 2026-03-17 01:45:25,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:45:25,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:45:25,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:45:25,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a567fbe29c53ae85f479 HTTP/1.1" 200 None 2026-03-17 01:45:25,962 - lava_callback - INFO - Completed processing callback for node 69b8a567fbe29c53ae85f479 INFO: 172.21.0.1:42186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:45:52,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:45:52,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33632 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:46:01,422 - lava_callback - INFO - Received callback for node 69b8a569fbe29c53ae85f47f INFO: 172.21.0.1:38674 - "POST /node/69b8a569fbe29c53ae85f47f HTTP/1.0" 202 Accepted 2026-03-17 01:46:01,428 - lava_callback - INFO - Starting async job submit for node 69b8a569fbe29c53ae85f47f 2026-03-17 01:46:01,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:46:01,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a569fbe29c53ae85f47f HTTP/1.1" 200 None 2026-03-17 01:46:01,468 - lava_callback - DEBUG - Processing node 69b8a569fbe29c53ae85f47f: ltp-controllers 2026-03-17 01:46:01,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:46:02,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:46:02,092 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69b8a569fbe29c53ae85f47f/log.txt.gz 2026-03-17 01:46:02,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:46:02,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:46:02,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69b8a569fbe29c53ae85f47f/lava-logs.yaml 2026-03-17 01:46:02,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:46:02,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:46:02,806 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69b8a569fbe29c53ae85f47f/lava_callback.json.gz 2026-03-17 01:46:02,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:46:02,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a569fbe29c53ae85f47f HTTP/1.1" 200 None 2026-03-17 01:46:02,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:46:02,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:46:02,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:46:02,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a569fbe29c53ae85f47f HTTP/1.1" 200 None 2026-03-17 01:46:02,903 - lava_callback - INFO - Completed processing callback for node 69b8a569fbe29c53ae85f47f INFO: 172.21.0.1:38684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59028 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:46:22,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:46:22,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44822 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:46:44,378 - lava_callback - INFO - Received callback for node 69b60f801727ff69d6f26d5f INFO: 172.21.0.1:56792 - "POST /node/69b60f801727ff69d6f26d5f HTTP/1.0" 202 Accepted 2026-03-17 01:46:44,384 - lava_callback - INFO - Starting async job submit for node 69b60f801727ff69d6f26d5f 2026-03-17 01:46:44,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:46:44,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60f801727ff69d6f26d5f HTTP/1.1" 200 None 2026-03-17 01:46:44,400 - lava_callback - DEBUG - Processing node 69b60f801727ff69d6f26d5f: baseline-arm64-baylibre 2026-03-17 01:46:44,400 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b60f801727ff69d6f26d5f 2026-03-17 01:46:44,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:46:44,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b60f801727ff69d6f26d5f HTTP/1.1" 200 None 2026-03-17 01:46:44,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:46:44,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-17 01:46:44,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:46:44,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b60f801727ff69d6f26d5f HTTP/1.1" 200 None 2026-03-17 01:46:44,452 - lava_callback - ERROR - Error processing callback for node 69b60f801727ff69d6f26d5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57630 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:47:21,395 - lava_callback - INFO - Received callback for node 69b8a56bfbe29c53ae85f48c INFO: 172.21.0.1:47158 - "POST /node/69b8a56bfbe29c53ae85f48c HTTP/1.0" 202 Accepted 2026-03-17 01:47:21,401 - lava_callback - INFO - Starting async job submit for node 69b8a56bfbe29c53ae85f48c 2026-03-17 01:47:21,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:21,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a56bfbe29c53ae85f48c HTTP/1.1" 200 None 2026-03-17 01:47:21,441 - lava_callback - DEBUG - Processing node 69b8a56bfbe29c53ae85f48c: ltp-cve 2026-03-17 01:47:21,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:47:21,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:47:21,991 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69b8a56bfbe29c53ae85f48c/log.txt.gz 2026-03-17 01:47:22,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:47:22,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:47:22,433 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69b8a56bfbe29c53ae85f48c/lava-logs.yaml 2026-03-17 01:47:22,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:47:22,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:47:22,613 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69b8a56bfbe29c53ae85f48c/lava_callback.json.gz 2026-03-17 01:47:22,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:22,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a56bfbe29c53ae85f48c HTTP/1.1" 200 None 2026-03-17 01:47:22,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:22,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:47:22,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:22,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a56bfbe29c53ae85f48c HTTP/1.1" 200 None 2026-03-17 01:47:22,708 - lava_callback - INFO - Completed processing callback for node 69b8a56bfbe29c53ae85f48c 2026-03-17 01:47:23,043 - lava_callback - INFO - Received callback for node 69b8a56ffbe29c53ae85f494 INFO: 172.21.0.1:47164 - "POST /node/69b8a56ffbe29c53ae85f494 HTTP/1.0" 202 Accepted 2026-03-17 01:47:23,052 - lava_callback - INFO - Starting async job submit for node 69b8a56ffbe29c53ae85f494 2026-03-17 01:47:23,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:23,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a56ffbe29c53ae85f494 HTTP/1.1" 200 None 2026-03-17 01:47:23,095 - lava_callback - DEBUG - Processing node 69b8a56ffbe29c53ae85f494: ltp-fs_bind 2026-03-17 01:47:23,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:47:23,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:47:23,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b8a56ffbe29c53ae85f494/log.txt.gz 2026-03-17 01:47:23,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:47:24,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:47:24,050 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b8a56ffbe29c53ae85f494/lava-logs.yaml 2026-03-17 01:47:24,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:47:24,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:47:24,215 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b8a56ffbe29c53ae85f494/lava_callback.json.gz 2026-03-17 01:47:24,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:24,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a56ffbe29c53ae85f494 HTTP/1.1" 200 None 2026-03-17 01:47:24,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:24,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:47:24,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:24,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a56ffbe29c53ae85f494 HTTP/1.1" 200 None 2026-03-17 01:47:24,321 - lava_callback - INFO - Completed processing callback for node 69b8a56ffbe29c53ae85f494 2026-03-17 01:47:24,750 - lava_callback - INFO - Received callback for node 69b8ab2ffbe29c53ae85f7ec INFO: 172.21.0.1:47170 - "POST /node/69b8ab2ffbe29c53ae85f7ec HTTP/1.0" 202 Accepted 2026-03-17 01:47:24,756 - lava_callback - INFO - Starting async job submit for node 69b8ab2ffbe29c53ae85f7ec 2026-03-17 01:47:24,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:24,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab2ffbe29c53ae85f7ec HTTP/1.1" 200 None 2026-03-17 01:47:24,796 - lava_callback - DEBUG - Processing node 69b8ab2ffbe29c53ae85f7ec: baseline-arm64-broonie 2026-03-17 01:47:25,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:47:25,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:47:25,171 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab2ffbe29c53ae85f7ec/log.txt.gz 2026-03-17 01:47:25,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:47:25,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:47:25,467 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab2ffbe29c53ae85f7ec/lava-logs.yaml 2026-03-17 01:47:25,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:47:25,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:47:25,606 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab2ffbe29c53ae85f7ec/lava_callback.json.gz 2026-03-17 01:47:25,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:25,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab2ffbe29c53ae85f7ec HTTP/1.1" 200 None 2026-03-17 01:47:25,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:25,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:47:25,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:25,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab2ffbe29c53ae85f7ec HTTP/1.1" 200 None 2026-03-17 01:47:25,715 - lava_callback - INFO - Completed processing callback for node 69b8ab2ffbe29c53ae85f7ec INFO: 172.21.0.1:47172 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:47:28,314 - lava_callback - INFO - Received callback for node 69b8b1fafbe29c53ae85fa85 INFO: 172.21.0.1:47176 - "POST /node/69b8b1fafbe29c53ae85fa85 HTTP/1.0" 202 Accepted 2026-03-17 01:47:28,326 - lava_callback - INFO - Starting async job submit for node 69b8b1fafbe29c53ae85fa85 2026-03-17 01:47:28,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:28,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b1fafbe29c53ae85fa85 HTTP/1.1" 200 None 2026-03-17 01:47:28,380 - lava_callback - DEBUG - Processing node 69b8b1fafbe29c53ae85fa85: baseline-arm64-foundriesio 2026-03-17 01:47:29,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:47:29,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:47:29,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8b1fafbe29c53ae85fa85/log.txt.gz 2026-03-17 01:47:29,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:47:29,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:47:29,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8b1fafbe29c53ae85fa85/lava-logs.yaml 2026-03-17 01:47:30,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:47:30,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:47:30,180 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8b1fafbe29c53ae85fa85/lava_callback.json.gz DEBUG: 69b8b1fafbe29c53ae85fa85 Transitting job node result: pass -> incomplete 2026-03-17 01:47:30,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:30,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b1fafbe29c53ae85fa85 HTTP/1.1" 200 None 2026-03-17 01:47:30,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:30,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:47:30,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:30,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b1fafbe29c53ae85fa85 HTTP/1.1" 200 None 2026-03-17 01:47:30,294 - lava_callback - INFO - Completed processing callback for node 69b8b1fafbe29c53ae85fa85 INFO: 172.21.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:47:52,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:47:52,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35256 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:49:25,586 - lava_callback - INFO - Received callback for node 69b8a570fbe29c53ae85f497 INFO: 172.21.0.1:34718 - "POST /node/69b8a570fbe29c53ae85f497 HTTP/1.0" 202 Accepted 2026-03-17 01:49:25,593 - lava_callback - INFO - Starting async job submit for node 69b8a570fbe29c53ae85f497 2026-03-17 01:49:25,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:49:25,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a570fbe29c53ae85f497 HTTP/1.1" 200 None 2026-03-17 01:49:25,632 - lava_callback - DEBUG - Processing node 69b8a570fbe29c53ae85f497: ltp-fsx 2026-03-17 01:49:25,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:49:26,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:49:26,152 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69b8a570fbe29c53ae85f497/log.txt.gz 2026-03-17 01:49:26,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:49:26,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:49:26,568 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69b8a570fbe29c53ae85f497/lava-logs.yaml 2026-03-17 01:49:26,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:49:26,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:49:26,738 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69b8a570fbe29c53ae85f497/lava_callback.json.gz 2026-03-17 01:49:26,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:49:26,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a570fbe29c53ae85f497 HTTP/1.1" 200 None 2026-03-17 01:49:26,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:49:26,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:49:26,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:49:26,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a570fbe29c53ae85f497 HTTP/1.1" 200 None 2026-03-17 01:49:26,825 - lava_callback - INFO - Completed processing callback for node 69b8a570fbe29c53ae85f497 INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32782 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:49:44,633 - lava_callback - INFO - Received callback for node 69b610341727ff69d6f26d69 INFO: 172.21.0.1:33218 - "POST /node/69b610341727ff69d6f26d69 HTTP/1.0" 202 Accepted 2026-03-17 01:49:44,639 - lava_callback - INFO - Starting async job submit for node 69b610341727ff69d6f26d69 2026-03-17 01:49:44,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:49:44,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b610341727ff69d6f26d69 HTTP/1.1" 200 None 2026-03-17 01:49:44,656 - lava_callback - DEBUG - Processing node 69b610341727ff69d6f26d69: baseline-arm64-baylibre 2026-03-17 01:49:44,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b610341727ff69d6f26d69 2026-03-17 01:49:44,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:49:44,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b610341727ff69d6f26d69 HTTP/1.1" 200 None 2026-03-17 01:49:44,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:49:44,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-17 01:49:44,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:49:44,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b610341727ff69d6f26d69 HTTP/1.1" 200 None 2026-03-17 01:49:44,723 - lava_callback - ERROR - Error processing callback for node 69b610341727ff69d6f26d69: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:49:52,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:49:52,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:50:37,928 - lava_callback - INFO - Received callback for node 69b8b194fbe29c53ae85fa71 INFO: 172.21.0.1:43240 - "POST /node/69b8b194fbe29c53ae85fa71 HTTP/1.0" 202 Accepted 2026-03-17 01:50:37,935 - lava_callback - INFO - Starting async job submit for node 69b8b194fbe29c53ae85fa71 2026-03-17 01:50:37,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:50:37,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b194fbe29c53ae85fa71 HTTP/1.1" 200 None 2026-03-17 01:50:37,986 - lava_callback - DEBUG - Processing node 69b8b194fbe29c53ae85fa71: baseline-arm64 2026-03-17 01:50:38,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:50:38,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:50:38,537 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b194fbe29c53ae85fa71/log.txt.gz 2026-03-17 01:50:38,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:50:38,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:50:39,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b194fbe29c53ae85fa71/lava-logs.yaml 2026-03-17 01:50:39,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:50:39,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:50:39,175 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b194fbe29c53ae85fa71/lava_callback.json.gz DEBUG: Setup failed for 69b8b194fbe29c53ae85fa71. Transitting job node result: incomplete -> fail 2026-03-17 01:50:39,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:50:39,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b194fbe29c53ae85fa71 HTTP/1.1" 200 None 2026-03-17 01:50:39,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:50:39,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:50:39,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:50:39,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b194fbe29c53ae85fa71 HTTP/1.1" 200 None 2026-03-17 01:50:39,396 - lava_callback - INFO - Completed processing callback for node 69b8b194fbe29c53ae85fa71 2026-03-17 01:50:41,496 - lava_callback - INFO - Received callback for node 69b8a572fbe29c53ae85f49a INFO: 172.21.0.1:54268 - "POST /node/69b8a572fbe29c53ae85f49a HTTP/1.0" 202 Accepted 2026-03-17 01:50:41,503 - lava_callback - INFO - Starting async job submit for node 69b8a572fbe29c53ae85f49a 2026-03-17 01:50:41,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:50:41,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a572fbe29c53ae85f49a HTTP/1.1" 200 None 2026-03-17 01:50:41,543 - lava_callback - DEBUG - Processing node 69b8a572fbe29c53ae85f49a: ltp-input 2026-03-17 01:50:41,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:50:42,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:50:42,083 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69b8a572fbe29c53ae85f49a/log.txt.gz 2026-03-17 01:50:42,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:50:42,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:50:42,505 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69b8a572fbe29c53ae85f49a/lava-logs.yaml 2026-03-17 01:50:42,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:50:42,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:50:42,689 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69b8a572fbe29c53ae85f49a/lava_callback.json.gz 2026-03-17 01:50:42,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:50:42,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a572fbe29c53ae85f49a HTTP/1.1" 200 None 2026-03-17 01:50:42,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:50:42,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:50:42,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:50:42,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a572fbe29c53ae85f49a HTTP/1.1" 200 None 2026-03-17 01:50:42,782 - lava_callback - INFO - Completed processing callback for node 69b8a572fbe29c53ae85f49a INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:50:52,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:50:52,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:51:21,590 - lava_callback - INFO - Received callback for node 69b8a574fbe29c53ae85f49d INFO: 172.21.0.1:35986 - "POST /node/69b8a574fbe29c53ae85f49d HTTP/1.0" 202 Accepted 2026-03-17 01:51:21,597 - lava_callback - INFO - Starting async job submit for node 69b8a574fbe29c53ae85f49d 2026-03-17 01:51:21,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:51:21,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a574fbe29c53ae85f49d HTTP/1.1" 200 None 2026-03-17 01:51:21,643 - lava_callback - DEBUG - Processing node 69b8a574fbe29c53ae85f49d: ltp-ipc 2026-03-17 01:51:22,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:51:22,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:51:22,126 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69b8a574fbe29c53ae85f49d/log.txt.gz 2026-03-17 01:51:22,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:51:22,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:51:22,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69b8a574fbe29c53ae85f49d/lava-logs.yaml 2026-03-17 01:51:22,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:51:22,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:51:22,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69b8a574fbe29c53ae85f49d/lava_callback.json.gz 2026-03-17 01:51:22,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:51:22,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a574fbe29c53ae85f49d HTTP/1.1" 200 None 2026-03-17 01:51:22,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:51:22,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:51:22,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:51:23,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a574fbe29c53ae85f49d HTTP/1.1" 200 None 2026-03-17 01:51:23,036 - lava_callback - INFO - Completed processing callback for node 69b8a574fbe29c53ae85f49d 2026-03-17 01:51:23,250 - lava_callback - INFO - Received callback for node 69b8a576fbe29c53ae85f4a0 INFO: 172.21.0.1:35998 - "POST /node/69b8a576fbe29c53ae85f4a0 HTTP/1.0" 202 Accepted 2026-03-17 01:51:23,257 - lava_callback - INFO - Starting async job submit for node 69b8a576fbe29c53ae85f4a0 2026-03-17 01:51:23,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:51:23,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a576fbe29c53ae85f4a0 HTTP/1.1" 200 None 2026-03-17 01:51:23,306 - lava_callback - DEBUG - Processing node 69b8a576fbe29c53ae85f4a0: ltp-pty 2026-03-17 01:51:23,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:51:23,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:51:23,806 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69b8a576fbe29c53ae85f4a0/log.txt.gz 2026-03-17 01:51:24,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:51:24,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:51:24,228 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69b8a576fbe29c53ae85f4a0/lava-logs.yaml 2026-03-17 01:51:24,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:51:24,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:51:24,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69b8a576fbe29c53ae85f4a0/lava_callback.json.gz 2026-03-17 01:51:24,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:51:24,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a576fbe29c53ae85f4a0 HTTP/1.1" 200 None 2026-03-17 01:51:24,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:51:24,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:51:24,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:51:24,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a576fbe29c53ae85f4a0 HTTP/1.1" 200 None 2026-03-17 01:51:24,492 - lava_callback - INFO - Completed processing callback for node 69b8a576fbe29c53ae85f4a0 2026-03-17 01:51:24,577 - lava_callback - INFO - Received callback for node 69b6109a1727ff69d6f26d71 INFO: 172.21.0.1:36012 - "POST /node/69b6109a1727ff69d6f26d71 HTTP/1.0" 202 Accepted 2026-03-17 01:51:24,586 - lava_callback - INFO - Starting async job submit for node 69b6109a1727ff69d6f26d71 2026-03-17 01:51:24,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:51:24,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6109a1727ff69d6f26d71 HTTP/1.1" 200 None 2026-03-17 01:51:24,604 - lava_callback - DEBUG - Processing node 69b6109a1727ff69d6f26d71: baseline-arm64-baylibre 2026-03-17 01:51:24,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6109a1727ff69d6f26d71 2026-03-17 01:51:24,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:51:24,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6109a1727ff69d6f26d71 HTTP/1.1" 200 None 2026-03-17 01:51:24,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:51:24,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-17 01:51:24,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:51:24,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6109a1727ff69d6f26d71 HTTP/1.1" 200 None 2026-03-17 01:51:24,675 - lava_callback - ERROR - Error processing callback for node 69b6109a1727ff69d6f26d71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:51:52,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:51:52,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46142 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:53:25,002 - lava_callback - INFO - Received callback for node 69b8a578fbe29c53ae85f4a3 INFO: 172.21.0.1:55322 - "POST /node/69b8a578fbe29c53ae85f4a3 HTTP/1.0" 202 Accepted 2026-03-17 01:53:25,008 - lava_callback - INFO - Starting async job submit for node 69b8a578fbe29c53ae85f4a3 2026-03-17 01:53:25,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:53:25,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a578fbe29c53ae85f4a3 HTTP/1.1" 200 None 2026-03-17 01:53:25,048 - lava_callback - DEBUG - Processing node 69b8a578fbe29c53ae85f4a3: ltp-sched 2026-03-17 01:53:25,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:53:25,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:53:25,539 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69b8a578fbe29c53ae85f4a3/log.txt.gz 2026-03-17 01:53:25,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:53:26,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:53:26,005 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69b8a578fbe29c53ae85f4a3/lava-logs.yaml 2026-03-17 01:53:26,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:53:26,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:53:26,193 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69b8a578fbe29c53ae85f4a3/lava_callback.json.gz 2026-03-17 01:53:26,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:53:26,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a578fbe29c53ae85f4a3 HTTP/1.1" 200 None 2026-03-17 01:53:26,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:53:26,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:53:26,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:53:26,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a578fbe29c53ae85f4a3 HTTP/1.1" 200 None 2026-03-17 01:53:26,282 - lava_callback - INFO - Completed processing callback for node 69b8a578fbe29c53ae85f4a3 INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60072 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:53:52,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:53:52,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:55:01,708 - lava_callback - INFO - Received callback for node 69b8a57afbe29c53ae85f4a6 INFO: 172.21.0.1:55078 - "POST /node/69b8a57afbe29c53ae85f4a6 HTTP/1.0" 202 Accepted 2026-03-17 01:55:01,714 - lava_callback - INFO - Starting async job submit for node 69b8a57afbe29c53ae85f4a6 2026-03-17 01:55:01,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:01,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a57afbe29c53ae85f4a6 HTTP/1.1" 200 None 2026-03-17 01:55:01,757 - lava_callback - DEBUG - Processing node 69b8a57afbe29c53ae85f4a6: ltp-smoke 2026-03-17 01:55:02,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:55:02,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:55:02,313 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8a57afbe29c53ae85f4a6/log.txt.gz 2026-03-17 01:55:02,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:55:02,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:55:02,798 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8a57afbe29c53ae85f4a6/lava-logs.yaml 2026-03-17 01:55:02,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:55:02,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:55:02,973 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8a57afbe29c53ae85f4a6/lava_callback.json.gz 2026-03-17 01:55:02,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:03,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a57afbe29c53ae85f4a6 HTTP/1.1" 200 None 2026-03-17 01:55:03,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:03,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:55:03,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:03,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a57afbe29c53ae85f4a6 HTTP/1.1" 200 None 2026-03-17 01:55:03,067 - lava_callback - INFO - Completed processing callback for node 69b8a57afbe29c53ae85f4a6 INFO: 172.21.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:55:22,212 - lava_callback - INFO - Received callback for node 69b8a57efbe29c53ae85f4ac INFO: 172.21.0.1:58294 - "POST /node/69b8a57efbe29c53ae85f4ac HTTP/1.0" 202 Accepted 2026-03-17 01:55:22,218 - lava_callback - INFO - Starting async job submit for node 69b8a57efbe29c53ae85f4ac 2026-03-17 01:55:22,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:22,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a57efbe29c53ae85f4ac HTTP/1.1" 200 None 2026-03-17 01:55:22,259 - lava_callback - DEBUG - Processing node 69b8a57efbe29c53ae85f4ac: ltp-syscalls-ipc 2026-03-17 01:55:22,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:22,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 01:55:22,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:55:22,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:55:22,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b8a57efbe29c53ae85f4ac/log.txt.gz 2026-03-17 01:55:23,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:55:23,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:55:23,200 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b8a57efbe29c53ae85f4ac/lava-logs.yaml 2026-03-17 01:55:23,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:55:23,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:55:23,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b8a57efbe29c53ae85f4ac/lava_callback.json.gz 2026-03-17 01:55:23,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:23,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a57efbe29c53ae85f4ac HTTP/1.1" 200 None 2026-03-17 01:55:23,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:23,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:55:23,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:23,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a57efbe29c53ae85f4ac HTTP/1.1" 200 None 2026-03-17 01:55:23,467 - lava_callback - INFO - Completed processing callback for node 69b8a57efbe29c53ae85f4ac 2026-03-17 01:55:23,863 - lava_callback - INFO - Received callback for node 69b8a580fbe29c53ae85f4af INFO: 172.21.0.1:58300 - "POST /node/69b8a580fbe29c53ae85f4af HTTP/1.0" 202 Accepted 2026-03-17 01:55:23,870 - lava_callback - INFO - Starting async job submit for node 69b8a580fbe29c53ae85f4af 2026-03-17 01:55:23,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:23,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a580fbe29c53ae85f4af HTTP/1.1" 200 None 2026-03-17 01:55:23,912 - lava_callback - DEBUG - Processing node 69b8a580fbe29c53ae85f4af: ltp-timers 2026-03-17 01:55:24,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:55:24,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:55:24,418 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69b8a580fbe29c53ae85f4af/log.txt.gz 2026-03-17 01:55:24,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:55:24,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:55:24,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69b8a580fbe29c53ae85f4af/lava-logs.yaml 2026-03-17 01:55:24,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:55:24,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:55:24,981 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69b8a580fbe29c53ae85f4af/lava_callback.json.gz 2026-03-17 01:55:25,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:25,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a580fbe29c53ae85f4af HTTP/1.1" 200 None 2026-03-17 01:55:25,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:25,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:55:25,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:25,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a580fbe29c53ae85f4af HTTP/1.1" 200 None 2026-03-17 01:55:25,082 - lava_callback - INFO - Completed processing callback for node 69b8a580fbe29c53ae85f4af INFO: 172.21.0.1:58304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:55:52,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:55:52,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:56:04,915 - lava_callback - INFO - Received callback for node 69b6119f1727ff69d6f26d7c INFO: 172.21.0.1:51924 - "POST /node/69b6119f1727ff69d6f26d7c HTTP/1.0" 202 Accepted 2026-03-17 01:56:04,920 - lava_callback - INFO - Starting async job submit for node 69b6119f1727ff69d6f26d7c 2026-03-17 01:56:04,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:56:04,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6119f1727ff69d6f26d7c HTTP/1.1" 200 None 2026-03-17 01:56:04,936 - lava_callback - DEBUG - Processing node 69b6119f1727ff69d6f26d7c: baseline-arm64-baylibre 2026-03-17 01:56:04,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6119f1727ff69d6f26d7c 2026-03-17 01:56:04,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:56:04,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6119f1727ff69d6f26d7c HTTP/1.1" 200 None 2026-03-17 01:56:04,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:56:04,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-17 01:56:04,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:56:04,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6119f1727ff69d6f26d7c HTTP/1.1" 200 None 2026-03-17 01:56:05,003 - lava_callback - ERROR - Error processing callback for node 69b6119f1727ff69d6f26d7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:57:25,052 - lava_callback - INFO - Received callback for node 69b8a582fbe29c53ae85f4cb INFO: 172.21.0.1:57370 - "POST /node/69b8a582fbe29c53ae85f4cb HTTP/1.0" 202 Accepted 2026-03-17 01:57:25,058 - lava_callback - INFO - Starting async job submit for node 69b8a582fbe29c53ae85f4cb 2026-03-17 01:57:25,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:57:25,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a582fbe29c53ae85f4cb HTTP/1.1" 200 None 2026-03-17 01:57:25,108 - lava_callback - DEBUG - Processing node 69b8a582fbe29c53ae85f4cb: ltp-watchqueue 2026-03-17 01:57:25,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:57:25,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:57:25,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b8a582fbe29c53ae85f4cb/log.txt.gz 2026-03-17 01:57:25,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:57:26,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:57:26,073 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b8a582fbe29c53ae85f4cb/lava-logs.yaml 2026-03-17 01:57:26,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:57:26,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:57:26,281 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b8a582fbe29c53ae85f4cb/lava_callback.json.gz 2026-03-17 01:57:26,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:57:26,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8a582fbe29c53ae85f4cb HTTP/1.1" 200 None 2026-03-17 01:57:26,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:57:26,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 01:57:26,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:57:26,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8a582fbe29c53ae85f4cb HTTP/1.1" 200 None 2026-03-17 01:57:26,368 - lava_callback - INFO - Completed processing callback for node 69b8a582fbe29c53ae85f4cb INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:57:44,906 - lava_callback - INFO - Received callback for node 69b612031727ff69d6f26d85 INFO: 172.21.0.1:39420 - "POST /node/69b612031727ff69d6f26d85 HTTP/1.0" 202 Accepted 2026-03-17 01:57:44,912 - lava_callback - INFO - Starting async job submit for node 69b612031727ff69d6f26d85 2026-03-17 01:57:44,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:57:44,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b612031727ff69d6f26d85 HTTP/1.1" 200 None 2026-03-17 01:57:44,948 - lava_callback - DEBUG - Processing node 69b612031727ff69d6f26d85: baseline-arm64-baylibre 2026-03-17 01:57:44,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b612031727ff69d6f26d85 2026-03-17 01:57:44,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:57:44,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b612031727ff69d6f26d85 HTTP/1.1" 200 None 2026-03-17 01:57:44,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:57:44,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-17 01:57:45,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:57:45,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b612031727ff69d6f26d85 HTTP/1.1" 200 None 2026-03-17 01:57:45,036 - lava_callback - ERROR - Error processing callback for node 69b612031727ff69d6f26d85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39436 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:57:52,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:57:52,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET / HTTP/1.0" 200 OK 2026-03-17 01:58:47,192 - lava_callback - INFO - Received callback for node 69b8b547fbe29c53ae85fb57 INFO: 172.21.0.1:41158 - "POST /node/69b8b547fbe29c53ae85fb57 HTTP/1.0" 202 Accepted 2026-03-17 01:58:47,198 - lava_callback - INFO - Starting async job submit for node 69b8b547fbe29c53ae85fb57 2026-03-17 01:58:47,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:58:47,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b547fbe29c53ae85fb57 HTTP/1.1" 200 None 2026-03-17 01:58:47,218 - lava_callback - DEBUG - Processing node 69b8b547fbe29c53ae85fb57: baseline-nfs-arm64 2026-03-17 01:58:47,219 - lava_callback - WARNING - Failed to upload log 2026-03-17 01:58:47,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:58:47,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:58:47,370 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8b547fbe29c53ae85fb57/lava-logs.yaml 2026-03-17 01:58:47,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 01:58:47,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 01:58:47,508 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8b547fbe29c53ae85fb57/lava_callback.json.gz 2026-03-17 01:58:47,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:58:47,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b547fbe29c53ae85fb57 HTTP/1.1" 200 None 2026-03-17 01:58:47,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:58:47,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 01:58:47,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:58:47,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b547fbe29c53ae85fb57 HTTP/1.1" 200 None 2026-03-17 01:58:47,591 - lava_callback - INFO - Completed processing callback for node 69b8b547fbe29c53ae85fb57 2026-03-17 01:58:52,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:58:52,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 01:59:15,936 - lava_callback - INFO - Received callback for node 69b612711727ff69d6f26d92 INFO: 172.21.0.1:41852 - "POST /node/69b612711727ff69d6f26d92 HTTP/1.0" 202 Accepted 2026-03-17 01:59:15,944 - lava_callback - INFO - Starting async job submit for node 69b612711727ff69d6f26d92 2026-03-17 01:59:15,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:59:15,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b612711727ff69d6f26d92 HTTP/1.1" 200 None 2026-03-17 01:59:15,960 - lava_callback - DEBUG - Processing node 69b612711727ff69d6f26d92: baseline-arm64-clabbe 2026-03-17 01:59:15,960 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b612711727ff69d6f26d92 2026-03-17 01:59:15,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:59:15,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b612711727ff69d6f26d92 HTTP/1.1" 200 None 2026-03-17 01:59:15,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:59:15,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-17 01:59:15,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 01:59:16,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b612711727ff69d6f26d92 HTTP/1.1" 200 None 2026-03-17 01:59:16,017 - lava_callback - ERROR - Error processing callback for node 69b612711727ff69d6f26d92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52650 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:00:55,994 - lava_callback - INFO - Received callback for node 69b612c11727ff69d6f26d9c INFO: 172.21.0.1:54774 - "POST /node/69b612c11727ff69d6f26d9c HTTP/1.0" 202 Accepted 2026-03-17 02:00:56,000 - lava_callback - INFO - Starting async job submit for node 69b612c11727ff69d6f26d9c 2026-03-17 02:00:56,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:00:56,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b612c11727ff69d6f26d9c HTTP/1.1" 200 None 2026-03-17 02:00:56,016 - lava_callback - DEBUG - Processing node 69b612c11727ff69d6f26d9c: baseline-arm64-clabbe 2026-03-17 02:00:56,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b612c11727ff69d6f26d9c 2026-03-17 02:00:56,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:00:56,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b612c11727ff69d6f26d9c HTTP/1.1" 200 None 2026-03-17 02:00:56,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:00:56,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-17 02:00:56,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:00:56,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b612c11727ff69d6f26d9c HTTP/1.1" 200 None 2026-03-17 02:00:56,093 - lava_callback - ERROR - Error processing callback for node 69b612c11727ff69d6f26d9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34264 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:01:12,996 - lava_callback - INFO - Received callback for node 69b8b592fbe29c53ae85fb62 INFO: 172.21.0.1:38198 - "POST /node/69b8b592fbe29c53ae85fb62 HTTP/1.0" 202 Accepted 2026-03-17 02:01:13,004 - lava_callback - INFO - Starting async job submit for node 69b8b592fbe29c53ae85fb62 2026-03-17 02:01:13,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:01:13,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b592fbe29c53ae85fb62 HTTP/1.1" 200 None 2026-03-17 02:01:13,056 - lava_callback - DEBUG - Processing node 69b8b592fbe29c53ae85fb62: baseline-arm64 2026-03-17 02:01:13,252 - lava_callback - WARNING - Failed to upload log 2026-03-17 02:01:13,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:01:13,416 - lava_callback - INFO - Received callback for node 69b8b35cfbe29c53ae85fae7 INFO: 172.21.0.1:38212 - "POST /node/69b8b35cfbe29c53ae85fae7 HTTP/1.0" 202 Accepted 2026-03-17 02:01:13,427 - lava_callback - INFO - Starting async job submit for node 69b8b35cfbe29c53ae85fae7 2026-03-17 02:01:13,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:01:13,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b35cfbe29c53ae85fae7 HTTP/1.1" 200 None 2026-03-17 02:01:13,471 - lava_callback - DEBUG - Processing node 69b8b35cfbe29c53ae85fae7: baseline-nfs-arm64 2026-03-17 02:01:13,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:01:13,655 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b592fbe29c53ae85fb62/lava-logs.yaml 2026-03-17 02:01:13,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:01:14,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:01:14,064 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b592fbe29c53ae85fb62/lava_callback.json.gz 2026-03-17 02:01:14,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:01:14,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:01:14,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b592fbe29c53ae85fb62 HTTP/1.1" 200 None 2026-03-17 02:01:14,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:01:14,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:01:14,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:01:14,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b592fbe29c53ae85fb62 HTTP/1.1" 200 None 2026-03-17 02:01:14,219 - lava_callback - INFO - Completed processing callback for node 69b8b592fbe29c53ae85fb62 2026-03-17 02:01:14,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:01:14,311 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8b35cfbe29c53ae85fae7/log.txt.gz 2026-03-17 02:01:14,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:01:14,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:01:14,812 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8b35cfbe29c53ae85fae7/lava-logs.yaml 2026-03-17 02:01:14,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:01:14,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:01:15,001 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8b35cfbe29c53ae85fae7/lava_callback.json.gz 2026-03-17 02:01:15,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:01:15,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b35cfbe29c53ae85fae7 HTTP/1.1" 200 None 2026-03-17 02:01:15,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:01:15,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:01:15,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:01:15,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b35cfbe29c53ae85fae7 HTTP/1.1" 200 None 2026-03-17 02:01:15,156 - lava_callback - INFO - Completed processing callback for node 69b8b35cfbe29c53ae85fae7 INFO: 172.21.0.1:38216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38226 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:01:22,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:01:22,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:02:05,134 - lava_callback - INFO - Received callback for node 69b8b5e5fbe29c53ae85fb6b INFO: 172.21.0.1:52892 - "POST /node/69b8b5e5fbe29c53ae85fb6b HTTP/1.0" 202 Accepted 2026-03-17 02:02:05,141 - lava_callback - INFO - Starting async job submit for node 69b8b5e5fbe29c53ae85fb6b 2026-03-17 02:02:05,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:02:05,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b5e5fbe29c53ae85fb6b HTTP/1.1" 200 None 2026-03-17 02:02:05,191 - lava_callback - DEBUG - Processing node 69b8b5e5fbe29c53ae85fb6b: baseline-arm64 2026-03-17 02:02:05,337 - lava_callback - WARNING - Failed to upload log 2026-03-17 02:02:05,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:02:05,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:02:05,559 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b5e5fbe29c53ae85fb6b/lava-logs.yaml 2026-03-17 02:02:05,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:02:05,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:02:05,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b5e5fbe29c53ae85fb6b/lava_callback.json.gz 2026-03-17 02:02:05,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:02:05,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b5e5fbe29c53ae85fb6b HTTP/1.1" 200 None 2026-03-17 02:02:05,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:02:05,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:02:05,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:02:05,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b5e5fbe29c53ae85fb6b HTTP/1.1" 200 None 2026-03-17 02:02:05,858 - lava_callback - INFO - Completed processing callback for node 69b8b5e5fbe29c53ae85fb6b INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:02:15,034 - lava_callback - INFO - Received callback for node 69b8b3a9fbe29c53ae85fb02 INFO: 172.21.0.1:41780 - "POST /node/69b8b3a9fbe29c53ae85fb02 HTTP/1.0" 202 Accepted 2026-03-17 02:02:15,040 - lava_callback - INFO - Starting async job submit for node 69b8b3a9fbe29c53ae85fb02 2026-03-17 02:02:15,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:02:15,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b3a9fbe29c53ae85fb02 HTTP/1.1" 200 None 2026-03-17 02:02:15,081 - lava_callback - DEBUG - Processing node 69b8b3a9fbe29c53ae85fb02: baseline-arm64 INFO: 172.21.0.1:41790 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 02:02:15,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:02:15,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:02:15,751 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b3a9fbe29c53ae85fb02/log.txt.gz 2026-03-17 02:02:16,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:02:16,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:02:16,232 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b3a9fbe29c53ae85fb02/lava-logs.yaml 2026-03-17 02:02:16,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:02:16,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:02:16,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b3a9fbe29c53ae85fb02/lava_callback.json.gz 2026-03-17 02:02:16,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:02:16,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b3a9fbe29c53ae85fb02 HTTP/1.1" 200 None 2026-03-17 02:02:16,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:02:16,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:02:16,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:41806 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:02:16,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b3a9fbe29c53ae85fb02 HTTP/1.1" 200 None 2026-03-17 02:02:16,579 - lava_callback - INFO - Completed processing callback for node 69b8b3a9fbe29c53ae85fb02 2026-03-17 02:02:22,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:02:22,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:02:36,076 - lava_callback - INFO - Received callback for node 69b613251727ff69d6f26da6 INFO: 172.21.0.1:56978 - "POST /node/69b613251727ff69d6f26da6 HTTP/1.0" 202 Accepted 2026-03-17 02:02:36,082 - lava_callback - INFO - Starting async job submit for node 69b613251727ff69d6f26da6 2026-03-17 02:02:36,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:02:36,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b613251727ff69d6f26da6 HTTP/1.1" 200 None 2026-03-17 02:02:36,099 - lava_callback - DEBUG - Processing node 69b613251727ff69d6f26da6: baseline-arm64-clabbe 2026-03-17 02:02:36,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b613251727ff69d6f26da6 2026-03-17 02:02:36,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:02:36,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b613251727ff69d6f26da6 HTTP/1.1" 200 None 2026-03-17 02:02:36,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:02:36,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-17 02:02:36,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:02:36,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b613251727ff69d6f26da6 HTTP/1.1" 200 None 2026-03-17 02:02:36,181 - lava_callback - ERROR - Error processing callback for node 69b613251727ff69d6f26da6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:03:56,125 - lava_callback - INFO - Received callback for node 69b613891727ff69d6f26dae INFO: 172.21.0.1:34106 - "POST /node/69b613891727ff69d6f26dae HTTP/1.0" 202 Accepted 2026-03-17 02:03:56,130 - lava_callback - INFO - Starting async job submit for node 69b613891727ff69d6f26dae 2026-03-17 02:03:56,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:03:56,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b613891727ff69d6f26dae HTTP/1.1" 200 None 2026-03-17 02:03:56,152 - lava_callback - DEBUG - Processing node 69b613891727ff69d6f26dae: baseline-arm64-clabbe 2026-03-17 02:03:56,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b613891727ff69d6f26dae 2026-03-17 02:03:56,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:03:56,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b613891727ff69d6f26dae HTTP/1.1" 200 None 2026-03-17 02:03:56,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:03:56,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-17 02:03:56,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:03:56,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b613891727ff69d6f26dae HTTP/1.1" 200 None 2026-03-17 02:03:56,213 - lava_callback - ERROR - Error processing callback for node 69b613891727ff69d6f26dae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42116 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 02:06:16,230 - lava_callback - INFO - Received callback for node 69b614021727ff69d6f26db8 INFO: 172.21.0.1:42132 - "POST /node/69b614021727ff69d6f26db8 HTTP/1.0" 202 Accepted 2026-03-17 02:06:16,235 - lava_callback - INFO - Starting async job submit for node 69b614021727ff69d6f26db8 2026-03-17 02:06:16,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:06:16,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b614021727ff69d6f26db8 HTTP/1.1" 200 None 2026-03-17 02:06:16,253 - lava_callback - DEBUG - Processing node 69b614021727ff69d6f26db8: baseline-arm64-clabbe 2026-03-17 02:06:16,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b614021727ff69d6f26db8 2026-03-17 02:06:16,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:06:16,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b614021727ff69d6f26db8 HTTP/1.1" 200 None 2026-03-17 02:06:16,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:06:16,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-17 02:06:16,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:06:16,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b614021727ff69d6f26db8 HTTP/1.1" 200 None 2026-03-17 02:06:16,318 - lava_callback - ERROR - Error processing callback for node 69b614021727ff69d6f26db8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39244 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:06:35,401 - lava_callback - INFO - Received callback for node 69b8b6b0fbe29c53ae85fb93 INFO: 172.21.0.1:47668 - "POST /node/69b8b6b0fbe29c53ae85fb93 HTTP/1.0" 202 Accepted 2026-03-17 02:06:35,408 - lava_callback - INFO - Starting async job submit for node 69b8b6b0fbe29c53ae85fb93 2026-03-17 02:06:35,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:06:35,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b6b0fbe29c53ae85fb93 HTTP/1.1" 200 None 2026-03-17 02:06:35,449 - lava_callback - DEBUG - Processing node 69b8b6b0fbe29c53ae85fb93: baseline-arm64 2026-03-17 02:06:35,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:06:36,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:06:36,088 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b6b0fbe29c53ae85fb93/log.txt.gz 2026-03-17 02:06:36,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:06:36,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:06:36,608 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b6b0fbe29c53ae85fb93/lava-logs.yaml 2026-03-17 02:06:36,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:06:36,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:06:36,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b6b0fbe29c53ae85fb93/lava_callback.json.gz 2026-03-17 02:06:36,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:06:36,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b6b0fbe29c53ae85fb93 HTTP/1.1" 200 None 2026-03-17 02:06:36,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:06:36,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:06:36,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:06:36,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b6b0fbe29c53ae85fb93 HTTP/1.1" 200 None 2026-03-17 02:06:36,991 - lava_callback - INFO - Completed processing callback for node 69b8b6b0fbe29c53ae85fb93 INFO: 172.21.0.1:47700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:06:52,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:06:52,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:09:03,381 - lava_callback - INFO - Received callback for node 69b8b336fbe29c53ae85fad7 INFO: 172.21.0.1:32772 - "POST /node/69b8b336fbe29c53ae85fad7 HTTP/1.0" 202 Accepted 2026-03-17 02:09:03,429 - lava_callback - INFO - Starting async job submit for node 69b8b336fbe29c53ae85fad7 2026-03-17 02:09:03,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:09:03,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b336fbe29c53ae85fad7 HTTP/1.1" 200 None 2026-03-17 02:09:03,468 - lava_callback - DEBUG - Processing node 69b8b336fbe29c53ae85fad7: baseline-arm-pengutronix 2026-03-17 02:09:03,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:09:03,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:09:03,741 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8b336fbe29c53ae85fad7/log.txt.gz 2026-03-17 02:09:03,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:09:03,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:09:03,973 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8b336fbe29c53ae85fad7/lava-logs.yaml 2026-03-17 02:09:03,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:09:04,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:09:04,111 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8b336fbe29c53ae85fad7/lava_callback.json.gz DEBUG: Setup failed for 69b8b336fbe29c53ae85fad7. Transitting job node result: incomplete -> fail 2026-03-17 02:09:04,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:09:04,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b336fbe29c53ae85fad7 HTTP/1.1" 200 None 2026-03-17 02:09:04,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:09:04,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-17 02:09:04,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:09:04,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b336fbe29c53ae85fad7 HTTP/1.1" 200 None 2026-03-17 02:09:04,283 - lava_callback - INFO - Completed processing callback for node 69b8b336fbe29c53ae85fad7 INFO: 172.21.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35796 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:09:22,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:09:22,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:10:56,430 - lava_callback - INFO - Received callback for node 69b6151a1727ff69d6f26dc4 INFO: 172.21.0.1:52904 - "POST /node/69b6151a1727ff69d6f26dc4 HTTP/1.0" 202 Accepted 2026-03-17 02:10:56,436 - lava_callback - INFO - Starting async job submit for node 69b6151a1727ff69d6f26dc4 2026-03-17 02:10:56,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:10:56,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6151a1727ff69d6f26dc4 HTTP/1.1" 200 None 2026-03-17 02:10:56,450 - lava_callback - DEBUG - Processing node 69b6151a1727ff69d6f26dc4: baseline-arm64-clabbe 2026-03-17 02:10:56,451 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6151a1727ff69d6f26dc4 2026-03-17 02:10:56,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:10:56,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6151a1727ff69d6f26dc4 HTTP/1.1" 200 None 2026-03-17 02:10:56,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:10:56,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-17 02:10:56,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:10:56,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6151a1727ff69d6f26dc4 HTTP/1.1" 200 None 2026-03-17 02:10:56,501 - lava_callback - ERROR - Error processing callback for node 69b6151a1727ff69d6f26dc4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:11:07,745 - lava_callback - INFO - Received callback for node 69b8b81dfbe29c53ae85fbcd INFO: 172.21.0.1:44058 - "POST /node/69b8b81dfbe29c53ae85fbcd HTTP/1.0" 202 Accepted 2026-03-17 02:11:07,751 - lava_callback - INFO - Starting async job submit for node 69b8b81dfbe29c53ae85fbcd 2026-03-17 02:11:07,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:11:07,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b81dfbe29c53ae85fbcd HTTP/1.1" 200 None 2026-03-17 02:11:07,799 - lava_callback - DEBUG - Processing node 69b8b81dfbe29c53ae85fbcd: baseline-nfs-arm64 2026-03-17 02:11:07,801 - lava_callback - WARNING - Failed to upload log 2026-03-17 02:11:07,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:11:07,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:11:07,950 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8b81dfbe29c53ae85fbcd/lava-logs.yaml 2026-03-17 02:11:07,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:11:08,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:11:08,089 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8b81dfbe29c53ae85fbcd/lava_callback.json.gz 2026-03-17 02:11:08,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:11:08,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b81dfbe29c53ae85fbcd HTTP/1.1" 200 None 2026-03-17 02:11:08,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:11:08,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:11:08,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:11:08,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b81dfbe29c53ae85fbcd HTTP/1.1" 200 None 2026-03-17 02:11:08,154 - lava_callback - INFO - Completed processing callback for node 69b8b81dfbe29c53ae85fbcd INFO: 172.21.0.1:52506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:11:22,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:11:22,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41944 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:12:13,317 - lava_callback - INFO - Received callback for node 69b8b73dfbe29c53ae85fbb4 INFO: 172.21.0.1:38024 - "POST /node/69b8b73dfbe29c53ae85fbb4 HTTP/1.0" 202 Accepted 2026-03-17 02:12:13,326 - lava_callback - INFO - Starting async job submit for node 69b8b73dfbe29c53ae85fbb4 2026-03-17 02:12:13,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:12:13,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b73dfbe29c53ae85fbb4 HTTP/1.1" 200 None 2026-03-17 02:12:13,387 - lava_callback - DEBUG - Processing node 69b8b73dfbe29c53ae85fbb4: baseline-arm64-foundriesio 2026-03-17 02:12:14,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:12:14,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:12:14,830 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8b73dfbe29c53ae85fbb4/log.txt.gz INFO: 172.21.0.1:38028 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 02:12:15,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:12:15,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:12:15,871 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8b73dfbe29c53ae85fbb4/lava-logs.yaml 2026-03-17 02:12:15,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:12:16,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:12:16,123 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8b73dfbe29c53ae85fbb4/lava_callback.json.gz DEBUG: 69b8b73dfbe29c53ae85fbb4 Transitting job node result: pass -> incomplete 2026-03-17 02:12:16,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:12:16,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b73dfbe29c53ae85fbb4 HTTP/1.1" 200 None 2026-03-17 02:12:16,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:12:16,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:12:16,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:12:16,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b73dfbe29c53ae85fbb4 HTTP/1.1" 200 None 2026-03-17 02:12:16,248 - lava_callback - INFO - Completed processing callback for node 69b8b73dfbe29c53ae85fbb4 INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:12:22,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:12:22,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46094 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:12:57,694 - lava_callback - INFO - Received callback for node 69b8b866fbe29c53ae85fbd9 INFO: 172.21.0.1:46106 - "POST /node/69b8b866fbe29c53ae85fbd9 HTTP/1.0" 202 Accepted 2026-03-17 02:12:57,700 - lava_callback - INFO - Starting async job submit for node 69b8b866fbe29c53ae85fbd9 2026-03-17 02:12:57,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:12:57,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b866fbe29c53ae85fbd9 HTTP/1.1" 200 None 2026-03-17 02:12:57,745 - lava_callback - DEBUG - Processing node 69b8b866fbe29c53ae85fbd9: baseline-arm64 2026-03-17 02:12:57,954 - lava_callback - WARNING - Failed to upload log 2026-03-17 02:12:58,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:12:58,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:12:58,276 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b866fbe29c53ae85fbd9/lava-logs.yaml 2026-03-17 02:12:58,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:12:58,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:12:58,441 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b866fbe29c53ae85fbd9/lava_callback.json.gz 2026-03-17 02:12:58,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:12:58,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b866fbe29c53ae85fbd9 HTTP/1.1" 200 None 2026-03-17 02:12:58,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:12:58,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:12:58,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:12:58,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b866fbe29c53ae85fbd9 HTTP/1.1" 200 None 2026-03-17 02:12:58,585 - lava_callback - INFO - Completed processing callback for node 69b8b866fbe29c53ae85fbd9 INFO: 172.21.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:13:22,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:13:22,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 02:13:25,552 - lava_callback - INFO - Received callback for node 69b8b779fbe29c53ae85fbb9 INFO: 172.21.0.1:46470 - "POST /node/69b8b779fbe29c53ae85fbb9 HTTP/1.0" 202 Accepted 2026-03-17 02:13:25,560 - lava_callback - INFO - Starting async job submit for node 69b8b779fbe29c53ae85fbb9 2026-03-17 02:13:25,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:13:25,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b779fbe29c53ae85fbb9 HTTP/1.1" 200 None 2026-03-17 02:13:25,613 - lava_callback - DEBUG - Processing node 69b8b779fbe29c53ae85fbb9: baseline-arm64 2026-03-17 02:13:25,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:13:26,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:13:26,149 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b779fbe29c53ae85fbb9/log.txt.gz 2026-03-17 02:13:26,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:46482 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:13:26,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:13:26,596 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b779fbe29c53ae85fbb9/lava-logs.yaml 2026-03-17 02:13:26,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:13:26,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:13:26,783 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b779fbe29c53ae85fbb9/lava_callback.json.gz DEBUG: Setup failed for 69b8b779fbe29c53ae85fbb9. Transitting job node result: incomplete -> fail 2026-03-17 02:13:26,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:13:26,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b779fbe29c53ae85fbb9 HTTP/1.1" 200 None 2026-03-17 02:13:26,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:13:26,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:13:26,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:13:26,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b779fbe29c53ae85fbb9 HTTP/1.1" 200 None 2026-03-17 02:13:26,997 - lava_callback - INFO - Completed processing callback for node 69b8b779fbe29c53ae85fbb9 INFO: 172.21.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40628 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:13:52,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:13:52,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:15:24,682 - lava_callback - INFO - Received callback for node 69b8b907fbe29c53ae85fbf8 INFO: 172.21.0.1:33102 - "POST /node/69b8b907fbe29c53ae85fbf8 HTTP/1.0" 202 Accepted 2026-03-17 02:15:24,689 - lava_callback - INFO - Starting async job submit for node 69b8b907fbe29c53ae85fbf8 2026-03-17 02:15:24,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:15:24,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b907fbe29c53ae85fbf8 HTTP/1.1" 200 None 2026-03-17 02:15:24,743 - lava_callback - DEBUG - Processing node 69b8b907fbe29c53ae85fbf8: baseline-arm64 2026-03-17 02:15:24,882 - lava_callback - WARNING - Failed to upload log 2026-03-17 02:15:24,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:15:25,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:15:25,152 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b907fbe29c53ae85fbf8/lava-logs.yaml 2026-03-17 02:15:25,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:15:25,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:15:25,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b907fbe29c53ae85fbf8/lava_callback.json.gz 2026-03-17 02:15:25,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:15:25,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b907fbe29c53ae85fbf8 HTTP/1.1" 200 None 2026-03-17 02:15:25,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:15:25,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:15:25,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:15:25,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b907fbe29c53ae85fbf8 HTTP/1.1" 200 None 2026-03-17 02:15:25,475 - lava_callback - INFO - Completed processing callback for node 69b8b907fbe29c53ae85fbf8 INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:15:52,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:15:52,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37452 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:18:41,423 - lava_callback - INFO - Received callback for node 69b8b9abfbe29c53ae85fc0a INFO: 172.21.0.1:40954 - "POST /node/69b8b9abfbe29c53ae85fc0a HTTP/1.0" 202 Accepted 2026-03-17 02:18:41,430 - lava_callback - INFO - Starting async job submit for node 69b8b9abfbe29c53ae85fc0a 2026-03-17 02:18:41,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:18:41,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b9abfbe29c53ae85fc0a HTTP/1.1" 200 None 2026-03-17 02:18:41,467 - lava_callback - DEBUG - Processing node 69b8b9abfbe29c53ae85fc0a: baseline-arm64 2026-03-17 02:18:41,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:18:42,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:18:42,114 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b9abfbe29c53ae85fc0a/log.txt.gz 2026-03-17 02:18:42,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:18:43,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:18:43,094 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b9abfbe29c53ae85fc0a/lava-logs.yaml 2026-03-17 02:18:43,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:18:43,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:18:43,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b9abfbe29c53ae85fc0a/lava_callback.json.gz 2026-03-17 02:18:43,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:18:43,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b9abfbe29c53ae85fc0a HTTP/1.1" 200 None 2026-03-17 02:18:43,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:18:43,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:18:43,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:18:43,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b9abfbe29c53ae85fc0a HTTP/1.1" 200 None 2026-03-17 02:18:43,418 - lava_callback - INFO - Completed processing callback for node 69b8b9abfbe29c53ae85fc0a INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:18:52,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:18:52,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45584 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:20:17,483 - lava_callback - INFO - Received callback for node 69b8ba14fbe29c53ae85fc1d INFO: 172.21.0.1:45592 - "POST /node/69b8ba14fbe29c53ae85fc1d HTTP/1.0" 202 Accepted 2026-03-17 02:20:17,490 - lava_callback - INFO - Starting async job submit for node 69b8ba14fbe29c53ae85fc1d 2026-03-17 02:20:17,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:20:17,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ba14fbe29c53ae85fc1d HTTP/1.1" 200 None 2026-03-17 02:20:17,534 - lava_callback - DEBUG - Processing node 69b8ba14fbe29c53ae85fc1d: baseline-arm64-foundriesio 2026-03-17 02:20:17,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:20:18,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:20:18,118 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8ba14fbe29c53ae85fc1d/log.txt.gz 2026-03-17 02:20:18,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:20:18,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:20:18,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8ba14fbe29c53ae85fc1d/lava-logs.yaml 2026-03-17 02:20:18,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:20:18,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:20:18,830 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b8ba14fbe29c53ae85fc1d/lava_callback.json.gz 2026-03-17 02:20:18,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:20:18,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ba14fbe29c53ae85fc1d HTTP/1.1" 200 None 2026-03-17 02:20:18,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:20:18,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:20:18,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:20:18,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ba14fbe29c53ae85fc1d HTTP/1.1" 200 None 2026-03-17 02:20:18,940 - lava_callback - INFO - Completed processing callback for node 69b8ba14fbe29c53ae85fc1d 2026-03-17 02:20:22,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:20:22,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:21:20,712 - lava_callback - INFO - Received callback for node 69b8b68afbe29c53ae85fb89 INFO: 172.21.0.1:58956 - "POST /node/69b8b68afbe29c53ae85fb89 HTTP/1.0" 202 Accepted 2026-03-17 02:21:20,718 - lava_callback - INFO - Starting async job submit for node 69b8b68afbe29c53ae85fb89 2026-03-17 02:21:20,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:21:20,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b68afbe29c53ae85fb89 HTTP/1.1" 200 None 2026-03-17 02:21:20,786 - lava_callback - DEBUG - Processing node 69b8b68afbe29c53ae85fb89: baseline-arm 2026-03-17 02:21:21,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:21:21,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:21:21,501 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b8b68afbe29c53ae85fb89/log.txt.gz 2026-03-17 02:21:21,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:21:22,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:21:22,111 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8b68afbe29c53ae85fb89/lava-logs.yaml 2026-03-17 02:21:22,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:21:22,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:21:22,327 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8b68afbe29c53ae85fb89/lava_callback.json.gz DEBUG: Setup failed for 69b8b68afbe29c53ae85fb89. Transitting job node result: incomplete -> fail 2026-03-17 02:21:22,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:21:22,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b68afbe29c53ae85fb89 HTTP/1.1" 200 None 2026-03-17 02:21:22,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:21:22,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 02:21:22,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:21:22,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b68afbe29c53ae85fb89 HTTP/1.1" 200 None 2026-03-17 02:21:22,610 - lava_callback - INFO - Completed processing callback for node 69b8b68afbe29c53ae85fb89 2026-03-17 02:21:22,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:21:22,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:22:48,737 - lava_callback - INFO - Received callback for node 69b8b640fbe29c53ae85fb80 INFO: 172.21.0.1:38042 - "POST /node/69b8b640fbe29c53ae85fb80 HTTP/1.0" 202 Accepted 2026-03-17 02:22:48,746 - lava_callback - INFO - Starting async job submit for node 69b8b640fbe29c53ae85fb80 2026-03-17 02:22:48,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:22:48,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b640fbe29c53ae85fb80 HTTP/1.1" 200 None 2026-03-17 02:22:48,822 - lava_callback - DEBUG - Processing node 69b8b640fbe29c53ae85fb80: baseline-nfs-arm64 2026-03-17 02:22:49,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:22:50,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:22:50,140 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8b640fbe29c53ae85fb80/log.txt.gz 2026-03-17 02:22:50,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:22:51,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:22:51,018 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8b640fbe29c53ae85fb80/lava-logs.yaml 2026-03-17 02:22:51,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:22:51,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:22:51,234 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8b640fbe29c53ae85fb80/lava_callback.json.gz DEBUG: Setup failed for 69b8b640fbe29c53ae85fb80. Transitting job node result: incomplete -> fail 2026-03-17 02:22:51,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:22:51,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b640fbe29c53ae85fb80 HTTP/1.1" 200 None 2026-03-17 02:22:51,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:22:51,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:22:51,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:22:51,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b640fbe29c53ae85fb80 HTTP/1.1" 200 None 2026-03-17 02:22:51,486 - lava_callback - INFO - Completed processing callback for node 69b8b640fbe29c53ae85fb80 2026-03-17 02:22:52,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:22:52,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43412 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:23:26,427 - lava_callback - INFO - Received callback for node 69b8b6fefbe29c53ae85fb9b INFO: 172.21.0.1:50372 - "POST /node/69b8b6fefbe29c53ae85fb9b HTTP/1.0" 202 Accepted 2026-03-17 02:23:26,434 - lava_callback - INFO - Starting async job submit for node 69b8b6fefbe29c53ae85fb9b 2026-03-17 02:23:26,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:23:26,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b6fefbe29c53ae85fb9b HTTP/1.1" 200 None 2026-03-17 02:23:26,509 - lava_callback - DEBUG - Processing node 69b8b6fefbe29c53ae85fb9b: ltp-smoke INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:23:26,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:23:27,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:23:27,097 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8b6fefbe29c53ae85fb9b/log.txt.gz 2026-03-17 02:23:27,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:23:27,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:23:27,586 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8b6fefbe29c53ae85fb9b/lava-logs.yaml 2026-03-17 02:23:27,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:23:27,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:23:27,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8b6fefbe29c53ae85fb9b/lava_callback.json.gz 2026-03-17 02:23:27,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:23:27,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b6fefbe29c53ae85fb9b HTTP/1.1" 200 None 2026-03-17 02:23:27,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:23:27,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89dadfbe29c53ae85cceb HTTP/1.1" 200 None 2026-03-17 02:23:27,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:23:27,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b6fefbe29c53ae85fb9b HTTP/1.1" 200 None 2026-03-17 02:23:28,070 - lava_callback - INFO - Completed processing callback for node 69b8b6fefbe29c53ae85fb9b INFO: 172.21.0.1:34516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36684 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:23:52,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:23:52,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:24:07,554 - lava_callback - INFO - Received callback for node 69b8b8bffbe29c53ae85fbec INFO: 172.21.0.1:46676 - "POST /node/69b8b8bffbe29c53ae85fbec HTTP/1.0" 202 Accepted 2026-03-17 02:24:07,561 - lava_callback - INFO - Starting async job submit for node 69b8b8bffbe29c53ae85fbec 2026-03-17 02:24:07,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:24:07,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b8bffbe29c53ae85fbec HTTP/1.1" 200 None 2026-03-17 02:24:07,606 - lava_callback - DEBUG - Processing node 69b8b8bffbe29c53ae85fbec: baseline-nfs-arm64 2026-03-17 02:24:08,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:24:08,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:24:08,277 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8b8bffbe29c53ae85fbec/log.txt.gz 2026-03-17 02:24:08,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:24:08,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:24:08,780 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8b8bffbe29c53ae85fbec/lava-logs.yaml 2026-03-17 02:24:08,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:24:08,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:24:08,968 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8b8bffbe29c53ae85fbec/lava_callback.json.gz 2026-03-17 02:24:08,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:24:09,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b8bffbe29c53ae85fbec HTTP/1.1" 200 None 2026-03-17 02:24:09,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:24:09,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:24:09,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:24:09,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b8bffbe29c53ae85fbec HTTP/1.1" 200 None 2026-03-17 02:24:09,125 - lava_callback - INFO - Completed processing callback for node 69b8b8bffbe29c53ae85fbec INFO: 172.21.0.1:33038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:24:22,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:24:22,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:26:42,502 - lava_callback - INFO - Received callback for node 69b8b95cfbe29c53ae85fc03 INFO: 172.21.0.1:39394 - "POST /node/69b8b95cfbe29c53ae85fc03 HTTP/1.0" 202 Accepted 2026-03-17 02:26:42,509 - lava_callback - INFO - Starting async job submit for node 69b8b95cfbe29c53ae85fc03 2026-03-17 02:26:42,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:26:42,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b95cfbe29c53ae85fc03 HTTP/1.1" 200 None 2026-03-17 02:26:42,556 - lava_callback - DEBUG - Processing node 69b8b95cfbe29c53ae85fc03: baseline-arm64 2026-03-17 02:26:43,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:26:43,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:26:43,198 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b95cfbe29c53ae85fc03/log.txt.gz 2026-03-17 02:26:43,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:26:43,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:26:43,654 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b95cfbe29c53ae85fc03/lava-logs.yaml 2026-03-17 02:26:43,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:26:43,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:26:43,834 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8b95cfbe29c53ae85fc03/lava_callback.json.gz 2026-03-17 02:26:43,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:26:43,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b95cfbe29c53ae85fc03 HTTP/1.1" 200 None 2026-03-17 02:26:43,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:26:43,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:26:43,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:26:43,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b95cfbe29c53ae85fc03 HTTP/1.1" 200 None 2026-03-17 02:26:44,014 - lava_callback - INFO - Completed processing callback for node 69b8b95cfbe29c53ae85fc03 INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:26:52,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:26:52,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51296 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:27:45,176 - lava_callback - INFO - Received callback for node 69b8ba52fbe29c53ae85fc22 INFO: 172.21.0.1:33980 - "POST /node/69b8ba52fbe29c53ae85fc22 HTTP/1.0" 202 Accepted 2026-03-17 02:27:45,183 - lava_callback - INFO - Starting async job submit for node 69b8ba52fbe29c53ae85fc22 2026-03-17 02:27:45,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:27:45,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ba52fbe29c53ae85fc22 HTTP/1.1" 200 None 2026-03-17 02:27:45,250 - lava_callback - DEBUG - Processing node 69b8ba52fbe29c53ae85fc22: baseline-arm64 2026-03-17 02:27:45,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:27:45,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:27:45,805 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ba52fbe29c53ae85fc22/log.txt.gz 2026-03-17 02:27:46,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:27:46,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:27:46,281 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ba52fbe29c53ae85fc22/lava-logs.yaml 2026-03-17 02:27:46,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:27:46,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:27:46,484 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8ba52fbe29c53ae85fc22/lava_callback.json.gz INFO: 172.21.0.1:33996 - "GET / HTTP/1.0" 200 OK DEBUG: Setup failed for 69b8ba52fbe29c53ae85fc22. Transitting job node result: incomplete -> fail 2026-03-17 02:27:46,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:27:46,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ba52fbe29c53ae85fc22 HTTP/1.1" 200 None 2026-03-17 02:27:46,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:27:46,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:27:46,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:27:46,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ba52fbe29c53ae85fc22 HTTP/1.1" 200 None 2026-03-17 02:27:46,708 - lava_callback - INFO - Completed processing callback for node 69b8ba52fbe29c53ae85fc22 2026-03-17 02:27:52,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:27:52,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52140 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:28:23,451 - lava_callback - INFO - Received callback for node 69b8b70afbe29c53ae85fb9e INFO: 172.21.0.1:54432 - "POST /node/69b8b70afbe29c53ae85fb9e HTTP/1.0" 202 Accepted 2026-03-17 02:28:23,497 - lava_callback - INFO - Starting async job submit for node 69b8b70afbe29c53ae85fb9e 2026-03-17 02:28:23,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:28:23,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b70afbe29c53ae85fb9e HTTP/1.1" 200 None 2026-03-17 02:28:23,538 - lava_callback - DEBUG - Processing node 69b8b70afbe29c53ae85fb9e: baseline-arm-pengutronix 2026-03-17 02:28:23,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:28:23,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:28:23,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8b70afbe29c53ae85fb9e/log.txt.gz 2026-03-17 02:28:23,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:28:23,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:28:23,982 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8b70afbe29c53ae85fb9e/lava-logs.yaml 2026-03-17 02:28:23,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:28:24,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:28:24,121 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8b70afbe29c53ae85fb9e/lava_callback.json.gz DEBUG: Setup failed for 69b8b70afbe29c53ae85fb9e. Transitting job node result: incomplete -> fail 2026-03-17 02:28:24,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:28:24,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8b70afbe29c53ae85fb9e HTTP/1.1" 200 None 2026-03-17 02:28:24,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:28:24,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 02:28:24,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:28:24,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8b70afbe29c53ae85fb9e HTTP/1.1" 200 None 2026-03-17 02:28:24,304 - lava_callback - INFO - Completed processing callback for node 69b8b70afbe29c53ae85fb9e INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42420 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:28:52,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:28:52,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43834 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:38:05,478 - lava_callback - INFO - Received callback for node 69b8baa3fbe29c53ae85fc39 INFO: 172.21.0.1:48218 - "POST /node/69b8baa3fbe29c53ae85fc39 HTTP/1.0" 202 Accepted 2026-03-17 02:38:05,485 - lava_callback - INFO - Starting async job submit for node 69b8baa3fbe29c53ae85fc39 2026-03-17 02:38:05,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:38:05,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8baa3fbe29c53ae85fc39 HTTP/1.1" 200 None 2026-03-17 02:38:05,576 - lava_callback - DEBUG - Processing node 69b8baa3fbe29c53ae85fc39: baseline-arm 2026-03-17 02:38:06,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:38:06,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:38:06,300 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b8baa3fbe29c53ae85fc39/log.txt.gz INFO: 172.21.0.1:48234 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:38:06,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:38:06,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:38:06,918 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8baa3fbe29c53ae85fc39/lava-logs.yaml 2026-03-17 02:38:06,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:38:07,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:38:07,121 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8baa3fbe29c53ae85fc39/lava_callback.json.gz DEBUG: Setup failed for 69b8baa3fbe29c53ae85fc39. Transitting job node result: incomplete -> fail 2026-03-17 02:38:07,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:38:07,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8baa3fbe29c53ae85fc39 HTTP/1.1" 200 None 2026-03-17 02:38:07,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:38:07,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 02:38:07,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:38:07,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8baa3fbe29c53ae85fc39 HTTP/1.1" 200 None 2026-03-17 02:38:07,408 - lava_callback - INFO - Completed processing callback for node 69b8baa3fbe29c53ae85fc39 INFO: 172.21.0.1:44950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:38:22,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:38:22,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-17 02:38:25,816 - lava_callback - INFO - Received callback for node 69b8bb55fbe29c53ae85fc5b INFO: 172.21.0.1:40732 - "POST /node/69b8bb55fbe29c53ae85fc5b HTTP/1.0" 202 Accepted 2026-03-17 02:38:25,823 - lava_callback - INFO - Starting async job submit for node 69b8bb55fbe29c53ae85fc5b 2026-03-17 02:38:25,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:38:25,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8bb55fbe29c53ae85fc5b HTTP/1.1" 200 None 2026-03-17 02:38:25,864 - lava_callback - DEBUG - Processing node 69b8bb55fbe29c53ae85fc5b: baseline-nfs-arm64 2026-03-17 02:38:26,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:38:26,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:38:26,388 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8bb55fbe29c53ae85fc5b/log.txt.gz INFO: 172.21.0.1:40742 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:38:26,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:38:26,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:38:26,796 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8bb55fbe29c53ae85fc5b/lava-logs.yaml 2026-03-17 02:38:26,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:38:26,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:38:26,952 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8bb55fbe29c53ae85fc5b/lava_callback.json.gz 2026-03-17 02:38:26,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:38:26,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8bb55fbe29c53ae85fc5b HTTP/1.1" 200 None 2026-03-17 02:38:26,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:38:27,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:38:27,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:38:27,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8bb55fbe29c53ae85fc5b HTTP/1.1" 200 None 2026-03-17 02:38:27,108 - lava_callback - INFO - Completed processing callback for node 69b8bb55fbe29c53ae85fc5b INFO: 172.21.0.1:44686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56396 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:38:52,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:38:52,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52998 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:39:22,869 - lava_callback - INFO - Received callback for node 69b8bbe8fbe29c53ae85fc65 INFO: 172.21.0.1:33454 - "POST /node/69b8bbe8fbe29c53ae85fc65 HTTP/1.0" 202 Accepted 2026-03-17 02:39:22,875 - lava_callback - INFO - Starting async job submit for node 69b8bbe8fbe29c53ae85fc65 2026-03-17 02:39:22,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:39:22,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8bbe8fbe29c53ae85fc65 HTTP/1.1" 200 None 2026-03-17 02:39:22,939 - lava_callback - DEBUG - Processing node 69b8bbe8fbe29c53ae85fc65: baseline-arm64 2026-03-17 02:39:23,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:39:23,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:39:23,596 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8bbe8fbe29c53ae85fc65/log.txt.gz 2026-03-17 02:39:23,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:39:24,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:39:24,121 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8bbe8fbe29c53ae85fc65/lava-logs.yaml 2026-03-17 02:39:24,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:39:24,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:39:24,288 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8bbe8fbe29c53ae85fc65/lava_callback.json.gz 2026-03-17 02:39:24,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:39:24,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8bbe8fbe29c53ae85fc65 HTTP/1.1" 200 None 2026-03-17 02:39:24,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:39:24,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:39:24,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:39:24,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8bbe8fbe29c53ae85fc65 HTTP/1.1" 200 None 2026-03-17 02:39:24,497 - lava_callback - INFO - Completed processing callback for node 69b8bbe8fbe29c53ae85fc65 INFO: 172.21.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:39:52,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:39:52,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:43:08,559 - lava_callback - INFO - Received callback for node 69b8bb03fbe29c53ae85fc48 INFO: 172.21.0.1:51340 - "POST /node/69b8bb03fbe29c53ae85fc48 HTTP/1.0" 202 Accepted 2026-03-17 02:43:08,567 - lava_callback - INFO - Starting async job submit for node 69b8bb03fbe29c53ae85fc48 2026-03-17 02:43:08,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:43:08,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8bb03fbe29c53ae85fc48 HTTP/1.1" 200 None 2026-03-17 02:43:08,631 - lava_callback - DEBUG - Processing node 69b8bb03fbe29c53ae85fc48: baseline-nfs-arm64 2026-03-17 02:43:09,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:43:09,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:43:09,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8bb03fbe29c53ae85fc48/log.txt.gz 2026-03-17 02:43:10,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:43:10,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:43:10,890 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8bb03fbe29c53ae85fc48/lava-logs.yaml 2026-03-17 02:43:10,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:43:11,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:43:11,109 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8bb03fbe29c53ae85fc48/lava_callback.json.gz DEBUG: Setup failed for 69b8bb03fbe29c53ae85fc48. Transitting job node result: incomplete -> fail 2026-03-17 02:43:11,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:43:11,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8bb03fbe29c53ae85fc48 HTTP/1.1" 200 None 2026-03-17 02:43:11,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:43:11,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 02:43:11,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:43:11,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8bb03fbe29c53ae85fc48 HTTP/1.1" 200 None 2026-03-17 02:43:11,419 - lava_callback - INFO - Completed processing callback for node 69b8bb03fbe29c53ae85fc48 INFO: 172.21.0.1:34122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34136 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:43:22,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:43:22,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36222 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:48:04,056 - lava_callback - INFO - Received callback for node 69b8bc53fbe29c53ae85fc76 INFO: 172.21.0.1:51628 - "POST /node/69b8bc53fbe29c53ae85fc76 HTTP/1.0" 202 Accepted 2026-03-17 02:48:04,105 - lava_callback - INFO - Starting async job submit for node 69b8bc53fbe29c53ae85fc76 2026-03-17 02:48:04,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:48:04,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8bc53fbe29c53ae85fc76 HTTP/1.1" 200 None 2026-03-17 02:48:04,153 - lava_callback - DEBUG - Processing node 69b8bc53fbe29c53ae85fc76: baseline-arm-pengutronix 2026-03-17 02:48:04,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:48:04,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:48:04,411 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8bc53fbe29c53ae85fc76/log.txt.gz 2026-03-17 02:48:04,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:48:04,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:48:04,686 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8bc53fbe29c53ae85fc76/lava-logs.yaml 2026-03-17 02:48:04,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 02:48:04,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 02:48:04,853 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8bc53fbe29c53ae85fc76/lava_callback.json.gz DEBUG: Setup failed for 69b8bc53fbe29c53ae85fc76. Transitting job node result: incomplete -> fail 2026-03-17 02:48:04,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:48:04,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8bc53fbe29c53ae85fc76 HTTP/1.1" 200 None 2026-03-17 02:48:04,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:48:04,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 02:48:04,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:48:04,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8bc53fbe29c53ae85fc76 HTTP/1.1" 200 None 2026-03-17 02:48:05,045 - lava_callback - INFO - Completed processing callback for node 69b8bc53fbe29c53ae85fc76 INFO: 172.21.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55366 - "GET / HTTP/1.0" 200 OK 2026-03-17 02:48:22,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 02:48:23,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET / HTTP/1.0" 200 OK 2026-03-17 03:03:31,015 - lava_callback - INFO - Received callback for node 69b8bfc8fbe29c53ae85fc92 INFO: 172.21.0.1:35512 - "POST /node/69b8bfc8fbe29c53ae85fc92 HTTP/1.0" 202 Accepted 2026-03-17 03:03:31,023 - lava_callback - INFO - Starting async job submit for node 69b8bfc8fbe29c53ae85fc92 2026-03-17 03:03:31,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:03:31,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8bfc8fbe29c53ae85fc92 HTTP/1.1" 200 None 2026-03-17 03:03:31,085 - lava_callback - DEBUG - Processing node 69b8bfc8fbe29c53ae85fc92: baseline-nfs-arm64 2026-03-17 03:03:32,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 03:03:32,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 03:03:32,414 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8bfc8fbe29c53ae85fc92/log.txt.gz 2026-03-17 03:03:33,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 03:03:33,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 03:03:33,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8bfc8fbe29c53ae85fc92/lava-logs.yaml 2026-03-17 03:03:33,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 03:03:33,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 03:03:33,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8bfc8fbe29c53ae85fc92/lava_callback.json.gz DEBUG: Setup failed for 69b8bfc8fbe29c53ae85fc92. Transitting job node result: incomplete -> fail 2026-03-17 03:03:33,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:03:33,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8bfc8fbe29c53ae85fc92 HTTP/1.1" 200 None 2026-03-17 03:03:33,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:03:33,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 03:03:33,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:03:33,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8bfc8fbe29c53ae85fc92 HTTP/1.1" 200 None 2026-03-17 03:03:33,845 - lava_callback - INFO - Completed processing callback for node 69b8bfc8fbe29c53ae85fc92 INFO: 172.21.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43084 - "GET / HTTP/1.0" 200 OK 2026-03-17 03:03:53,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:03:53,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK 2026-03-17 03:07:45,503 - lava_callback - INFO - Received callback for node 69b8c0f1fbe29c53ae85fca2 INFO: 172.21.0.1:51934 - "POST /node/69b8c0f1fbe29c53ae85fca2 HTTP/1.0" 202 Accepted 2026-03-17 03:07:45,549 - lava_callback - INFO - Starting async job submit for node 69b8c0f1fbe29c53ae85fca2 2026-03-17 03:07:45,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:07:45,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8c0f1fbe29c53ae85fca2 HTTP/1.1" 200 None 2026-03-17 03:07:45,594 - lava_callback - DEBUG - Processing node 69b8c0f1fbe29c53ae85fca2: baseline-arm-pengutronix 2026-03-17 03:07:45,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 03:07:45,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 03:07:45,857 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8c0f1fbe29c53ae85fca2/log.txt.gz 2026-03-17 03:07:45,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 03:07:46,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 03:07:46,134 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8c0f1fbe29c53ae85fca2/lava-logs.yaml 2026-03-17 03:07:46,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 03:07:46,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 03:07:46,280 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8c0f1fbe29c53ae85fca2/lava_callback.json.gz DEBUG: Setup failed for 69b8c0f1fbe29c53ae85fca2. Transitting job node result: incomplete -> fail 2026-03-17 03:07:46,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:07:46,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8c0f1fbe29c53ae85fca2 HTTP/1.1" 200 None 2026-03-17 03:07:46,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:07:46,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-17 03:07:46,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:07:46,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8c0f1fbe29c53ae85fca2 HTTP/1.1" 200 None 2026-03-17 03:07:46,435 - lava_callback - INFO - Completed processing callback for node 69b8c0f1fbe29c53ae85fca2 INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK 2026-03-17 03:07:53,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:07:53,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42844 - "GET / HTTP/1.0" 200 OK 2026-03-17 03:52:29,301 - lava_callback - INFO - Received callback for node 69b8ab31fbe29c53ae85f7ef INFO: 172.21.0.1:42852 - "POST /node/69b8ab31fbe29c53ae85f7ef HTTP/1.0" 202 Accepted 2026-03-17 03:52:29,307 - lava_callback - INFO - Starting async job submit for node 69b8ab31fbe29c53ae85f7ef 2026-03-17 03:52:29,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:52:29,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab31fbe29c53ae85f7ef HTTP/1.1" 200 None 2026-03-17 03:52:29,370 - lava_callback - DEBUG - Processing node 69b8ab31fbe29c53ae85f7ef: baseline-arm64-broonie 2026-03-17 03:52:29,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 03:52:29,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 03:52:29,737 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab31fbe29c53ae85f7ef/log.txt.gz 2026-03-17 03:52:29,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 03:52:30,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 03:52:30,099 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab31fbe29c53ae85f7ef/lava-logs.yaml 2026-03-17 03:52:30,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 03:52:30,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 03:52:30,272 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab31fbe29c53ae85f7ef/lava_callback.json.gz 2026-03-17 03:52:30,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:52:30,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab31fbe29c53ae85f7ef HTTP/1.1" 200 None 2026-03-17 03:52:30,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:52:30,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 03:52:30,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:52:30,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab31fbe29c53ae85f7ef HTTP/1.1" 200 None 2026-03-17 03:52:30,354 - lava_callback - INFO - Completed processing callback for node 69b8ab31fbe29c53ae85f7ef INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50150 - "GET / HTTP/1.0" 200 OK 2026-03-17 03:52:53,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:52:53,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41810 - "GET / HTTP/1.0" 200 OK 2026-03-17 03:56:46,143 - lava_callback - INFO - Received callback for node 69b8ab3bfbe29c53ae85f803 INFO: 172.21.0.1:34084 - "POST /node/69b8ab3bfbe29c53ae85f803 HTTP/1.0" 202 Accepted 2026-03-17 03:56:46,149 - lava_callback - INFO - Starting async job submit for node 69b8ab3bfbe29c53ae85f803 2026-03-17 03:56:46,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:56:46,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab3bfbe29c53ae85f803 HTTP/1.1" 200 None 2026-03-17 03:56:46,186 - lava_callback - DEBUG - Processing node 69b8ab3bfbe29c53ae85f803: baseline-arm64-broonie 2026-03-17 03:56:46,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK 2026-03-17 03:56:46,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 03:56:46,633 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab3bfbe29c53ae85f803/log.txt.gz 2026-03-17 03:56:46,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 03:56:46,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 03:56:46,974 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab3bfbe29c53ae85f803/lava-logs.yaml 2026-03-17 03:56:46,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 03:56:47,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 03:56:47,151 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab3bfbe29c53ae85f803/lava_callback.json.gz 2026-03-17 03:56:47,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:56:47,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab3bfbe29c53ae85f803 HTTP/1.1" 200 None 2026-03-17 03:56:47,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:56:47,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 03:56:47,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:56:47,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab3bfbe29c53ae85f803 HTTP/1.1" 200 None 2026-03-17 03:56:47,236 - lava_callback - INFO - Completed processing callback for node 69b8ab3bfbe29c53ae85f803 2026-03-17 03:56:53,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 03:56:53,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57032 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:01:35,089 - lava_callback - INFO - Received callback for node 69b63d1c1727ff69d6f26e35 INFO: 172.21.0.1:49458 - "POST /node/69b63d1c1727ff69d6f26e35 HTTP/1.0" 202 Accepted 2026-03-17 05:01:35,094 - lava_callback - INFO - Starting async job submit for node 69b63d1c1727ff69d6f26e35 2026-03-17 05:01:35,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:01:35,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63d1c1727ff69d6f26e35 HTTP/1.1" 200 None 2026-03-17 05:01:35,111 - lava_callback - DEBUG - Processing node 69b63d1c1727ff69d6f26e35: baseline-arm64-baylibre 2026-03-17 05:01:35,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b63d1c1727ff69d6f26e35 2026-03-17 05:01:35,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:01:35,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63d1c1727ff69d6f26e35 HTTP/1.1" 200 None 2026-03-17 05:01:35,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:01:35,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:01:35,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:01:35,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b63d1c1727ff69d6f26e35 HTTP/1.1" 200 None 2026-03-17 05:01:35,186 - lava_callback - ERROR - Error processing callback for node 69b63d1c1727ff69d6f26e35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:03:35,295 - lava_callback - INFO - Received callback for node 69b63d921727ff69d6f26e44 INFO: 172.21.0.1:58178 - "POST /node/69b63d921727ff69d6f26e44 HTTP/1.0" 202 Accepted 2026-03-17 05:03:35,300 - lava_callback - INFO - Starting async job submit for node 69b63d921727ff69d6f26e44 2026-03-17 05:03:35,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:03:35,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63d921727ff69d6f26e44 HTTP/1.1" 200 None 2026-03-17 05:03:35,318 - lava_callback - DEBUG - Processing node 69b63d921727ff69d6f26e44: baseline-arm64-baylibre 2026-03-17 05:03:35,318 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b63d921727ff69d6f26e44 2026-03-17 05:03:35,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:03:35,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63d921727ff69d6f26e44 HTTP/1.1" 200 None 2026-03-17 05:03:35,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:03:35,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:03:35,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:03:35,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b63d921727ff69d6f26e44 HTTP/1.1" 200 None 2026-03-17 05:03:35,381 - lava_callback - ERROR - Error processing callback for node 69b63d921727ff69d6f26e44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:04:35,075 - lava_callback - INFO - Received callback for node 69b63ddc1727ff69d6f26e4c INFO: 172.21.0.1:53900 - "POST /node/69b63ddc1727ff69d6f26e4c HTTP/1.0" 202 Accepted 2026-03-17 05:04:35,081 - lava_callback - INFO - Starting async job submit for node 69b63ddc1727ff69d6f26e4c 2026-03-17 05:04:35,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:04:35,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63ddc1727ff69d6f26e4c HTTP/1.1" 200 None 2026-03-17 05:04:35,096 - lava_callback - DEBUG - Processing node 69b63ddc1727ff69d6f26e4c: baseline-arm64-baylibre 2026-03-17 05:04:35,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b63ddc1727ff69d6f26e4c 2026-03-17 05:04:35,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:04:35,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63ddc1727ff69d6f26e4c HTTP/1.1" 200 None 2026-03-17 05:04:35,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:04:35,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:04:35,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:04:35,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b63ddc1727ff69d6f26e4c HTTP/1.1" 200 None 2026-03-17 05:04:35,157 - lava_callback - ERROR - Error processing callback for node 69b63ddc1727ff69d6f26e4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44914 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:05:55,160 - lava_callback - INFO - Received callback for node 69b63e291727ff69d6f26e5c INFO: 172.21.0.1:36908 - "POST /node/69b63e291727ff69d6f26e5c HTTP/1.0" 202 Accepted 2026-03-17 05:05:55,165 - lava_callback - INFO - Starting async job submit for node 69b63e291727ff69d6f26e5c 2026-03-17 05:05:55,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:05:55,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63e291727ff69d6f26e5c HTTP/1.1" 200 None 2026-03-17 05:05:55,181 - lava_callback - DEBUG - Processing node 69b63e291727ff69d6f26e5c: baseline-arm64-baylibre 2026-03-17 05:05:55,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b63e291727ff69d6f26e5c 2026-03-17 05:05:55,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:05:55,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63e291727ff69d6f26e5c HTTP/1.1" 200 None 2026-03-17 05:05:55,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:05:55,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:05:55,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:05:55,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b63e291727ff69d6f26e5c HTTP/1.1" 200 None 2026-03-17 05:05:55,314 - lava_callback - ERROR - Error processing callback for node 69b63e291727ff69d6f26e5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-17 05:07:15,398 - lava_callback - INFO - Received callback for node 69b63e731727ff69d6f26e67 INFO: 172.21.0.1:45470 - "POST /node/69b63e731727ff69d6f26e67 HTTP/1.0" 202 Accepted 2026-03-17 05:07:15,404 - lava_callback - INFO - Starting async job submit for node 69b63e731727ff69d6f26e67 2026-03-17 05:07:15,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:07:15,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63e731727ff69d6f26e67 HTTP/1.1" 200 None 2026-03-17 05:07:15,429 - lava_callback - DEBUG - Processing node 69b63e731727ff69d6f26e67: baseline-arm64-baylibre 2026-03-17 05:07:15,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b63e731727ff69d6f26e67 2026-03-17 05:07:15,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:07:15,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63e731727ff69d6f26e67 HTTP/1.1" 200 None 2026-03-17 05:07:15,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:07:15,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:07:15,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:07:15,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b63e731727ff69d6f26e67 HTTP/1.1" 200 None 2026-03-17 05:07:15,500 - lava_callback - ERROR - Error processing callback for node 69b63e731727ff69d6f26e67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37092 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:08:24,119 - lava_callback - INFO - Received callback for node 69b63ec31727ff69d6f26e76 INFO: 172.21.0.1:36464 - "POST /node/69b63ec31727ff69d6f26e76 HTTP/1.0" 202 Accepted 2026-03-17 05:08:24,124 - lava_callback - INFO - Starting async job submit for node 69b63ec31727ff69d6f26e76 2026-03-17 05:08:24,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:08:24,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63ec31727ff69d6f26e76 HTTP/1.1" 200 None 2026-03-17 05:08:24,141 - lava_callback - DEBUG - Processing node 69b63ec31727ff69d6f26e76: baseline-arm64-clabbe 2026-03-17 05:08:24,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b63ec31727ff69d6f26e76 2026-03-17 05:08:24,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:08:24,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63ec31727ff69d6f26e76 HTTP/1.1" 200 None 2026-03-17 05:08:24,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:08:24,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:08:24,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:08:24,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b63ec31727ff69d6f26e76 HTTP/1.1" 200 None 2026-03-17 05:08:24,193 - lava_callback - ERROR - Error processing callback for node 69b63ec31727ff69d6f26e76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:09:43,943 - lava_callback - INFO - Received callback for node 69b63f0f1727ff69d6f26e85 INFO: 172.21.0.1:50508 - "POST /node/69b63f0f1727ff69d6f26e85 HTTP/1.0" 202 Accepted 2026-03-17 05:09:43,948 - lava_callback - INFO - Starting async job submit for node 69b63f0f1727ff69d6f26e85 2026-03-17 05:09:43,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:09:44,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63f0f1727ff69d6f26e85 HTTP/1.1" 200 None 2026-03-17 05:09:44,004 - lava_callback - DEBUG - Processing node 69b63f0f1727ff69d6f26e85: baseline-arm64-clabbe 2026-03-17 05:09:44,004 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b63f0f1727ff69d6f26e85 2026-03-17 05:09:44,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:09:44,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63f0f1727ff69d6f26e85 HTTP/1.1" 200 None 2026-03-17 05:09:44,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:09:44,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:09:44,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:09:44,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b63f0f1727ff69d6f26e85 HTTP/1.1" 200 None 2026-03-17 05:09:44,067 - lava_callback - ERROR - Error processing callback for node 69b63f0f1727ff69d6f26e85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49096 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:11:04,066 - lava_callback - INFO - Received callback for node 69b63f5a1727ff69d6f26e91 INFO: 172.21.0.1:58084 - "POST /node/69b63f5a1727ff69d6f26e91 HTTP/1.0" 202 Accepted 2026-03-17 05:11:04,071 - lava_callback - INFO - Starting async job submit for node 69b63f5a1727ff69d6f26e91 2026-03-17 05:11:04,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:11:04,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63f5a1727ff69d6f26e91 HTTP/1.1" 200 None 2026-03-17 05:11:04,088 - lava_callback - DEBUG - Processing node 69b63f5a1727ff69d6f26e91: baseline-arm64-clabbe 2026-03-17 05:11:04,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b63f5a1727ff69d6f26e91 2026-03-17 05:11:04,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:11:04,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63f5a1727ff69d6f26e91 HTTP/1.1" 200 None 2026-03-17 05:11:04,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:11:04,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:11:04,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:11:04,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b63f5a1727ff69d6f26e91 HTTP/1.1" 200 None 2026-03-17 05:11:04,142 - lava_callback - ERROR - Error processing callback for node 69b63f5a1727ff69d6f26e91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32916 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:12:24,066 - lava_callback - INFO - Received callback for node 69b63fa81727ff69d6f26e9f INFO: 172.21.0.1:48344 - "POST /node/69b63fa81727ff69d6f26e9f HTTP/1.0" 202 Accepted 2026-03-17 05:12:24,072 - lava_callback - INFO - Starting async job submit for node 69b63fa81727ff69d6f26e9f 2026-03-17 05:12:24,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:12:24,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63fa81727ff69d6f26e9f HTTP/1.1" 200 None 2026-03-17 05:12:24,087 - lava_callback - DEBUG - Processing node 69b63fa81727ff69d6f26e9f: baseline-arm64-clabbe 2026-03-17 05:12:24,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b63fa81727ff69d6f26e9f 2026-03-17 05:12:24,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:12:24,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63fa81727ff69d6f26e9f HTTP/1.1" 200 None 2026-03-17 05:12:24,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:12:24,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:12:24,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:12:24,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b63fa81727ff69d6f26e9f HTTP/1.1" 200 None 2026-03-17 05:12:24,160 - lava_callback - ERROR - Error processing callback for node 69b63fa81727ff69d6f26e9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:13:35,616 - lava_callback - INFO - Received callback for node 69b63fee1727ff69d6f26ea7 INFO: 172.21.0.1:42280 - "POST /node/69b63fee1727ff69d6f26ea7 HTTP/1.0" 202 Accepted 2026-03-17 05:13:35,622 - lava_callback - INFO - Starting async job submit for node 69b63fee1727ff69d6f26ea7 2026-03-17 05:13:35,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:13:35,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63fee1727ff69d6f26ea7 HTTP/1.1" 200 None 2026-03-17 05:13:35,638 - lava_callback - DEBUG - Processing node 69b63fee1727ff69d6f26ea7: baseline-arm64-baylibre 2026-03-17 05:13:35,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b63fee1727ff69d6f26ea7 2026-03-17 05:13:35,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:13:35,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b63fee1727ff69d6f26ea7 HTTP/1.1" 200 None 2026-03-17 05:13:35,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:13:35,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:13:35,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:13:35,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b63fee1727ff69d6f26ea7 HTTP/1.1" 200 None 2026-03-17 05:13:35,690 - lava_callback - ERROR - Error processing callback for node 69b63fee1727ff69d6f26ea7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55438 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:14:44,172 - lava_callback - INFO - Received callback for node 69b6403e1727ff69d6f26eb5 INFO: 172.21.0.1:55450 - "POST /node/69b6403e1727ff69d6f26eb5 HTTP/1.0" 202 Accepted 2026-03-17 05:14:44,178 - lava_callback - INFO - Starting async job submit for node 69b6403e1727ff69d6f26eb5 2026-03-17 05:14:44,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:14:44,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6403e1727ff69d6f26eb5 HTTP/1.1" 200 None 2026-03-17 05:14:44,192 - lava_callback - DEBUG - Processing node 69b6403e1727ff69d6f26eb5: baseline-arm64-clabbe 2026-03-17 05:14:44,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6403e1727ff69d6f26eb5 2026-03-17 05:14:44,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:14:44,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6403e1727ff69d6f26eb5 HTTP/1.1" 200 None 2026-03-17 05:14:44,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:14:44,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:14:44,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:14:44,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6403e1727ff69d6f26eb5 HTTP/1.1" 200 None 2026-03-17 05:14:44,264 - lava_callback - ERROR - Error processing callback for node 69b6403e1727ff69d6f26eb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46468 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:16:04,261 - lava_callback - INFO - Received callback for node 69b6408a1727ff69d6f26ebe INFO: 172.21.0.1:49558 - "POST /node/69b6408a1727ff69d6f26ebe HTTP/1.0" 202 Accepted 2026-03-17 05:16:04,266 - lava_callback - INFO - Starting async job submit for node 69b6408a1727ff69d6f26ebe 2026-03-17 05:16:04,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:16:04,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6408a1727ff69d6f26ebe HTTP/1.1" 200 None 2026-03-17 05:16:04,286 - lava_callback - DEBUG - Processing node 69b6408a1727ff69d6f26ebe: baseline-arm64-clabbe 2026-03-17 05:16:04,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6408a1727ff69d6f26ebe 2026-03-17 05:16:04,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:16:04,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6408a1727ff69d6f26ebe HTTP/1.1" 200 None 2026-03-17 05:16:04,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:16:04,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:16:04,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:16:04,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6408a1727ff69d6f26ebe HTTP/1.1" 200 None 2026-03-17 05:16:04,351 - lava_callback - ERROR - Error processing callback for node 69b6408a1727ff69d6f26ebe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60772 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:17:24,266 - lava_callback - INFO - Received callback for node 69b640d41727ff69d6f26ecb INFO: 172.21.0.1:50958 - "POST /node/69b640d41727ff69d6f26ecb HTTP/1.0" 202 Accepted 2026-03-17 05:17:24,272 - lava_callback - INFO - Starting async job submit for node 69b640d41727ff69d6f26ecb 2026-03-17 05:17:24,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:17:24,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b640d41727ff69d6f26ecb HTTP/1.1" 200 None 2026-03-17 05:17:24,313 - lava_callback - DEBUG - Processing node 69b640d41727ff69d6f26ecb: baseline-arm64-clabbe 2026-03-17 05:17:24,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b640d41727ff69d6f26ecb 2026-03-17 05:17:24,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:17:24,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b640d41727ff69d6f26ecb HTTP/1.1" 200 None 2026-03-17 05:17:24,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:17:24,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:17:24,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:17:24,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b640d41727ff69d6f26ecb HTTP/1.1" 200 None 2026-03-17 05:17:24,371 - lava_callback - ERROR - Error processing callback for node 69b640d41727ff69d6f26ecb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38064 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:18:44,352 - lava_callback - INFO - Received callback for node 69b6411f1727ff69d6f26ed3 INFO: 172.21.0.1:38080 - "POST /node/69b6411f1727ff69d6f26ed3 HTTP/1.0" 202 Accepted 2026-03-17 05:18:44,357 - lava_callback - INFO - Starting async job submit for node 69b6411f1727ff69d6f26ed3 2026-03-17 05:18:44,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:18:44,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6411f1727ff69d6f26ed3 HTTP/1.1" 200 None 2026-03-17 05:18:44,373 - lava_callback - DEBUG - Processing node 69b6411f1727ff69d6f26ed3: baseline-arm64-clabbe 2026-03-17 05:18:44,374 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6411f1727ff69d6f26ed3 2026-03-17 05:18:44,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:18:44,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6411f1727ff69d6f26ed3 HTTP/1.1" 200 None 2026-03-17 05:18:44,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:18:44,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:18:44,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:18:44,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6411f1727ff69d6f26ed3 HTTP/1.1" 200 None 2026-03-17 05:18:44,470 - lava_callback - ERROR - Error processing callback for node 69b6411f1727ff69d6f26ed3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55460 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:19:44,366 - lava_callback - INFO - Received callback for node 69b6416a1727ff69d6f26ee1 INFO: 172.21.0.1:55466 - "POST /node/69b6416a1727ff69d6f26ee1 HTTP/1.0" 202 Accepted 2026-03-17 05:19:44,372 - lava_callback - INFO - Starting async job submit for node 69b6416a1727ff69d6f26ee1 2026-03-17 05:19:44,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:19:44,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6416a1727ff69d6f26ee1 HTTP/1.1" 200 None 2026-03-17 05:19:44,388 - lava_callback - DEBUG - Processing node 69b6416a1727ff69d6f26ee1: baseline-arm64-clabbe 2026-03-17 05:19:44,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6416a1727ff69d6f26ee1 2026-03-17 05:19:44,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:19:44,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6416a1727ff69d6f26ee1 HTTP/1.1" 200 None 2026-03-17 05:19:44,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:19:44,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:19:44,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:19:44,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6416a1727ff69d6f26ee1 HTTP/1.1" 200 None 2026-03-17 05:19:44,440 - lava_callback - ERROR - Error processing callback for node 69b6416a1727ff69d6f26ee1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36588 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:21:04,428 - lava_callback - INFO - Received callback for node 69b641b61727ff69d6f26eea INFO: 172.21.0.1:44626 - "POST /node/69b641b61727ff69d6f26eea HTTP/1.0" 202 Accepted 2026-03-17 05:21:04,434 - lava_callback - INFO - Starting async job submit for node 69b641b61727ff69d6f26eea 2026-03-17 05:21:04,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:21:04,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b641b61727ff69d6f26eea HTTP/1.1" 200 None 2026-03-17 05:21:04,449 - lava_callback - DEBUG - Processing node 69b641b61727ff69d6f26eea: baseline-arm64-clabbe 2026-03-17 05:21:04,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b641b61727ff69d6f26eea 2026-03-17 05:21:04,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:21:04,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b641b61727ff69d6f26eea HTTP/1.1" 200 None 2026-03-17 05:21:04,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:21:04,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:21:04,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:21:04,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b641b61727ff69d6f26eea HTTP/1.1" 200 None 2026-03-17 05:21:04,508 - lava_callback - ERROR - Error processing callback for node 69b641b61727ff69d6f26eea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:22:24,458 - lava_callback - INFO - Received callback for node 69b642011727ff69d6f26ef8 INFO: 172.21.0.1:50046 - "POST /node/69b642011727ff69d6f26ef8 HTTP/1.0" 202 Accepted 2026-03-17 05:22:24,463 - lava_callback - INFO - Starting async job submit for node 69b642011727ff69d6f26ef8 2026-03-17 05:22:24,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:22:24,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b642011727ff69d6f26ef8 HTTP/1.1" 200 None 2026-03-17 05:22:24,489 - lava_callback - DEBUG - Processing node 69b642011727ff69d6f26ef8: baseline-arm64-clabbe 2026-03-17 05:22:24,489 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b642011727ff69d6f26ef8 2026-03-17 05:22:24,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:22:24,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b642011727ff69d6f26ef8 HTTP/1.1" 200 None 2026-03-17 05:22:24,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:22:24,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:22:24,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:22:24,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b642011727ff69d6f26ef8 HTTP/1.1" 200 None 2026-03-17 05:22:24,593 - lava_callback - ERROR - Error processing callback for node 69b642011727ff69d6f26ef8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44802 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:23:44,501 - lava_callback - INFO - Received callback for node 69b6424c1727ff69d6f26efe INFO: 172.21.0.1:44818 - "POST /node/69b6424c1727ff69d6f26efe HTTP/1.0" 202 Accepted 2026-03-17 05:23:44,507 - lava_callback - INFO - Starting async job submit for node 69b6424c1727ff69d6f26efe 2026-03-17 05:23:44,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:23:44,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6424c1727ff69d6f26efe HTTP/1.1" 200 None 2026-03-17 05:23:44,523 - lava_callback - DEBUG - Processing node 69b6424c1727ff69d6f26efe: baseline-arm64-clabbe 2026-03-17 05:23:44,523 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6424c1727ff69d6f26efe 2026-03-17 05:23:44,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:23:44,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6424c1727ff69d6f26efe HTTP/1.1" 200 None 2026-03-17 05:23:44,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:23:44,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:23:44,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:23:44,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6424c1727ff69d6f26efe HTTP/1.1" 200 None 2026-03-17 05:23:44,619 - lava_callback - ERROR - Error processing callback for node 69b6424c1727ff69d6f26efe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40870 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:24:44,580 - lava_callback - INFO - Received callback for node 69b642961727ff69d6f26f08 INFO: 172.21.0.1:40872 - "POST /node/69b642961727ff69d6f26f08 HTTP/1.0" 202 Accepted 2026-03-17 05:24:44,585 - lava_callback - INFO - Starting async job submit for node 69b642961727ff69d6f26f08 2026-03-17 05:24:44,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:24:44,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b642961727ff69d6f26f08 HTTP/1.1" 200 None 2026-03-17 05:24:44,601 - lava_callback - DEBUG - Processing node 69b642961727ff69d6f26f08: baseline-arm64-clabbe 2026-03-17 05:24:44,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b642961727ff69d6f26f08 2026-03-17 05:24:44,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:24:44,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b642961727ff69d6f26f08 HTTP/1.1" 200 None 2026-03-17 05:24:44,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:24:44,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:24:44,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:24:44,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b642961727ff69d6f26f08 HTTP/1.1" 200 None 2026-03-17 05:24:44,675 - lava_callback - ERROR - Error processing callback for node 69b642961727ff69d6f26f08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40850 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:26:04,660 - lava_callback - INFO - Received callback for node 69b642e21727ff69d6f26f0e INFO: 172.21.0.1:48930 - "POST /node/69b642e21727ff69d6f26f0e HTTP/1.0" 202 Accepted 2026-03-17 05:26:04,665 - lava_callback - INFO - Starting async job submit for node 69b642e21727ff69d6f26f0e 2026-03-17 05:26:04,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:26:04,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b642e21727ff69d6f26f0e HTTP/1.1" 200 None 2026-03-17 05:26:04,682 - lava_callback - DEBUG - Processing node 69b642e21727ff69d6f26f0e: baseline-arm64-clabbe 2026-03-17 05:26:04,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b642e21727ff69d6f26f0e 2026-03-17 05:26:04,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:26:04,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b642e21727ff69d6f26f0e HTTP/1.1" 200 None 2026-03-17 05:26:04,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:26:04,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:26:04,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:26:04,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b642e21727ff69d6f26f0e HTTP/1.1" 200 None 2026-03-17 05:26:04,767 - lava_callback - ERROR - Error processing callback for node 69b642e21727ff69d6f26f0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41298 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:27:24,678 - lava_callback - INFO - Received callback for node 69b6432d1727ff69d6f26f18 INFO: 172.21.0.1:43320 - "POST /node/69b6432d1727ff69d6f26f18 HTTP/1.0" 202 Accepted 2026-03-17 05:27:24,683 - lava_callback - INFO - Starting async job submit for node 69b6432d1727ff69d6f26f18 2026-03-17 05:27:24,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:27:24,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6432d1727ff69d6f26f18 HTTP/1.1" 200 None 2026-03-17 05:27:24,702 - lava_callback - DEBUG - Processing node 69b6432d1727ff69d6f26f18: baseline-arm64-clabbe 2026-03-17 05:27:24,702 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6432d1727ff69d6f26f18 2026-03-17 05:27:24,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:27:24,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6432d1727ff69d6f26f18 HTTP/1.1" 200 None 2026-03-17 05:27:24,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:27:24,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:27:24,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:27:24,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6432d1727ff69d6f26f18 HTTP/1.1" 200 None 2026-03-17 05:27:24,790 - lava_callback - ERROR - Error processing callback for node 69b6432d1727ff69d6f26f18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48192 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:28:44,789 - lava_callback - INFO - Received callback for node 69b643791727ff69d6f26f1e INFO: 172.21.0.1:48202 - "POST /node/69b643791727ff69d6f26f1e HTTP/1.0" 202 Accepted 2026-03-17 05:28:44,794 - lava_callback - INFO - Starting async job submit for node 69b643791727ff69d6f26f1e 2026-03-17 05:28:44,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:28:44,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b643791727ff69d6f26f1e HTTP/1.1" 200 None 2026-03-17 05:28:44,811 - lava_callback - DEBUG - Processing node 69b643791727ff69d6f26f1e: baseline-arm64-clabbe 2026-03-17 05:28:44,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b643791727ff69d6f26f1e 2026-03-17 05:28:44,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:28:44,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b643791727ff69d6f26f1e HTTP/1.1" 200 None 2026-03-17 05:28:44,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:28:44,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:28:44,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:28:44,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b643791727ff69d6f26f1e HTTP/1.1" 200 None 2026-03-17 05:28:44,882 - lava_callback - ERROR - Error processing callback for node 69b643791727ff69d6f26f1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:29:44,782 - lava_callback - INFO - Received callback for node 69b643c41727ff69d6f26f28 INFO: 172.21.0.1:55342 - "POST /node/69b643c41727ff69d6f26f28 HTTP/1.0" 202 Accepted 2026-03-17 05:29:44,788 - lava_callback - INFO - Starting async job submit for node 69b643c41727ff69d6f26f28 2026-03-17 05:29:44,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:29:44,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b643c41727ff69d6f26f28 HTTP/1.1" 200 None 2026-03-17 05:29:44,804 - lava_callback - DEBUG - Processing node 69b643c41727ff69d6f26f28: baseline-arm64-clabbe 2026-03-17 05:29:44,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b643c41727ff69d6f26f28 2026-03-17 05:29:44,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:29:44,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b643c41727ff69d6f26f28 HTTP/1.1" 200 None 2026-03-17 05:29:44,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:29:44,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:29:44,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:29:44,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b643c41727ff69d6f26f28 HTTP/1.1" 200 None 2026-03-17 05:29:44,865 - lava_callback - ERROR - Error processing callback for node 69b643c41727ff69d6f26f28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:31:04,843 - lava_callback - INFO - Received callback for node 69b6440e1727ff69d6f26f2e INFO: 172.21.0.1:37752 - "POST /node/69b6440e1727ff69d6f26f2e HTTP/1.0" 202 Accepted 2026-03-17 05:31:04,849 - lava_callback - INFO - Starting async job submit for node 69b6440e1727ff69d6f26f2e 2026-03-17 05:31:04,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:31:04,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6440e1727ff69d6f26f2e HTTP/1.1" 200 None 2026-03-17 05:31:04,879 - lava_callback - DEBUG - Processing node 69b6440e1727ff69d6f26f2e: baseline-arm64-clabbe 2026-03-17 05:31:04,879 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6440e1727ff69d6f26f2e 2026-03-17 05:31:04,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:31:04,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6440e1727ff69d6f26f2e HTTP/1.1" 200 None 2026-03-17 05:31:04,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:31:04,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-17 05:31:04,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:31:04,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6440e1727ff69d6f26f2e HTTP/1.1" 200 None 2026-03-17 05:31:04,942 - lava_callback - ERROR - Error processing callback for node 69b6440e1727ff69d6f26f2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39958 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:51:17,763 - lava_callback - INFO - Received callback for node 69b648cf1727ff69d6f26f37 INFO: 172.21.0.1:39968 - "POST /node/69b648cf1727ff69d6f26f37 HTTP/1.0" 202 Accepted 2026-03-17 05:51:17,769 - lava_callback - INFO - Starting async job submit for node 69b648cf1727ff69d6f26f37 2026-03-17 05:51:17,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:51:17,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b648cf1727ff69d6f26f37 HTTP/1.1" 200 None 2026-03-17 05:51:17,785 - lava_callback - DEBUG - Processing node 69b648cf1727ff69d6f26f37: baseline-arm-baylibre 2026-03-17 05:51:17,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b648cf1727ff69d6f26f37 2026-03-17 05:51:17,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:51:17,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b648cf1727ff69d6f26f37 HTTP/1.1" 200 None 2026-03-17 05:51:17,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:51:17,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 05:51:17,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:51:17,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b648cf1727ff69d6f26f37 HTTP/1.1" 200 None 2026-03-17 05:51:17,872 - lava_callback - ERROR - Error processing callback for node 69b648cf1727ff69d6f26f37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:52:17,664 - lava_callback - INFO - Received callback for node 69b6490c1727ff69d6f26f43 INFO: 172.21.0.1:55482 - "POST /node/69b6490c1727ff69d6f26f43 HTTP/1.0" 202 Accepted 2026-03-17 05:52:17,670 - lava_callback - INFO - Starting async job submit for node 69b6490c1727ff69d6f26f43 2026-03-17 05:52:17,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:52:17,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6490c1727ff69d6f26f43 HTTP/1.1" 200 None 2026-03-17 05:52:17,686 - lava_callback - DEBUG - Processing node 69b6490c1727ff69d6f26f43: baseline-arm-baylibre 2026-03-17 05:52:17,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6490c1727ff69d6f26f43 2026-03-17 05:52:17,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:52:17,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6490c1727ff69d6f26f43 HTTP/1.1" 200 None 2026-03-17 05:52:17,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:52:17,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 05:52:17,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:52:17,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6490c1727ff69d6f26f43 HTTP/1.1" 200 None 2026-03-17 05:52:17,738 - lava_callback - ERROR - Error processing callback for node 69b6490c1727ff69d6f26f43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:53:25,934 - lava_callback - INFO - Received callback for node 69b6494a1727ff69d6f26f4f INFO: 172.21.0.1:51402 - "POST /node/69b6494a1727ff69d6f26f4f HTTP/1.0" 202 Accepted 2026-03-17 05:53:25,939 - lava_callback - INFO - Starting async job submit for node 69b6494a1727ff69d6f26f4f 2026-03-17 05:53:25,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:53:25,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6494a1727ff69d6f26f4f HTTP/1.1" 200 None 2026-03-17 05:53:25,967 - lava_callback - DEBUG - Processing node 69b6494a1727ff69d6f26f4f: baseline-arm-clabbe 2026-03-17 05:53:25,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6494a1727ff69d6f26f4f 2026-03-17 05:53:25,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:53:25,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6494a1727ff69d6f26f4f HTTP/1.1" 200 None 2026-03-17 05:53:25,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:53:26,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 05:53:26,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:53:26,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6494a1727ff69d6f26f4f HTTP/1.1" 200 None 2026-03-17 05:53:26,032 - lava_callback - ERROR - Error processing callback for node 69b6494a1727ff69d6f26f4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:54:26,064 - lava_callback - INFO - Received callback for node 69b649871727ff69d6f26f5d INFO: 172.21.0.1:54102 - "POST /node/69b649871727ff69d6f26f5d HTTP/1.0" 202 Accepted 2026-03-17 05:54:26,069 - lava_callback - INFO - Starting async job submit for node 69b649871727ff69d6f26f5d 2026-03-17 05:54:26,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:54:26,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b649871727ff69d6f26f5d HTTP/1.1" 200 None 2026-03-17 05:54:26,107 - lava_callback - DEBUG - Processing node 69b649871727ff69d6f26f5d: baseline-arm-clabbe 2026-03-17 05:54:26,107 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b649871727ff69d6f26f5d 2026-03-17 05:54:26,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:54:26,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b649871727ff69d6f26f5d HTTP/1.1" 200 None 2026-03-17 05:54:26,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:54:26,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 05:54:26,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:54:26,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b649871727ff69d6f26f5d HTTP/1.1" 200 None 2026-03-17 05:54:26,170 - lava_callback - ERROR - Error processing callback for node 69b649871727ff69d6f26f5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:55:05,950 - lava_callback - INFO - Received callback for node 69b649ab1727ff69d6f26f68 INFO: 172.21.0.1:55958 - "POST /node/69b649ab1727ff69d6f26f68 HTTP/1.0" 202 Accepted 2026-03-17 05:55:05,955 - lava_callback - INFO - Starting async job submit for node 69b649ab1727ff69d6f26f68 2026-03-17 05:55:05,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:55:05,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b649ab1727ff69d6f26f68 HTTP/1.1" 200 None 2026-03-17 05:55:05,972 - lava_callback - DEBUG - Processing node 69b649ab1727ff69d6f26f68: baseline-arm-clabbe 2026-03-17 05:55:05,972 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b649ab1727ff69d6f26f68 2026-03-17 05:55:05,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:55:05,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b649ab1727ff69d6f26f68 HTTP/1.1" 200 None 2026-03-17 05:55:05,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:55:06,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 05:55:06,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:55:06,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b649ab1727ff69d6f26f68 HTTP/1.1" 200 None 2026-03-17 05:55:06,026 - lava_callback - ERROR - Error processing callback for node 69b649ab1727ff69d6f26f68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:55:45,944 - lava_callback - INFO - Received callback for node 69b649d01727ff69d6f26f73 INFO: 172.21.0.1:53726 - "POST /node/69b649d01727ff69d6f26f73 HTTP/1.0" 202 Accepted 2026-03-17 05:55:45,950 - lava_callback - INFO - Starting async job submit for node 69b649d01727ff69d6f26f73 2026-03-17 05:55:45,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:55:45,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b649d01727ff69d6f26f73 HTTP/1.1" 200 None 2026-03-17 05:55:45,966 - lava_callback - DEBUG - Processing node 69b649d01727ff69d6f26f73: baseline-arm-clabbe 2026-03-17 05:55:45,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b649d01727ff69d6f26f73 2026-03-17 05:55:45,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:55:45,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b649d01727ff69d6f26f73 HTTP/1.1" 200 None 2026-03-17 05:55:45,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:55:45,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 05:55:46,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:55:46,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b649d01727ff69d6f26f73 HTTP/1.1" 200 None 2026-03-17 05:55:46,022 - lava_callback - ERROR - Error processing callback for node 69b649d01727ff69d6f26f73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41078 - "GET / HTTP/1.0" 200 OK 2026-03-17 05:56:25,995 - lava_callback - INFO - Received callback for node 69b649ff1727ff69d6f26f7f INFO: 172.21.0.1:38320 - "POST /node/69b649ff1727ff69d6f26f7f HTTP/1.0" 202 Accepted 2026-03-17 05:56:26,000 - lava_callback - INFO - Starting async job submit for node 69b649ff1727ff69d6f26f7f 2026-03-17 05:56:26,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:56:26,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b649ff1727ff69d6f26f7f HTTP/1.1" 200 None 2026-03-17 05:56:26,028 - lava_callback - DEBUG - Processing node 69b649ff1727ff69d6f26f7f: baseline-arm-clabbe 2026-03-17 05:56:26,028 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b649ff1727ff69d6f26f7f 2026-03-17 05:56:26,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:56:26,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b649ff1727ff69d6f26f7f HTTP/1.1" 200 None 2026-03-17 05:56:26,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:56:26,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 05:56:26,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 05:56:26,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b649ff1727ff69d6f26f7f HTTP/1.1" 200 None 2026-03-17 05:56:26,088 - lava_callback - ERROR - Error processing callback for node 69b649ff1727ff69d6f26f7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:07:26,529 - lava_callback - INFO - Received callback for node 69b64c951727ff69d6f26f8b INFO: 172.21.0.1:33806 - "POST /node/69b64c951727ff69d6f26f8b HTTP/1.0" 202 Accepted 2026-03-17 06:07:26,535 - lava_callback - INFO - Starting async job submit for node 69b64c951727ff69d6f26f8b 2026-03-17 06:07:26,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:07:26,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64c951727ff69d6f26f8b HTTP/1.1" 200 None 2026-03-17 06:07:26,551 - lava_callback - DEBUG - Processing node 69b64c951727ff69d6f26f8b: baseline-arm-clabbe 2026-03-17 06:07:26,551 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b64c951727ff69d6f26f8b 2026-03-17 06:07:26,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:07:26,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64c951727ff69d6f26f8b HTTP/1.1" 200 None 2026-03-17 06:07:26,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:07:26,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 06:07:26,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:07:26,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b64c951727ff69d6f26f8b HTTP/1.1" 200 None 2026-03-17 06:07:26,609 - lava_callback - ERROR - Error processing callback for node 69b64c951727ff69d6f26f8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:08:06,541 - lava_callback - INFO - Received callback for node 69b64cb91727ff69d6f26f97 INFO: 172.21.0.1:46796 - "POST /node/69b64cb91727ff69d6f26f97 HTTP/1.0" 202 Accepted 2026-03-17 06:08:06,546 - lava_callback - INFO - Starting async job submit for node 69b64cb91727ff69d6f26f97 2026-03-17 06:08:06,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:08:06,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64cb91727ff69d6f26f97 HTTP/1.1" 200 None 2026-03-17 06:08:06,569 - lava_callback - DEBUG - Processing node 69b64cb91727ff69d6f26f97: baseline-arm-clabbe 2026-03-17 06:08:06,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b64cb91727ff69d6f26f97 2026-03-17 06:08:06,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:08:06,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64cb91727ff69d6f26f97 HTTP/1.1" 200 None 2026-03-17 06:08:06,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:08:06,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 06:08:06,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:08:06,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b64cb91727ff69d6f26f97 HTTP/1.1" 200 None 2026-03-17 06:08:06,628 - lava_callback - ERROR - Error processing callback for node 69b64cb91727ff69d6f26f97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45914 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:08:46,572 - lava_callback - INFO - Received callback for node 69b64cde1727ff69d6f26fa4 INFO: 172.21.0.1:45918 - "POST /node/69b64cde1727ff69d6f26fa4 HTTP/1.0" 202 Accepted 2026-03-17 06:08:46,578 - lava_callback - INFO - Starting async job submit for node 69b64cde1727ff69d6f26fa4 2026-03-17 06:08:46,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:08:46,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64cde1727ff69d6f26fa4 HTTP/1.1" 200 None 2026-03-17 06:08:46,595 - lava_callback - DEBUG - Processing node 69b64cde1727ff69d6f26fa4: baseline-arm-clabbe 2026-03-17 06:08:46,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b64cde1727ff69d6f26fa4 2026-03-17 06:08:46,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:08:46,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64cde1727ff69d6f26fa4 HTTP/1.1" 200 None 2026-03-17 06:08:46,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:08:46,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 06:08:46,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:08:46,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b64cde1727ff69d6f26fa4 HTTP/1.1" 200 None 2026-03-17 06:08:46,681 - lava_callback - ERROR - Error processing callback for node 69b64cde1727ff69d6f26fa4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:09:26,666 - lava_callback - INFO - Received callback for node 69b64d031727ff69d6f26fb2 INFO: 172.21.0.1:41624 - "POST /node/69b64d031727ff69d6f26fb2 HTTP/1.0" 202 Accepted 2026-03-17 06:09:26,672 - lava_callback - INFO - Starting async job submit for node 69b64d031727ff69d6f26fb2 2026-03-17 06:09:26,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:09:26,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64d031727ff69d6f26fb2 HTTP/1.1" 200 None 2026-03-17 06:09:26,711 - lava_callback - DEBUG - Processing node 69b64d031727ff69d6f26fb2: baseline-arm-clabbe 2026-03-17 06:09:26,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b64d031727ff69d6f26fb2 2026-03-17 06:09:26,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:09:26,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64d031727ff69d6f26fb2 HTTP/1.1" 200 None 2026-03-17 06:09:26,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:09:26,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 06:09:26,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:09:26,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b64d031727ff69d6f26fb2 HTTP/1.1" 200 None 2026-03-17 06:09:26,775 - lava_callback - ERROR - Error processing callback for node 69b64d031727ff69d6f26fb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37384 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:09:46,573 - lava_callback - INFO - Received callback for node 69b64d271727ff69d6f26fc1 INFO: 172.21.0.1:37386 - "POST /node/69b64d271727ff69d6f26fc1 HTTP/1.0" 202 Accepted 2026-03-17 06:09:46,579 - lava_callback - INFO - Starting async job submit for node 69b64d271727ff69d6f26fc1 2026-03-17 06:09:46,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:09:46,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64d271727ff69d6f26fc1 HTTP/1.1" 200 None 2026-03-17 06:09:46,597 - lava_callback - DEBUG - Processing node 69b64d271727ff69d6f26fc1: baseline-arm-clabbe 2026-03-17 06:09:46,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b64d271727ff69d6f26fc1 2026-03-17 06:09:46,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:09:46,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64d271727ff69d6f26fc1 HTTP/1.1" 200 None 2026-03-17 06:09:46,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:09:46,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 06:09:46,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:09:46,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b64d271727ff69d6f26fc1 HTTP/1.1" 200 None 2026-03-17 06:09:46,650 - lava_callback - ERROR - Error processing callback for node 69b64d271727ff69d6f26fc1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41624 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:10:26,624 - lava_callback - INFO - Received callback for node 69b64d4b1727ff69d6f26fcc INFO: 172.21.0.1:41638 - "POST /node/69b64d4b1727ff69d6f26fcc HTTP/1.0" 202 Accepted 2026-03-17 06:10:26,629 - lava_callback - INFO - Starting async job submit for node 69b64d4b1727ff69d6f26fcc 2026-03-17 06:10:26,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:10:26,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64d4b1727ff69d6f26fcc HTTP/1.1" 200 None 2026-03-17 06:10:26,645 - lava_callback - DEBUG - Processing node 69b64d4b1727ff69d6f26fcc: baseline-arm-clabbe 2026-03-17 06:10:26,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b64d4b1727ff69d6f26fcc 2026-03-17 06:10:26,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:10:26,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64d4b1727ff69d6f26fcc HTTP/1.1" 200 None 2026-03-17 06:10:26,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:10:26,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 06:10:26,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:10:26,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b64d4b1727ff69d6f26fcc HTTP/1.1" 200 None 2026-03-17 06:10:26,726 - lava_callback - ERROR - Error processing callback for node 69b64d4b1727ff69d6f26fcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:11:06,708 - lava_callback - INFO - Received callback for node 69b64d6f1727ff69d6f26fd8 INFO: 172.21.0.1:37770 - "POST /node/69b64d6f1727ff69d6f26fd8 HTTP/1.0" 202 Accepted 2026-03-17 06:11:06,713 - lava_callback - INFO - Starting async job submit for node 69b64d6f1727ff69d6f26fd8 2026-03-17 06:11:06,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:11:06,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64d6f1727ff69d6f26fd8 HTTP/1.1" 200 None 2026-03-17 06:11:06,730 - lava_callback - DEBUG - Processing node 69b64d6f1727ff69d6f26fd8: baseline-arm-clabbe 2026-03-17 06:11:06,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b64d6f1727ff69d6f26fd8 2026-03-17 06:11:06,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:11:06,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64d6f1727ff69d6f26fd8 HTTP/1.1" 200 None 2026-03-17 06:11:06,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:11:06,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 06:11:06,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:11:06,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b64d6f1727ff69d6f26fd8 HTTP/1.1" 200 None 2026-03-17 06:11:06,822 - lava_callback - ERROR - Error processing callback for node 69b64d6f1727ff69d6f26fd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:11:46,638 - lava_callback - INFO - Received callback for node 69b64d931727ff69d6f26fe1 INFO: 172.21.0.1:59900 - "POST /node/69b64d931727ff69d6f26fe1 HTTP/1.0" 202 Accepted 2026-03-17 06:11:46,644 - lava_callback - INFO - Starting async job submit for node 69b64d931727ff69d6f26fe1 2026-03-17 06:11:46,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:11:46,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64d931727ff69d6f26fe1 HTTP/1.1" 200 None 2026-03-17 06:11:46,661 - lava_callback - DEBUG - Processing node 69b64d931727ff69d6f26fe1: baseline-arm-clabbe 2026-03-17 06:11:46,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b64d931727ff69d6f26fe1 2026-03-17 06:11:46,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:11:46,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64d931727ff69d6f26fe1 HTTP/1.1" 200 None 2026-03-17 06:11:46,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:11:46,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 06:11:46,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:11:46,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b64d931727ff69d6f26fe1 HTTP/1.1" 200 None 2026-03-17 06:11:46,758 - lava_callback - ERROR - Error processing callback for node 69b64d931727ff69d6f26fe1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:12:26,671 - lava_callback - INFO - Received callback for node 69b64db71727ff69d6f26fec INFO: 172.21.0.1:48174 - "POST /node/69b64db71727ff69d6f26fec HTTP/1.0" 202 Accepted 2026-03-17 06:12:26,678 - lava_callback - INFO - Starting async job submit for node 69b64db71727ff69d6f26fec 2026-03-17 06:12:26,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:12:26,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64db71727ff69d6f26fec HTTP/1.1" 200 None 2026-03-17 06:12:26,722 - lava_callback - DEBUG - Processing node 69b64db71727ff69d6f26fec: baseline-arm-clabbe 2026-03-17 06:12:26,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b64db71727ff69d6f26fec 2026-03-17 06:12:26,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:12:26,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64db71727ff69d6f26fec HTTP/1.1" 200 None 2026-03-17 06:12:26,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:12:26,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 06:12:26,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:12:26,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b64db71727ff69d6f26fec HTTP/1.1" 200 None 2026-03-17 06:12:26,787 - lava_callback - ERROR - Error processing callback for node 69b64db71727ff69d6f26fec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:12:46,668 - lava_callback - INFO - Received callback for node 69b64ddc1727ff69d6f26ff3 INFO: 172.21.0.1:41710 - "POST /node/69b64ddc1727ff69d6f26ff3 HTTP/1.0" 202 Accepted 2026-03-17 06:12:46,673 - lava_callback - INFO - Starting async job submit for node 69b64ddc1727ff69d6f26ff3 2026-03-17 06:12:46,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:12:46,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64ddc1727ff69d6f26ff3 HTTP/1.1" 200 None 2026-03-17 06:12:46,690 - lava_callback - DEBUG - Processing node 69b64ddc1727ff69d6f26ff3: baseline-arm-clabbe 2026-03-17 06:12:46,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b64ddc1727ff69d6f26ff3 2026-03-17 06:12:46,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:12:46,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b64ddc1727ff69d6f26ff3 HTTP/1.1" 200 None 2026-03-17 06:12:46,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:12:46,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 06:12:46,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:12:46,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b64ddc1727ff69d6f26ff3 HTTP/1.1" 200 None 2026-03-17 06:12:46,766 - lava_callback - ERROR - Error processing callback for node 69b64ddc1727ff69d6f26ff3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46052 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:41:20,782 - lava_callback - INFO - Received callback for node 69b654821727ff69d6f26fff INFO: 172.21.0.1:57150 - "POST /node/69b654821727ff69d6f26fff HTTP/1.0" 202 Accepted 2026-03-17 06:41:20,788 - lava_callback - INFO - Starting async job submit for node 69b654821727ff69d6f26fff 2026-03-17 06:41:20,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:41:20,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b654821727ff69d6f26fff HTTP/1.1" 200 None 2026-03-17 06:41:20,804 - lava_callback - DEBUG - Processing node 69b654821727ff69d6f26fff: baseline-arm-baylibre 2026-03-17 06:41:20,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b654821727ff69d6f26fff 2026-03-17 06:41:20,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:41:20,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b654821727ff69d6f26fff HTTP/1.1" 200 None 2026-03-17 06:41:20,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:41:20,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:41:20,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:41:20,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b654821727ff69d6f26fff HTTP/1.1" 200 None 2026-03-17 06:41:20,889 - lava_callback - ERROR - Error processing callback for node 69b654821727ff69d6f26fff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52892 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:42:00,411 - lava_callback - INFO - Received callback for node 69b654a71727ff69d6f2700a INFO: 172.21.0.1:38924 - "POST /node/69b654a71727ff69d6f2700a HTTP/1.0" 202 Accepted 2026-03-17 06:42:00,417 - lava_callback - INFO - Starting async job submit for node 69b654a71727ff69d6f2700a 2026-03-17 06:42:00,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:42:00,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b654a71727ff69d6f2700a HTTP/1.1" 200 None 2026-03-17 06:42:00,438 - lava_callback - DEBUG - Processing node 69b654a71727ff69d6f2700a: baseline-arm-baylibre 2026-03-17 06:42:00,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b654a71727ff69d6f2700a 2026-03-17 06:42:00,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:42:00,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b654a71727ff69d6f2700a HTTP/1.1" 200 None 2026-03-17 06:42:00,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:42:00,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:42:00,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:42:00,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b654a71727ff69d6f2700a HTTP/1.1" 200 None 2026-03-17 06:42:00,490 - lava_callback - ERROR - Error processing callback for node 69b654a71727ff69d6f2700a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:42:28,037 - lava_callback - INFO - Received callback for node 69b654ce1727ff69d6f27019 INFO: 172.21.0.1:57752 - "POST /node/69b654ce1727ff69d6f27019 HTTP/1.0" 202 Accepted 2026-03-17 06:42:28,043 - lava_callback - INFO - Starting async job submit for node 69b654ce1727ff69d6f27019 2026-03-17 06:42:28,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:42:28,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b654ce1727ff69d6f27019 HTTP/1.1" 200 None 2026-03-17 06:42:28,089 - lava_callback - DEBUG - Processing node 69b654ce1727ff69d6f27019: baseline-arm-clabbe 2026-03-17 06:42:28,090 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b654ce1727ff69d6f27019 2026-03-17 06:42:28,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:42:28,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b654ce1727ff69d6f27019 HTTP/1.1" 200 None 2026-03-17 06:42:28,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:42:28,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:42:28,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:42:28,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b654ce1727ff69d6f27019 HTTP/1.1" 200 None 2026-03-17 06:42:28,154 - lava_callback - ERROR - Error processing callback for node 69b654ce1727ff69d6f27019: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50638 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:43:07,969 - lava_callback - INFO - Received callback for node 69b654f31727ff69d6f27026 INFO: 172.21.0.1:50642 - "POST /node/69b654f31727ff69d6f27026 HTTP/1.0" 202 Accepted 2026-03-17 06:43:07,975 - lava_callback - INFO - Starting async job submit for node 69b654f31727ff69d6f27026 2026-03-17 06:43:07,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:43:07,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b654f31727ff69d6f27026 HTTP/1.1" 200 None 2026-03-17 06:43:07,991 - lava_callback - DEBUG - Processing node 69b654f31727ff69d6f27026: baseline-arm-clabbe 2026-03-17 06:43:07,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b654f31727ff69d6f27026 2026-03-17 06:43:07,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:43:08,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b654f31727ff69d6f27026 HTTP/1.1" 200 None 2026-03-17 06:43:08,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:43:08,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:43:08,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:43:08,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b654f31727ff69d6f27026 HTTP/1.1" 200 None 2026-03-17 06:43:08,046 - lava_callback - ERROR - Error processing callback for node 69b654f31727ff69d6f27026: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43346 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:43:48,060 - lava_callback - INFO - Received callback for node 69b655171727ff69d6f27036 INFO: 172.21.0.1:43352 - "POST /node/69b655171727ff69d6f27036 HTTP/1.0" 202 Accepted 2026-03-17 06:43:48,065 - lava_callback - INFO - Starting async job submit for node 69b655171727ff69d6f27036 2026-03-17 06:43:48,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:43:48,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b655171727ff69d6f27036 HTTP/1.1" 200 None 2026-03-17 06:43:48,105 - lava_callback - DEBUG - Processing node 69b655171727ff69d6f27036: baseline-arm-clabbe 2026-03-17 06:43:48,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b655171727ff69d6f27036 2026-03-17 06:43:48,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:43:48,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b655171727ff69d6f27036 HTTP/1.1" 200 None 2026-03-17 06:43:48,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:43:48,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:43:48,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:43:48,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b655171727ff69d6f27036 HTTP/1.1" 200 None 2026-03-17 06:43:48,172 - lava_callback - ERROR - Error processing callback for node 69b655171727ff69d6f27036: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41412 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:44:28,012 - lava_callback - INFO - Received callback for node 69b6553b1727ff69d6f27044 INFO: 172.21.0.1:41428 - "POST /node/69b6553b1727ff69d6f27044 HTTP/1.0" 202 Accepted 2026-03-17 06:44:28,018 - lava_callback - INFO - Starting async job submit for node 69b6553b1727ff69d6f27044 2026-03-17 06:44:28,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:44:28,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6553b1727ff69d6f27044 HTTP/1.1" 200 None 2026-03-17 06:44:28,034 - lava_callback - DEBUG - Processing node 69b6553b1727ff69d6f27044: baseline-arm-clabbe 2026-03-17 06:44:28,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6553b1727ff69d6f27044 2026-03-17 06:44:28,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:44:28,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6553b1727ff69d6f27044 HTTP/1.1" 200 None 2026-03-17 06:44:28,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:44:28,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:44:28,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:44:28,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6553b1727ff69d6f27044 HTTP/1.1" 200 None 2026-03-17 06:44:28,092 - lava_callback - ERROR - Error processing callback for node 69b6553b1727ff69d6f27044: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:45:08,143 - lava_callback - INFO - Received callback for node 69b655601727ff69d6f27050 INFO: 172.21.0.1:52206 - "POST /node/69b655601727ff69d6f27050 HTTP/1.0" 202 Accepted 2026-03-17 06:45:08,149 - lava_callback - INFO - Starting async job submit for node 69b655601727ff69d6f27050 2026-03-17 06:45:08,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:45:08,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b655601727ff69d6f27050 HTTP/1.1" 200 None 2026-03-17 06:45:08,186 - lava_callback - DEBUG - Processing node 69b655601727ff69d6f27050: baseline-arm-clabbe 2026-03-17 06:45:08,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b655601727ff69d6f27050 2026-03-17 06:45:08,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:45:08,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b655601727ff69d6f27050 HTTP/1.1" 200 None 2026-03-17 06:45:08,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:45:08,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:45:08,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:45:08,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b655601727ff69d6f27050 HTTP/1.1" 200 None 2026-03-17 06:45:08,243 - lava_callback - ERROR - Error processing callback for node 69b655601727ff69d6f27050: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39104 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:45:40,643 - lava_callback - INFO - Received callback for node 69b6557f1727ff69d6f2705b INFO: 172.21.0.1:37808 - "POST /node/69b6557f1727ff69d6f2705b HTTP/1.0" 202 Accepted 2026-03-17 06:45:40,649 - lava_callback - INFO - Starting async job submit for node 69b6557f1727ff69d6f2705b 2026-03-17 06:45:40,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:45:40,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6557f1727ff69d6f2705b HTTP/1.1" 200 None 2026-03-17 06:45:40,678 - lava_callback - DEBUG - Processing node 69b6557f1727ff69d6f2705b: baseline-arm-baylibre 2026-03-17 06:45:40,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6557f1727ff69d6f2705b 2026-03-17 06:45:40,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:45:40,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6557f1727ff69d6f2705b HTTP/1.1" 200 None 2026-03-17 06:45:40,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:45:40,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:45:40,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:45:40,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6557f1727ff69d6f2705b HTTP/1.1" 200 None 2026-03-17 06:45:40,801 - lava_callback - ERROR - Error processing callback for node 69b6557f1727ff69d6f2705b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42462 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:46:08,168 - lava_callback - INFO - Received callback for node 69b655a81727ff69d6f27066 INFO: 172.21.0.1:42474 - "POST /node/69b655a81727ff69d6f27066 HTTP/1.0" 202 Accepted 2026-03-17 06:46:08,173 - lava_callback - INFO - Starting async job submit for node 69b655a81727ff69d6f27066 2026-03-17 06:46:08,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:46:08,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b655a81727ff69d6f27066 HTTP/1.1" 200 None 2026-03-17 06:46:08,202 - lava_callback - DEBUG - Processing node 69b655a81727ff69d6f27066: baseline-arm-clabbe 2026-03-17 06:46:08,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b655a81727ff69d6f27066 2026-03-17 06:46:08,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:46:08,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b655a81727ff69d6f27066 HTTP/1.1" 200 None 2026-03-17 06:46:08,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:46:08,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:46:08,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:46:08,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b655a81727ff69d6f27066 HTTP/1.1" 200 None 2026-03-17 06:46:08,265 - lava_callback - ERROR - Error processing callback for node 69b655a81727ff69d6f27066: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:46:48,190 - lava_callback - INFO - Received callback for node 69b655cd1727ff69d6f27073 INFO: 172.21.0.1:49232 - "POST /node/69b655cd1727ff69d6f27073 HTTP/1.0" 202 Accepted 2026-03-17 06:46:48,195 - lava_callback - INFO - Starting async job submit for node 69b655cd1727ff69d6f27073 2026-03-17 06:46:48,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:46:48,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b655cd1727ff69d6f27073 HTTP/1.1" 200 None 2026-03-17 06:46:48,227 - lava_callback - DEBUG - Processing node 69b655cd1727ff69d6f27073: baseline-arm-clabbe 2026-03-17 06:46:48,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b655cd1727ff69d6f27073 2026-03-17 06:46:48,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:46:48,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b655cd1727ff69d6f27073 HTTP/1.1" 200 None 2026-03-17 06:46:48,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:46:48,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:46:48,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:46:48,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b655cd1727ff69d6f27073 HTTP/1.1" 200 None 2026-03-17 06:46:48,310 - lava_callback - ERROR - Error processing callback for node 69b655cd1727ff69d6f27073: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:47:28,243 - lava_callback - INFO - Received callback for node 69b655f11727ff69d6f2707c INFO: 172.21.0.1:53108 - "POST /node/69b655f11727ff69d6f2707c HTTP/1.0" 202 Accepted 2026-03-17 06:47:28,249 - lava_callback - INFO - Starting async job submit for node 69b655f11727ff69d6f2707c 2026-03-17 06:47:28,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:47:28,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b655f11727ff69d6f2707c HTTP/1.1" 200 None 2026-03-17 06:47:28,275 - lava_callback - DEBUG - Processing node 69b655f11727ff69d6f2707c: baseline-arm-clabbe 2026-03-17 06:47:28,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b655f11727ff69d6f2707c 2026-03-17 06:47:28,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:47:28,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b655f11727ff69d6f2707c HTTP/1.1" 200 None 2026-03-17 06:47:28,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:47:28,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:47:28,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:47:28,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b655f11727ff69d6f2707c HTTP/1.1" 200 None 2026-03-17 06:47:28,340 - lava_callback - ERROR - Error processing callback for node 69b655f11727ff69d6f2707c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57514 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:48:08,239 - lava_callback - INFO - Received callback for node 69b656151727ff69d6f27087 INFO: 172.21.0.1:57524 - "POST /node/69b656151727ff69d6f27087 HTTP/1.0" 202 Accepted 2026-03-17 06:48:08,244 - lava_callback - INFO - Starting async job submit for node 69b656151727ff69d6f27087 2026-03-17 06:48:08,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:48:08,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b656151727ff69d6f27087 HTTP/1.1" 200 None 2026-03-17 06:48:08,260 - lava_callback - DEBUG - Processing node 69b656151727ff69d6f27087: baseline-arm-clabbe 2026-03-17 06:48:08,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b656151727ff69d6f27087 2026-03-17 06:48:08,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:48:08,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b656151727ff69d6f27087 HTTP/1.1" 200 None 2026-03-17 06:48:08,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:48:08,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:48:08,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:48:08,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b656151727ff69d6f27087 HTTP/1.1" 200 None 2026-03-17 06:48:08,316 - lava_callback - ERROR - Error processing callback for node 69b656151727ff69d6f27087: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:48:28,304 - lava_callback - INFO - Received callback for node 69b656391727ff69d6f27095 INFO: 172.21.0.1:55084 - "POST /node/69b656391727ff69d6f27095 HTTP/1.0" 202 Accepted 2026-03-17 06:48:28,310 - lava_callback - INFO - Starting async job submit for node 69b656391727ff69d6f27095 2026-03-17 06:48:28,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:48:28,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b656391727ff69d6f27095 HTTP/1.1" 200 None 2026-03-17 06:48:28,347 - lava_callback - DEBUG - Processing node 69b656391727ff69d6f27095: baseline-arm-clabbe 2026-03-17 06:48:28,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b656391727ff69d6f27095 2026-03-17 06:48:28,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:48:28,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b656391727ff69d6f27095 HTTP/1.1" 200 None 2026-03-17 06:48:28,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:48:28,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:48:28,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:48:28,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b656391727ff69d6f27095 HTTP/1.1" 200 None 2026-03-17 06:48:28,428 - lava_callback - ERROR - Error processing callback for node 69b656391727ff69d6f27095: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:49:08,315 - lava_callback - INFO - Received callback for node 69b6565d1727ff69d6f270a1 INFO: 172.21.0.1:45006 - "POST /node/69b6565d1727ff69d6f270a1 HTTP/1.0" 202 Accepted 2026-03-17 06:49:08,321 - lava_callback - INFO - Starting async job submit for node 69b6565d1727ff69d6f270a1 2026-03-17 06:49:08,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:49:08,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6565d1727ff69d6f270a1 HTTP/1.1" 200 None 2026-03-17 06:49:08,342 - lava_callback - DEBUG - Processing node 69b6565d1727ff69d6f270a1: baseline-arm-clabbe 2026-03-17 06:49:08,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6565d1727ff69d6f270a1 2026-03-17 06:49:08,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:49:08,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6565d1727ff69d6f270a1 HTTP/1.1" 200 None 2026-03-17 06:49:08,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:49:08,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:49:08,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:49:08,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6565d1727ff69d6f270a1 HTTP/1.1" 200 None 2026-03-17 06:49:08,402 - lava_callback - ERROR - Error processing callback for node 69b6565d1727ff69d6f270a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34800 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:49:48,364 - lava_callback - INFO - Received callback for node 69b656811727ff69d6f270b0 INFO: 172.21.0.1:34810 - "POST /node/69b656811727ff69d6f270b0 HTTP/1.0" 202 Accepted 2026-03-17 06:49:48,369 - lava_callback - INFO - Starting async job submit for node 69b656811727ff69d6f270b0 2026-03-17 06:49:48,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:49:48,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b656811727ff69d6f270b0 HTTP/1.1" 200 None 2026-03-17 06:49:48,412 - lava_callback - DEBUG - Processing node 69b656811727ff69d6f270b0: baseline-arm-clabbe 2026-03-17 06:49:48,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b656811727ff69d6f270b0 2026-03-17 06:49:48,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:49:48,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b656811727ff69d6f270b0 HTTP/1.1" 200 None 2026-03-17 06:49:48,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:49:48,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:49:48,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:49:48,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b656811727ff69d6f270b0 HTTP/1.1" 200 None 2026-03-17 06:49:48,491 - lava_callback - ERROR - Error processing callback for node 69b656811727ff69d6f270b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:50:28,375 - lava_callback - INFO - Received callback for node 69b656a41727ff69d6f270bb INFO: 172.21.0.1:55310 - "POST /node/69b656a41727ff69d6f270bb HTTP/1.0" 202 Accepted 2026-03-17 06:50:28,380 - lava_callback - INFO - Starting async job submit for node 69b656a41727ff69d6f270bb 2026-03-17 06:50:28,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:50:28,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b656a41727ff69d6f270bb HTTP/1.1" 200 None 2026-03-17 06:50:28,397 - lava_callback - DEBUG - Processing node 69b656a41727ff69d6f270bb: baseline-arm-clabbe 2026-03-17 06:50:28,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b656a41727ff69d6f270bb 2026-03-17 06:50:28,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:50:28,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b656a41727ff69d6f270bb HTTP/1.1" 200 None 2026-03-17 06:50:28,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:50:28,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:50:28,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:50:28,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b656a41727ff69d6f270bb HTTP/1.1" 200 None 2026-03-17 06:50:28,453 - lava_callback - ERROR - Error processing callback for node 69b656a41727ff69d6f270bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:51:08,415 - lava_callback - INFO - Received callback for node 69b656c81727ff69d6f270c6 INFO: 172.21.0.1:34928 - "POST /node/69b656c81727ff69d6f270c6 HTTP/1.0" 202 Accepted 2026-03-17 06:51:08,421 - lava_callback - INFO - Starting async job submit for node 69b656c81727ff69d6f270c6 2026-03-17 06:51:08,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:51:08,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b656c81727ff69d6f270c6 HTTP/1.1" 200 None 2026-03-17 06:51:08,438 - lava_callback - DEBUG - Processing node 69b656c81727ff69d6f270c6: baseline-arm-clabbe 2026-03-17 06:51:08,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b656c81727ff69d6f270c6 2026-03-17 06:51:08,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:51:08,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b656c81727ff69d6f270c6 HTTP/1.1" 200 None 2026-03-17 06:51:08,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:51:08,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:51:08,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:51:08,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b656c81727ff69d6f270c6 HTTP/1.1" 200 None 2026-03-17 06:51:08,502 - lava_callback - ERROR - Error processing callback for node 69b656c81727ff69d6f270c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48236 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:51:41,267 - lava_callback - INFO - Received callback for node 69b656e71727ff69d6f270d4 INFO: 172.21.0.1:53346 - "POST /node/69b656e71727ff69d6f270d4 HTTP/1.0" 202 Accepted 2026-03-17 06:51:41,272 - lava_callback - INFO - Starting async job submit for node 69b656e71727ff69d6f270d4 2026-03-17 06:51:41,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:51:41,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b656e71727ff69d6f270d4 HTTP/1.1" 200 None 2026-03-17 06:51:41,290 - lava_callback - DEBUG - Processing node 69b656e71727ff69d6f270d4: baseline-arm-baylibre 2026-03-17 06:51:41,290 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b656e71727ff69d6f270d4 2026-03-17 06:51:41,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:51:41,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b656e71727ff69d6f270d4 HTTP/1.1" 200 None 2026-03-17 06:51:41,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:51:41,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 06:51:41,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:51:41,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b656e71727ff69d6f270d4 HTTP/1.1" 200 None 2026-03-17 06:51:41,367 - lava_callback - ERROR - Error processing callback for node 69b656e71727ff69d6f270d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41888 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:52:08,459 - lava_callback - INFO - Received callback for node 69b6570f1727ff69d6f270e1 INFO: 172.21.0.1:41904 - "POST /node/69b6570f1727ff69d6f270e1 HTTP/1.0" 202 Accepted 2026-03-17 06:52:08,465 - lava_callback - INFO - Starting async job submit for node 69b6570f1727ff69d6f270e1 2026-03-17 06:52:08,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:52:08,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6570f1727ff69d6f270e1 HTTP/1.1" 200 None 2026-03-17 06:52:08,481 - lava_callback - DEBUG - Processing node 69b6570f1727ff69d6f270e1: baseline-arm-clabbe 2026-03-17 06:52:08,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6570f1727ff69d6f270e1 2026-03-17 06:52:08,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:52:08,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6570f1727ff69d6f270e1 HTTP/1.1" 200 None 2026-03-17 06:52:08,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:52:08,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b4fc9d19175818251fd6 HTTP/1.1" 200 None 2026-03-17 06:52:08,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:52:08,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6570f1727ff69d6f270e1 HTTP/1.1" 200 None 2026-03-17 06:52:08,559 - lava_callback - ERROR - Error processing callback for node 69b6570f1727ff69d6f270e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:52:48,460 - lava_callback - INFO - Received callback for node 69b657331727ff69d6f270ee INFO: 172.21.0.1:49598 - "POST /node/69b657331727ff69d6f270ee HTTP/1.0" 202 Accepted 2026-03-17 06:52:48,465 - lava_callback - INFO - Starting async job submit for node 69b657331727ff69d6f270ee 2026-03-17 06:52:48,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:52:48,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b657331727ff69d6f270ee HTTP/1.1" 200 None 2026-03-17 06:52:48,482 - lava_callback - DEBUG - Processing node 69b657331727ff69d6f270ee: baseline-arm-clabbe 2026-03-17 06:52:48,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b657331727ff69d6f270ee 2026-03-17 06:52:48,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:52:48,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b657331727ff69d6f270ee HTTP/1.1" 200 None 2026-03-17 06:52:48,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:52:48,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 06:52:48,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:52:48,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b657331727ff69d6f270ee HTTP/1.1" 200 None 2026-03-17 06:52:48,537 - lava_callback - ERROR - Error processing callback for node 69b657331727ff69d6f270ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:53:28,507 - lava_callback - INFO - Received callback for node 69b657571727ff69d6f270f6 INFO: 172.21.0.1:36256 - "POST /node/69b657571727ff69d6f270f6 HTTP/1.0" 202 Accepted 2026-03-17 06:53:28,513 - lava_callback - INFO - Starting async job submit for node 69b657571727ff69d6f270f6 2026-03-17 06:53:28,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:53:28,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b657571727ff69d6f270f6 HTTP/1.1" 200 None 2026-03-17 06:53:28,531 - lava_callback - DEBUG - Processing node 69b657571727ff69d6f270f6: baseline-arm-clabbe 2026-03-17 06:53:28,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b657571727ff69d6f270f6 2026-03-17 06:53:28,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:53:28,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b657571727ff69d6f270f6 HTTP/1.1" 200 None 2026-03-17 06:53:28,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:53:28,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 06:53:28,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:53:28,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b657571727ff69d6f270f6 HTTP/1.1" 200 None 2026-03-17 06:53:28,592 - lava_callback - ERROR - Error processing callback for node 69b657571727ff69d6f270f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:54:08,495 - lava_callback - INFO - Received callback for node 69b6577b1727ff69d6f27100 INFO: 172.21.0.1:51428 - "POST /node/69b6577b1727ff69d6f27100 HTTP/1.0" 202 Accepted 2026-03-17 06:54:08,501 - lava_callback - INFO - Starting async job submit for node 69b6577b1727ff69d6f27100 2026-03-17 06:54:08,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:54:08,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6577b1727ff69d6f27100 HTTP/1.1" 200 None 2026-03-17 06:54:08,517 - lava_callback - DEBUG - Processing node 69b6577b1727ff69d6f27100: baseline-arm-clabbe 2026-03-17 06:54:08,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6577b1727ff69d6f27100 2026-03-17 06:54:08,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:54:08,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6577b1727ff69d6f27100 HTTP/1.1" 200 None 2026-03-17 06:54:08,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:54:08,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 06:54:08,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:54:08,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6577b1727ff69d6f27100 HTTP/1.1" 200 None 2026-03-17 06:54:08,570 - lava_callback - ERROR - Error processing callback for node 69b6577b1727ff69d6f27100: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33292 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:54:28,540 - lava_callback - INFO - Received callback for node 69b6579f1727ff69d6f2710a INFO: 172.21.0.1:33294 - "POST /node/69b6579f1727ff69d6f2710a HTTP/1.0" 202 Accepted 2026-03-17 06:54:28,546 - lava_callback - INFO - Starting async job submit for node 69b6579f1727ff69d6f2710a 2026-03-17 06:54:28,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:54:28,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6579f1727ff69d6f2710a HTTP/1.1" 200 None 2026-03-17 06:54:28,567 - lava_callback - DEBUG - Processing node 69b6579f1727ff69d6f2710a: baseline-arm-clabbe 2026-03-17 06:54:28,568 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6579f1727ff69d6f2710a 2026-03-17 06:54:28,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:54:28,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6579f1727ff69d6f2710a HTTP/1.1" 200 None 2026-03-17 06:54:28,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:54:28,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 06:54:28,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:54:28,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6579f1727ff69d6f2710a HTTP/1.1" 200 None 2026-03-17 06:54:28,632 - lava_callback - ERROR - Error processing callback for node 69b6579f1727ff69d6f2710a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47948 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:55:08,541 - lava_callback - INFO - Received callback for node 69b657c31727ff69d6f27116 INFO: 172.21.0.1:47964 - "POST /node/69b657c31727ff69d6f27116 HTTP/1.0" 202 Accepted 2026-03-17 06:55:08,546 - lava_callback - INFO - Starting async job submit for node 69b657c31727ff69d6f27116 2026-03-17 06:55:08,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:55:08,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b657c31727ff69d6f27116 HTTP/1.1" 200 None 2026-03-17 06:55:08,563 - lava_callback - DEBUG - Processing node 69b657c31727ff69d6f27116: baseline-arm-clabbe 2026-03-17 06:55:08,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b657c31727ff69d6f27116 2026-03-17 06:55:08,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:55:08,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b657c31727ff69d6f27116 HTTP/1.1" 200 None 2026-03-17 06:55:08,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:55:08,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 06:55:08,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:55:08,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b657c31727ff69d6f27116 HTTP/1.1" 200 None 2026-03-17 06:55:08,633 - lava_callback - ERROR - Error processing callback for node 69b657c31727ff69d6f27116: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56860 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:55:41,171 - lava_callback - INFO - Received callback for node 69b657e11727ff69d6f27122 INFO: 172.21.0.1:37832 - "POST /node/69b657e11727ff69d6f27122 HTTP/1.0" 202 Accepted 2026-03-17 06:55:41,177 - lava_callback - INFO - Starting async job submit for node 69b657e11727ff69d6f27122 2026-03-17 06:55:41,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:55:41,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b657e11727ff69d6f27122 HTTP/1.1" 200 None 2026-03-17 06:55:41,193 - lava_callback - DEBUG - Processing node 69b657e11727ff69d6f27122: baseline-arm-baylibre 2026-03-17 06:55:41,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b657e11727ff69d6f27122 2026-03-17 06:55:41,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:55:41,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b657e11727ff69d6f27122 HTTP/1.1" 200 None 2026-03-17 06:55:41,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:55:41,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 06:55:41,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:55:41,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b657e11727ff69d6f27122 HTTP/1.1" 200 None 2026-03-17 06:55:41,251 - lava_callback - ERROR - Error processing callback for node 69b657e11727ff69d6f27122: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46588 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:56:28,637 - lava_callback - INFO - Received callback for node 69b6580a1727ff69d6f27130 INFO: 172.21.0.1:46600 - "POST /node/69b6580a1727ff69d6f27130 HTTP/1.0" 202 Accepted 2026-03-17 06:56:28,643 - lava_callback - INFO - Starting async job submit for node 69b6580a1727ff69d6f27130 2026-03-17 06:56:28,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:56:28,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6580a1727ff69d6f27130 HTTP/1.1" 200 None 2026-03-17 06:56:28,660 - lava_callback - DEBUG - Processing node 69b6580a1727ff69d6f27130: baseline-arm-clabbe 2026-03-17 06:56:28,660 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6580a1727ff69d6f27130 2026-03-17 06:56:28,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:56:28,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6580a1727ff69d6f27130 HTTP/1.1" 200 None 2026-03-17 06:56:28,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:56:28,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 06:56:28,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:56:28,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6580a1727ff69d6f27130 HTTP/1.1" 200 None 2026-03-17 06:56:28,713 - lava_callback - ERROR - Error processing callback for node 69b6580a1727ff69d6f27130: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:56:48,621 - lava_callback - INFO - Received callback for node 69b6582e1727ff69d6f2713c INFO: 172.21.0.1:36716 - "POST /node/69b6582e1727ff69d6f2713c HTTP/1.0" 202 Accepted 2026-03-17 06:56:48,627 - lava_callback - INFO - Starting async job submit for node 69b6582e1727ff69d6f2713c 2026-03-17 06:56:48,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:56:48,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6582e1727ff69d6f2713c HTTP/1.1" 200 None 2026-03-17 06:56:48,643 - lava_callback - DEBUG - Processing node 69b6582e1727ff69d6f2713c: baseline-arm-clabbe 2026-03-17 06:56:48,644 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6582e1727ff69d6f2713c 2026-03-17 06:56:48,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:56:48,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6582e1727ff69d6f2713c HTTP/1.1" 200 None 2026-03-17 06:56:48,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:56:48,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 06:56:48,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:56:48,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6582e1727ff69d6f2713c HTTP/1.1" 200 None 2026-03-17 06:56:48,709 - lava_callback - ERROR - Error processing callback for node 69b6582e1727ff69d6f2713c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:57:28,686 - lava_callback - INFO - Received callback for node 69b658521727ff69d6f27145 INFO: 172.21.0.1:39930 - "POST /node/69b658521727ff69d6f27145 HTTP/1.0" 202 Accepted 2026-03-17 06:57:28,691 - lava_callback - INFO - Starting async job submit for node 69b658521727ff69d6f27145 2026-03-17 06:57:28,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:57:28,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b658521727ff69d6f27145 HTTP/1.1" 200 None 2026-03-17 06:57:28,707 - lava_callback - DEBUG - Processing node 69b658521727ff69d6f27145: baseline-arm-clabbe 2026-03-17 06:57:28,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b658521727ff69d6f27145 2026-03-17 06:57:28,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:57:28,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b658521727ff69d6f27145 HTTP/1.1" 200 None 2026-03-17 06:57:28,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:57:28,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 06:57:28,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:57:28,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b658521727ff69d6f27145 HTTP/1.1" 200 None 2026-03-17 06:57:28,759 - lava_callback - ERROR - Error processing callback for node 69b658521727ff69d6f27145: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40400 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:58:08,678 - lava_callback - INFO - Received callback for node 69b658751727ff69d6f2714f INFO: 172.21.0.1:40402 - "POST /node/69b658751727ff69d6f2714f HTTP/1.0" 202 Accepted 2026-03-17 06:58:08,684 - lava_callback - INFO - Starting async job submit for node 69b658751727ff69d6f2714f 2026-03-17 06:58:08,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:58:08,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b658751727ff69d6f2714f HTTP/1.1" 200 None 2026-03-17 06:58:08,700 - lava_callback - DEBUG - Processing node 69b658751727ff69d6f2714f: baseline-arm-clabbe 2026-03-17 06:58:08,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b658751727ff69d6f2714f 2026-03-17 06:58:08,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:58:08,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b658751727ff69d6f2714f HTTP/1.1" 200 None 2026-03-17 06:58:08,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:58:08,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 06:58:08,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:58:08,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b658751727ff69d6f2714f HTTP/1.1" 200 None 2026-03-17 06:58:08,762 - lava_callback - ERROR - Error processing callback for node 69b658751727ff69d6f2714f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45914 - "GET / HTTP/1.0" 200 OK 2026-03-17 06:58:48,769 - lava_callback - INFO - Received callback for node 69b658991727ff69d6f2715b INFO: 172.21.0.1:45930 - "POST /node/69b658991727ff69d6f2715b HTTP/1.0" 202 Accepted 2026-03-17 06:58:48,775 - lava_callback - INFO - Starting async job submit for node 69b658991727ff69d6f2715b 2026-03-17 06:58:48,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:58:48,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b658991727ff69d6f2715b HTTP/1.1" 200 None 2026-03-17 06:58:48,792 - lava_callback - DEBUG - Processing node 69b658991727ff69d6f2715b: baseline-arm-clabbe 2026-03-17 06:58:48,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b658991727ff69d6f2715b 2026-03-17 06:58:48,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:58:48,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b658991727ff69d6f2715b HTTP/1.1" 200 None 2026-03-17 06:58:48,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:58:48,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b35934974c91e64560e49d HTTP/1.1" 200 None 2026-03-17 06:58:48,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 06:58:48,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b658991727ff69d6f2715b HTTP/1.1" 200 None 2026-03-17 06:58:48,850 - lava_callback - ERROR - Error processing callback for node 69b658991727ff69d6f2715b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:07:41,968 - lava_callback - INFO - Received callback for node 69b65aaf1727ff69d6f2717e INFO: 172.21.0.1:47418 - "POST /node/69b65aaf1727ff69d6f2717e HTTP/1.0" 202 Accepted 2026-03-17 07:07:41,973 - lava_callback - INFO - Starting async job submit for node 69b65aaf1727ff69d6f2717e 2026-03-17 07:07:41,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:07:41,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65aaf1727ff69d6f2717e HTTP/1.1" 200 None 2026-03-17 07:07:41,992 - lava_callback - DEBUG - Processing node 69b65aaf1727ff69d6f2717e: baseline-arm64-baylibre 2026-03-17 07:07:41,992 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65aaf1727ff69d6f2717e 2026-03-17 07:07:41,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:07:42,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65aaf1727ff69d6f2717e HTTP/1.1" 200 None 2026-03-17 07:07:42,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:07:42,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:07:42,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:07:42,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65aaf1727ff69d6f2717e HTTP/1.1" 200 None 2026-03-17 07:07:42,066 - lava_callback - ERROR - Error processing callback for node 69b65aaf1727ff69d6f2717e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:09:41,909 - lava_callback - INFO - Received callback for node 69b65b271727ff69d6f2718c INFO: 172.21.0.1:56646 - "POST /node/69b65b271727ff69d6f2718c HTTP/1.0" 202 Accepted 2026-03-17 07:09:41,915 - lava_callback - INFO - Starting async job submit for node 69b65b271727ff69d6f2718c 2026-03-17 07:09:41,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:09:41,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65b271727ff69d6f2718c HTTP/1.1" 200 None 2026-03-17 07:09:41,931 - lava_callback - DEBUG - Processing node 69b65b271727ff69d6f2718c: baseline-arm64-baylibre 2026-03-17 07:09:41,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65b271727ff69d6f2718c 2026-03-17 07:09:41,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:09:41,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65b271727ff69d6f2718c HTTP/1.1" 200 None 2026-03-17 07:09:41,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:09:41,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:09:41,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:09:41,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65b271727ff69d6f2718c HTTP/1.1" 200 None 2026-03-17 07:09:41,990 - lava_callback - ERROR - Error processing callback for node 69b65b271727ff69d6f2718c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:11:02,062 - lava_callback - INFO - Received callback for node 69b65b721727ff69d6f2719d INFO: 172.21.0.1:59690 - "POST /node/69b65b721727ff69d6f2719d HTTP/1.0" 202 Accepted 2026-03-17 07:11:02,068 - lava_callback - INFO - Starting async job submit for node 69b65b721727ff69d6f2719d 2026-03-17 07:11:02,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:11:02,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65b721727ff69d6f2719d HTTP/1.1" 200 None 2026-03-17 07:11:02,084 - lava_callback - DEBUG - Processing node 69b65b721727ff69d6f2719d: baseline-arm64-baylibre 2026-03-17 07:11:02,084 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65b721727ff69d6f2719d 2026-03-17 07:11:02,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:11:02,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65b721727ff69d6f2719d HTTP/1.1" 200 None 2026-03-17 07:11:02,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:11:02,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:11:02,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:11:02,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65b721727ff69d6f2719d HTTP/1.1" 200 None 2026-03-17 07:11:02,144 - lava_callback - ERROR - Error processing callback for node 69b65b721727ff69d6f2719d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:12:02,020 - lava_callback - INFO - Received callback for node 69b65bbb1727ff69d6f271a9 INFO: 172.21.0.1:59534 - "POST /node/69b65bbb1727ff69d6f271a9 HTTP/1.0" 202 Accepted 2026-03-17 07:12:02,026 - lava_callback - INFO - Starting async job submit for node 69b65bbb1727ff69d6f271a9 2026-03-17 07:12:02,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:12:02,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65bbb1727ff69d6f271a9 HTTP/1.1" 200 None 2026-03-17 07:12:02,041 - lava_callback - DEBUG - Processing node 69b65bbb1727ff69d6f271a9: baseline-arm64-baylibre 2026-03-17 07:12:02,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65bbb1727ff69d6f271a9 2026-03-17 07:12:02,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:12:02,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65bbb1727ff69d6f271a9 HTTP/1.1" 200 None 2026-03-17 07:12:02,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:12:02,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:12:02,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:12:02,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65bbb1727ff69d6f271a9 HTTP/1.1" 200 None 2026-03-17 07:12:02,109 - lava_callback - ERROR - Error processing callback for node 69b65bbb1727ff69d6f271a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:13:22,279 - lava_callback - INFO - Received callback for node 69b65c061727ff69d6f271ba INFO: 172.21.0.1:33990 - "POST /node/69b65c061727ff69d6f271ba HTTP/1.0" 202 Accepted 2026-03-17 07:13:22,284 - lava_callback - INFO - Starting async job submit for node 69b65c061727ff69d6f271ba 2026-03-17 07:13:22,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:13:22,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65c061727ff69d6f271ba HTTP/1.1" 200 None 2026-03-17 07:13:22,301 - lava_callback - DEBUG - Processing node 69b65c061727ff69d6f271ba: baseline-arm64-baylibre 2026-03-17 07:13:22,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65c061727ff69d6f271ba 2026-03-17 07:13:22,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:13:22,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65c061727ff69d6f271ba HTTP/1.1" 200 None 2026-03-17 07:13:22,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:13:22,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:13:22,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:13:22,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65c061727ff69d6f271ba HTTP/1.1" 200 None 2026-03-17 07:13:22,372 - lava_callback - ERROR - Error processing callback for node 69b65c061727ff69d6f271ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:14:42,198 - lava_callback - INFO - Received callback for node 69b65c4d1727ff69d6f271c3 INFO: 172.21.0.1:45114 - "POST /node/69b65c4d1727ff69d6f271c3 HTTP/1.0" 202 Accepted 2026-03-17 07:14:42,203 - lava_callback - INFO - Starting async job submit for node 69b65c4d1727ff69d6f271c3 2026-03-17 07:14:42,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:14:42,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65c4d1727ff69d6f271c3 HTTP/1.1" 200 None 2026-03-17 07:14:42,220 - lava_callback - DEBUG - Processing node 69b65c4d1727ff69d6f271c3: baseline-arm64-baylibre 2026-03-17 07:14:42,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65c4d1727ff69d6f271c3 2026-03-17 07:14:42,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:14:42,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65c4d1727ff69d6f271c3 HTTP/1.1" 200 None 2026-03-17 07:14:42,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:14:42,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:14:42,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:14:42,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65c4d1727ff69d6f271c3 HTTP/1.1" 200 None 2026-03-17 07:14:42,275 - lava_callback - ERROR - Error processing callback for node 69b65c4d1727ff69d6f271c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:15:42,236 - lava_callback - INFO - Received callback for node 69b65c981727ff69d6f271d2 INFO: 172.21.0.1:41612 - "POST /node/69b65c981727ff69d6f271d2 HTTP/1.0" 202 Accepted 2026-03-17 07:15:42,242 - lava_callback - INFO - Starting async job submit for node 69b65c981727ff69d6f271d2 2026-03-17 07:15:42,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:15:42,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65c981727ff69d6f271d2 HTTP/1.1" 200 None 2026-03-17 07:15:42,258 - lava_callback - DEBUG - Processing node 69b65c981727ff69d6f271d2: baseline-arm64-baylibre 2026-03-17 07:15:42,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65c981727ff69d6f271d2 2026-03-17 07:15:42,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:15:42,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65c981727ff69d6f271d2 HTTP/1.1" 200 None 2026-03-17 07:15:42,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:15:42,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:15:42,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:15:42,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65c981727ff69d6f271d2 HTTP/1.1" 200 None 2026-03-17 07:15:42,328 - lava_callback - ERROR - Error processing callback for node 69b65c981727ff69d6f271d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:17:09,651 - lava_callback - INFO - Received callback for node 69b65ce91727ff69d6f271db INFO: 172.21.0.1:55452 - "POST /node/69b65ce91727ff69d6f271db HTTP/1.0" 202 Accepted 2026-03-17 07:17:09,656 - lava_callback - INFO - Starting async job submit for node 69b65ce91727ff69d6f271db 2026-03-17 07:17:09,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:17:09,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65ce91727ff69d6f271db HTTP/1.1" 200 None 2026-03-17 07:17:09,676 - lava_callback - DEBUG - Processing node 69b65ce91727ff69d6f271db: baseline-arm64-clabbe 2026-03-17 07:17:09,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65ce91727ff69d6f271db 2026-03-17 07:17:09,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:17:09,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65ce91727ff69d6f271db HTTP/1.1" 200 None 2026-03-17 07:17:09,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:17:09,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:17:09,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:17:09,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65ce91727ff69d6f271db HTTP/1.1" 200 None 2026-03-17 07:17:09,732 - lava_callback - ERROR - Error processing callback for node 69b65ce91727ff69d6f271db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46436 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:18:29,618 - lava_callback - INFO - Received callback for node 69b65d321727ff69d6f271eb INFO: 172.21.0.1:46446 - "POST /node/69b65d321727ff69d6f271eb HTTP/1.0" 202 Accepted 2026-03-17 07:18:29,624 - lava_callback - INFO - Starting async job submit for node 69b65d321727ff69d6f271eb 2026-03-17 07:18:29,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:18:29,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65d321727ff69d6f271eb HTTP/1.1" 200 None 2026-03-17 07:18:29,640 - lava_callback - DEBUG - Processing node 69b65d321727ff69d6f271eb: baseline-arm64-clabbe 2026-03-17 07:18:29,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65d321727ff69d6f271eb 2026-03-17 07:18:29,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:18:29,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65d321727ff69d6f271eb HTTP/1.1" 200 None 2026-03-17 07:18:29,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:18:29,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:18:29,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:18:29,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65d321727ff69d6f271eb HTTP/1.1" 200 None 2026-03-17 07:18:29,704 - lava_callback - ERROR - Error processing callback for node 69b65d321727ff69d6f271eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:19:29,836 - lava_callback - INFO - Received callback for node 69b65d7c1727ff69d6f271f3 INFO: 172.21.0.1:57320 - "POST /node/69b65d7c1727ff69d6f271f3 HTTP/1.0" 202 Accepted 2026-03-17 07:19:29,844 - lava_callback - INFO - Starting async job submit for node 69b65d7c1727ff69d6f271f3 2026-03-17 07:19:29,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:19:29,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65d7c1727ff69d6f271f3 HTTP/1.1" 200 None 2026-03-17 07:19:29,861 - lava_callback - DEBUG - Processing node 69b65d7c1727ff69d6f271f3: baseline-arm64-clabbe 2026-03-17 07:19:29,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65d7c1727ff69d6f271f3 2026-03-17 07:19:29,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:19:29,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65d7c1727ff69d6f271f3 HTTP/1.1" 200 None 2026-03-17 07:19:29,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:19:29,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:19:29,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:19:29,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65d7c1727ff69d6f271f3 HTTP/1.1" 200 None 2026-03-17 07:19:29,931 - lava_callback - ERROR - Error processing callback for node 69b65d7c1727ff69d6f271f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:20:49,602 - lava_callback - INFO - Received callback for node 69b65dc51727ff69d6f27205 INFO: 172.21.0.1:40914 - "POST /node/69b65dc51727ff69d6f27205 HTTP/1.0" 202 Accepted 2026-03-17 07:20:49,610 - lava_callback - INFO - Starting async job submit for node 69b65dc51727ff69d6f27205 2026-03-17 07:20:49,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:20:49,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65dc51727ff69d6f27205 HTTP/1.1" 200 None 2026-03-17 07:20:49,631 - lava_callback - DEBUG - Processing node 69b65dc51727ff69d6f27205: baseline-arm64-clabbe 2026-03-17 07:20:49,631 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65dc51727ff69d6f27205 2026-03-17 07:20:49,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:20:49,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65dc51727ff69d6f27205 HTTP/1.1" 200 None 2026-03-17 07:20:49,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:20:49,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:20:49,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:20:49,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65dc51727ff69d6f27205 HTTP/1.1" 200 None 2026-03-17 07:20:49,708 - lava_callback - ERROR - Error processing callback for node 69b65dc51727ff69d6f27205: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:22:09,796 - lava_callback - INFO - Received callback for node 69b65e0f1727ff69d6f27211 INFO: 172.21.0.1:53172 - "POST /node/69b65e0f1727ff69d6f27211 HTTP/1.0" 202 Accepted 2026-03-17 07:22:09,802 - lava_callback - INFO - Starting async job submit for node 69b65e0f1727ff69d6f27211 2026-03-17 07:22:09,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:22:09,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65e0f1727ff69d6f27211 HTTP/1.1" 200 None 2026-03-17 07:22:09,818 - lava_callback - DEBUG - Processing node 69b65e0f1727ff69d6f27211: baseline-arm64-clabbe 2026-03-17 07:22:09,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65e0f1727ff69d6f27211 2026-03-17 07:22:09,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:22:09,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65e0f1727ff69d6f27211 HTTP/1.1" 200 None 2026-03-17 07:22:09,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:22:09,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:22:09,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:22:09,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65e0f1727ff69d6f27211 HTTP/1.1" 200 None 2026-03-17 07:22:09,885 - lava_callback - ERROR - Error processing callback for node 69b65e0f1727ff69d6f27211: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:23:09,843 - lava_callback - INFO - Received callback for node 69b65e5a1727ff69d6f27221 INFO: 172.21.0.1:54964 - "POST /node/69b65e5a1727ff69d6f27221 HTTP/1.0" 202 Accepted 2026-03-17 07:23:09,849 - lava_callback - INFO - Starting async job submit for node 69b65e5a1727ff69d6f27221 2026-03-17 07:23:09,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:23:09,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65e5a1727ff69d6f27221 HTTP/1.1" 200 None 2026-03-17 07:23:09,866 - lava_callback - DEBUG - Processing node 69b65e5a1727ff69d6f27221: baseline-arm64-clabbe 2026-03-17 07:23:09,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65e5a1727ff69d6f27221 2026-03-17 07:23:09,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:23:09,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65e5a1727ff69d6f27221 HTTP/1.1" 200 None 2026-03-17 07:23:09,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:23:09,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:23:09,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:23:09,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65e5a1727ff69d6f27221 HTTP/1.1" 200 None 2026-03-17 07:23:09,949 - lava_callback - ERROR - Error processing callback for node 69b65e5a1727ff69d6f27221: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:24:23,468 - lava_callback - INFO - Received callback for node 69b65e9e1727ff69d6f27228 INFO: 172.21.0.1:34250 - "POST /node/69b65e9e1727ff69d6f27228 HTTP/1.0" 202 Accepted 2026-03-17 07:24:23,474 - lava_callback - INFO - Starting async job submit for node 69b65e9e1727ff69d6f27228 2026-03-17 07:24:23,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:24:23,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65e9e1727ff69d6f27228 HTTP/1.1" 200 None 2026-03-17 07:24:23,491 - lava_callback - DEBUG - Processing node 69b65e9e1727ff69d6f27228: baseline-arm64-baylibre 2026-03-17 07:24:23,491 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65e9e1727ff69d6f27228 2026-03-17 07:24:23,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:24:23,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65e9e1727ff69d6f27228 HTTP/1.1" 200 None 2026-03-17 07:24:23,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:24:23,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:24:23,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:24:23,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65e9e1727ff69d6f27228 HTTP/1.1" 200 None 2026-03-17 07:24:23,548 - lava_callback - ERROR - Error processing callback for node 69b65e9e1727ff69d6f27228: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38804 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:25:42,803 - lava_callback - INFO - Received callback for node 69b65ee91727ff69d6f27234 INFO: 172.21.0.1:38814 - "POST /node/69b65ee91727ff69d6f27234 HTTP/1.0" 202 Accepted 2026-03-17 07:25:42,808 - lava_callback - INFO - Starting async job submit for node 69b65ee91727ff69d6f27234 2026-03-17 07:25:42,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:25:42,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65ee91727ff69d6f27234 HTTP/1.1" 200 None 2026-03-17 07:25:42,825 - lava_callback - DEBUG - Processing node 69b65ee91727ff69d6f27234: baseline-arm64-baylibre 2026-03-17 07:25:42,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65ee91727ff69d6f27234 2026-03-17 07:25:42,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:25:42,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65ee91727ff69d6f27234 HTTP/1.1" 200 None 2026-03-17 07:25:42,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:25:42,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:25:42,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:25:42,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65ee91727ff69d6f27234 HTTP/1.1" 200 None 2026-03-17 07:25:42,896 - lava_callback - ERROR - Error processing callback for node 69b65ee91727ff69d6f27234: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41890 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:26:42,850 - lava_callback - INFO - Received callback for node 69b65f311727ff69d6f27244 INFO: 172.21.0.1:41894 - "POST /node/69b65f311727ff69d6f27244 HTTP/1.0" 202 Accepted 2026-03-17 07:26:42,855 - lava_callback - INFO - Starting async job submit for node 69b65f311727ff69d6f27244 2026-03-17 07:26:42,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:26:42,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65f311727ff69d6f27244 HTTP/1.1" 200 None 2026-03-17 07:26:42,871 - lava_callback - DEBUG - Processing node 69b65f311727ff69d6f27244: baseline-arm64-baylibre 2026-03-17 07:26:42,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65f311727ff69d6f27244 2026-03-17 07:26:42,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:26:42,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65f311727ff69d6f27244 HTTP/1.1" 200 None 2026-03-17 07:26:42,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:26:42,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:26:42,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:26:42,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65f311727ff69d6f27244 HTTP/1.1" 200 None 2026-03-17 07:26:42,926 - lava_callback - ERROR - Error processing callback for node 69b65f311727ff69d6f27244: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33828 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:28:10,088 - lava_callback - INFO - Received callback for node 69b65f811727ff69d6f2724f INFO: 172.21.0.1:36816 - "POST /node/69b65f811727ff69d6f2724f HTTP/1.0" 202 Accepted 2026-03-17 07:28:10,094 - lava_callback - INFO - Starting async job submit for node 69b65f811727ff69d6f2724f 2026-03-17 07:28:10,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:28:10,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65f811727ff69d6f2724f HTTP/1.1" 200 None 2026-03-17 07:28:10,122 - lava_callback - DEBUG - Processing node 69b65f811727ff69d6f2724f: baseline-arm64-clabbe 2026-03-17 07:28:10,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65f811727ff69d6f2724f 2026-03-17 07:28:10,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:28:10,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65f811727ff69d6f2724f HTTP/1.1" 200 None 2026-03-17 07:28:10,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:28:10,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:28:10,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:28:10,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65f811727ff69d6f2724f HTTP/1.1" 200 None 2026-03-17 07:28:10,183 - lava_callback - ERROR - Error processing callback for node 69b65f811727ff69d6f2724f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:29:23,350 - lava_callback - INFO - Received callback for node 69b65fc61727ff69d6f2725d INFO: 172.21.0.1:45718 - "POST /node/69b65fc61727ff69d6f2725d HTTP/1.0" 202 Accepted 2026-03-17 07:29:23,357 - lava_callback - INFO - Starting async job submit for node 69b65fc61727ff69d6f2725d 2026-03-17 07:29:23,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:29:23,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65fc61727ff69d6f2725d HTTP/1.1" 200 None 2026-03-17 07:29:23,372 - lava_callback - DEBUG - Processing node 69b65fc61727ff69d6f2725d: baseline-arm64-baylibre 2026-03-17 07:29:23,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b65fc61727ff69d6f2725d 2026-03-17 07:29:23,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:29:23,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b65fc61727ff69d6f2725d HTTP/1.1" 200 None 2026-03-17 07:29:23,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:29:23,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:29:23,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:29:23,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b65fc61727ff69d6f2725d HTTP/1.1" 200 None 2026-03-17 07:29:23,431 - lava_callback - ERROR - Error processing callback for node 69b65fc61727ff69d6f2725d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35554 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:30:50,213 - lava_callback - INFO - Received callback for node 69b660171727ff69d6f27268 INFO: 172.21.0.1:55370 - "POST /node/69b660171727ff69d6f27268 HTTP/1.0" 202 Accepted 2026-03-17 07:30:50,219 - lava_callback - INFO - Starting async job submit for node 69b660171727ff69d6f27268 2026-03-17 07:30:50,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:30:50,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b660171727ff69d6f27268 HTTP/1.1" 200 None 2026-03-17 07:30:50,265 - lava_callback - DEBUG - Processing node 69b660171727ff69d6f27268: baseline-arm64-clabbe 2026-03-17 07:30:50,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b660171727ff69d6f27268 2026-03-17 07:30:50,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:30:50,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b660171727ff69d6f27268 HTTP/1.1" 200 None 2026-03-17 07:30:50,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:30:50,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:30:50,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:30:50,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b660171727ff69d6f27268 HTTP/1.1" 200 None 2026-03-17 07:30:50,320 - lava_callback - ERROR - Error processing callback for node 69b660171727ff69d6f27268: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 07:30:54,711 - lava_callback - INFO - Received callback for node 69b8ab34fbe29c53ae85f7f7 INFO: 172.21.0.1:55372 - "POST /node/69b8ab34fbe29c53ae85f7f7 HTTP/1.0" 202 Accepted 2026-03-17 07:30:54,718 - lava_callback - INFO - Starting async job submit for node 69b8ab34fbe29c53ae85f7f7 2026-03-17 07:30:54,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:30:54,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab34fbe29c53ae85f7f7 HTTP/1.1" 200 None 2026-03-17 07:30:54,766 - lava_callback - DEBUG - Processing node 69b8ab34fbe29c53ae85f7f7: baseline-arm64-broonie 2026-03-17 07:30:55,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 07:30:55,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 07:30:55,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab34fbe29c53ae85f7f7/log.txt.gz 2026-03-17 07:30:55,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 07:30:55,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 07:30:55,711 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab34fbe29c53ae85f7f7/lava-logs.yaml 2026-03-17 07:30:55,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 07:30:56,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 07:30:56,216 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8ab34fbe29c53ae85f7f7/lava_callback.json.gz 2026-03-17 07:30:56,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:30:56,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8ab34fbe29c53ae85f7f7 HTTP/1.1" 200 None 2026-03-17 07:30:56,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:30:56,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 07:30:56,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:30:56,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8ab34fbe29c53ae85f7f7 HTTP/1.1" 200 None 2026-03-17 07:30:56,306 - lava_callback - INFO - Completed processing callback for node 69b8ab34fbe29c53ae85f7f7 INFO: 172.21.0.1:55374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51546 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:31:23,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:31:23,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57582 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:31:50,253 - lava_callback - INFO - Received callback for node 69b660611727ff69d6f27276 INFO: 172.21.0.1:49658 - "POST /node/69b660611727ff69d6f27276 HTTP/1.0" 202 Accepted 2026-03-17 07:31:50,258 - lava_callback - INFO - Starting async job submit for node 69b660611727ff69d6f27276 2026-03-17 07:31:50,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:31:50,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b660611727ff69d6f27276 HTTP/1.1" 200 None 2026-03-17 07:31:50,275 - lava_callback - DEBUG - Processing node 69b660611727ff69d6f27276: baseline-arm64-clabbe 2026-03-17 07:31:50,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b660611727ff69d6f27276 2026-03-17 07:31:50,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:31:50,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b660611727ff69d6f27276 HTTP/1.1" 200 None 2026-03-17 07:31:50,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:31:50,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:31:50,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:31:50,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b660611727ff69d6f27276 HTTP/1.1" 200 None 2026-03-17 07:31:50,343 - lava_callback - ERROR - Error processing callback for node 69b660611727ff69d6f27276: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52690 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:33:10,318 - lava_callback - INFO - Received callback for node 69b660ab1727ff69d6f2727e INFO: 172.21.0.1:59190 - "POST /node/69b660ab1727ff69d6f2727e HTTP/1.0" 202 Accepted 2026-03-17 07:33:10,324 - lava_callback - INFO - Starting async job submit for node 69b660ab1727ff69d6f2727e 2026-03-17 07:33:10,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:33:10,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b660ab1727ff69d6f2727e HTTP/1.1" 200 None 2026-03-17 07:33:10,344 - lava_callback - DEBUG - Processing node 69b660ab1727ff69d6f2727e: baseline-arm64-clabbe 2026-03-17 07:33:10,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b660ab1727ff69d6f2727e 2026-03-17 07:33:10,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:33:10,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b660ab1727ff69d6f2727e HTTP/1.1" 200 None 2026-03-17 07:33:10,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:33:10,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:33:10,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:33:10,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b660ab1727ff69d6f2727e HTTP/1.1" 200 None 2026-03-17 07:33:10,423 - lava_callback - ERROR - Error processing callback for node 69b660ab1727ff69d6f2727e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:34:30,396 - lava_callback - INFO - Received callback for node 69b660f61727ff69d6f2728c INFO: 172.21.0.1:54750 - "POST /node/69b660f61727ff69d6f2728c HTTP/1.0" 202 Accepted 2026-03-17 07:34:30,401 - lava_callback - INFO - Starting async job submit for node 69b660f61727ff69d6f2728c 2026-03-17 07:34:30,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:34:30,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b660f61727ff69d6f2728c HTTP/1.1" 200 None 2026-03-17 07:34:30,418 - lava_callback - DEBUG - Processing node 69b660f61727ff69d6f2728c: baseline-arm64-clabbe 2026-03-17 07:34:30,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b660f61727ff69d6f2728c 2026-03-17 07:34:30,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:34:30,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b660f61727ff69d6f2728c HTTP/1.1" 200 None 2026-03-17 07:34:30,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:34:30,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:34:30,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:34:30,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b660f61727ff69d6f2728c HTTP/1.1" 200 None 2026-03-17 07:34:30,483 - lava_callback - ERROR - Error processing callback for node 69b660f61727ff69d6f2728c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35540 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:35:50,532 - lava_callback - INFO - Received callback for node 69b661421727ff69d6f27295 INFO: 172.21.0.1:38646 - "POST /node/69b661421727ff69d6f27295 HTTP/1.0" 202 Accepted 2026-03-17 07:35:50,538 - lava_callback - INFO - Starting async job submit for node 69b661421727ff69d6f27295 2026-03-17 07:35:50,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:35:50,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b661421727ff69d6f27295 HTTP/1.1" 200 None 2026-03-17 07:35:50,554 - lava_callback - DEBUG - Processing node 69b661421727ff69d6f27295: baseline-arm64-clabbe 2026-03-17 07:35:50,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b661421727ff69d6f27295 2026-03-17 07:35:50,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:35:50,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b661421727ff69d6f27295 HTTP/1.1" 200 None 2026-03-17 07:35:50,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:35:50,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:35:50,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:35:50,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b661421727ff69d6f27295 HTTP/1.1" 200 None 2026-03-17 07:35:50,605 - lava_callback - ERROR - Error processing callback for node 69b661421727ff69d6f27295: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:36:50,433 - lava_callback - INFO - Received callback for node 69b6618c1727ff69d6f272a1 INFO: 172.21.0.1:36758 - "POST /node/69b6618c1727ff69d6f272a1 HTTP/1.0" 202 Accepted 2026-03-17 07:36:50,439 - lava_callback - INFO - Starting async job submit for node 69b6618c1727ff69d6f272a1 2026-03-17 07:36:50,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:36:50,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6618c1727ff69d6f272a1 HTTP/1.1" 200 None 2026-03-17 07:36:50,456 - lava_callback - DEBUG - Processing node 69b6618c1727ff69d6f272a1: baseline-arm64-clabbe 2026-03-17 07:36:50,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6618c1727ff69d6f272a1 2026-03-17 07:36:50,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:36:50,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6618c1727ff69d6f272a1 HTTP/1.1" 200 None 2026-03-17 07:36:50,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:36:50,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:36:50,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:36:50,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6618c1727ff69d6f272a1 HTTP/1.1" 200 None 2026-03-17 07:36:50,520 - lava_callback - ERROR - Error processing callback for node 69b6618c1727ff69d6f272a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:38:10,691 - lava_callback - INFO - Received callback for node 69b661d71727ff69d6f272a9 INFO: 172.21.0.1:50334 - "POST /node/69b661d71727ff69d6f272a9 HTTP/1.0" 202 Accepted 2026-03-17 07:38:10,696 - lava_callback - INFO - Starting async job submit for node 69b661d71727ff69d6f272a9 2026-03-17 07:38:10,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:38:10,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b661d71727ff69d6f272a9 HTTP/1.1" 200 None 2026-03-17 07:38:10,727 - lava_callback - DEBUG - Processing node 69b661d71727ff69d6f272a9: baseline-arm64-clabbe 2026-03-17 07:38:10,727 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b661d71727ff69d6f272a9 2026-03-17 07:38:10,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:38:10,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b661d71727ff69d6f272a9 HTTP/1.1" 200 None 2026-03-17 07:38:10,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:38:10,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:38:10,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:38:10,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b661d71727ff69d6f272a9 HTTP/1.1" 200 None 2026-03-17 07:38:10,779 - lava_callback - ERROR - Error processing callback for node 69b661d71727ff69d6f272a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44858 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:39:30,604 - lava_callback - INFO - Received callback for node 69b662211727ff69d6f272b8 INFO: 172.21.0.1:45586 - "POST /node/69b662211727ff69d6f272b8 HTTP/1.0" 202 Accepted 2026-03-17 07:39:30,610 - lava_callback - INFO - Starting async job submit for node 69b662211727ff69d6f272b8 2026-03-17 07:39:30,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:39:30,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b662211727ff69d6f272b8 HTTP/1.1" 200 None 2026-03-17 07:39:30,626 - lava_callback - DEBUG - Processing node 69b662211727ff69d6f272b8: baseline-arm64-clabbe 2026-03-17 07:39:30,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b662211727ff69d6f272b8 2026-03-17 07:39:30,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:39:30,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b662211727ff69d6f272b8 HTTP/1.1" 200 None 2026-03-17 07:39:30,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:39:30,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:39:30,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:39:30,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b662211727ff69d6f272b8 HTTP/1.1" 200 None 2026-03-17 07:39:30,690 - lava_callback - ERROR - Error processing callback for node 69b662211727ff69d6f272b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:40:35,120 - lava_callback - INFO - Received callback for node 69b904e6fbe29c53ae86041c INFO: 172.21.0.1:56294 - "POST /node/69b904e6fbe29c53ae86041c HTTP/1.0" 202 Accepted 2026-03-17 07:40:35,126 - lava_callback - INFO - Starting async job submit for node 69b904e6fbe29c53ae86041c 2026-03-17 07:40:35,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:40:35,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b904e6fbe29c53ae86041c HTTP/1.1" 200 None 2026-03-17 07:40:35,173 - lava_callback - DEBUG - Processing node 69b904e6fbe29c53ae86041c: baseline-arm64-broonie 2026-03-17 07:40:35,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 07:40:35,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 07:40:35,607 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b904e6fbe29c53ae86041c/log.txt.gz 2026-03-17 07:40:35,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 07:40:36,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 07:40:36,005 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b904e6fbe29c53ae86041c/lava-logs.yaml 2026-03-17 07:40:36,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-17 07:40:36,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-17 07:40:36,171 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b904e6fbe29c53ae86041c/lava_callback.json.gz 2026-03-17 07:40:36,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:40:36,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b904e6fbe29c53ae86041c HTTP/1.1" 200 None 2026-03-17 07:40:36,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:40:36,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-17 07:40:36,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:40:36,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b904e6fbe29c53ae86041c HTTP/1.1" 200 None 2026-03-17 07:40:36,258 - lava_callback - INFO - Completed processing callback for node 69b904e6fbe29c53ae86041c INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54166 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:40:50,931 - lava_callback - INFO - Received callback for node 69b6626c1727ff69d6f272c0 INFO: 172.21.0.1:57118 - "POST /node/69b6626c1727ff69d6f272c0 HTTP/1.0" 202 Accepted 2026-03-17 07:40:50,937 - lava_callback - INFO - Starting async job submit for node 69b6626c1727ff69d6f272c0 2026-03-17 07:40:50,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:40:50,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6626c1727ff69d6f272c0 HTTP/1.1" 200 None 2026-03-17 07:40:50,953 - lava_callback - DEBUG - Processing node 69b6626c1727ff69d6f272c0: baseline-arm64-clabbe 2026-03-17 07:40:50,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6626c1727ff69d6f272c0 2026-03-17 07:40:50,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:40:50,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6626c1727ff69d6f272c0 HTTP/1.1" 200 None 2026-03-17 07:40:50,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:40:50,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:40:50,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:40:51,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6626c1727ff69d6f272c0 HTTP/1.1" 200 None 2026-03-17 07:40:51,009 - lava_callback - ERROR - Error processing callback for node 69b6626c1727ff69d6f272c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-17 07:40:53,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:40:53,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:41:50,727 - lava_callback - INFO - Received callback for node 69b662b61727ff69d6f272cf INFO: 172.21.0.1:40828 - "POST /node/69b662b61727ff69d6f272cf HTTP/1.0" 202 Accepted 2026-03-17 07:41:50,732 - lava_callback - INFO - Starting async job submit for node 69b662b61727ff69d6f272cf 2026-03-17 07:41:50,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:41:50,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b662b61727ff69d6f272cf HTTP/1.1" 200 None 2026-03-17 07:41:50,749 - lava_callback - DEBUG - Processing node 69b662b61727ff69d6f272cf: baseline-arm64-clabbe 2026-03-17 07:41:50,749 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b662b61727ff69d6f272cf 2026-03-17 07:41:50,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:41:50,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b662b61727ff69d6f272cf HTTP/1.1" 200 None 2026-03-17 07:41:50,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:41:50,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:41:50,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:41:50,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b662b61727ff69d6f272cf HTTP/1.1" 200 None 2026-03-17 07:41:50,804 - lava_callback - ERROR - Error processing callback for node 69b662b61727ff69d6f272cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:43:10,774 - lava_callback - INFO - Received callback for node 69b663011727ff69d6f272d7 INFO: 172.21.0.1:41878 - "POST /node/69b663011727ff69d6f272d7 HTTP/1.0" 202 Accepted 2026-03-17 07:43:10,781 - lava_callback - INFO - Starting async job submit for node 69b663011727ff69d6f272d7 2026-03-17 07:43:10,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:43:10,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b663011727ff69d6f272d7 HTTP/1.1" 200 None 2026-03-17 07:43:10,804 - lava_callback - DEBUG - Processing node 69b663011727ff69d6f272d7: baseline-arm64-clabbe 2026-03-17 07:43:10,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b663011727ff69d6f272d7 2026-03-17 07:43:10,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:43:10,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b663011727ff69d6f272d7 HTTP/1.1" 200 None 2026-03-17 07:43:10,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:43:10,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3594d974c91e64560e4b2 HTTP/1.1" 200 None 2026-03-17 07:43:10,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:43:10,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b663011727ff69d6f272d7 HTTP/1.1" 200 None 2026-03-17 07:43:10,977 - lava_callback - ERROR - Error processing callback for node 69b663011727ff69d6f272d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35202 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:44:24,195 - lava_callback - INFO - Received callback for node 69b663451727ff69d6f272e0 INFO: 172.21.0.1:46478 - "POST /node/69b663451727ff69d6f272e0 HTTP/1.0" 202 Accepted 2026-03-17 07:44:24,201 - lava_callback - INFO - Starting async job submit for node 69b663451727ff69d6f272e0 2026-03-17 07:44:24,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:44:24,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b663451727ff69d6f272e0 HTTP/1.1" 200 None 2026-03-17 07:44:24,217 - lava_callback - DEBUG - Processing node 69b663451727ff69d6f272e0: baseline-arm64-baylibre 2026-03-17 07:44:24,217 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b663451727ff69d6f272e0 2026-03-17 07:44:24,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:44:24,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b663451727ff69d6f272e0 HTTP/1.1" 200 None 2026-03-17 07:44:24,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:44:24,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:44:24,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:44:24,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b663451727ff69d6f272e0 HTTP/1.1" 200 None 2026-03-17 07:44:24,280 - lava_callback - ERROR - Error processing callback for node 69b663451727ff69d6f272e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46846 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:45:23,853 - lava_callback - INFO - Received callback for node 69b6638e1727ff69d6f272ef INFO: 172.21.0.1:34490 - "POST /node/69b6638e1727ff69d6f272ef HTTP/1.0" 202 Accepted 2026-03-17 07:45:23,859 - lava_callback - INFO - Starting async job submit for node 69b6638e1727ff69d6f272ef 2026-03-17 07:45:23,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:45:23,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6638e1727ff69d6f272ef HTTP/1.1" 200 None 2026-03-17 07:45:23,875 - lava_callback - DEBUG - Processing node 69b6638e1727ff69d6f272ef: baseline-arm64-baylibre 2026-03-17 07:45:23,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6638e1727ff69d6f272ef 2026-03-17 07:45:23,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:45:23,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6638e1727ff69d6f272ef HTTP/1.1" 200 None 2026-03-17 07:45:23,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:45:23,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:45:23,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:45:23,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6638e1727ff69d6f272ef HTTP/1.1" 200 None 2026-03-17 07:45:23,931 - lava_callback - ERROR - Error processing callback for node 69b6638e1727ff69d6f272ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:46:50,924 - lava_callback - INFO - Received callback for node 69b663dd1727ff69d6f272fd INFO: 172.21.0.1:36720 - "POST /node/69b663dd1727ff69d6f272fd HTTP/1.0" 202 Accepted 2026-03-17 07:46:50,930 - lava_callback - INFO - Starting async job submit for node 69b663dd1727ff69d6f272fd 2026-03-17 07:46:50,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:46:50,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b663dd1727ff69d6f272fd HTTP/1.1" 200 None 2026-03-17 07:46:50,946 - lava_callback - DEBUG - Processing node 69b663dd1727ff69d6f272fd: baseline-arm64-clabbe 2026-03-17 07:46:50,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b663dd1727ff69d6f272fd 2026-03-17 07:46:50,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:46:50,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b663dd1727ff69d6f272fd HTTP/1.1" 200 None 2026-03-17 07:46:50,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:46:50,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:46:50,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:46:51,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b663dd1727ff69d6f272fd HTTP/1.1" 200 None 2026-03-17 07:46:51,018 - lava_callback - ERROR - Error processing callback for node 69b663dd1727ff69d6f272fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:48:10,995 - lava_callback - INFO - Received callback for node 69b664281727ff69d6f27308 INFO: 172.21.0.1:41048 - "POST /node/69b664281727ff69d6f27308 HTTP/1.0" 202 Accepted 2026-03-17 07:48:11,000 - lava_callback - INFO - Starting async job submit for node 69b664281727ff69d6f27308 2026-03-17 07:48:11,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:48:11,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b664281727ff69d6f27308 HTTP/1.1" 200 None 2026-03-17 07:48:11,039 - lava_callback - DEBUG - Processing node 69b664281727ff69d6f27308: baseline-arm64-clabbe 2026-03-17 07:48:11,039 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b664281727ff69d6f27308 2026-03-17 07:48:11,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:48:11,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b664281727ff69d6f27308 HTTP/1.1" 200 None 2026-03-17 07:48:11,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:48:11,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:48:11,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:48:11,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b664281727ff69d6f27308 HTTP/1.1" 200 None 2026-03-17 07:48:11,099 - lava_callback - ERROR - Error processing callback for node 69b664281727ff69d6f27308: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:49:11,001 - lava_callback - INFO - Received callback for node 69b664721727ff69d6f27313 INFO: 172.21.0.1:49692 - "POST /node/69b664721727ff69d6f27313 HTTP/1.0" 202 Accepted 2026-03-17 07:49:11,008 - lava_callback - INFO - Starting async job submit for node 69b664721727ff69d6f27313 2026-03-17 07:49:11,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:49:11,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b664721727ff69d6f27313 HTTP/1.1" 200 None 2026-03-17 07:49:11,026 - lava_callback - DEBUG - Processing node 69b664721727ff69d6f27313: baseline-arm64-clabbe 2026-03-17 07:49:11,026 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b664721727ff69d6f27313 2026-03-17 07:49:11,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:49:11,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b664721727ff69d6f27313 HTTP/1.1" 200 None 2026-03-17 07:49:11,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:49:11,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:49:11,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:49:11,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b664721727ff69d6f27313 HTTP/1.1" 200 None 2026-03-17 07:49:11,092 - lava_callback - ERROR - Error processing callback for node 69b664721727ff69d6f27313: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47122 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:50:31,069 - lava_callback - INFO - Received callback for node 69b664bd1727ff69d6f2731d INFO: 172.21.0.1:53638 - "POST /node/69b664bd1727ff69d6f2731d HTTP/1.0" 202 Accepted 2026-03-17 07:50:31,074 - lava_callback - INFO - Starting async job submit for node 69b664bd1727ff69d6f2731d 2026-03-17 07:50:31,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:50:31,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b664bd1727ff69d6f2731d HTTP/1.1" 200 None 2026-03-17 07:50:31,091 - lava_callback - DEBUG - Processing node 69b664bd1727ff69d6f2731d: baseline-arm64-clabbe 2026-03-17 07:50:31,092 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b664bd1727ff69d6f2731d 2026-03-17 07:50:31,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:50:31,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b664bd1727ff69d6f2731d HTTP/1.1" 200 None 2026-03-17 07:50:31,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:50:31,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:50:31,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:50:31,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b664bd1727ff69d6f2731d HTTP/1.1" 200 None 2026-03-17 07:50:31,167 - lava_callback - ERROR - Error processing callback for node 69b664bd1727ff69d6f2731d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:51:51,160 - lava_callback - INFO - Received callback for node 69b665071727ff69d6f27327 INFO: 172.21.0.1:54530 - "POST /node/69b665071727ff69d6f27327 HTTP/1.0" 202 Accepted 2026-03-17 07:51:51,165 - lava_callback - INFO - Starting async job submit for node 69b665071727ff69d6f27327 2026-03-17 07:51:51,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:51:51,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b665071727ff69d6f27327 HTTP/1.1" 200 None 2026-03-17 07:51:51,185 - lava_callback - DEBUG - Processing node 69b665071727ff69d6f27327: baseline-arm64-clabbe 2026-03-17 07:51:51,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b665071727ff69d6f27327 2026-03-17 07:51:51,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:51:51,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b665071727ff69d6f27327 HTTP/1.1" 200 None 2026-03-17 07:51:51,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:51:51,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:51:51,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:51:51,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b665071727ff69d6f27327 HTTP/1.1" 200 None 2026-03-17 07:51:51,250 - lava_callback - ERROR - Error processing callback for node 69b665071727ff69d6f27327: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54064 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:53:11,224 - lava_callback - INFO - Received callback for node 69b665521727ff69d6f27336 INFO: 172.21.0.1:58222 - "POST /node/69b665521727ff69d6f27336 HTTP/1.0" 202 Accepted 2026-03-17 07:53:11,230 - lava_callback - INFO - Starting async job submit for node 69b665521727ff69d6f27336 2026-03-17 07:53:11,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:53:11,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b665521727ff69d6f27336 HTTP/1.1" 200 None 2026-03-17 07:53:11,247 - lava_callback - DEBUG - Processing node 69b665521727ff69d6f27336: baseline-arm64-clabbe 2026-03-17 07:53:11,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b665521727ff69d6f27336 2026-03-17 07:53:11,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:53:11,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b665521727ff69d6f27336 HTTP/1.1" 200 None 2026-03-17 07:53:11,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:53:11,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:53:11,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:53:11,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b665521727ff69d6f27336 HTTP/1.1" 200 None 2026-03-17 07:53:11,318 - lava_callback - ERROR - Error processing callback for node 69b665521727ff69d6f27336: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:54:11,268 - lava_callback - INFO - Received callback for node 69b6659c1727ff69d6f2733f INFO: 172.21.0.1:58924 - "POST /node/69b6659c1727ff69d6f2733f HTTP/1.0" 202 Accepted 2026-03-17 07:54:11,274 - lava_callback - INFO - Starting async job submit for node 69b6659c1727ff69d6f2733f 2026-03-17 07:54:11,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:54:11,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6659c1727ff69d6f2733f HTTP/1.1" 200 None 2026-03-17 07:54:11,292 - lava_callback - DEBUG - Processing node 69b6659c1727ff69d6f2733f: baseline-arm64-clabbe 2026-03-17 07:54:11,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6659c1727ff69d6f2733f 2026-03-17 07:54:11,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:54:11,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6659c1727ff69d6f2733f HTTP/1.1" 200 None 2026-03-17 07:54:11,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:54:11,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:54:11,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:54:11,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6659c1727ff69d6f2733f HTTP/1.1" 200 None 2026-03-17 07:54:11,362 - lava_callback - ERROR - Error processing callback for node 69b6659c1727ff69d6f2733f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:55:31,341 - lava_callback - INFO - Received callback for node 69b665e81727ff69d6f2734b INFO: 172.21.0.1:44868 - "POST /node/69b665e81727ff69d6f2734b HTTP/1.0" 202 Accepted 2026-03-17 07:55:31,346 - lava_callback - INFO - Starting async job submit for node 69b665e81727ff69d6f2734b 2026-03-17 07:55:31,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:55:31,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b665e81727ff69d6f2734b HTTP/1.1" 200 None 2026-03-17 07:55:31,362 - lava_callback - DEBUG - Processing node 69b665e81727ff69d6f2734b: baseline-arm64-clabbe 2026-03-17 07:55:31,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b665e81727ff69d6f2734b 2026-03-17 07:55:31,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:55:31,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b665e81727ff69d6f2734b HTTP/1.1" 200 None 2026-03-17 07:55:31,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:55:31,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:55:31,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:55:31,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b665e81727ff69d6f2734b HTTP/1.1" 200 None 2026-03-17 07:55:31,417 - lava_callback - ERROR - Error processing callback for node 69b665e81727ff69d6f2734b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:56:51,537 - lava_callback - INFO - Received callback for node 69b666321727ff69d6f27355 INFO: 172.21.0.1:51308 - "POST /node/69b666321727ff69d6f27355 HTTP/1.0" 202 Accepted 2026-03-17 07:56:51,543 - lava_callback - INFO - Starting async job submit for node 69b666321727ff69d6f27355 2026-03-17 07:56:51,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:56:51,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b666321727ff69d6f27355 HTTP/1.1" 200 None 2026-03-17 07:56:51,560 - lava_callback - DEBUG - Processing node 69b666321727ff69d6f27355: baseline-arm64-clabbe 2026-03-17 07:56:51,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b666321727ff69d6f27355 2026-03-17 07:56:51,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:56:51,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b666321727ff69d6f27355 HTTP/1.1" 200 None 2026-03-17 07:56:51,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:56:51,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:56:51,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:56:51,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b666321727ff69d6f27355 HTTP/1.1" 200 None 2026-03-17 07:56:51,627 - lava_callback - ERROR - Error processing callback for node 69b666321727ff69d6f27355: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43816 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:57:51,400 - lava_callback - INFO - Received callback for node 69b6667c1727ff69d6f27361 INFO: 172.21.0.1:49732 - "POST /node/69b6667c1727ff69d6f27361 HTTP/1.0" 202 Accepted 2026-03-17 07:57:51,405 - lava_callback - INFO - Starting async job submit for node 69b6667c1727ff69d6f27361 2026-03-17 07:57:51,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:57:51,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6667c1727ff69d6f27361 HTTP/1.1" 200 None 2026-03-17 07:57:51,421 - lava_callback - DEBUG - Processing node 69b6667c1727ff69d6f27361: baseline-arm64-clabbe 2026-03-17 07:57:51,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b6667c1727ff69d6f27361 2026-03-17 07:57:51,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:57:51,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b6667c1727ff69d6f27361 HTTP/1.1" 200 None 2026-03-17 07:57:51,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:57:51,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:57:51,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:57:51,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b6667c1727ff69d6f27361 HTTP/1.1" 200 None 2026-03-17 07:57:51,474 - lava_callback - ERROR - Error processing callback for node 69b6667c1727ff69d6f27361: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK 2026-03-17 07:59:09,395 - lava_callback - INFO - User chris.paterson2@renesas.com is checking out None at custom commit 4a8da9cdb192bf691ba3cad0a593aebd84931b4c 2026-03-17 07:59:09,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:59:09,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/node HTTP/1.1" 200 None 2026-03-17 07:59:09,421 - lava_callback - INFO - Checkout node 69b909cdfbe29c53ae8604d4 submitted INFO: 172.21.0.1:42166 - "POST /api/checkout HTTP/1.0" 200 OK 2026-03-17 07:59:11,446 - lava_callback - INFO - Received callback for node 69b666c61727ff69d6f27369 INFO: 172.21.0.1:51326 - "POST /node/69b666c61727ff69d6f27369 HTTP/1.0" 202 Accepted 2026-03-17 07:59:11,451 - lava_callback - INFO - Starting async job submit for node 69b666c61727ff69d6f27369 2026-03-17 07:59:11,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:59:11,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b666c61727ff69d6f27369 HTTP/1.1" 200 None 2026-03-17 07:59:11,482 - lava_callback - DEBUG - Processing node 69b666c61727ff69d6f27369: baseline-arm64-clabbe 2026-03-17 07:59:11,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b666c61727ff69d6f27369 2026-03-17 07:59:11,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:59:11,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b666c61727ff69d6f27369 HTTP/1.1" 200 None 2026-03-17 07:59:11,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:59:11,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 07:59:11,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 07:59:11,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b666c61727ff69d6f27369 HTTP/1.1" 200 None 2026-03-17 07:59:11,546 - lava_callback - ERROR - Error processing callback for node 69b666c61727ff69d6f27369: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45442 - "GET / HTTP/1.0" 200 OK 2026-03-17 08:00:31,748 - lava_callback - INFO - Received callback for node 69b667101727ff69d6f27377 INFO: 172.21.0.1:44730 - "POST /node/69b667101727ff69d6f27377 HTTP/1.0" 202 Accepted 2026-03-17 08:00:31,757 - lava_callback - INFO - Starting async job submit for node 69b667101727ff69d6f27377 2026-03-17 08:00:31,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:00:31,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b667101727ff69d6f27377 HTTP/1.1" 200 None 2026-03-17 08:00:31,780 - lava_callback - DEBUG - Processing node 69b667101727ff69d6f27377: baseline-arm64-clabbe 2026-03-17 08:00:31,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b667101727ff69d6f27377 2026-03-17 08:00:31,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:00:31,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b667101727ff69d6f27377 HTTP/1.1" 200 None 2026-03-17 08:00:31,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:00:31,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-17 08:00:31,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 08:00:31,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b667101727ff69d6f27377 HTTP/1.1" 200 None 2026-03-17 08:00:31,864 - lava_callback - ERROR - Error processing callback for node 69b667101727ff69d6f27377: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49842 - "GET /wiki HTTP/1.0" 404 Not Found INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]