INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51742 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:29:32,769 - lava_callback - INFO - Received callback for node 69b7e19b00b80c8ffdcb8eaf 2026-03-16 11:29:32,777 - lava_callback - INFO - Starting async job submit for node 69b7e19b00b80c8ffdcb8eaf INFO: 172.20.0.1:57020 - "POST /node/69b7e19b00b80c8ffdcb8eaf HTTP/1.0" 202 Accepted 2026-03-16 11:29:32,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:29:32,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e19b00b80c8ffdcb8eaf HTTP/1.1" 200 None 2026-03-16 11:29:32,843 - lava_callback - DEBUG - Processing node 69b7e19b00b80c8ffdcb8eaf: baseline-arm64-broonie 2026-03-16 11:29:33,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:29:33,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:29:33,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b7e19b00b80c8ffdcb8eaf/log.txt.gz 2026-03-16 11:29:33,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:29:33,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:29:33,616 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b7e19b00b80c8ffdcb8eaf/lava-logs.yaml 2026-03-16 11:29:33,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:29:33,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:29:33,797 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b7e19b00b80c8ffdcb8eaf/lava_callback.json.gz 2026-03-16 11:29:33,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:29:33,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e19b00b80c8ffdcb8eaf HTTP/1.1" 200 None 2026-03-16 11:29:33,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:29:33,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:29:33,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:29:33,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e19b00b80c8ffdcb8eaf HTTP/1.1" 200 None 2026-03-16 11:29:33,924 - lava_callback - INFO - Completed processing callback for node 69b7e19b00b80c8ffdcb8eaf INFO: 172.20.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39098 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:30:03,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:30:03,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44144 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:30:27,932 - lava_callback - INFO - Received callback for node 69b7e7e500b80c8ffdcb90ae INFO: 172.20.0.1:44150 - "POST /node/69b7e7e500b80c8ffdcb90ae HTTP/1.0" 202 Accepted 2026-03-16 11:30:27,944 - lava_callback - INFO - Starting async job submit for node 69b7e7e500b80c8ffdcb90ae 2026-03-16 11:30:28,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:30:28,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e7e500b80c8ffdcb90ae HTTP/1.1" 200 None 2026-03-16 11:30:28,038 - lava_callback - DEBUG - Processing node 69b7e7e500b80c8ffdcb90ae: baseline-arm64 2026-03-16 11:30:28,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:30:28,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:30:28,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e7e500b80c8ffdcb90ae/log.txt.gz 2026-03-16 11:30:29,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:30:29,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:30:29,569 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e7e500b80c8ffdcb90ae/lava-logs.yaml 2026-03-16 11:30:29,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:30:29,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:30:29,844 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e7e500b80c8ffdcb90ae/lava_callback.json.gz DEBUG: Setup failed for 69b7e7e500b80c8ffdcb90ae. Transitting job node result: incomplete -> fail 2026-03-16 11:30:29,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:30:29,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e7e500b80c8ffdcb90ae HTTP/1.1" 200 None 2026-03-16 11:30:29,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:30:29,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:30:30,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:30:30,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e7e500b80c8ffdcb90ae HTTP/1.1" 200 None 2026-03-16 11:30:30,106 - lava_callback - INFO - Completed processing callback for node 69b7e7e500b80c8ffdcb90ae 2026-03-16 11:30:33,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:30:33,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51688 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:33:05,513 - lava_callback - INFO - Received callback for node 69b7e5e100b80c8ffdcb9072 INFO: 172.20.0.1:42984 - "POST /node/69b7e5e100b80c8ffdcb9072 HTTP/1.0" 202 Accepted 2026-03-16 11:33:05,561 - lava_callback - INFO - Starting async job submit for node 69b7e5e100b80c8ffdcb9072 2026-03-16 11:33:05,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:33:05,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e5e100b80c8ffdcb9072 HTTP/1.1" 200 None 2026-03-16 11:33:05,644 - lava_callback - DEBUG - Processing node 69b7e5e100b80c8ffdcb9072: baseline-arm-pengutronix 2026-03-16 11:33:05,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:33:05,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:33:05,914 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7e5e100b80c8ffdcb9072/log.txt.gz 2026-03-16 11:33:05,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:33:06,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:33:06,184 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7e5e100b80c8ffdcb9072/lava-logs.yaml 2026-03-16 11:33:06,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:33:06,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:33:06,354 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7e5e100b80c8ffdcb9072/lava_callback.json.gz DEBUG: Setup failed for 69b7e5e100b80c8ffdcb9072. Transitting job node result: incomplete -> fail 2026-03-16 11:33:06,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:42996 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:33:06,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e5e100b80c8ffdcb9072 HTTP/1.1" 200 None 2026-03-16 11:33:06,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:33:06,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-16 11:33:06,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:33:06,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e5e100b80c8ffdcb9072 HTTP/1.1" 200 None 2026-03-16 11:33:06,688 - lava_callback - INFO - Completed processing callback for node 69b7e5e100b80c8ffdcb9072 INFO: 172.20.0.1:47608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52268 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:33:33,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:33:33,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60020 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:37:37,053 - lava_callback - INFO - Received callback for node 69b7e17400b80c8ffdcb8e2d INFO: 172.20.0.1:60030 - "POST /node/69b7e17400b80c8ffdcb8e2d HTTP/1.0" 202 Accepted 2026-03-16 11:37:37,059 - lava_callback - INFO - Starting async job submit for node 69b7e17400b80c8ffdcb8e2d 2026-03-16 11:37:37,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:37:37,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17400b80c8ffdcb8e2d HTTP/1.1" 200 None 2026-03-16 11:37:37,096 - lava_callback - DEBUG - Processing node 69b7e17400b80c8ffdcb8e2d: baseline-arm64 2026-03-16 11:37:37,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:37:37,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:37:37,576 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17400b80c8ffdcb8e2d/log.txt.gz 2026-03-16 11:37:37,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:37:38,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:37:38,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17400b80c8ffdcb8e2d/lava-logs.yaml 2026-03-16 11:37:38,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:37:38,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:37:38,189 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17400b80c8ffdcb8e2d/lava_callback.json.gz 2026-03-16 11:37:38,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:37:38,237 - lava_callback - INFO - Received callback for node 69b7e17200b80c8ffdcb8e2a 2026-03-16 11:37:38,243 - lava_callback - INFO - Starting async job submit for node 69b7e17200b80c8ffdcb8e2a INFO: 172.20.0.1:60036 - "POST /node/69b7e17200b80c8ffdcb8e2a HTTP/1.0" 202 Accepted 2026-03-16 11:37:38,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:37:38,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17400b80c8ffdcb8e2d HTTP/1.1" 200 None 2026-03-16 11:37:38,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:37:38,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17200b80c8ffdcb8e2a HTTP/1.1" 200 None 2026-03-16 11:37:38,283 - lava_callback - DEBUG - Processing node 69b7e17200b80c8ffdcb8e2a: baseline-arm64 2026-03-16 11:37:38,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:37:38,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:37:38,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e17400b80c8ffdcb8e2d HTTP/1.1" 200 None 2026-03-16 11:37:38,485 - lava_callback - INFO - Completed processing callback for node 69b7e17400b80c8ffdcb8e2d 2026-03-16 11:37:38,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:37:38,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:37:38,955 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17200b80c8ffdcb8e2a/log.txt.gz 2026-03-16 11:37:39,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:37:39,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:37:39,402 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17200b80c8ffdcb8e2a/lava-logs.yaml 2026-03-16 11:37:39,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:37:39,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:37:39,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17200b80c8ffdcb8e2a/lava_callback.json.gz 2026-03-16 11:37:39,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:37:39,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17200b80c8ffdcb8e2a HTTP/1.1" 200 None 2026-03-16 11:37:39,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:37:39,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:37:39,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:37:39,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e17200b80c8ffdcb8e2a HTTP/1.1" 200 None 2026-03-16 11:37:39,658 - lava_callback - INFO - Completed processing callback for node 69b7e17200b80c8ffdcb8e2a INFO: 172.20.0.1:41702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56258 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:38:04,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:38:04,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47606 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:38:10,095 - lava_callback - INFO - Received callback for node 69b7e18400b80c8ffdcb8e59 INFO: 172.20.0.1:35380 - "POST /node/69b7e18400b80c8ffdcb8e59 HTTP/1.0" 202 Accepted 2026-03-16 11:38:10,101 - lava_callback - INFO - Starting async job submit for node 69b7e18400b80c8ffdcb8e59 2026-03-16 11:38:10,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:38:10,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18400b80c8ffdcb8e59 HTTP/1.1" 200 None 2026-03-16 11:38:10,140 - lava_callback - DEBUG - Processing node 69b7e18400b80c8ffdcb8e59: baseline-nfs-arm64 2026-03-16 11:38:10,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:38:10,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:38:10,855 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18400b80c8ffdcb8e59/log.txt.gz 2026-03-16 11:38:11,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:38:11,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:38:11,316 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18400b80c8ffdcb8e59/lava-logs.yaml 2026-03-16 11:38:11,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:38:11,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:38:11,542 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18400b80c8ffdcb8e59/lava_callback.json.gz 2026-03-16 11:38:11,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:38:11,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18400b80c8ffdcb8e59 HTTP/1.1" 200 None 2026-03-16 11:38:11,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:38:11,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:38:11,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:38:11,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e18400b80c8ffdcb8e59 HTTP/1.1" 200 None 2026-03-16 11:38:11,679 - lava_callback - INFO - Completed processing callback for node 69b7e18400b80c8ffdcb8e59 INFO: 172.20.0.1:35382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51716 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:38:34,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:38:34,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57878 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:39:24,193 - lava_callback - INFO - Received callback for node 69b7e18500b80c8ffdcb8e5c INFO: 172.20.0.1:57890 - "POST /node/69b7e18500b80c8ffdcb8e5c HTTP/1.0" 202 Accepted 2026-03-16 11:39:24,199 - lava_callback - INFO - Starting async job submit for node 69b7e18500b80c8ffdcb8e5c 2026-03-16 11:39:24,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:39:24,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18500b80c8ffdcb8e5c HTTP/1.1" 200 None 2026-03-16 11:39:24,245 - lava_callback - DEBUG - Processing node 69b7e18500b80c8ffdcb8e5c: baseline-nfs-arm64 2026-03-16 11:39:24,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:39:24,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:39:24,853 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18500b80c8ffdcb8e5c/log.txt.gz 2026-03-16 11:39:25,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:39:25,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:39:25,344 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18500b80c8ffdcb8e5c/lava-logs.yaml 2026-03-16 11:39:25,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:39:25,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:39:25,515 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18500b80c8ffdcb8e5c/lava_callback.json.gz 2026-03-16 11:39:25,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:39:25,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18500b80c8ffdcb8e5c HTTP/1.1" 200 None 2026-03-16 11:39:25,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:39:25,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:39:25,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:39:25,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e18500b80c8ffdcb8e5c HTTP/1.1" 200 None 2026-03-16 11:39:25,595 - lava_callback - INFO - Completed processing callback for node 69b7e18500b80c8ffdcb8e5c INFO: 172.20.0.1:57898 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:39:34,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:39:34,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59116 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:39:57,831 - lava_callback - INFO - Received callback for node 69b7e17500b80c8ffdcb8e30 INFO: 172.20.0.1:59124 - "POST /node/69b7e17500b80c8ffdcb8e30 HTTP/1.0" 202 Accepted 2026-03-16 11:39:57,838 - lava_callback - INFO - Starting async job submit for node 69b7e17500b80c8ffdcb8e30 2026-03-16 11:39:57,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:39:57,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17500b80c8ffdcb8e30 HTTP/1.1" 200 None 2026-03-16 11:39:57,875 - lava_callback - DEBUG - Processing node 69b7e17500b80c8ffdcb8e30: baseline-arm64 2026-03-16 11:39:58,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:39:58,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:39:58,455 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17500b80c8ffdcb8e30/log.txt.gz 2026-03-16 11:39:58,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:39:58,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:39:58,929 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17500b80c8ffdcb8e30/lava-logs.yaml 2026-03-16 11:39:58,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:39:59,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:39:59,098 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17500b80c8ffdcb8e30/lava_callback.json.gz 2026-03-16 11:39:59,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:39:59,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17500b80c8ffdcb8e30 HTTP/1.1" 200 None 2026-03-16 11:39:59,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:39:59,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:39:59,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:39:59,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e17500b80c8ffdcb8e30 HTTP/1.1" 200 None 2026-03-16 11:39:59,244 - lava_callback - INFO - Completed processing callback for node 69b7e17500b80c8ffdcb8e30 2026-03-16 11:40:04,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:40:04,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47712 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:41:03,937 - lava_callback - INFO - Received callback for node 69b7ec15113612b7716b9e6b INFO: 172.20.0.1:50244 - "POST /node/69b7ec15113612b7716b9e6b HTTP/1.0" 202 Accepted 2026-03-16 11:41:03,944 - lava_callback - INFO - Starting async job submit for node 69b7ec15113612b7716b9e6b 2026-03-16 11:41:03,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:41:03,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ec15113612b7716b9e6b HTTP/1.1" 200 None 2026-03-16 11:41:03,985 - lava_callback - DEBUG - Processing node 69b7ec15113612b7716b9e6b: baseline-arm64 2026-03-16 11:41:04,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:41:04,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:41:04,519 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7ec15113612b7716b9e6b/log.txt.gz 2026-03-16 11:41:04,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:41:05,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:41:05,012 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7ec15113612b7716b9e6b/lava-logs.yaml 2026-03-16 11:41:05,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:41:05,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:41:05,218 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7ec15113612b7716b9e6b/lava_callback.json.gz 2026-03-16 11:41:05,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:41:05,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ec15113612b7716b9e6b HTTP/1.1" 200 None 2026-03-16 11:41:05,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:41:05,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:41:05,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:41:05,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7ec15113612b7716b9e6b HTTP/1.1" 200 None 2026-03-16 11:41:05,319 - lava_callback - INFO - Completed processing callback for node 69b7ec15113612b7716b9e6b INFO: 172.20.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35080 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:41:34,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:41:34,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56784 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:46:53,153 - lava_callback - INFO - Received callback for node 69b7ed3a113612b7716b9e7c INFO: 172.20.0.1:35320 - "POST /node/69b7ed3a113612b7716b9e7c HTTP/1.0" 202 Accepted 2026-03-16 11:46:53,159 - lava_callback - INFO - Starting async job submit for node 69b7ed3a113612b7716b9e7c 2026-03-16 11:46:53,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:46:53,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ed3a113612b7716b9e7c HTTP/1.1" 200 None 2026-03-16 11:46:53,196 - lava_callback - DEBUG - Processing node 69b7ed3a113612b7716b9e7c: baseline-arm 2026-03-16 11:46:53,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:46:53,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:46:53,531 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b7ed3a113612b7716b9e7c/log.txt.gz 2026-03-16 11:46:53,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:46:53,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:46:53,845 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b7ed3a113612b7716b9e7c/lava-logs.yaml 2026-03-16 11:46:53,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:46:54,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:46:54,006 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b7ed3a113612b7716b9e7c/lava_callback.json.gz 2026-03-16 11:46:54,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:46:54,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ed3a113612b7716b9e7c HTTP/1.1" 200 None 2026-03-16 11:46:54,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:46:54,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e976113612b7716b9df8 HTTP/1.1" 200 None 2026-03-16 11:46:54,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:46:54,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7ed3a113612b7716b9e7c HTTP/1.1" 200 None 2026-03-16 11:46:54,088 - lava_callback - INFO - Completed processing callback for node 69b7ed3a113612b7716b9e7c INFO: 172.20.0.1:35334 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:47:04,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:47:04,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52830 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:47:40,951 - lava_callback - INFO - Received callback for node 69b7e17c00b80c8ffdcb8e43 INFO: 172.20.0.1:55206 - "POST /node/69b7e17c00b80c8ffdcb8e43 HTTP/1.0" 202 Accepted 2026-03-16 11:47:40,958 - lava_callback - INFO - Starting async job submit for node 69b7e17c00b80c8ffdcb8e43 2026-03-16 11:47:40,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:47:41,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17c00b80c8ffdcb8e43 HTTP/1.1" 200 None 2026-03-16 11:47:41,001 - lava_callback - DEBUG - Processing node 69b7e17c00b80c8ffdcb8e43: baseline-arm64 2026-03-16 11:47:41,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:47:41,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:47:41,454 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17c00b80c8ffdcb8e43/log.txt.gz 2026-03-16 11:47:41,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:47:41,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:47:41,884 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17c00b80c8ffdcb8e43/lava-logs.yaml 2026-03-16 11:47:41,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:47:42,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:47:42,045 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17c00b80c8ffdcb8e43/lava_callback.json.gz 2026-03-16 11:47:42,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:47:42,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17c00b80c8ffdcb8e43 HTTP/1.1" 200 None 2026-03-16 11:47:42,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:47:42,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:47:42,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:47:42,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e17c00b80c8ffdcb8e43 HTTP/1.1" 200 None 2026-03-16 11:47:42,142 - lava_callback - INFO - Completed processing callback for node 69b7e17c00b80c8ffdcb8e43 INFO: 172.20.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35512 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:48:04,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:04,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46606 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:48:10,772 - lava_callback - INFO - Received callback for node 69b7edd9113612b7716b9e9a INFO: 172.20.0.1:43148 - "POST /node/69b7edd9113612b7716b9e9a HTTP/1.0" 202 Accepted 2026-03-16 11:48:10,778 - lava_callback - INFO - Starting async job submit for node 69b7edd9113612b7716b9e9a 2026-03-16 11:48:10,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:10,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7edd9113612b7716b9e9a HTTP/1.1" 200 None 2026-03-16 11:48:10,811 - lava_callback - DEBUG - Processing node 69b7edd9113612b7716b9e9a: baseline-x86 2026-03-16 11:48:11,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:48:11,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:48:11,160 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b7edd9113612b7716b9e9a/log.txt.gz 2026-03-16 11:48:11,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:48:11,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:48:11,448 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b7edd9113612b7716b9e9a/lava-logs.yaml 2026-03-16 11:48:11,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:48:11,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:48:11,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b7edd9113612b7716b9e9a/lava_callback.json.gz 2026-03-16 11:48:11,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:11,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7edd9113612b7716b9e9a HTTP/1.1" 200 None 2026-03-16 11:48:11,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:11,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e997113612b7716b9e1b HTTP/1.1" 200 None 2026-03-16 11:48:11,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:11,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7edd9113612b7716b9e9a HTTP/1.1" 200 None 2026-03-16 11:48:11,709 - lava_callback - INFO - Completed processing callback for node 69b7edd9113612b7716b9e9a INFO: 172.20.0.1:43150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36906 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:48:34,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:34,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50664 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:48:52,723 - lava_callback - INFO - Received callback for node 69b7edd7113612b7716b9e94 INFO: 172.20.0.1:56428 - "POST /node/69b7edd7113612b7716b9e94 HTTP/1.0" 202 Accepted 2026-03-16 11:48:52,730 - lava_callback - INFO - Starting async job submit for node 69b7edd7113612b7716b9e94 2026-03-16 11:48:52,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:52,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7edd7113612b7716b9e94 HTTP/1.1" 200 None 2026-03-16 11:48:52,773 - lava_callback - DEBUG - Processing node 69b7edd7113612b7716b9e94: baseline-x86 2026-03-16 11:48:53,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:48:53,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:48:53,403 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b7edd7113612b7716b9e94/log.txt.gz 2026-03-16 11:48:53,600 - lava_callback - INFO - Received callback for node 69b7edd7113612b7716b9e91 INFO: 172.20.0.1:56444 - "POST /node/69b7edd7113612b7716b9e91 HTTP/1.0" 202 Accepted 2026-03-16 11:48:53,610 - lava_callback - INFO - Starting async job submit for node 69b7edd7113612b7716b9e91 2026-03-16 11:48:53,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:48:53,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:53,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7edd7113612b7716b9e91 HTTP/1.1" 200 None 2026-03-16 11:48:53,651 - lava_callback - DEBUG - Processing node 69b7edd7113612b7716b9e91: baseline-x86 2026-03-16 11:48:53,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:48:53,893 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b7edd7113612b7716b9e94/lava-logs.yaml 2026-03-16 11:48:53,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:48:53,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:48:54,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:48:54,052 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b7edd7113612b7716b9e91/log.txt.gz 2026-03-16 11:48:54,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:48:54,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:48:54,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b7edd7113612b7716b9e94/lava_callback.json.gz 2026-03-16 11:48:54,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:54,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7edd7113612b7716b9e94 HTTP/1.1" 200 None 2026-03-16 11:48:54,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:54,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e997113612b7716b9e1b HTTP/1.1" 200 None 2026-03-16 11:48:54,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:54,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7edd7113612b7716b9e94 HTTP/1.1" 200 None 2026-03-16 11:48:54,371 - lava_callback - INFO - Completed processing callback for node 69b7edd7113612b7716b9e94 2026-03-16 11:48:54,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:48:54,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b7edd7113612b7716b9e91/lava-logs.yaml 2026-03-16 11:48:54,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:48:54,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:48:54,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b7edd7113612b7716b9e91/lava_callback.json.gz 2026-03-16 11:48:54,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:54,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7edd7113612b7716b9e91 HTTP/1.1" 200 None 2026-03-16 11:48:54,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:54,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e997113612b7716b9e1b HTTP/1.1" 200 None 2026-03-16 11:48:54,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:48:54,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7edd7113612b7716b9e91 HTTP/1.1" 200 None 2026-03-16 11:48:54,757 - lava_callback - INFO - Completed processing callback for node 69b7edd7113612b7716b9e91 INFO: 172.20.0.1:56460 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:49:04,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:49:04,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 11:49:06,153 - lava_callback - INFO - Received callback for node 69b7e18c00b80c8ffdcb8e90 INFO: 172.20.0.1:59226 - "POST /node/69b7e18c00b80c8ffdcb8e90 HTTP/1.0" 202 Accepted 2026-03-16 11:49:06,160 - lava_callback - INFO - Starting async job submit for node 69b7e18c00b80c8ffdcb8e90 2026-03-16 11:49:06,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:49:06,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18c00b80c8ffdcb8e90 HTTP/1.1" 200 None 2026-03-16 11:49:06,217 - lava_callback - DEBUG - Processing node 69b7e18c00b80c8ffdcb8e90: baseline-nfs-arm64 INFO: 172.20.0.1:59240 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:49:06,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:49:06,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:49:06,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18c00b80c8ffdcb8e90/log.txt.gz 2026-03-16 11:49:07,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:49:07,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:49:07,474 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18c00b80c8ffdcb8e90/lava-logs.yaml 2026-03-16 11:49:07,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:49:07,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:49:07,699 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18c00b80c8ffdcb8e90/lava_callback.json.gz 2026-03-16 11:49:07,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:49:07,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18c00b80c8ffdcb8e90 HTTP/1.1" 200 None 2026-03-16 11:49:07,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:49:07,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:49:07,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:49:07,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e18c00b80c8ffdcb8e90 HTTP/1.1" 200 None 2026-03-16 11:49:07,795 - lava_callback - INFO - Completed processing callback for node 69b7e18c00b80c8ffdcb8e90 INFO: 172.20.0.1:38750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50482 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:49:34,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:49:34,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41184 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:54:53,106 - lava_callback - INFO - Received callback for node 69b7e16d00b80c8ffdcb8e1e INFO: 172.20.0.1:42176 - "POST /node/69b7e16d00b80c8ffdcb8e1e HTTP/1.0" 202 Accepted 2026-03-16 11:54:53,113 - lava_callback - INFO - Starting async job submit for node 69b7e16d00b80c8ffdcb8e1e 2026-03-16 11:54:53,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:54:53,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e16d00b80c8ffdcb8e1e HTTP/1.1" 200 None 2026-03-16 11:54:53,157 - lava_callback - DEBUG - Processing node 69b7e16d00b80c8ffdcb8e1e: baseline-arm64 2026-03-16 11:54:53,296 - lava_callback - WARNING - Failed to upload log 2026-03-16 11:54:53,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:54:53,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:54:53,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e16d00b80c8ffdcb8e1e/lava-logs.yaml 2026-03-16 11:54:53,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:54:53,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:54:53,777 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e16d00b80c8ffdcb8e1e/lava_callback.json.gz 2026-03-16 11:54:53,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:54:53,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e16d00b80c8ffdcb8e1e HTTP/1.1" 200 None 2026-03-16 11:54:53,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:54:53,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:54:53,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:54:53,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e16d00b80c8ffdcb8e1e HTTP/1.1" 200 None 2026-03-16 11:54:53,924 - lava_callback - INFO - Completed processing callback for node 69b7e16d00b80c8ffdcb8e1e INFO: 172.20.0.1:42190 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:55:04,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:55:04,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36254 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:55:50,943 - lava_callback - INFO - Received callback for node 69b7ef90113612b7716bc482 INFO: 172.20.0.1:60080 - "POST /node/69b7ef90113612b7716bc482 HTTP/1.0" 202 Accepted 2026-03-16 11:55:50,949 - lava_callback - INFO - Starting async job submit for node 69b7ef90113612b7716bc482 2026-03-16 11:55:50,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:55:50,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ef90113612b7716bc482 HTTP/1.1" 200 None 2026-03-16 11:55:50,992 - lava_callback - DEBUG - Processing node 69b7ef90113612b7716bc482: baseline-arm64 2026-03-16 11:55:51,150 - lava_callback - WARNING - Failed to upload log 2026-03-16 11:55:51,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:55:51,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:55:51,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7ef90113612b7716bc482/lava-logs.yaml 2026-03-16 11:55:51,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:55:51,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:55:51,548 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7ef90113612b7716bc482/lava_callback.json.gz 2026-03-16 11:55:51,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:55:51,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ef90113612b7716bc482 HTTP/1.1" 200 None 2026-03-16 11:55:51,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:55:51,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:55:51,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:55:51,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7ef90113612b7716bc482 HTTP/1.1" 200 None 2026-03-16 11:55:51,710 - lava_callback - INFO - Completed processing callback for node 69b7ef90113612b7716bc482 INFO: 172.20.0.1:60084 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:56:04,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:56:04,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59756 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:56:41,788 - lava_callback - INFO - Received callback for node 69b7e18200b80c8ffdcb8e52 INFO: 172.20.0.1:37820 - "POST /node/69b7e18200b80c8ffdcb8e52 HTTP/1.0" 202 Accepted 2026-03-16 11:56:41,796 - lava_callback - INFO - Starting async job submit for node 69b7e18200b80c8ffdcb8e52 2026-03-16 11:56:41,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:56:41,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18200b80c8ffdcb8e52 HTTP/1.1" 200 None 2026-03-16 11:56:41,868 - lava_callback - DEBUG - Processing node 69b7e18200b80c8ffdcb8e52: baseline-nfs-arm64 2026-03-16 11:56:42,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:56:43,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:56:43,123 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18200b80c8ffdcb8e52/log.txt.gz 2026-03-16 11:56:43,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:56:43,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:56:43,979 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18200b80c8ffdcb8e52/lava-logs.yaml 2026-03-16 11:56:43,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:56:44,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:56:44,188 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18200b80c8ffdcb8e52/lava_callback.json.gz DEBUG: Setup failed for 69b7e18200b80c8ffdcb8e52. Transitting job node result: incomplete -> fail 2026-03-16 11:56:44,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:56:44,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18200b80c8ffdcb8e52 HTTP/1.1" 200 None 2026-03-16 11:56:44,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:56:44,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:56:44,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:56:44,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e18200b80c8ffdcb8e52 HTTP/1.1" 200 None 2026-03-16 11:56:44,442 - lava_callback - INFO - Completed processing callback for node 69b7e18200b80c8ffdcb8e52 INFO: 172.20.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44100 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:57:04,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:57:04,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53602 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:57:09,525 - lava_callback - INFO - Received callback for node 69b7efdf113612b7716bc48e INFO: 172.20.0.1:53614 - "POST /node/69b7efdf113612b7716bc48e HTTP/1.0" 202 Accepted 2026-03-16 11:57:09,531 - lava_callback - INFO - Starting async job submit for node 69b7efdf113612b7716bc48e 2026-03-16 11:57:09,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:57:09,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7efdf113612b7716bc48e HTTP/1.1" 200 None 2026-03-16 11:57:09,595 - lava_callback - DEBUG - Processing node 69b7efdf113612b7716bc48e: baseline-arm64 2026-03-16 11:57:09,727 - lava_callback - WARNING - Failed to upload log 2026-03-16 11:57:09,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:57:10,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:57:10,002 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7efdf113612b7716bc48e/lava-logs.yaml 2026-03-16 11:57:10,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:57:10,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:57:10,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7efdf113612b7716bc48e/lava_callback.json.gz 2026-03-16 11:57:10,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:57:10,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7efdf113612b7716bc48e HTTP/1.1" 200 None 2026-03-16 11:57:10,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:57:10,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:57:10,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:57:10,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7efdf113612b7716bc48e HTTP/1.1" 200 None 2026-03-16 11:57:10,339 - lava_callback - INFO - Completed processing callback for node 69b7efdf113612b7716bc48e INFO: 172.20.0.1:34208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58794 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:57:34,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:57:34,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54932 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:59:06,804 - lava_callback - INFO - Received callback for node 69b7e17700b80c8ffdcb8e36 INFO: 172.20.0.1:54940 - "POST /node/69b7e17700b80c8ffdcb8e36 HTTP/1.0" 202 Accepted 2026-03-16 11:59:06,810 - lava_callback - INFO - Starting async job submit for node 69b7e17700b80c8ffdcb8e36 2026-03-16 11:59:06,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:59:06,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17700b80c8ffdcb8e36 HTTP/1.1" 200 None 2026-03-16 11:59:06,846 - lava_callback - DEBUG - Processing node 69b7e17700b80c8ffdcb8e36: baseline-arm64 2026-03-16 11:59:07,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:59:07,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:59:07,186 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17700b80c8ffdcb8e36/log.txt.gz 2026-03-16 11:59:07,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:59:07,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:59:07,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17700b80c8ffdcb8e36/lava-logs.yaml 2026-03-16 11:59:07,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:59:07,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:59:07,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17700b80c8ffdcb8e36/lava_callback.json.gz 2026-03-16 11:59:07,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:59:07,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17700b80c8ffdcb8e36 HTTP/1.1" 200 None 2026-03-16 11:59:07,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:59:07,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:59:07,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:59:07,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e17700b80c8ffdcb8e36 HTTP/1.1" 200 None 2026-03-16 11:59:07,774 - lava_callback - INFO - Completed processing callback for node 69b7e17700b80c8ffdcb8e36 INFO: 172.20.0.1:52770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33874 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:59:34,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:59:34,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60122 - "GET / HTTP/1.0" 200 OK 2026-03-16 11:59:49,514 - lava_callback - INFO - Received callback for node 69b7f078113612b7716bc4a8 INFO: 172.20.0.1:60124 - "POST /node/69b7f078113612b7716bc4a8 HTTP/1.0" 202 Accepted 2026-03-16 11:59:49,522 - lava_callback - INFO - Starting async job submit for node 69b7f078113612b7716bc4a8 2026-03-16 11:59:49,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:59:49,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f078113612b7716bc4a8 HTTP/1.1" 200 None 2026-03-16 11:59:49,566 - lava_callback - DEBUG - Processing node 69b7f078113612b7716bc4a8: baseline-arm64 2026-03-16 11:59:49,699 - lava_callback - WARNING - Failed to upload log 2026-03-16 11:59:49,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:59:49,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:59:49,963 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7f078113612b7716bc4a8/lava-logs.yaml 2026-03-16 11:59:49,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 11:59:50,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 11:59:50,121 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7f078113612b7716bc4a8/lava_callback.json.gz 2026-03-16 11:59:50,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:59:50,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f078113612b7716bc4a8 HTTP/1.1" 200 None 2026-03-16 11:59:50,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:59:50,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 11:59:50,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 11:59:50,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7f078113612b7716bc4a8 HTTP/1.1" 200 None 2026-03-16 11:59:50,272 - lava_callback - INFO - Completed processing callback for node 69b7f078113612b7716bc4a8 INFO: 172.20.0.1:51202 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:00:04,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:00:04,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33676 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:00:48,564 - lava_callback - INFO - Received callback for node 69b7e18800b80c8ffdcb8e83 INFO: 172.20.0.1:33678 - "POST /node/69b7e18800b80c8ffdcb8e83 HTTP/1.0" 202 Accepted 2026-03-16 12:00:48,571 - lava_callback - INFO - Starting async job submit for node 69b7e18800b80c8ffdcb8e83 2026-03-16 12:00:48,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:00:48,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18800b80c8ffdcb8e83 HTTP/1.1" 200 None 2026-03-16 12:00:48,649 - lava_callback - DEBUG - Processing node 69b7e18800b80c8ffdcb8e83: baseline-nfs-arm64 2026-03-16 12:00:48,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:00:49,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:00:49,128 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18800b80c8ffdcb8e83/log.txt.gz 2026-03-16 12:00:49,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:00:49,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:00:49,542 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18800b80c8ffdcb8e83/lava-logs.yaml 2026-03-16 12:00:49,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:00:49,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:00:49,700 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18800b80c8ffdcb8e83/lava_callback.json.gz 2026-03-16 12:00:49,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:00:49,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18800b80c8ffdcb8e83 HTTP/1.1" 200 None 2026-03-16 12:00:49,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:00:49,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 12:00:49,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:00:49,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e18800b80c8ffdcb8e83 HTTP/1.1" 200 None 2026-03-16 12:00:49,800 - lava_callback - INFO - Completed processing callback for node 69b7e18800b80c8ffdcb8e83 2026-03-16 12:00:53,805 - lava_callback - INFO - Received callback for node 69b7e9b1113612b7716b9e32 INFO: 172.20.0.1:57486 - "POST /node/69b7e9b1113612b7716b9e32 HTTP/1.0" 202 Accepted 2026-03-16 12:00:53,810 - lava_callback - INFO - Starting async job submit for node 69b7e9b1113612b7716b9e32 2026-03-16 12:00:53,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:00:53,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e9b1113612b7716b9e32 HTTP/1.1" 200 None 2026-03-16 12:00:53,860 - lava_callback - DEBUG - Processing node 69b7e9b1113612b7716b9e32: baseline-arm64-broonie 2026-03-16 12:00:53,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:00:54,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:00:54,060 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b7e9b1113612b7716b9e32/log.txt.gz 2026-03-16 12:00:54,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:00:54,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:00:54,254 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b7e9b1113612b7716b9e32/lava-logs.yaml 2026-03-16 12:00:54,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:00:54,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:00:54,389 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b7e9b1113612b7716b9e32/lava_callback.json.gz 2026-03-16 12:00:54,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:00:54,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e9b1113612b7716b9e32 HTTP/1.1" 200 None 2026-03-16 12:00:54,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:00:54,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 12:00:54,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:00:54,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e9b1113612b7716b9e32 HTTP/1.1" 200 None 2026-03-16 12:00:54,513 - lava_callback - INFO - Completed processing callback for node 69b7e9b1113612b7716b9e32 INFO: 172.20.0.1:57500 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:01:04,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:01:04,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43994 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:03:27,114 - lava_callback - INFO - Received callback for node 69b7edd8113612b7716b9e97 INFO: 172.20.0.1:43998 - "POST /node/69b7edd8113612b7716b9e97 HTTP/1.0" 202 Accepted 2026-03-16 12:03:27,121 - lava_callback - INFO - Starting async job submit for node 69b7edd8113612b7716b9e97 2026-03-16 12:03:27,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:03:27,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7edd8113612b7716b9e97 HTTP/1.1" 200 None 2026-03-16 12:03:27,203 - lava_callback - DEBUG - Processing node 69b7edd8113612b7716b9e97: baseline-x86 2026-03-16 12:03:27,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:03:28,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:03:28,138 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b7edd8113612b7716b9e97/log.txt.gz 2026-03-16 12:03:28,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:03:28,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:03:28,837 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b7edd8113612b7716b9e97/lava-logs.yaml 2026-03-16 12:03:28,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:03:29,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:03:29,066 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b7edd8113612b7716b9e97/lava_callback.json.gz DEBUG: Setup failed for 69b7edd8113612b7716b9e97. Transitting job node result: incomplete -> fail 2026-03-16 12:03:29,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:03:29,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7edd8113612b7716b9e97 HTTP/1.1" 200 None 2026-03-16 12:03:29,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:03:29,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e997113612b7716b9e1b HTTP/1.1" 200 None 2026-03-16 12:03:29,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:03:29,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7edd8113612b7716b9e97 HTTP/1.1" 200 None 2026-03-16 12:03:29,358 - lava_callback - INFO - Completed processing callback for node 69b7edd8113612b7716b9e97 2026-03-16 12:03:34,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:03:34,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37038 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:04:34,062 - lava_callback - INFO - Received callback for node 69b7ed3b113612b7716b9e7f INFO: 172.20.0.1:42072 - "POST /node/69b7ed3b113612b7716b9e7f HTTP/1.0" 202 Accepted 2026-03-16 12:04:34,069 - lava_callback - INFO - Starting async job submit for node 69b7ed3b113612b7716b9e7f 2026-03-16 12:04:34,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:04:34,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ed3b113612b7716b9e7f HTTP/1.1" 200 None 2026-03-16 12:04:34,141 - lava_callback - DEBUG - Processing node 69b7ed3b113612b7716b9e7f: ltp-smoke 2026-03-16 12:04:34,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:04:34,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:04:34,819 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7ed3b113612b7716b9e7f/log.txt.gz 2026-03-16 12:04:35,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:04:35,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:04:35,311 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7ed3b113612b7716b9e7f/lava-logs.yaml 2026-03-16 12:04:35,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:04:35,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:04:35,486 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7ed3b113612b7716b9e7f/lava_callback.json.gz 2026-03-16 12:04:35,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:04:35,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ed3b113612b7716b9e7f HTTP/1.1" 200 None 2026-03-16 12:04:35,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:04:35,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e976113612b7716b9df8 HTTP/1.1" 200 None 2026-03-16 12:04:35,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:04:35,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7ed3b113612b7716b9e7f HTTP/1.1" 200 None 2026-03-16 12:04:35,825 - lava_callback - INFO - Completed processing callback for node 69b7ed3b113612b7716b9e7f INFO: 172.20.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49412 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:05:04,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:05:04,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60306 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:05:51,900 - lava_callback - INFO - Received callback for node 69b7f1cf113612b7716bc4d4 INFO: 172.20.0.1:45566 - "POST /node/69b7f1cf113612b7716bc4d4 HTTP/1.0" 202 Accepted 2026-03-16 12:05:51,906 - lava_callback - INFO - Starting async job submit for node 69b7f1cf113612b7716bc4d4 2026-03-16 12:05:51,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:05:51,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f1cf113612b7716bc4d4 HTTP/1.1" 200 None 2026-03-16 12:05:51,973 - lava_callback - DEBUG - Processing node 69b7f1cf113612b7716bc4d4: baseline-x86 2026-03-16 12:05:52,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:05:52,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:05:52,374 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b7f1cf113612b7716bc4d4/log.txt.gz 2026-03-16 12:05:52,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:05:52,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:05:52,742 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b7f1cf113612b7716bc4d4/lava-logs.yaml 2026-03-16 12:05:52,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:05:52,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:05:52,902 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b7f1cf113612b7716bc4d4/lava_callback.json.gz 2026-03-16 12:05:52,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:05:52,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f1cf113612b7716bc4d4 HTTP/1.1" 200 None 2026-03-16 12:05:52,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:05:52,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e997113612b7716b9e1b HTTP/1.1" 200 None 2026-03-16 12:05:52,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:05:53,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7f1cf113612b7716bc4d4 HTTP/1.1" 200 None 2026-03-16 12:05:53,023 - lava_callback - INFO - Completed processing callback for node 69b7f1cf113612b7716bc4d4 INFO: 172.20.0.1:45568 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:06:04,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:06:04,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41702 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 12:17:16,330 - lava_callback - INFO - Received callback for node 69b7f033113612b7716bc4a1 INFO: 172.20.0.1:41706 - "POST /node/69b7f033113612b7716bc4a1 HTTP/1.0" 202 Accepted 2026-03-16 12:17:16,338 - lava_callback - INFO - Starting async job submit for node 69b7f033113612b7716bc4a1 2026-03-16 12:17:16,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:17:16,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f033113612b7716bc4a1 HTTP/1.1" 200 None 2026-03-16 12:17:16,396 - lava_callback - DEBUG - Processing node 69b7f033113612b7716bc4a1: baseline-nfs-arm64 INFO: 172.20.0.1:41710 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:17:17,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:17:17,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:17:17,608 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7f033113612b7716bc4a1/log.txt.gz 2026-03-16 12:17:18,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:17:22,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:17:22,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7f033113612b7716bc4a1/lava-logs.yaml 2026-03-16 12:17:23,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:17:23,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:17:23,200 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7f033113612b7716bc4a1/lava_callback.json.gz DEBUG: Setup failed for 69b7f033113612b7716bc4a1. Transitting job node result: incomplete -> fail 2026-03-16 12:17:23,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:17:23,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f033113612b7716bc4a1 HTTP/1.1" 200 None 2026-03-16 12:17:23,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:17:23,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 12:17:23,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:17:23,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7f033113612b7716bc4a1 HTTP/1.1" 200 None 2026-03-16 12:17:23,467 - lava_callback - INFO - Completed processing callback for node 69b7f033113612b7716bc4a1 INFO: 172.20.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56480 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:17:34,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:17:34,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34904 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:22:15,107 - lava_callback - INFO - Received callback for node 69b7f1d5113612b7716bc4dc INFO: 172.20.0.1:38104 - "POST /node/69b7f1d5113612b7716bc4dc HTTP/1.0" 202 Accepted 2026-03-16 12:22:15,114 - lava_callback - INFO - Starting async job submit for node 69b7f1d5113612b7716bc4dc INFO: 172.20.0.1:38106 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 12:22:15,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:22:15,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f1d5113612b7716bc4dc HTTP/1.1" 200 None 2026-03-16 12:22:15,220 - lava_callback - DEBUG - Processing node 69b7f1d5113612b7716bc4dc: ltp-smoke 2026-03-16 12:22:15,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:22:15,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:22:15,893 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7f1d5113612b7716bc4dc/log.txt.gz 2026-03-16 12:22:16,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:22:16,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:22:16,420 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7f1d5113612b7716bc4dc/lava-logs.yaml 2026-03-16 12:22:16,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:38110 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:22:16,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:22:16,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7f1d5113612b7716bc4dc/lava_callback.json.gz 2026-03-16 12:22:16,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:22:16,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f1d5113612b7716bc4dc HTTP/1.1" 200 None 2026-03-16 12:22:16,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:22:16,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e976113612b7716b9df8 HTTP/1.1" 200 None 2026-03-16 12:22:16,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:22:16,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7f1d5113612b7716bc4dc HTTP/1.1" 200 None 2026-03-16 12:22:17,072 - lava_callback - INFO - Completed processing callback for node 69b7f1d5113612b7716bc4dc INFO: 172.20.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41402 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:22:34,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:22:34,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55176 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:32:35,222 - lava_callback - INFO - Received callback for node 69b7f10a113612b7716bc4c4 INFO: 172.20.0.1:59886 - "POST /node/69b7f10a113612b7716bc4c4 HTTP/1.0" 202 Accepted 2026-03-16 12:32:35,233 - lava_callback - INFO - Starting async job submit for node 69b7f10a113612b7716bc4c4 2026-03-16 12:32:35,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:32:35,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f10a113612b7716bc4c4 HTTP/1.1" 200 None 2026-03-16 12:32:35,282 - lava_callback - DEBUG - Processing node 69b7f10a113612b7716bc4c4: baseline-arm64-broonie 2026-03-16 12:32:35,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:32:35,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:32:35,632 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b7f10a113612b7716bc4c4/log.txt.gz 2026-03-16 12:32:35,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:32:35,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:32:35,986 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b7f10a113612b7716bc4c4/lava-logs.yaml 2026-03-16 12:32:35,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:32:36,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:32:36,177 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b7f10a113612b7716bc4c4/lava_callback.json.gz 2026-03-16 12:32:36,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:32:36,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f10a113612b7716bc4c4 HTTP/1.1" 200 None 2026-03-16 12:32:36,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:32:36,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 12:32:36,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:32:36,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7f10a113612b7716bc4c4 HTTP/1.1" 200 None 2026-03-16 12:32:36,310 - lava_callback - INFO - Completed processing callback for node 69b7f10a113612b7716bc4c4 INFO: 172.20.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59548 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:33:04,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:33:04,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38182 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:37:14,531 - lava_callback - INFO - Received callback for node 69b7f4dc113612b7716bc4f3 INFO: 172.20.0.1:39942 - "POST /node/69b7f4dc113612b7716bc4f3 HTTP/1.0" 202 Accepted 2026-03-16 12:37:14,538 - lava_callback - INFO - Starting async job submit for node 69b7f4dc113612b7716bc4f3 2026-03-16 12:37:14,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:37:14,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f4dc113612b7716bc4f3 HTTP/1.1" 200 None 2026-03-16 12:37:14,597 - lava_callback - DEBUG - Processing node 69b7f4dc113612b7716bc4f3: baseline-nfs-arm64 INFO: 172.20.0.1:39954 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 12:37:15,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:37:15,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:37:15,805 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7f4dc113612b7716bc4f3/log.txt.gz 2026-03-16 12:37:16,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:39968 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:37:16,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:37:16,667 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7f4dc113612b7716bc4f3/lava-logs.yaml 2026-03-16 12:37:16,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:37:16,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:37:16,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7f4dc113612b7716bc4f3/lava_callback.json.gz DEBUG: Setup failed for 69b7f4dc113612b7716bc4f3. Transitting job node result: incomplete -> fail 2026-03-16 12:37:16,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:37:16,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f4dc113612b7716bc4f3 HTTP/1.1" 200 None 2026-03-16 12:37:16,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:37:17,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 12:37:17,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:37:17,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7f4dc113612b7716bc4f3 HTTP/1.1" 200 None 2026-03-16 12:37:17,172 - lava_callback - INFO - Completed processing callback for node 69b7f4dc113612b7716bc4f3 INFO: 172.20.0.1:60454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60458 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:37:34,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:37:34,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54620 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:39:55,484 - lava_callback - INFO - Received callback for node 69b7f5fa113612b7716bc502 INFO: 172.20.0.1:51038 - "POST /node/69b7f5fa113612b7716bc502 HTTP/1.0" 202 Accepted 2026-03-16 12:39:55,491 - lava_callback - INFO - Starting async job submit for node 69b7f5fa113612b7716bc502 2026-03-16 12:39:55,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:39:55,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f5fa113612b7716bc502 HTTP/1.1" 200 None 2026-03-16 12:39:55,566 - lava_callback - DEBUG - Processing node 69b7f5fa113612b7716bc502: ltp-smoke 2026-03-16 12:39:56,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:39:56,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:39:56,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7f5fa113612b7716bc502/log.txt.gz 2026-03-16 12:39:56,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:51046 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:39:56,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:39:56,712 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7f5fa113612b7716bc502/lava-logs.yaml 2026-03-16 12:39:56,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:39:56,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:39:56,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7f5fa113612b7716bc502/lava_callback.json.gz 2026-03-16 12:39:57,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:39:57,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f5fa113612b7716bc502 HTTP/1.1" 200 None 2026-03-16 12:39:57,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:39:57,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e976113612b7716b9df8 HTTP/1.1" 200 None 2026-03-16 12:39:57,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:39:57,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7f5fa113612b7716bc502 HTTP/1.1" 200 None 2026-03-16 12:39:57,214 - lava_callback - INFO - Completed processing callback for node 69b7f5fa113612b7716bc502 2026-03-16 12:40:04,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:40:04,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54858 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:47:34,251 - lava_callback - INFO - Received callback for node 69b7e18100b80c8ffdcb8e4f INFO: 172.20.0.1:58672 - "POST /node/69b7e18100b80c8ffdcb8e4f HTTP/1.0" 202 Accepted 2026-03-16 12:47:34,261 - lava_callback - INFO - Starting async job submit for node 69b7e18100b80c8ffdcb8e4f 2026-03-16 12:47:34,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:47:34,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18100b80c8ffdcb8e4f HTTP/1.1" 200 None 2026-03-16 12:47:34,342 - lava_callback - DEBUG - Processing node 69b7e18100b80c8ffdcb8e4f: baseline-nfs-arm64 2026-03-16 12:47:34,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:47:35,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:47:35,076 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18100b80c8ffdcb8e4f/log.txt.gz 2026-03-16 12:47:35,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:47:35,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:47:35,728 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18100b80c8ffdcb8e4f/lava-logs.yaml 2026-03-16 12:47:35,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:47:36,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:47:36,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e18100b80c8ffdcb8e4f/lava_callback.json.gz 2026-03-16 12:47:36,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:47:36,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18100b80c8ffdcb8e4f HTTP/1.1" 200 None 2026-03-16 12:47:36,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:47:36,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 12:47:36,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:47:36,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e18100b80c8ffdcb8e4f HTTP/1.1" 200 None 2026-03-16 12:47:36,304 - lava_callback - INFO - Completed processing callback for node 69b7e18100b80c8ffdcb8e4f INFO: 172.20.0.1:58684 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:47:39,762 - lava_callback - INFO - Received callback for node 69b7e17100b80c8ffdcb8e27 INFO: 172.20.0.1:59438 - "POST /node/69b7e17100b80c8ffdcb8e27 HTTP/1.0" 202 Accepted 2026-03-16 12:47:39,772 - lava_callback - INFO - Starting async job submit for node 69b7e17100b80c8ffdcb8e27 2026-03-16 12:47:39,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:47:39,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17100b80c8ffdcb8e27 HTTP/1.1" 200 None 2026-03-16 12:47:39,854 - lava_callback - DEBUG - Processing node 69b7e17100b80c8ffdcb8e27: baseline-arm64 2026-03-16 12:47:40,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:47:40,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:47:40,640 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17100b80c8ffdcb8e27/log.txt.gz 2026-03-16 12:47:40,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:47:41,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:47:41,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17100b80c8ffdcb8e27/lava-logs.yaml 2026-03-16 12:47:41,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:47:41,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:47:41,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e17100b80c8ffdcb8e27/lava_callback.json.gz 2026-03-16 12:47:41,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:47:41,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17100b80c8ffdcb8e27 HTTP/1.1" 200 None 2026-03-16 12:47:41,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:47:41,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 12:47:41,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:47:41,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e17100b80c8ffdcb8e27 HTTP/1.1" 200 None 2026-03-16 12:47:41,589 - lava_callback - INFO - Completed processing callback for node 69b7e17100b80c8ffdcb8e27 INFO: 172.20.0.1:59444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41854 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:48:04,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:48:04,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40460 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:48:33,020 - lava_callback - INFO - Received callback for node 69b7fc0b113612b7716bc563 INFO: 172.20.0.1:46758 - "POST /node/69b7fc0b113612b7716bc563 HTTP/1.0" 202 Accepted 2026-03-16 12:48:33,040 - lava_callback - INFO - Starting async job submit for node 69b7fc0b113612b7716bc563 2026-03-16 12:48:33,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:48:33,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc0b113612b7716bc563 HTTP/1.1" 200 None 2026-03-16 12:48:33,079 - lava_callback - DEBUG - Processing node 69b7fc0b113612b7716bc563: baseline-arm 2026-03-16 12:48:33,084 - lava_callback - WARNING - Failed to upload log 2026-03-16 12:48:33,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:48:33,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:48:33,261 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0b113612b7716bc563/lava-logs.yaml 2026-03-16 12:48:33,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:48:33,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:48:33,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0b113612b7716bc563/lava_callback.json.gz 2026-03-16 12:48:33,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:48:33,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc0b113612b7716bc563 HTTP/1.1" 200 None 2026-03-16 12:48:33,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:48:33,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:48:33,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:48:33,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc0b113612b7716bc563 HTTP/1.1" 200 None 2026-03-16 12:48:33,444 - lava_callback - INFO - Completed processing callback for node 69b7fc0b113612b7716bc563 2026-03-16 12:48:34,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:48:34,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55228 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:49:00,458 - lava_callback - INFO - Received callback for node 69b7fc0f113612b7716bc56f INFO: 172.20.0.1:34686 - "POST /node/69b7fc0f113612b7716bc56f HTTP/1.0" 202 Accepted 2026-03-16 12:49:00,506 - lava_callback - INFO - Starting async job submit for node 69b7fc0f113612b7716bc56f 2026-03-16 12:49:00,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:00,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc0f113612b7716bc56f HTTP/1.1" 200 None 2026-03-16 12:49:00,538 - lava_callback - DEBUG - Processing node 69b7fc0f113612b7716bc56f: baseline-arm 2026-03-16 12:49:00,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:00,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:00,800 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0f113612b7716bc56f/log.txt.gz 2026-03-16 12:49:00,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:01,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:01,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0f113612b7716bc56f/lava-logs.yaml 2026-03-16 12:49:01,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:01,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:01,207 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0f113612b7716bc56f/lava_callback.json.gz 2026-03-16 12:49:01,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:01,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc0f113612b7716bc56f HTTP/1.1" 200 None 2026-03-16 12:49:01,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:01,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:49:01,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:01,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc0f113612b7716bc56f HTTP/1.1" 200 None 2026-03-16 12:49:01,298 - lava_callback - INFO - Completed processing callback for node 69b7fc0f113612b7716bc56f 2026-03-16 12:49:04,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:04,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34700 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:49:06,701 - lava_callback - INFO - Received callback for node 69b7fc0c113612b7716bc566 INFO: 172.20.0.1:34704 - "POST /node/69b7fc0c113612b7716bc566 HTTP/1.0" 202 Accepted 2026-03-16 12:49:06,756 - lava_callback - INFO - Starting async job submit for node 69b7fc0c113612b7716bc566 2026-03-16 12:49:06,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:06,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc0c113612b7716bc566 HTTP/1.1" 200 None 2026-03-16 12:49:06,824 - lava_callback - DEBUG - Processing node 69b7fc0c113612b7716bc566: baseline-arm 2026-03-16 12:49:07,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:07,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:07,153 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0c113612b7716bc566/log.txt.gz 2026-03-16 12:49:07,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:07,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:07,496 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0c113612b7716bc566/lava-logs.yaml 2026-03-16 12:49:07,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:07,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:07,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0c113612b7716bc566/lava_callback.json.gz 2026-03-16 12:49:07,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:07,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc0c113612b7716bc566 HTTP/1.1" 200 None 2026-03-16 12:49:07,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:07,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:49:07,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:07,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc0c113612b7716bc566 HTTP/1.1" 200 None 2026-03-16 12:49:07,742 - lava_callback - INFO - Completed processing callback for node 69b7fc0c113612b7716bc566 INFO: 172.20.0.1:48004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48020 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:49:20,119 - lava_callback - INFO - Received callback for node 69b7fc0e113612b7716bc56c INFO: 172.20.0.1:34374 - "POST /node/69b7fc0e113612b7716bc56c HTTP/1.0" 202 Accepted 2026-03-16 12:49:20,126 - lava_callback - INFO - Starting async job submit for node 69b7fc0e113612b7716bc56c 2026-03-16 12:49:20,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:20,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc0e113612b7716bc56c HTTP/1.1" 200 None 2026-03-16 12:49:20,162 - lava_callback - DEBUG - Processing node 69b7fc0e113612b7716bc56c: baseline-arm 2026-03-16 12:49:20,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:20,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:20,604 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0e113612b7716bc56c/log.txt.gz 2026-03-16 12:49:20,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:20,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:20,905 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0e113612b7716bc56c/lava-logs.yaml 2026-03-16 12:49:20,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:21,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:21,042 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0e113612b7716bc56c/lava_callback.json.gz 2026-03-16 12:49:21,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:21,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc0e113612b7716bc56c HTTP/1.1" 200 None 2026-03-16 12:49:21,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:21,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:49:21,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:21,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc0e113612b7716bc56c HTTP/1.1" 200 None 2026-03-16 12:49:21,126 - lava_callback - INFO - Completed processing callback for node 69b7fc0e113612b7716bc56c INFO: 172.20.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34386 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:49:34,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:34,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 12:49:35,688 - lava_callback - INFO - Received callback for node 69b7fc1d113612b7716bc5a4 INFO: 172.20.0.1:42900 - "POST /node/69b7fc1d113612b7716bc5a4 HTTP/1.0" 202 Accepted 2026-03-16 12:49:35,694 - lava_callback - INFO - Starting async job submit for node 69b7fc1d113612b7716bc5a4 2026-03-16 12:49:35,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:35,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc1d113612b7716bc5a4 HTTP/1.1" 200 None 2026-03-16 12:49:35,741 - lava_callback - DEBUG - Processing node 69b7fc1d113612b7716bc5a4: baseline-arm-broonie 2026-03-16 12:49:35,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:36,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:36,092 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b7fc1d113612b7716bc5a4/log.txt.gz 2026-03-16 12:49:36,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:36,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:36,405 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b7fc1d113612b7716bc5a4/lava-logs.yaml 2026-03-16 12:49:36,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:42910 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:49:36,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:36,552 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b7fc1d113612b7716bc5a4/lava_callback.json.gz 2026-03-16 12:49:36,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:36,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc1d113612b7716bc5a4 HTTP/1.1" 200 None 2026-03-16 12:49:36,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:36,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:49:36,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:36,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc1d113612b7716bc5a4 HTTP/1.1" 200 None 2026-03-16 12:49:36,639 - lava_callback - INFO - Completed processing callback for node 69b7fc1d113612b7716bc5a4 2026-03-16 12:49:38,101 - lava_callback - INFO - Received callback for node 69b7fc0a113612b7716bc560 INFO: 172.20.0.1:42914 - "POST /node/69b7fc0a113612b7716bc560 HTTP/1.0" 202 Accepted 2026-03-16 12:49:38,108 - lava_callback - INFO - Starting async job submit for node 69b7fc0a113612b7716bc560 2026-03-16 12:49:38,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:38,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc0a113612b7716bc560 HTTP/1.1" 200 None 2026-03-16 12:49:38,146 - lava_callback - DEBUG - Processing node 69b7fc0a113612b7716bc560: baseline-arm 2026-03-16 12:49:38,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:38,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:38,491 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0a113612b7716bc560/log.txt.gz 2026-03-16 12:49:38,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:38,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:38,799 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0a113612b7716bc560/lava-logs.yaml 2026-03-16 12:49:38,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:38,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:38,946 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0a113612b7716bc560/lava_callback.json.gz 2026-03-16 12:49:38,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:38,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc0a113612b7716bc560 HTTP/1.1" 200 None 2026-03-16 12:49:38,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:39,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:49:39,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:39,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc0a113612b7716bc560 HTTP/1.1" 200 None 2026-03-16 12:49:39,075 - lava_callback - INFO - Completed processing callback for node 69b7fc0a113612b7716bc560 INFO: 172.20.0.1:52182 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:49:49,245 - lava_callback - INFO - Received callback for node 69b7fc31113612b7716bc5e6 INFO: 172.20.0.1:52190 - "POST /node/69b7fc31113612b7716bc5e6 HTTP/1.0" 202 Accepted 2026-03-16 12:49:49,293 - lava_callback - INFO - Starting async job submit for node 69b7fc31113612b7716bc5e6 2026-03-16 12:49:49,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:49,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc31113612b7716bc5e6 HTTP/1.1" 200 None 2026-03-16 12:49:49,346 - lava_callback - DEBUG - Processing node 69b7fc31113612b7716bc5e6: baseline-arm-pengutronix 2026-03-16 12:49:49,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:50,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:50,143 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7fc31113612b7716bc5e6/log.txt.gz 2026-03-16 12:49:50,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:50,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:50,374 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7fc31113612b7716bc5e6/lava-logs.yaml 2026-03-16 12:49:50,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:50,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:50,491 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7fc31113612b7716bc5e6/lava_callback.json.gz 2026-03-16 12:49:50,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:50,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc31113612b7716bc5e6 HTTP/1.1" 200 None 2026-03-16 12:49:50,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:50,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:49:50,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:50,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc31113612b7716bc5e6 HTTP/1.1" 200 None 2026-03-16 12:49:50,572 - lava_callback - INFO - Completed processing callback for node 69b7fc31113612b7716bc5e6 2026-03-16 12:49:54,506 - lava_callback - INFO - Received callback for node 69b7fc2e113612b7716bc5dd INFO: 172.20.0.1:55810 - "POST /node/69b7fc2e113612b7716bc5dd HTTP/1.0" 202 Accepted 2026-03-16 12:49:54,512 - lava_callback - INFO - Starting async job submit for node 69b7fc2e113612b7716bc5dd 2026-03-16 12:49:54,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:54,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc2e113612b7716bc5dd HTTP/1.1" 200 None 2026-03-16 12:49:54,544 - lava_callback - DEBUG - Processing node 69b7fc2e113612b7716bc5dd: baseline-arm-pengutronix 2026-03-16 12:49:54,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:54,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:54,812 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7fc2e113612b7716bc5dd/log.txt.gz 2026-03-16 12:49:54,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:55,056 - lava_callback - INFO - Received callback for node 69b7fc23113612b7716bc5b9 INFO: 172.20.0.1:55824 - "POST /node/69b7fc23113612b7716bc5b9 HTTP/1.0" 202 Accepted 2026-03-16 12:49:55,063 - lava_callback - INFO - Starting async job submit for node 69b7fc23113612b7716bc5b9 2026-03-16 12:49:55,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:55,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:55,088 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7fc2e113612b7716bc5dd/lava-logs.yaml 2026-03-16 12:49:55,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:55,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc23113612b7716bc5b9 HTTP/1.1" 200 None 2026-03-16 12:49:55,107 - lava_callback - DEBUG - Processing node 69b7fc23113612b7716bc5b9: baseline-arm-clabbe 2026-03-16 12:49:55,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:55,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7fc2e113612b7716bc5dd/lava_callback.json.gz 2026-03-16 12:49:55,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:55,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:55,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc2e113612b7716bc5dd HTTP/1.1" 200 None 2026-03-16 12:49:55,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:55,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:49:55,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:55,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc2e113612b7716bc5dd HTTP/1.1" 200 None 2026-03-16 12:49:55,424 - lava_callback - INFO - Completed processing callback for node 69b7fc2e113612b7716bc5dd 2026-03-16 12:49:55,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:55,517 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b7fc23113612b7716bc5b9/log.txt.gz 2026-03-16 12:49:55,639 - lava_callback - INFO - Received callback for node 69b7fc1c113612b7716bc5a1 INFO: 172.20.0.1:55826 - "POST /node/69b7fc1c113612b7716bc5a1 HTTP/1.0" 202 Accepted 2026-03-16 12:49:55,666 - lava_callback - INFO - Received callback for node 69b7fc2f113612b7716bc5e0 2026-03-16 12:49:55,671 - lava_callback - INFO - Starting async job submit for node 69b7fc1c113612b7716bc5a1 2026-03-16 12:49:55,697 - lava_callback - INFO - Starting async job submit for node 69b7fc2f113612b7716bc5e0 INFO: 172.20.0.1:55828 - "POST /node/69b7fc2f113612b7716bc5e0 HTTP/1.0" 202 Accepted 2026-03-16 12:49:55,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:55,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:55,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:55,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc1c113612b7716bc5a1 HTTP/1.1" 200 None 2026-03-16 12:49:55,802 - lava_callback - DEBUG - Processing node 69b7fc1c113612b7716bc5a1: baseline-arm-broonie 2026-03-16 12:49:55,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc2f113612b7716bc5e0 HTTP/1.1" 200 None 2026-03-16 12:49:55,855 - lava_callback - DEBUG - Processing node 69b7fc2f113612b7716bc5e0: baseline-arm-pengutronix 2026-03-16 12:49:56,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:56,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:56,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:56,378 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7fc2f113612b7716bc5e0/log.txt.gz 2026-03-16 12:49:56,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:56,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:56,409 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b7fc1c113612b7716bc5a1/log.txt.gz 2026-03-16 12:49:56,544 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b7fc23113612b7716bc5b9/lava-logs.yaml INFO: 172.20.0.1:55838 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:49:56,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:56,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:56,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:56,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:56,777 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b7fc23113612b7716bc5b9/lava_callback.json.gz 2026-03-16 12:49:56,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:56,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:56,808 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7fc2f113612b7716bc5e0/lava-logs.yaml 2026-03-16 12:49:56,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:56,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc23113612b7716bc5b9 HTTP/1.1" 200 None 2026-03-16 12:49:56,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:56,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:49:56,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:56,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:56,873 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b7fc1c113612b7716bc5a1/lava-logs.yaml 2026-03-16 12:49:56,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:49:56,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc23113612b7716bc5b9 HTTP/1.1" 200 None 2026-03-16 12:49:56,884 - lava_callback - INFO - Completed processing callback for node 69b7fc23113612b7716bc5b9 2026-03-16 12:49:57,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:57,034 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7fc2f113612b7716bc5e0/lava_callback.json.gz 2026-03-16 12:49:57,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:57,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc2f113612b7716bc5e0 HTTP/1.1" 200 None 2026-03-16 12:49:57,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:57,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:49:57,099 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b7fc1c113612b7716bc5a1/lava_callback.json.gz 2026-03-16 12:49:57,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:57,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:49:57,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:57,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc1c113612b7716bc5a1 HTTP/1.1" 200 None 2026-03-16 12:49:57,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:57,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc2f113612b7716bc5e0 HTTP/1.1" 200 None 2026-03-16 12:49:57,179 - lava_callback - INFO - Completed processing callback for node 69b7fc2f113612b7716bc5e0 2026-03-16 12:49:57,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:49:57,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:49:57,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc1c113612b7716bc5a1 HTTP/1.1" 200 None 2026-03-16 12:49:57,275 - lava_callback - INFO - Completed processing callback for node 69b7fc1c113612b7716bc5a1 2026-03-16 12:50:04,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:04,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:49742 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:50:12,426 - lava_callback - INFO - Received callback for node 69b7fc1f113612b7716bc5a7 INFO: 172.20.0.1:45316 - "POST /node/69b7fc1f113612b7716bc5a7 HTTP/1.0" 202 Accepted 2026-03-16 12:50:12,433 - lava_callback - INFO - Starting async job submit for node 69b7fc1f113612b7716bc5a7 2026-03-16 12:50:12,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:12,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc1f113612b7716bc5a7 HTTP/1.1" 200 None 2026-03-16 12:50:12,472 - lava_callback - DEBUG - Processing node 69b7fc1f113612b7716bc5a7: baseline-arm-broonie 2026-03-16 12:50:12,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:50:12,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:50:12,932 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b7fc1f113612b7716bc5a7/log.txt.gz 2026-03-16 12:50:13,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:50:13,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:50:13,253 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b7fc1f113612b7716bc5a7/lava-logs.yaml 2026-03-16 12:50:13,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:50:13,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:50:13,391 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b7fc1f113612b7716bc5a7/lava_callback.json.gz 2026-03-16 12:50:13,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:13,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc1f113612b7716bc5a7 HTTP/1.1" 200 None 2026-03-16 12:50:13,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:13,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:50:13,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:13,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc1f113612b7716bc5a7 HTTP/1.1" 200 None 2026-03-16 12:50:13,484 - lava_callback - INFO - Completed processing callback for node 69b7fc1f113612b7716bc5a7 INFO: 172.20.0.1:45322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45328 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:50:23,053 - lava_callback - INFO - Received callback for node 69b7fc2b113612b7716bc5d2 INFO: 172.20.0.1:39250 - "POST /node/69b7fc2b113612b7716bc5d2 HTTP/1.0" 202 Accepted 2026-03-16 12:50:23,061 - lava_callback - INFO - Starting async job submit for node 69b7fc2b113612b7716bc5d2 2026-03-16 12:50:23,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:23,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc2b113612b7716bc5d2 HTTP/1.1" 200 None 2026-03-16 12:50:23,099 - lava_callback - DEBUG - Processing node 69b7fc2b113612b7716bc5d2: baseline-arm-kontron 2026-03-16 12:50:23,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:50:23,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:50:23,421 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b7fc2b113612b7716bc5d2/log.txt.gz 2026-03-16 12:50:23,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:50:23,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:50:23,714 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b7fc2b113612b7716bc5d2/lava-logs.yaml 2026-03-16 12:50:23,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:50:23,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:50:23,854 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b7fc2b113612b7716bc5d2/lava_callback.json.gz 2026-03-16 12:50:23,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:23,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc2b113612b7716bc5d2 HTTP/1.1" 200 None 2026-03-16 12:50:23,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:23,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:50:23,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:23,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc2b113612b7716bc5d2 HTTP/1.1" 200 None 2026-03-16 12:50:23,943 - lava_callback - INFO - Completed processing callback for node 69b7fc2b113612b7716bc5d2 INFO: 172.20.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39276 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:50:27,672 - lava_callback - INFO - Received callback for node 69b7fc84113612b7716bc6ac INFO: 172.20.0.1:39278 - "POST /node/69b7fc84113612b7716bc6ac HTTP/1.0" 202 Accepted 2026-03-16 12:50:27,678 - lava_callback - INFO - Starting async job submit for node 69b7fc84113612b7716bc6ac 2026-03-16 12:50:27,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:27,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc84113612b7716bc6ac HTTP/1.1" 200 None 2026-03-16 12:50:27,711 - lava_callback - DEBUG - Processing node 69b7fc84113612b7716bc6ac: baseline-arm 2026-03-16 12:50:27,716 - lava_callback - WARNING - Failed to upload log 2026-03-16 12:50:27,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:50:27,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:50:27,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc84113612b7716bc6ac/lava-logs.yaml 2026-03-16 12:50:27,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:50:27,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:50:27,948 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc84113612b7716bc6ac/lava_callback.json.gz 2026-03-16 12:50:27,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:27,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc84113612b7716bc6ac HTTP/1.1" 200 None 2026-03-16 12:50:27,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:27,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:50:27,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:28,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc84113612b7716bc6ac HTTP/1.1" 200 None 2026-03-16 12:50:28,025 - lava_callback - INFO - Completed processing callback for node 69b7fc84113612b7716bc6ac 2026-03-16 12:50:34,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:34,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47926 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:50:52,676 - lava_callback - INFO - Received callback for node 69b7fc1b113612b7716bc59a INFO: 172.20.0.1:48710 - "POST /node/69b7fc1b113612b7716bc59a HTTP/1.0" 202 Accepted 2026-03-16 12:50:52,682 - lava_callback - INFO - Starting async job submit for node 69b7fc1b113612b7716bc59a 2026-03-16 12:50:52,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:52,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc1b113612b7716bc59a HTTP/1.1" 200 None 2026-03-16 12:50:52,738 - lava_callback - DEBUG - Processing node 69b7fc1b113612b7716bc59a: baseline-arm-broonie 2026-03-16 12:50:52,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:50:53,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:50:53,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b7fc1b113612b7716bc59a/log.txt.gz 2026-03-16 12:50:53,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:50:53,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:50:53,436 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b7fc1b113612b7716bc59a/lava-logs.yaml 2026-03-16 12:50:53,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:50:53,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:50:53,573 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b7fc1b113612b7716bc59a/lava_callback.json.gz 2026-03-16 12:50:53,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:53,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc1b113612b7716bc59a HTTP/1.1" 200 None 2026-03-16 12:50:53,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:53,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:50:53,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:50:53,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc1b113612b7716bc59a HTTP/1.1" 200 None 2026-03-16 12:50:53,652 - lava_callback - INFO - Completed processing callback for node 69b7fc1b113612b7716bc59a INFO: 172.20.0.1:48718 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:51:04,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:51:04,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55996 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:51:30,103 - lava_callback - INFO - Received callback for node 69b7fc24113612b7716bc5bd INFO: 172.20.0.1:57930 - "POST /node/69b7fc24113612b7716bc5bd HTTP/1.0" 202 Accepted 2026-03-16 12:51:30,109 - lava_callback - INFO - Starting async job submit for node 69b7fc24113612b7716bc5bd 2026-03-16 12:51:30,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:51:30,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc24113612b7716bc5bd HTTP/1.1" 200 None 2026-03-16 12:51:30,148 - lava_callback - DEBUG - Processing node 69b7fc24113612b7716bc5bd: baseline-arm-clabbe 2026-03-16 12:51:30,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:51:30,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:51:30,505 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b7fc24113612b7716bc5bd/log.txt.gz 2026-03-16 12:51:30,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:51:30,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:51:30,839 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b7fc24113612b7716bc5bd/lava-logs.yaml 2026-03-16 12:51:30,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:51:31,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:51:31,124 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b7fc24113612b7716bc5bd/lava_callback.json.gz 2026-03-16 12:51:31,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:51:31,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc24113612b7716bc5bd HTTP/1.1" 200 None 2026-03-16 12:51:31,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:51:31,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:51:31,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:51:31,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc24113612b7716bc5bd HTTP/1.1" 200 None 2026-03-16 12:51:31,223 - lava_callback - INFO - Completed processing callback for node 69b7fc24113612b7716bc5bd 2026-03-16 12:51:34,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:51:34,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48650 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:52:18,737 - lava_callback - INFO - Received callback for node 69b7fc48113612b7716bc62d INFO: 172.20.0.1:48658 - "POST /node/69b7fc48113612b7716bc62d HTTP/1.0" 202 Accepted 2026-03-16 12:52:18,743 - lava_callback - INFO - Starting async job submit for node 69b7fc48113612b7716bc62d 2026-03-16 12:52:18,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:52:18,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc48113612b7716bc62d HTTP/1.1" 200 None 2026-03-16 12:52:18,781 - lava_callback - DEBUG - Processing node 69b7fc48113612b7716bc62d: ltp-dio 2026-03-16 12:52:19,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:52:19,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:52:19,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69b7fc48113612b7716bc62d/log.txt.gz 2026-03-16 12:52:19,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:52:19,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:52:19,817 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69b7fc48113612b7716bc62d/lava-logs.yaml 2026-03-16 12:52:19,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:52:19,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:52:19,977 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69b7fc48113612b7716bc62d/lava_callback.json.gz 2026-03-16 12:52:20,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:52:20,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc48113612b7716bc62d HTTP/1.1" 200 None 2026-03-16 12:52:20,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:52:20,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:52:20,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:52:20,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc48113612b7716bc62d HTTP/1.1" 200 None 2026-03-16 12:52:20,066 - lava_callback - INFO - Completed processing callback for node 69b7fc48113612b7716bc62d INFO: 172.20.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54650 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:52:34,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:52:34,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45414 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:52:56,248 - lava_callback - INFO - Received callback for node 69b7fc47113612b7716bc62a INFO: 172.20.0.1:44768 - "POST /node/69b7fc47113612b7716bc62a HTTP/1.0" 202 Accepted 2026-03-16 12:52:56,254 - lava_callback - INFO - Starting async job submit for node 69b7fc47113612b7716bc62a 2026-03-16 12:52:56,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:52:56,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc47113612b7716bc62a HTTP/1.1" 200 None 2026-03-16 12:52:56,294 - lava_callback - DEBUG - Processing node 69b7fc47113612b7716bc62a: ltp-cve INFO: 172.20.0.1:44772 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:52:56,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:52:56,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:52:56,851 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69b7fc47113612b7716bc62a/log.txt.gz 2026-03-16 12:52:57,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:52:57,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:52:57,289 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69b7fc47113612b7716bc62a/lava-logs.yaml 2026-03-16 12:52:57,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:52:57,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:52:57,453 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69b7fc47113612b7716bc62a/lava_callback.json.gz 2026-03-16 12:52:57,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:52:57,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc47113612b7716bc62a HTTP/1.1" 200 None 2026-03-16 12:52:57,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:52:57,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:52:57,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:52:57,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc47113612b7716bc62a HTTP/1.1" 200 None 2026-03-16 12:52:57,557 - lava_callback - INFO - Completed processing callback for node 69b7fc47113612b7716bc62a 2026-03-16 12:53:04,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:04,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 12:53:05,262 - lava_callback - INFO - Received callback for node 69b7fc27113612b7716bc5c9 INFO: 172.20.0.1:37616 - "POST /node/69b7fc27113612b7716bc5c9 HTTP/1.0" 202 Accepted 2026-03-16 12:53:05,269 - lava_callback - INFO - Starting async job submit for node 69b7fc27113612b7716bc5c9 2026-03-16 12:53:05,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:05,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc27113612b7716bc5c9 HTTP/1.1" 200 None 2026-03-16 12:53:05,314 - lava_callback - DEBUG - Processing node 69b7fc27113612b7716bc5c9: baseline-arm-clabbe 2026-03-16 12:53:05,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:53:05,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:53:05,651 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b7fc27113612b7716bc5c9/log.txt.gz 2026-03-16 12:53:05,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:53:05,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:53:05,970 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b7fc27113612b7716bc5c9/lava-logs.yaml 2026-03-16 12:53:05,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:53:06,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:53:06,122 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b7fc27113612b7716bc5c9/lava_callback.json.gz 2026-03-16 12:53:06,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:06,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc27113612b7716bc5c9 HTTP/1.1" 200 None 2026-03-16 12:53:06,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:06,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:53:06,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:06,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc27113612b7716bc5c9 HTTP/1.1" 200 None 2026-03-16 12:53:06,229 - lava_callback - INFO - Completed processing callback for node 69b7fc27113612b7716bc5c9 INFO: 172.20.0.1:37624 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:53:12,697 - lava_callback - INFO - Received callback for node 69b7fc41113612b7716bc61d INFO: 172.20.0.1:57142 - "POST /node/69b7fc41113612b7716bc61d HTTP/1.0" 202 Accepted 2026-03-16 12:53:12,704 - lava_callback - INFO - Starting async job submit for node 69b7fc41113612b7716bc61d 2026-03-16 12:53:12,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:12,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc41113612b7716bc61d HTTP/1.1" 200 None 2026-03-16 12:53:12,744 - lava_callback - DEBUG - Processing node 69b7fc41113612b7716bc61d: ltp-cap_bounds 2026-03-16 12:53:13,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:53:13,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:53:13,214 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b7fc41113612b7716bc61d/log.txt.gz 2026-03-16 12:53:13,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:53:13,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:53:13,654 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b7fc41113612b7716bc61d/lava-logs.yaml 2026-03-16 12:53:13,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:53:13,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:53:13,835 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b7fc41113612b7716bc61d/lava_callback.json.gz 2026-03-16 12:53:13,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:13,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc41113612b7716bc61d HTTP/1.1" 200 None 2026-03-16 12:53:13,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:13,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:53:13,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:13,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc41113612b7716bc61d HTTP/1.1" 200 None 2026-03-16 12:53:13,944 - lava_callback - INFO - Completed processing callback for node 69b7fc41113612b7716bc61d 2026-03-16 12:53:14,294 - lava_callback - INFO - Received callback for node 69b7fc43113612b7716bc620 INFO: 172.20.0.1:57158 - "POST /node/69b7fc43113612b7716bc620 HTTP/1.0" 202 Accepted 2026-03-16 12:53:14,300 - lava_callback - INFO - Starting async job submit for node 69b7fc43113612b7716bc620 2026-03-16 12:53:14,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:14,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc43113612b7716bc620 HTTP/1.1" 200 None 2026-03-16 12:53:14,341 - lava_callback - DEBUG - Processing node 69b7fc43113612b7716bc620: ltp-containers 2026-03-16 12:53:14,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:53:14,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:53:14,873 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69b7fc43113612b7716bc620/log.txt.gz 2026-03-16 12:53:15,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:57174 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 12:53:15,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:53:15,305 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69b7fc43113612b7716bc620/lava-logs.yaml 2026-03-16 12:53:15,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:53:15,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:53:15,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69b7fc43113612b7716bc620/lava_callback.json.gz 2026-03-16 12:53:15,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:15,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc43113612b7716bc620 HTTP/1.1" 200 None 2026-03-16 12:53:15,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:15,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:53:15,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:15,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc43113612b7716bc620 HTTP/1.1" 200 None 2026-03-16 12:53:15,585 - lava_callback - INFO - Completed processing callback for node 69b7fc43113612b7716bc620 INFO: 172.20.0.1:57178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50674 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:53:32,913 - lava_callback - INFO - Received callback for node 69b7fc54113612b7716bc659 INFO: 172.20.0.1:59920 - "POST /node/69b7fc54113612b7716bc659 HTTP/1.0" 202 Accepted 2026-03-16 12:53:32,920 - lava_callback - INFO - Starting async job submit for node 69b7fc54113612b7716bc659 2026-03-16 12:53:32,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:32,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc54113612b7716bc659 HTTP/1.1" 200 None 2026-03-16 12:53:32,959 - lava_callback - DEBUG - Processing node 69b7fc54113612b7716bc659: ltp-syscalls 2026-03-16 12:53:33,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:53:33,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:53:33,815 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b7fc54113612b7716bc659/log.txt.gz 2026-03-16 12:53:34,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:53:34,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:53:34,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b7fc54113612b7716bc659/lava-logs.yaml 2026-03-16 12:53:34,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:53:34,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:53:34,657 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b7fc54113612b7716bc659/lava_callback.json.gz 2026-03-16 12:53:34,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:34,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc54113612b7716bc659 HTTP/1.1" 200 None 2026-03-16 12:53:34,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:34,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:53:34,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:34,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc54113612b7716bc659 HTTP/1.1" 200 None 2026-03-16 12:53:34,744 - lava_callback - INFO - Completed processing callback for node 69b7fc54113612b7716bc659 2026-03-16 12:53:34,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:53:34,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50272 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:54:22,141 - lava_callback - INFO - Received callback for node 69b55a6c1727ff69d6f25b03 INFO: 172.20.0.1:46756 - "POST /node/69b55a6c1727ff69d6f25b03 HTTP/1.0" 202 Accepted 2026-03-16 12:54:22,147 - lava_callback - INFO - Starting async job submit for node 69b55a6c1727ff69d6f25b03 2026-03-16 12:54:22,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:54:22,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55a6c1727ff69d6f25b03 HTTP/1.1" 200 None 2026-03-16 12:54:22,168 - lava_callback - DEBUG - Processing node 69b55a6c1727ff69d6f25b03: baseline-arm-baylibre 2026-03-16 12:54:22,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55a6c1727ff69d6f25b03 2026-03-16 12:54:22,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:54:22,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55a6c1727ff69d6f25b03 HTTP/1.1" 200 None 2026-03-16 12:54:22,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:54:22,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 12:54:22,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:54:22,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55a6c1727ff69d6f25b03 HTTP/1.1" 200 None 2026-03-16 12:54:22,239 - lava_callback - ERROR - Error processing callback for node 69b55a6c1727ff69d6f25b03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38796 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:54:44,324 - lava_callback - INFO - Received callback for node 69b7fc28113612b7716bc5cc INFO: 172.20.0.1:58612 - "POST /node/69b7fc28113612b7716bc5cc HTTP/1.0" 202 Accepted 2026-03-16 12:54:44,330 - lava_callback - INFO - Starting async job submit for node 69b7fc28113612b7716bc5cc 2026-03-16 12:54:44,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:54:44,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc28113612b7716bc5cc HTTP/1.1" 200 None 2026-03-16 12:54:44,366 - lava_callback - DEBUG - Processing node 69b7fc28113612b7716bc5cc: baseline-arm-clabbe 2026-03-16 12:54:44,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:54:44,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:54:44,736 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b7fc28113612b7716bc5cc/log.txt.gz 2026-03-16 12:54:44,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:54:45,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:54:45,097 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b7fc28113612b7716bc5cc/lava-logs.yaml 2026-03-16 12:54:45,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:54:45,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:54:45,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b7fc28113612b7716bc5cc/lava_callback.json.gz 2026-03-16 12:54:45,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:54:45,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc28113612b7716bc5cc HTTP/1.1" 200 None 2026-03-16 12:54:45,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:54:45,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:54:45,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:54:45,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc28113612b7716bc5cc HTTP/1.1" 200 None 2026-03-16 12:54:45,354 - lava_callback - INFO - Completed processing callback for node 69b7fc28113612b7716bc5cc INFO: 172.20.0.1:58628 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:54:53,078 - lava_callback - INFO - Received callback for node 69b7fd8b113612b7716bc744 INFO: 172.20.0.1:32884 - "POST /node/69b7fd8b113612b7716bc744 HTTP/1.0" 202 Accepted 2026-03-16 12:54:53,085 - lava_callback - INFO - Starting async job submit for node 69b7fd8b113612b7716bc744 2026-03-16 12:54:53,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:54:53,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fd8b113612b7716bc744 HTTP/1.1" 200 None 2026-03-16 12:54:53,104 - lava_callback - DEBUG - Processing node 69b7fd8b113612b7716bc744: baseline-arm 2026-03-16 12:54:53,109 - lava_callback - WARNING - Failed to upload log 2026-03-16 12:54:53,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:54:53,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:54:53,241 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fd8b113612b7716bc744/lava-logs.yaml 2026-03-16 12:54:53,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:54:53,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:54:53,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fd8b113612b7716bc744/lava_callback.json.gz 2026-03-16 12:54:53,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:54:53,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fd8b113612b7716bc744 HTTP/1.1" 200 None 2026-03-16 12:54:53,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:54:53,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:54:53,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:54:53,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fd8b113612b7716bc744 HTTP/1.1" 200 None 2026-03-16 12:54:53,451 - lava_callback - INFO - Completed processing callback for node 69b7fd8b113612b7716bc744 INFO: 172.20.0.1:32890 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:55:04,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:55:04,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37610 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:55:12,798 - lava_callback - INFO - Received callback for node 69b7fc4a113612b7716bc630 INFO: 172.20.0.1:49122 - "POST /node/69b7fc4a113612b7716bc630 HTTP/1.0" 202 Accepted 2026-03-16 12:55:12,804 - lava_callback - INFO - Starting async job submit for node 69b7fc4a113612b7716bc630 2026-03-16 12:55:12,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:55:12,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc4a113612b7716bc630 HTTP/1.1" 200 None 2026-03-16 12:55:12,845 - lava_callback - DEBUG - Processing node 69b7fc4a113612b7716bc630: ltp-fs_bind 2026-03-16 12:55:13,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:55:13,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:55:13,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b7fc4a113612b7716bc630/log.txt.gz 2026-03-16 12:55:13,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:55:13,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:55:13,876 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b7fc4a113612b7716bc630/lava-logs.yaml 2026-03-16 12:55:13,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:55:14,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:55:14,041 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b7fc4a113612b7716bc630/lava_callback.json.gz 2026-03-16 12:55:14,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:55:14,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc4a113612b7716bc630 HTTP/1.1" 200 None 2026-03-16 12:55:14,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:55:14,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:55:14,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:55:14,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc4a113612b7716bc630 HTTP/1.1" 200 None 2026-03-16 12:55:14,147 - lava_callback - INFO - Completed processing callback for node 69b7fc4a113612b7716bc630 INFO: 172.20.0.1:49138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49154 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:55:22,006 - lava_callback - INFO - Received callback for node 69b55aa81727ff69d6f25b13 INFO: 172.20.0.1:43564 - "POST /node/69b55aa81727ff69d6f25b13 HTTP/1.0" 202 Accepted 2026-03-16 12:55:22,012 - lava_callback - INFO - Starting async job submit for node 69b55aa81727ff69d6f25b13 2026-03-16 12:55:22,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:55:22,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55aa81727ff69d6f25b13 HTTP/1.1" 200 None 2026-03-16 12:55:22,028 - lava_callback - DEBUG - Processing node 69b55aa81727ff69d6f25b13: baseline-arm-baylibre 2026-03-16 12:55:22,028 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55aa81727ff69d6f25b13 2026-03-16 12:55:22,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:55:22,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55aa81727ff69d6f25b13 HTTP/1.1" 200 None 2026-03-16 12:55:22,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:55:22,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 12:55:22,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:55:22,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55aa81727ff69d6f25b13 HTTP/1.1" 200 None 2026-03-16 12:55:22,086 - lava_callback - ERROR - Error processing callback for node 69b55aa81727ff69d6f25b13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43584 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:55:34,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:55:34,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43060 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:56:22,109 - lava_callback - INFO - Received callback for node 69b55ae51727ff69d6f25b22 INFO: 172.20.0.1:43814 - "POST /node/69b55ae51727ff69d6f25b22 HTTP/1.0" 202 Accepted 2026-03-16 12:56:22,114 - lava_callback - INFO - Starting async job submit for node 69b55ae51727ff69d6f25b22 2026-03-16 12:56:22,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:56:22,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55ae51727ff69d6f25b22 HTTP/1.1" 200 None 2026-03-16 12:56:22,133 - lava_callback - DEBUG - Processing node 69b55ae51727ff69d6f25b22: baseline-arm-baylibre 2026-03-16 12:56:22,133 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55ae51727ff69d6f25b22 2026-03-16 12:56:22,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:56:22,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55ae51727ff69d6f25b22 HTTP/1.1" 200 None 2026-03-16 12:56:22,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:56:22,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 12:56:22,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:56:22,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55ae51727ff69d6f25b22 HTTP/1.1" 200 None 2026-03-16 12:56:22,200 - lava_callback - ERROR - Error processing callback for node 69b55ae51727ff69d6f25b22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57648 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:57:12,874 - lava_callback - INFO - Received callback for node 69b7fc4b113612b7716bc633 INFO: 172.20.0.1:51522 - "POST /node/69b7fc4b113612b7716bc633 HTTP/1.0" 202 Accepted 2026-03-16 12:57:12,883 - lava_callback - INFO - Starting async job submit for node 69b7fc4b113612b7716bc633 2026-03-16 12:57:12,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:12,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc4b113612b7716bc633 HTTP/1.1" 200 None 2026-03-16 12:57:12,942 - lava_callback - DEBUG - Processing node 69b7fc4b113612b7716bc633: ltp-fsx 2026-03-16 12:57:13,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:57:13,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:57:13,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69b7fc4b113612b7716bc633/log.txt.gz 2026-03-16 12:57:13,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:57:13,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:57:13,956 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69b7fc4b113612b7716bc633/lava-logs.yaml 2026-03-16 12:57:13,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:57:14,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:57:14,147 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69b7fc4b113612b7716bc633/lava_callback.json.gz 2026-03-16 12:57:14,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:14,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc4b113612b7716bc633 HTTP/1.1" 200 None 2026-03-16 12:57:14,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:14,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:57:14,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:14,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc4b113612b7716bc633 HTTP/1.1" 200 None 2026-03-16 12:57:14,241 - lava_callback - INFO - Completed processing callback for node 69b7fc4b113612b7716bc633 INFO: 172.20.0.1:51536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51542 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:57:21,924 - lava_callback - INFO - Received callback for node 69b55b251727ff69d6f25b33 INFO: 172.20.0.1:36012 - "POST /node/69b55b251727ff69d6f25b33 HTTP/1.0" 202 Accepted 2026-03-16 12:57:21,929 - lava_callback - INFO - Starting async job submit for node 69b55b251727ff69d6f25b33 2026-03-16 12:57:21,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:21,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55b251727ff69d6f25b33 HTTP/1.1" 200 None 2026-03-16 12:57:21,945 - lava_callback - DEBUG - Processing node 69b55b251727ff69d6f25b33: baseline-arm-clabbe 2026-03-16 12:57:21,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55b251727ff69d6f25b33 2026-03-16 12:57:21,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:21,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55b251727ff69d6f25b33 HTTP/1.1" 200 None 2026-03-16 12:57:21,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:21,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 12:57:21,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:22,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55b251727ff69d6f25b33 HTTP/1.1" 200 None 2026-03-16 12:57:22,015 - lava_callback - ERROR - Error processing callback for node 69b55b251727ff69d6f25b33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36024 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:57:33,050 - lava_callback - INFO - Received callback for node 69b7fc4d113612b7716bc636 INFO: 172.20.0.1:55740 - "POST /node/69b7fc4d113612b7716bc636 HTTP/1.0" 202 Accepted 2026-03-16 12:57:33,057 - lava_callback - INFO - Starting async job submit for node 69b7fc4d113612b7716bc636 2026-03-16 12:57:33,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:33,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc4d113612b7716bc636 HTTP/1.1" 200 None 2026-03-16 12:57:33,099 - lava_callback - DEBUG - Processing node 69b7fc4d113612b7716bc636: ltp-input 2026-03-16 12:57:33,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:57:33,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:57:33,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69b7fc4d113612b7716bc636/log.txt.gz 2026-03-16 12:57:33,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:57:34,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:57:34,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69b7fc4d113612b7716bc636/lava-logs.yaml 2026-03-16 12:57:34,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:57:34,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:57:34,238 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69b7fc4d113612b7716bc636/lava_callback.json.gz 2026-03-16 12:57:34,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:34,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc4d113612b7716bc636 HTTP/1.1" 200 None 2026-03-16 12:57:34,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:34,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:57:34,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:34,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc4d113612b7716bc636 HTTP/1.1" 200 None 2026-03-16 12:57:34,333 - lava_callback - INFO - Completed processing callback for node 69b7fc4d113612b7716bc636 2026-03-16 12:57:34,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:35,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 12:57:36,102 - lava_callback - INFO - Received callback for node 69b7fa1e113612b7716bc540 INFO: 172.20.0.1:55748 - "POST /node/69b7fa1e113612b7716bc540 HTTP/1.0" 202 Accepted 2026-03-16 12:57:36,108 - lava_callback - INFO - Starting async job submit for node 69b7fa1e113612b7716bc540 2026-03-16 12:57:36,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:36,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fa1e113612b7716bc540 HTTP/1.1" 200 None 2026-03-16 12:57:36,184 - lava_callback - DEBUG - Processing node 69b7fa1e113612b7716bc540: ltp-smoke INFO: 172.20.0.1:55750 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:57:36,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:57:36,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:57:36,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7fa1e113612b7716bc540/log.txt.gz 2026-03-16 12:57:37,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:57:37,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:57:37,306 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7fa1e113612b7716bc540/lava-logs.yaml 2026-03-16 12:57:37,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:57:37,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:57:37,502 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7fa1e113612b7716bc540/lava_callback.json.gz 2026-03-16 12:57:37,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:37,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fa1e113612b7716bc540 HTTP/1.1" 200 None 2026-03-16 12:57:37,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:37,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e976113612b7716b9df8 HTTP/1.1" 200 None 2026-03-16 12:57:37,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:57:37,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fa1e113612b7716bc540 HTTP/1.1" 200 None 2026-03-16 12:57:37,802 - lava_callback - INFO - Completed processing callback for node 69b7fa1e113612b7716bc540 INFO: 172.20.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36202 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:58:02,202 - lava_callback - INFO - Received callback for node 69b55b471727ff69d6f25b3d INFO: 172.20.0.1:42564 - "POST /node/69b55b471727ff69d6f25b3d HTTP/1.0" 202 Accepted 2026-03-16 12:58:02,208 - lava_callback - INFO - Starting async job submit for node 69b55b471727ff69d6f25b3d 2026-03-16 12:58:02,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:02,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55b471727ff69d6f25b3d HTTP/1.1" 200 None 2026-03-16 12:58:02,223 - lava_callback - DEBUG - Processing node 69b55b471727ff69d6f25b3d: baseline-arm-baylibre 2026-03-16 12:58:02,223 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55b471727ff69d6f25b3d 2026-03-16 12:58:02,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:02,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55b471727ff69d6f25b3d HTTP/1.1" 200 None 2026-03-16 12:58:02,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:02,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 12:58:02,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:02,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55b471727ff69d6f25b3d HTTP/1.1" 200 None 2026-03-16 12:58:02,286 - lava_callback - ERROR - Error processing callback for node 69b55b471727ff69d6f25b3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 12:58:05,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:05,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37030 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:58:28,144 - lava_callback - INFO - Received callback for node 69b7fe6b113612b7716bc7bc INFO: 172.20.0.1:37040 - "POST /node/69b7fe6b113612b7716bc7bc HTTP/1.0" 202 Accepted 2026-03-16 12:58:28,150 - lava_callback - INFO - Starting async job submit for node 69b7fe6b113612b7716bc7bc 2026-03-16 12:58:28,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:28,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fe6b113612b7716bc7bc HTTP/1.1" 200 None 2026-03-16 12:58:28,173 - lava_callback - DEBUG - Processing node 69b7fe6b113612b7716bc7bc: baseline-arm 2026-03-16 12:58:28,178 - lava_callback - WARNING - Failed to upload log 2026-03-16 12:58:28,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:58:28,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:58:28,311 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fe6b113612b7716bc7bc/lava-logs.yaml 2026-03-16 12:58:28,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:58:28,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:58:28,442 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fe6b113612b7716bc7bc/lava_callback.json.gz 2026-03-16 12:58:28,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:28,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fe6b113612b7716bc7bc HTTP/1.1" 200 None 2026-03-16 12:58:28,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:28,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:58:28,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:28,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fe6b113612b7716bc7bc HTTP/1.1" 200 None 2026-03-16 12:58:28,515 - lava_callback - INFO - Completed processing callback for node 69b7fe6b113612b7716bc7bc 2026-03-16 12:58:35,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:35,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59994 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:58:41,961 - lava_callback - INFO - Received callback for node 69b55b6c1727ff69d6f25b4c INFO: 172.20.0.1:42460 - "POST /node/69b55b6c1727ff69d6f25b4c HTTP/1.0" 202 Accepted 2026-03-16 12:58:41,967 - lava_callback - INFO - Starting async job submit for node 69b55b6c1727ff69d6f25b4c 2026-03-16 12:58:41,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:41,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55b6c1727ff69d6f25b4c HTTP/1.1" 200 None 2026-03-16 12:58:41,988 - lava_callback - DEBUG - Processing node 69b55b6c1727ff69d6f25b4c: baseline-arm-clabbe 2026-03-16 12:58:41,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55b6c1727ff69d6f25b4c 2026-03-16 12:58:41,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:42,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55b6c1727ff69d6f25b4c HTTP/1.1" 200 None 2026-03-16 12:58:42,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:42,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 12:58:42,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:58:42,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55b6c1727ff69d6f25b4c HTTP/1.1" 200 None 2026-03-16 12:58:42,045 - lava_callback - ERROR - Error processing callback for node 69b55b6c1727ff69d6f25b4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39974 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:59:02,210 - lava_callback - INFO - Received callback for node 69b55b8d1727ff69d6f25b55 INFO: 172.20.0.1:45092 - "POST /node/69b55b8d1727ff69d6f25b55 HTTP/1.0" 202 Accepted 2026-03-16 12:59:02,215 - lava_callback - INFO - Starting async job submit for node 69b55b8d1727ff69d6f25b55 2026-03-16 12:59:02,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:59:02,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55b8d1727ff69d6f25b55 HTTP/1.1" 200 None 2026-03-16 12:59:02,231 - lava_callback - DEBUG - Processing node 69b55b8d1727ff69d6f25b55: baseline-arm-baylibre 2026-03-16 12:59:02,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55b8d1727ff69d6f25b55 2026-03-16 12:59:02,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:59:02,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55b8d1727ff69d6f25b55 HTTP/1.1" 200 None 2026-03-16 12:59:02,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:59:02,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 12:59:02,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:59:02,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55b8d1727ff69d6f25b55 HTTP/1.1" 200 None 2026-03-16 12:59:02,289 - lava_callback - ERROR - Error processing callback for node 69b55b8d1727ff69d6f25b55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42236 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:59:42,279 - lava_callback - INFO - Received callback for node 69b55bb31727ff69d6f25b64 INFO: 172.20.0.1:34302 - "POST /node/69b55bb31727ff69d6f25b64 HTTP/1.0" 202 Accepted 2026-03-16 12:59:42,285 - lava_callback - INFO - Starting async job submit for node 69b55bb31727ff69d6f25b64 2026-03-16 12:59:42,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:59:42,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55bb31727ff69d6f25b64 HTTP/1.1" 200 None 2026-03-16 12:59:42,300 - lava_callback - DEBUG - Processing node 69b55bb31727ff69d6f25b64: baseline-arm-baylibre 2026-03-16 12:59:42,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55bb31727ff69d6f25b64 2026-03-16 12:59:42,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:59:42,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55bb31727ff69d6f25b64 HTTP/1.1" 200 None 2026-03-16 12:59:42,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:59:42,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 12:59:42,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:59:42,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55bb31727ff69d6f25b64 HTTP/1.1" 200 None 2026-03-16 12:59:42,364 - lava_callback - ERROR - Error processing callback for node 69b55bb31727ff69d6f25b64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34318 - "GET / HTTP/1.0" 200 OK 2026-03-16 12:59:52,957 - lava_callback - INFO - Received callback for node 69b7fc4e113612b7716bc639 INFO: 172.20.0.1:50692 - "POST /node/69b7fc4e113612b7716bc639 HTTP/1.0" 202 Accepted 2026-03-16 12:59:52,964 - lava_callback - INFO - Starting async job submit for node 69b7fc4e113612b7716bc639 2026-03-16 12:59:52,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:59:53,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc4e113612b7716bc639 HTTP/1.1" 200 None 2026-03-16 12:59:53,003 - lava_callback - DEBUG - Processing node 69b7fc4e113612b7716bc639: ltp-ipc 2026-03-16 12:59:53,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:59:53,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:59:53,557 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69b7fc4e113612b7716bc639/log.txt.gz 2026-03-16 12:59:53,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:59:54,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:59:54,004 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69b7fc4e113612b7716bc639/lava-logs.yaml 2026-03-16 12:59:54,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 12:59:54,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 12:59:54,239 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69b7fc4e113612b7716bc639/lava_callback.json.gz 2026-03-16 12:59:54,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:59:54,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc4e113612b7716bc639 HTTP/1.1" 200 None 2026-03-16 12:59:54,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:59:54,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 12:59:54,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 12:59:54,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc4e113612b7716bc639 HTTP/1.1" 200 None 2026-03-16 12:59:54,336 - lava_callback - INFO - Completed processing callback for node 69b7fc4e113612b7716bc639 INFO: 172.20.0.1:50704 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:00:05,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:00:05,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59264 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:00:22,051 - lava_callback - INFO - Received callback for node 69b55bda1727ff69d6f25b71 INFO: 172.20.0.1:39572 - "POST /node/69b55bda1727ff69d6f25b71 HTTP/1.0" 202 Accepted 2026-03-16 13:00:22,057 - lava_callback - INFO - Starting async job submit for node 69b55bda1727ff69d6f25b71 2026-03-16 13:00:22,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:00:22,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55bda1727ff69d6f25b71 HTTP/1.1" 200 None 2026-03-16 13:00:22,075 - lava_callback - DEBUG - Processing node 69b55bda1727ff69d6f25b71: baseline-arm-clabbe 2026-03-16 13:00:22,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55bda1727ff69d6f25b71 2026-03-16 13:00:22,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:00:22,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55bda1727ff69d6f25b71 HTTP/1.1" 200 None 2026-03-16 13:00:22,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:00:22,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 13:00:22,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:00:22,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55bda1727ff69d6f25b71 HTTP/1.1" 200 None 2026-03-16 13:00:22,146 - lava_callback - ERROR - Error processing callback for node 69b55bda1727ff69d6f25b71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51724 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:01:02,067 - lava_callback - INFO - Received callback for node 69b55bfe1727ff69d6f25b7c INFO: 172.20.0.1:48536 - "POST /node/69b55bfe1727ff69d6f25b7c HTTP/1.0" 202 Accepted 2026-03-16 13:01:02,073 - lava_callback - INFO - Starting async job submit for node 69b55bfe1727ff69d6f25b7c 2026-03-16 13:01:02,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:02,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55bfe1727ff69d6f25b7c HTTP/1.1" 200 None 2026-03-16 13:01:02,089 - lava_callback - DEBUG - Processing node 69b55bfe1727ff69d6f25b7c: baseline-arm-clabbe 2026-03-16 13:01:02,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55bfe1727ff69d6f25b7c 2026-03-16 13:01:02,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:02,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55bfe1727ff69d6f25b7c HTTP/1.1" 200 None 2026-03-16 13:01:02,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:02,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 13:01:02,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:02,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55bfe1727ff69d6f25b7c HTTP/1.1" 200 None 2026-03-16 13:01:02,161 - lava_callback - ERROR - Error processing callback for node 69b55bfe1727ff69d6f25b7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48550 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:01:13,047 - lava_callback - INFO - Received callback for node 69b7fc50113612b7716bc63c INFO: 172.20.0.1:43216 - "POST /node/69b7fc50113612b7716bc63c HTTP/1.0" 202 Accepted 2026-03-16 13:01:13,053 - lava_callback - INFO - Starting async job submit for node 69b7fc50113612b7716bc63c 2026-03-16 13:01:13,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:13,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc50113612b7716bc63c HTTP/1.1" 200 None 2026-03-16 13:01:13,114 - lava_callback - DEBUG - Processing node 69b7fc50113612b7716bc63c: ltp-pty 2026-03-16 13:01:13,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:01:13,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:01:13,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69b7fc50113612b7716bc63c/log.txt.gz 2026-03-16 13:01:13,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:01:14,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:01:14,064 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69b7fc50113612b7716bc63c/lava-logs.yaml 2026-03-16 13:01:14,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:01:14,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:01:14,265 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69b7fc50113612b7716bc63c/lava_callback.json.gz 2026-03-16 13:01:14,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:14,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc50113612b7716bc63c HTTP/1.1" 200 None 2026-03-16 13:01:14,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:14,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 13:01:14,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:14,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc50113612b7716bc63c HTTP/1.1" 200 None 2026-03-16 13:01:14,373 - lava_callback - INFO - Completed processing callback for node 69b7fc50113612b7716bc63c INFO: 172.20.0.1:43220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53256 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:01:33,203 - lava_callback - INFO - Received callback for node 69b7fc51113612b7716bc643 INFO: 172.20.0.1:58830 - "POST /node/69b7fc51113612b7716bc643 HTTP/1.0" 202 Accepted 2026-03-16 13:01:33,210 - lava_callback - INFO - Starting async job submit for node 69b7fc51113612b7716bc643 2026-03-16 13:01:33,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:33,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc51113612b7716bc643 HTTP/1.1" 200 None 2026-03-16 13:01:33,253 - lava_callback - DEBUG - Processing node 69b7fc51113612b7716bc643: ltp-sched 2026-03-16 13:01:33,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:01:33,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:01:33,746 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69b7fc51113612b7716bc643/log.txt.gz 2026-03-16 13:01:33,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:01:34,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:01:34,151 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69b7fc51113612b7716bc643/lava-logs.yaml 2026-03-16 13:01:34,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:01:34,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:01:34,342 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69b7fc51113612b7716bc643/lava_callback.json.gz 2026-03-16 13:01:34,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:34,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc51113612b7716bc643 HTTP/1.1" 200 None 2026-03-16 13:01:34,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:34,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 13:01:34,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:34,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc51113612b7716bc643 HTTP/1.1" 200 None 2026-03-16 13:01:34,440 - lava_callback - INFO - Completed processing callback for node 69b7fc51113612b7716bc643 2026-03-16 13:01:35,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:35,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58838 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:01:42,172 - lava_callback - INFO - Received callback for node 69b55c221727ff69d6f25b8d INFO: 172.20.0.1:45940 - "POST /node/69b55c221727ff69d6f25b8d HTTP/1.0" 202 Accepted 2026-03-16 13:01:42,177 - lava_callback - INFO - Starting async job submit for node 69b55c221727ff69d6f25b8d 2026-03-16 13:01:42,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:42,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55c221727ff69d6f25b8d HTTP/1.1" 200 None 2026-03-16 13:01:42,194 - lava_callback - DEBUG - Processing node 69b55c221727ff69d6f25b8d: baseline-arm-clabbe 2026-03-16 13:01:42,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55c221727ff69d6f25b8d 2026-03-16 13:01:42,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:42,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55c221727ff69d6f25b8d HTTP/1.1" 200 None 2026-03-16 13:01:42,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:42,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 13:01:42,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:01:42,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55c221727ff69d6f25b8d HTTP/1.1" 200 None 2026-03-16 13:01:42,266 - lava_callback - ERROR - Error processing callback for node 69b55c221727ff69d6f25b8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48924 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:02:02,115 - lava_callback - INFO - Received callback for node 69b55c461727ff69d6f25b98 INFO: 172.20.0.1:33140 - "POST /node/69b55c461727ff69d6f25b98 HTTP/1.0" 202 Accepted 2026-03-16 13:02:02,120 - lava_callback - INFO - Starting async job submit for node 69b55c461727ff69d6f25b98 2026-03-16 13:02:02,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:02:02,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55c461727ff69d6f25b98 HTTP/1.1" 200 None 2026-03-16 13:02:02,140 - lava_callback - DEBUG - Processing node 69b55c461727ff69d6f25b98: baseline-arm-clabbe 2026-03-16 13:02:02,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55c461727ff69d6f25b98 2026-03-16 13:02:02,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:02:02,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55c461727ff69d6f25b98 HTTP/1.1" 200 None 2026-03-16 13:02:02,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:02:02,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 13:02:02,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:02:02,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55c461727ff69d6f25b98 HTTP/1.1" 200 None 2026-03-16 13:02:02,192 - lava_callback - ERROR - Error processing callback for node 69b55c461727ff69d6f25b98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58606 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 13:02:16,375 - lava_callback - INFO - Received callback for node 69b7fc53113612b7716bc656 INFO: 172.20.0.1:58612 - "POST /node/69b7fc53113612b7716bc656 HTTP/1.0" 202 Accepted 2026-03-16 13:02:16,382 - lava_callback - INFO - Starting async job submit for node 69b7fc53113612b7716bc656 2026-03-16 13:02:16,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:02:16,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc53113612b7716bc656 HTTP/1.1" 200 None 2026-03-16 13:02:16,440 - lava_callback - DEBUG - Processing node 69b7fc53113612b7716bc656: ltp-smoke INFO: 172.20.0.1:58622 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:02:16,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:02:16,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:02:16,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7fc53113612b7716bc656/log.txt.gz 2026-03-16 13:02:17,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:02:17,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:02:17,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7fc53113612b7716bc656/lava-logs.yaml 2026-03-16 13:02:17,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:02:17,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:02:17,579 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b7fc53113612b7716bc656/lava_callback.json.gz 2026-03-16 13:02:17,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:02:17,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc53113612b7716bc656 HTTP/1.1" 200 None 2026-03-16 13:02:17,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:02:17,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 13:02:17,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:02:17,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc53113612b7716bc656 HTTP/1.1" 200 None 2026-03-16 13:02:17,691 - lava_callback - INFO - Completed processing callback for node 69b7fc53113612b7716bc656 INFO: 172.20.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33046 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:02:35,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:02:35,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38712 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:02:42,151 - lava_callback - INFO - Received callback for node 69b55c6a1727ff69d6f25ba6 INFO: 172.20.0.1:59718 - "POST /node/69b55c6a1727ff69d6f25ba6 HTTP/1.0" 202 Accepted 2026-03-16 13:02:42,157 - lava_callback - INFO - Starting async job submit for node 69b55c6a1727ff69d6f25ba6 2026-03-16 13:02:42,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:02:42,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55c6a1727ff69d6f25ba6 HTTP/1.1" 200 None 2026-03-16 13:02:42,181 - lava_callback - DEBUG - Processing node 69b55c6a1727ff69d6f25ba6: baseline-arm-clabbe 2026-03-16 13:02:42,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55c6a1727ff69d6f25ba6 2026-03-16 13:02:42,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:02:42,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55c6a1727ff69d6f25ba6 HTTP/1.1" 200 None 2026-03-16 13:02:42,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:02:42,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 13:02:42,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:02:42,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55c6a1727ff69d6f25ba6 HTTP/1.1" 200 None 2026-03-16 13:02:42,246 - lava_callback - ERROR - Error processing callback for node 69b55c6a1727ff69d6f25ba6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59402 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:03:22,182 - lava_callback - INFO - Received callback for node 69b55c8e1727ff69d6f25bb2 INFO: 172.20.0.1:51126 - "POST /node/69b55c8e1727ff69d6f25bb2 HTTP/1.0" 202 Accepted 2026-03-16 13:03:22,188 - lava_callback - INFO - Starting async job submit for node 69b55c8e1727ff69d6f25bb2 2026-03-16 13:03:22,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:03:22,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55c8e1727ff69d6f25bb2 HTTP/1.1" 200 None 2026-03-16 13:03:22,204 - lava_callback - DEBUG - Processing node 69b55c8e1727ff69d6f25bb2: baseline-arm-clabbe 2026-03-16 13:03:22,204 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55c8e1727ff69d6f25bb2 2026-03-16 13:03:22,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:03:22,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55c8e1727ff69d6f25bb2 HTTP/1.1" 200 None 2026-03-16 13:03:22,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:03:22,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 13:03:22,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:03:22,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55c8e1727ff69d6f25bb2 HTTP/1.1" 200 None 2026-03-16 13:03:22,260 - lava_callback - ERROR - Error processing callback for node 69b55c8e1727ff69d6f25bb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60876 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:04:02,216 - lava_callback - INFO - Received callback for node 69b55cb21727ff69d6f25bbd INFO: 172.20.0.1:51946 - "POST /node/69b55cb21727ff69d6f25bbd HTTP/1.0" 202 Accepted 2026-03-16 13:04:02,223 - lava_callback - INFO - Starting async job submit for node 69b55cb21727ff69d6f25bbd 2026-03-16 13:04:02,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:02,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55cb21727ff69d6f25bbd HTTP/1.1" 200 None 2026-03-16 13:04:02,239 - lava_callback - DEBUG - Processing node 69b55cb21727ff69d6f25bbd: baseline-arm-clabbe 2026-03-16 13:04:02,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55cb21727ff69d6f25bbd 2026-03-16 13:04:02,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:02,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55cb21727ff69d6f25bbd HTTP/1.1" 200 None 2026-03-16 13:04:02,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:02,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 13:04:02,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:02,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55cb21727ff69d6f25bbd HTTP/1.1" 200 None 2026-03-16 13:04:02,313 - lava_callback - ERROR - Error processing callback for node 69b55cb21727ff69d6f25bbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51948 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:04:13,199 - lava_callback - INFO - Received callback for node 69b7fc56113612b7716bc65c INFO: 172.20.0.1:40686 - "POST /node/69b7fc56113612b7716bc65c HTTP/1.0" 202 Accepted 2026-03-16 13:04:13,206 - lava_callback - INFO - Starting async job submit for node 69b7fc56113612b7716bc65c 2026-03-16 13:04:13,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:13,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc56113612b7716bc65c HTTP/1.1" 200 None 2026-03-16 13:04:13,252 - lava_callback - DEBUG - Processing node 69b7fc56113612b7716bc65c: ltp-syscalls-ipc 2026-03-16 13:04:13,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:04:13,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:04:13,806 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b7fc56113612b7716bc65c/log.txt.gz 2026-03-16 13:04:14,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:04:14,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:04:14,226 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b7fc56113612b7716bc65c/lava-logs.yaml 2026-03-16 13:04:14,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:04:14,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:04:14,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b7fc56113612b7716bc65c/lava_callback.json.gz 2026-03-16 13:04:14,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:14,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc56113612b7716bc65c HTTP/1.1" 200 None 2026-03-16 13:04:14,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:14,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 13:04:14,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:14,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc56113612b7716bc65c HTTP/1.1" 200 None 2026-03-16 13:04:14,543 - lava_callback - INFO - Completed processing callback for node 69b7fc56113612b7716bc65c INFO: 172.20.0.1:40692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37296 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:04:35,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:35,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 13:04:36,490 - lava_callback - INFO - Received callback for node 69b7f879113612b7716bc521 INFO: 172.20.0.1:42388 - "POST /node/69b7f879113612b7716bc521 HTTP/1.0" 202 Accepted 2026-03-16 13:04:36,496 - lava_callback - INFO - Starting async job submit for node 69b7f879113612b7716bc521 2026-03-16 13:04:36,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:42404 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:04:36,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f879113612b7716bc521 HTTP/1.1" 200 None 2026-03-16 13:04:36,567 - lava_callback - DEBUG - Processing node 69b7f879113612b7716bc521: baseline-arm64-broonie 2026-03-16 13:04:36,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:04:36,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:04:36,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b7f879113612b7716bc521/log.txt.gz 2026-03-16 13:04:36,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:04:36,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:04:36,993 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b7f879113612b7716bc521/lava-logs.yaml 2026-03-16 13:04:36,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:04:37,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:04:37,127 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b7f879113612b7716bc521/lava_callback.json.gz 2026-03-16 13:04:37,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:37,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f879113612b7716bc521 HTTP/1.1" 200 None 2026-03-16 13:04:37,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:37,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 13:04:37,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:37,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7f879113612b7716bc521 HTTP/1.1" 200 None 2026-03-16 13:04:37,243 - lava_callback - INFO - Completed processing callback for node 69b7f879113612b7716bc521 2026-03-16 13:04:42,236 - lava_callback - INFO - Received callback for node 69b55cd71727ff69d6f25bca INFO: 172.20.0.1:44346 - "POST /node/69b55cd71727ff69d6f25bca HTTP/1.0" 202 Accepted 2026-03-16 13:04:42,242 - lava_callback - INFO - Starting async job submit for node 69b55cd71727ff69d6f25bca 2026-03-16 13:04:42,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:42,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55cd71727ff69d6f25bca HTTP/1.1" 200 None 2026-03-16 13:04:42,262 - lava_callback - DEBUG - Processing node 69b55cd71727ff69d6f25bca: baseline-arm-clabbe 2026-03-16 13:04:42,262 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55cd71727ff69d6f25bca 2026-03-16 13:04:42,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:42,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55cd71727ff69d6f25bca HTTP/1.1" 200 None 2026-03-16 13:04:42,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:42,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 13:04:42,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:04:42,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55cd71727ff69d6f25bca HTTP/1.1" 200 None 2026-03-16 13:04:42,323 - lava_callback - ERROR - Error processing callback for node 69b55cd71727ff69d6f25bca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36088 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:05:02,176 - lava_callback - INFO - Received callback for node 69b55cfb1727ff69d6f25bd3 INFO: 172.20.0.1:56104 - "POST /node/69b55cfb1727ff69d6f25bd3 HTTP/1.0" 202 Accepted 2026-03-16 13:05:02,182 - lava_callback - INFO - Starting async job submit for node 69b55cfb1727ff69d6f25bd3 2026-03-16 13:05:02,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:02,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55cfb1727ff69d6f25bd3 HTTP/1.1" 200 None 2026-03-16 13:05:02,198 - lava_callback - DEBUG - Processing node 69b55cfb1727ff69d6f25bd3: baseline-arm-clabbe 2026-03-16 13:05:02,198 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55cfb1727ff69d6f25bd3 2026-03-16 13:05:02,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:02,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55cfb1727ff69d6f25bd3 HTTP/1.1" 200 None 2026-03-16 13:05:02,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:02,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 13:05:02,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:02,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55cfb1727ff69d6f25bd3 HTTP/1.1" 200 None 2026-03-16 13:05:02,273 - lava_callback - ERROR - Error processing callback for node 69b55cfb1727ff69d6f25bd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 13:05:05,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:05,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35272 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:05:33,189 - lava_callback - INFO - Received callback for node 69b7fc59113612b7716bc662 INFO: 172.20.0.1:35786 - "POST /node/69b7fc59113612b7716bc662 HTTP/1.0" 202 Accepted 2026-03-16 13:05:33,201 - lava_callback - INFO - Starting async job submit for node 69b7fc59113612b7716bc662 2026-03-16 13:05:33,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:33,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc59113612b7716bc662 HTTP/1.1" 200 None 2026-03-16 13:05:33,277 - lava_callback - DEBUG - Processing node 69b7fc59113612b7716bc662: ltp-watchqueue 2026-03-16 13:05:33,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:05:34,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:05:34,119 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b7fc59113612b7716bc662/log.txt.gz 2026-03-16 13:05:34,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:05:34,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:05:34,800 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b7fc59113612b7716bc662/lava-logs.yaml 2026-03-16 13:05:34,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:05:35,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:05:35,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b7fc59113612b7716bc662/lava_callback.json.gz 2026-03-16 13:05:35,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:35,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc59113612b7716bc662 HTTP/1.1" 200 None 2026-03-16 13:05:35,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:35,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 13:05:35,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:35,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc59113612b7716bc662 HTTP/1.1" 200 None 2026-03-16 13:05:35,115 - lava_callback - INFO - Completed processing callback for node 69b7fc59113612b7716bc662 2026-03-16 13:05:35,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:35,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35802 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:05:42,649 - lava_callback - INFO - Received callback for node 69b55d231727ff69d6f25be4 INFO: 172.20.0.1:35172 - "POST /node/69b55d231727ff69d6f25be4 HTTP/1.0" 202 Accepted 2026-03-16 13:05:42,655 - lava_callback - INFO - Starting async job submit for node 69b55d231727ff69d6f25be4 2026-03-16 13:05:42,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:42,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55d231727ff69d6f25be4 HTTP/1.1" 200 None 2026-03-16 13:05:42,697 - lava_callback - DEBUG - Processing node 69b55d231727ff69d6f25be4: baseline-arm64-baylibre 2026-03-16 13:05:42,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55d231727ff69d6f25be4 2026-03-16 13:05:42,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:42,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55d231727ff69d6f25be4 HTTP/1.1" 200 None 2026-03-16 13:05:42,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:42,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:05:42,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:05:42,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55d231727ff69d6f25be4 HTTP/1.1" 200 None 2026-03-16 13:05:42,779 - lava_callback - ERROR - Error processing callback for node 69b55d231727ff69d6f25be4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55846 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:06:11,331 - lava_callback - INFO - Received callback for node 69b7fc0c113612b7716bc569 INFO: 172.20.0.1:46644 - "POST /node/69b7fc0c113612b7716bc569 HTTP/1.0" 202 Accepted 2026-03-16 13:06:11,337 - lava_callback - INFO - Starting async job submit for node 69b7fc0c113612b7716bc569 2026-03-16 13:06:11,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:06:11,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc0c113612b7716bc569 HTTP/1.1" 200 None 2026-03-16 13:06:11,406 - lava_callback - DEBUG - Processing node 69b7fc0c113612b7716bc569: baseline-arm 2026-03-16 13:06:11,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:06:12,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:06:12,122 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0c113612b7716bc569/log.txt.gz 2026-03-16 13:06:12,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:06:12,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:06:12,728 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0c113612b7716bc569/lava-logs.yaml 2026-03-16 13:06:12,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:06:12,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:06:12,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b7fc0c113612b7716bc569/lava_callback.json.gz DEBUG: Setup failed for 69b7fc0c113612b7716bc569. Transitting job node result: incomplete -> fail 2026-03-16 13:06:13,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:06:13,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc0c113612b7716bc569 HTTP/1.1" 200 None 2026-03-16 13:06:13,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:06:13,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 13:06:13,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:06:13,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc0c113612b7716bc569 HTTP/1.1" 200 None 2026-03-16 13:06:13,184 - lava_callback - INFO - Completed processing callback for node 69b7fc0c113612b7716bc569 INFO: 172.20.0.1:46654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41982 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:06:35,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:06:35,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39684 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:07:02,349 - lava_callback - INFO - Received callback for node 69b55d6c1727ff69d6f25bec INFO: 172.20.0.1:40016 - "POST /node/69b55d6c1727ff69d6f25bec HTTP/1.0" 202 Accepted 2026-03-16 13:07:02,355 - lava_callback - INFO - Starting async job submit for node 69b55d6c1727ff69d6f25bec 2026-03-16 13:07:02,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:07:02,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55d6c1727ff69d6f25bec HTTP/1.1" 200 None 2026-03-16 13:07:02,372 - lava_callback - DEBUG - Processing node 69b55d6c1727ff69d6f25bec: baseline-arm-clabbe 2026-03-16 13:07:02,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55d6c1727ff69d6f25bec 2026-03-16 13:07:02,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:07:02,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55d6c1727ff69d6f25bec HTTP/1.1" 200 None 2026-03-16 13:07:02,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:07:02,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 13:07:02,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:07:02,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55d6c1727ff69d6f25bec HTTP/1.1" 200 None 2026-03-16 13:07:02,458 - lava_callback - ERROR - Error processing callback for node 69b55d6c1727ff69d6f25bec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46248 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:07:42,374 - lava_callback - INFO - Received callback for node 69b55d901727ff69d6f25bf9 INFO: 172.20.0.1:46708 - "POST /node/69b55d901727ff69d6f25bf9 HTTP/1.0" 202 Accepted 2026-03-16 13:07:42,379 - lava_callback - INFO - Starting async job submit for node 69b55d901727ff69d6f25bf9 2026-03-16 13:07:42,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:07:42,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55d901727ff69d6f25bf9 HTTP/1.1" 200 None 2026-03-16 13:07:42,422 - lava_callback - DEBUG - Processing node 69b55d901727ff69d6f25bf9: baseline-arm-clabbe 2026-03-16 13:07:42,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55d901727ff69d6f25bf9 2026-03-16 13:07:42,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:07:42,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55d901727ff69d6f25bf9 HTTP/1.1" 200 None 2026-03-16 13:07:42,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:07:42,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 13:07:42,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:07:42,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55d901727ff69d6f25bf9 HTTP/1.1" 200 None 2026-03-16 13:07:42,479 - lava_callback - ERROR - Error processing callback for node 69b55d901727ff69d6f25bf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39814 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:08:17,207 - lava_callback - INFO - Received callback for node 69b7fc30113612b7716bc5e3 INFO: 172.20.0.1:39816 - "POST /node/69b7fc30113612b7716bc5e3 HTTP/1.0" 202 Accepted 2026-03-16 13:08:17,253 - lava_callback - INFO - Starting async job submit for node 69b7fc30113612b7716bc5e3 2026-03-16 13:08:17,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:17,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc30113612b7716bc5e3 HTTP/1.1" 200 None 2026-03-16 13:08:17,297 - lava_callback - DEBUG - Processing node 69b7fc30113612b7716bc5e3: baseline-arm-pengutronix 2026-03-16 13:08:17,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:08:17,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:08:17,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7fc30113612b7716bc5e3/log.txt.gz 2026-03-16 13:08:17,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:08:17,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:08:17,822 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7fc30113612b7716bc5e3/lava-logs.yaml 2026-03-16 13:08:17,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:08:17,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:08:17,982 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b7fc30113612b7716bc5e3/lava_callback.json.gz DEBUG: Setup failed for 69b7fc30113612b7716bc5e3. Transitting job node result: incomplete -> fail 2026-03-16 13:08:18,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:18,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc30113612b7716bc5e3 HTTP/1.1" 200 None 2026-03-16 13:08:18,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:18,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 13:08:18,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:18,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc30113612b7716bc5e3 HTTP/1.1" 200 None 2026-03-16 13:08:18,167 - lava_callback - INFO - Completed processing callback for node 69b7fc30113612b7716bc5e3 2026-03-16 13:08:22,422 - lava_callback - INFO - Received callback for node 69b55db41727ff69d6f25c04 INFO: 172.20.0.1:51468 - "POST /node/69b55db41727ff69d6f25c04 HTTP/1.0" 202 Accepted 2026-03-16 13:08:22,428 - lava_callback - INFO - Starting async job submit for node 69b55db41727ff69d6f25c04 2026-03-16 13:08:22,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:22,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55db41727ff69d6f25c04 HTTP/1.1" 200 None 2026-03-16 13:08:22,445 - lava_callback - DEBUG - Processing node 69b55db41727ff69d6f25c04: baseline-arm-clabbe 2026-03-16 13:08:22,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55db41727ff69d6f25c04 2026-03-16 13:08:22,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:22,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55db41727ff69d6f25c04 HTTP/1.1" 200 None 2026-03-16 13:08:22,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:22,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 13:08:22,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:22,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55db41727ff69d6f25c04 HTTP/1.1" 200 None 2026-03-16 13:08:22,521 - lava_callback - ERROR - Error processing callback for node 69b55db41727ff69d6f25c04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51478 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:08:33,312 - lava_callback - INFO - Received callback for node 69b7fc57113612b7716bc65f INFO: 172.20.0.1:56986 - "POST /node/69b7fc57113612b7716bc65f HTTP/1.0" 202 Accepted 2026-03-16 13:08:33,318 - lava_callback - INFO - Starting async job submit for node 69b7fc57113612b7716bc65f 2026-03-16 13:08:33,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:33,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc57113612b7716bc65f HTTP/1.1" 200 None 2026-03-16 13:08:33,369 - lava_callback - DEBUG - Processing node 69b7fc57113612b7716bc65f: ltp-timers 2026-03-16 13:08:33,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:08:33,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:08:33,919 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69b7fc57113612b7716bc65f/log.txt.gz 2026-03-16 13:08:34,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:08:34,367 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:08:34,369 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69b7fc57113612b7716bc65f/lava-logs.yaml 2026-03-16 13:08:34,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:08:34,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:08:34,558 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69b7fc57113612b7716bc65f/lava_callback.json.gz 2026-03-16 13:08:34,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:34,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc57113612b7716bc65f HTTP/1.1" 200 None 2026-03-16 13:08:34,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:34,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 13:08:34,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:34,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc57113612b7716bc65f HTTP/1.1" 200 None 2026-03-16 13:08:34,667 - lava_callback - INFO - Completed processing callback for node 69b7fc57113612b7716bc65f 2026-03-16 13:08:35,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:35,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56998 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:08:42,394 - lava_callback - INFO - Received callback for node 69b55dd81727ff69d6f25c0b INFO: 172.20.0.1:34348 - "POST /node/69b55dd81727ff69d6f25c0b HTTP/1.0" 202 Accepted 2026-03-16 13:08:42,400 - lava_callback - INFO - Starting async job submit for node 69b55dd81727ff69d6f25c0b 2026-03-16 13:08:42,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:42,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55dd81727ff69d6f25c0b HTTP/1.1" 200 None 2026-03-16 13:08:42,416 - lava_callback - DEBUG - Processing node 69b55dd81727ff69d6f25c0b: baseline-arm-clabbe 2026-03-16 13:08:42,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55dd81727ff69d6f25c0b 2026-03-16 13:08:42,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:42,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55dd81727ff69d6f25c0b HTTP/1.1" 200 None 2026-03-16 13:08:42,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:42,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2060ab0f5558b5d7cc5e3 HTTP/1.1" 200 None 2026-03-16 13:08:42,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:08:42,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55dd81727ff69d6f25c0b HTTP/1.1" 200 None 2026-03-16 13:08:42,477 - lava_callback - ERROR - Error processing callback for node 69b55dd81727ff69d6f25c0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47104 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:09:22,788 - lava_callback - INFO - Received callback for node 69b55e011727ff69d6f25c17 INFO: 172.20.0.1:57942 - "POST /node/69b55e011727ff69d6f25c17 HTTP/1.0" 202 Accepted 2026-03-16 13:09:22,793 - lava_callback - INFO - Starting async job submit for node 69b55e011727ff69d6f25c17 2026-03-16 13:09:22,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:09:22,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55e011727ff69d6f25c17 HTTP/1.1" 200 None 2026-03-16 13:09:22,815 - lava_callback - DEBUG - Processing node 69b55e011727ff69d6f25c17: baseline-arm64-baylibre 2026-03-16 13:09:22,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55e011727ff69d6f25c17 2026-03-16 13:09:22,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:09:22,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55e011727ff69d6f25c17 HTTP/1.1" 200 None 2026-03-16 13:09:22,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:09:22,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:09:22,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:09:22,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55e011727ff69d6f25c17 HTTP/1.1" 200 None 2026-03-16 13:09:22,909 - lava_callback - ERROR - Error processing callback for node 69b55e011727ff69d6f25c17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50286 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:10:42,848 - lava_callback - INFO - Received callback for node 69b55e4d1727ff69d6f25c24 INFO: 172.20.0.1:45942 - "POST /node/69b55e4d1727ff69d6f25c24 HTTP/1.0" 202 Accepted 2026-03-16 13:10:42,854 - lava_callback - INFO - Starting async job submit for node 69b55e4d1727ff69d6f25c24 2026-03-16 13:10:42,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:10:42,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55e4d1727ff69d6f25c24 HTTP/1.1" 200 None 2026-03-16 13:10:42,895 - lava_callback - DEBUG - Processing node 69b55e4d1727ff69d6f25c24: baseline-arm64-baylibre 2026-03-16 13:10:42,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55e4d1727ff69d6f25c24 2026-03-16 13:10:42,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:10:42,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55e4d1727ff69d6f25c24 HTTP/1.1" 200 None 2026-03-16 13:10:42,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:10:42,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:10:42,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:10:42,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55e4d1727ff69d6f25c24 HTTP/1.1" 200 None 2026-03-16 13:10:42,959 - lava_callback - ERROR - Error processing callback for node 69b55e4d1727ff69d6f25c24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47012 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:11:13,096 - lava_callback - INFO - Received callback for node 69b7fc44113612b7716bc627 INFO: 172.20.0.1:44156 - "POST /node/69b7fc44113612b7716bc627 HTTP/1.0" 202 Accepted 2026-03-16 13:11:13,145 - lava_callback - INFO - Starting async job submit for node 69b7fc44113612b7716bc627 2026-03-16 13:11:13,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:11:13,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc44113612b7716bc627 HTTP/1.1" 200 None 2026-03-16 13:11:13,211 - lava_callback - DEBUG - Processing node 69b7fc44113612b7716bc627: ltp-controllers 2026-03-16 13:11:13,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:11:13,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:11:13,460 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69b7fc44113612b7716bc627/log.txt.gz 2026-03-16 13:11:13,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:11:13,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:11:13,702 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69b7fc44113612b7716bc627/lava-logs.yaml 2026-03-16 13:11:13,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:11:13,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:11:13,845 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69b7fc44113612b7716bc627/lava_callback.json.gz 2026-03-16 13:11:13,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:11:13,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc44113612b7716bc627 HTTP/1.1" 200 None 2026-03-16 13:11:13,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:11:13,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 13:11:13,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:11:13,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc44113612b7716bc627 HTTP/1.1" 200 None 2026-03-16 13:11:13,979 - lava_callback - INFO - Completed processing callback for node 69b7fc44113612b7716bc627 INFO: 172.20.0.1:44170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44442 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:11:35,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:11:35,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50134 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:12:02,944 - lava_callback - INFO - Received callback for node 69b55e9a1727ff69d6f25c2e INFO: 172.20.0.1:54624 - "POST /node/69b55e9a1727ff69d6f25c2e HTTP/1.0" 202 Accepted 2026-03-16 13:12:02,950 - lava_callback - INFO - Starting async job submit for node 69b55e9a1727ff69d6f25c2e 2026-03-16 13:12:02,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:12:02,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55e9a1727ff69d6f25c2e HTTP/1.1" 200 None 2026-03-16 13:12:02,966 - lava_callback - DEBUG - Processing node 69b55e9a1727ff69d6f25c2e: baseline-arm64-baylibre 2026-03-16 13:12:02,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55e9a1727ff69d6f25c2e 2026-03-16 13:12:02,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:12:02,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55e9a1727ff69d6f25c2e HTTP/1.1" 200 None 2026-03-16 13:12:02,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:12:03,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:12:03,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:12:03,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55e9a1727ff69d6f25c2e HTTP/1.1" 200 None 2026-03-16 13:12:03,024 - lava_callback - ERROR - Error processing callback for node 69b55e9a1727ff69d6f25c2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37040 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:13:23,527 - lava_callback - INFO - Received callback for node 69b55ee61727ff69d6f25c3b INFO: 172.20.0.1:33736 - "POST /node/69b55ee61727ff69d6f25c3b HTTP/1.0" 202 Accepted 2026-03-16 13:13:23,532 - lava_callback - INFO - Starting async job submit for node 69b55ee61727ff69d6f25c3b 2026-03-16 13:13:23,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:13:23,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55ee61727ff69d6f25c3b HTTP/1.1" 200 None 2026-03-16 13:13:23,565 - lava_callback - DEBUG - Processing node 69b55ee61727ff69d6f25c3b: baseline-arm64-baylibre 2026-03-16 13:13:23,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55ee61727ff69d6f25c3b 2026-03-16 13:13:23,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:13:23,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55ee61727ff69d6f25c3b HTTP/1.1" 200 None 2026-03-16 13:13:23,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:13:23,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:13:23,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:13:23,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55ee61727ff69d6f25c3b HTTP/1.1" 200 None 2026-03-16 13:13:23,647 - lava_callback - ERROR - Error processing callback for node 69b55ee61727ff69d6f25c3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45108 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:14:43,252 - lava_callback - INFO - Received callback for node 69b55f331727ff69d6f25c45 INFO: 172.20.0.1:33006 - "POST /node/69b55f331727ff69d6f25c45 HTTP/1.0" 202 Accepted 2026-03-16 13:14:43,257 - lava_callback - INFO - Starting async job submit for node 69b55f331727ff69d6f25c45 2026-03-16 13:14:43,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:14:43,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55f331727ff69d6f25c45 HTTP/1.1" 200 None 2026-03-16 13:14:43,291 - lava_callback - DEBUG - Processing node 69b55f331727ff69d6f25c45: baseline-arm64-baylibre 2026-03-16 13:14:43,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55f331727ff69d6f25c45 2026-03-16 13:14:43,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:14:43,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55f331727ff69d6f25c45 HTTP/1.1" 200 None 2026-03-16 13:14:43,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:14:43,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:14:43,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:14:43,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55f331727ff69d6f25c45 HTTP/1.1" 200 None 2026-03-16 13:14:43,378 - lava_callback - ERROR - Error processing callback for node 69b55f331727ff69d6f25c45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56452 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:15:43,117 - lava_callback - INFO - Received callback for node 69b55f7c1727ff69d6f25c54 INFO: 172.20.0.1:50388 - "POST /node/69b55f7c1727ff69d6f25c54 HTTP/1.0" 202 Accepted 2026-03-16 13:15:43,123 - lava_callback - INFO - Starting async job submit for node 69b55f7c1727ff69d6f25c54 2026-03-16 13:15:43,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:15:43,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55f7c1727ff69d6f25c54 HTTP/1.1" 200 None 2026-03-16 13:15:43,152 - lava_callback - DEBUG - Processing node 69b55f7c1727ff69d6f25c54: baseline-arm64-baylibre 2026-03-16 13:15:43,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55f7c1727ff69d6f25c54 2026-03-16 13:15:43,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:15:43,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55f7c1727ff69d6f25c54 HTTP/1.1" 200 None 2026-03-16 13:15:43,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:15:43,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:15:43,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:15:43,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55f7c1727ff69d6f25c54 HTTP/1.1" 200 None 2026-03-16 13:15:43,207 - lava_callback - ERROR - Error processing callback for node 69b55f7c1727ff69d6f25c54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60788 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:17:22,835 - lava_callback - INFO - Received callback for node 69b55fd11727ff69d6f25c62 INFO: 172.20.0.1:39068 - "POST /node/69b55fd11727ff69d6f25c62 HTTP/1.0" 202 Accepted 2026-03-16 13:17:22,843 - lava_callback - INFO - Starting async job submit for node 69b55fd11727ff69d6f25c62 2026-03-16 13:17:22,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:17:22,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55fd11727ff69d6f25c62 HTTP/1.1" 200 None 2026-03-16 13:17:22,875 - lava_callback - DEBUG - Processing node 69b55fd11727ff69d6f25c62: baseline-arm64-clabbe 2026-03-16 13:17:22,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b55fd11727ff69d6f25c62 2026-03-16 13:17:22,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:17:22,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b55fd11727ff69d6f25c62 HTTP/1.1" 200 None 2026-03-16 13:17:22,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:17:22,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:17:22,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:17:22,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b55fd11727ff69d6f25c62 HTTP/1.1" 200 None 2026-03-16 13:17:22,988 - lava_callback - ERROR - Error processing callback for node 69b55fd11727ff69d6f25c62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54212 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:18:23,409 - lava_callback - INFO - Received callback for node 69b560151727ff69d6f25c6d INFO: 172.20.0.1:39936 - "POST /node/69b560151727ff69d6f25c6d HTTP/1.0" 202 Accepted 2026-03-16 13:18:23,418 - lava_callback - INFO - Starting async job submit for node 69b560151727ff69d6f25c6d 2026-03-16 13:18:23,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:18:23,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b560151727ff69d6f25c6d HTTP/1.1" 200 None 2026-03-16 13:18:23,470 - lava_callback - DEBUG - Processing node 69b560151727ff69d6f25c6d: baseline-arm64-baylibre 2026-03-16 13:18:23,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b560151727ff69d6f25c6d 2026-03-16 13:18:23,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:18:23,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b560151727ff69d6f25c6d HTTP/1.1" 200 None 2026-03-16 13:18:23,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:18:23,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:18:23,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:18:23,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b560151727ff69d6f25c6d HTTP/1.1" 200 None 2026-03-16 13:18:23,573 - lava_callback - ERROR - Error processing callback for node 69b560151727ff69d6f25c6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45768 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:19:43,383 - lava_callback - INFO - Received callback for node 69b560611727ff69d6f25c78 INFO: 172.20.0.1:35322 - "POST /node/69b560611727ff69d6f25c78 HTTP/1.0" 202 Accepted 2026-03-16 13:19:43,389 - lava_callback - INFO - Starting async job submit for node 69b560611727ff69d6f25c78 2026-03-16 13:19:43,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:19:43,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b560611727ff69d6f25c78 HTTP/1.1" 200 None 2026-03-16 13:19:43,406 - lava_callback - DEBUG - Processing node 69b560611727ff69d6f25c78: baseline-arm64-baylibre 2026-03-16 13:19:43,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b560611727ff69d6f25c78 2026-03-16 13:19:43,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:19:43,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b560611727ff69d6f25c78 HTTP/1.1" 200 None 2026-03-16 13:19:43,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:19:43,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:19:43,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:19:43,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b560611727ff69d6f25c78 HTTP/1.1" 200 None 2026-03-16 13:19:43,478 - lava_callback - ERROR - Error processing callback for node 69b560611727ff69d6f25c78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57852 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:21:03,421 - lava_callback - INFO - Received callback for node 69b560ae1727ff69d6f25c82 INFO: 172.20.0.1:42456 - "POST /node/69b560ae1727ff69d6f25c82 HTTP/1.0" 202 Accepted 2026-03-16 13:21:03,426 - lava_callback - INFO - Starting async job submit for node 69b560ae1727ff69d6f25c82 2026-03-16 13:21:03,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:21:03,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b560ae1727ff69d6f25c82 HTTP/1.1" 200 None 2026-03-16 13:21:03,478 - lava_callback - DEBUG - Processing node 69b560ae1727ff69d6f25c82: baseline-arm64-baylibre 2026-03-16 13:21:03,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b560ae1727ff69d6f25c82 2026-03-16 13:21:03,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:21:03,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b560ae1727ff69d6f25c82 HTTP/1.1" 200 None 2026-03-16 13:21:03,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:21:03,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:21:03,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:21:03,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b560ae1727ff69d6f25c82 HTTP/1.1" 200 None 2026-03-16 13:21:03,589 - lava_callback - ERROR - Error processing callback for node 69b560ae1727ff69d6f25c82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44804 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:22:23,084 - lava_callback - INFO - Received callback for node 69b561021727ff69d6f25c94 INFO: 172.20.0.1:49666 - "POST /node/69b561021727ff69d6f25c94 HTTP/1.0" 202 Accepted 2026-03-16 13:22:23,093 - lava_callback - INFO - Starting async job submit for node 69b561021727ff69d6f25c94 2026-03-16 13:22:23,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:22:23,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b561021727ff69d6f25c94 HTTP/1.1" 200 None 2026-03-16 13:22:23,126 - lava_callback - DEBUG - Processing node 69b561021727ff69d6f25c94: baseline-arm64-clabbe 2026-03-16 13:22:23,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b561021727ff69d6f25c94 2026-03-16 13:22:23,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:22:23,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b561021727ff69d6f25c94 HTTP/1.1" 200 None 2026-03-16 13:22:23,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:22:23,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:22:23,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:22:23,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b561021727ff69d6f25c94 HTTP/1.1" 200 None 2026-03-16 13:22:23,202 - lava_callback - ERROR - Error processing callback for node 69b561021727ff69d6f25c94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52714 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:23:23,581 - lava_callback - INFO - Received callback for node 69b561471727ff69d6f25c9f INFO: 172.20.0.1:49866 - "POST /node/69b561471727ff69d6f25c9f HTTP/1.0" 202 Accepted 2026-03-16 13:23:23,586 - lava_callback - INFO - Starting async job submit for node 69b561471727ff69d6f25c9f 2026-03-16 13:23:23,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:23:23,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b561471727ff69d6f25c9f HTTP/1.1" 200 None 2026-03-16 13:23:23,607 - lava_callback - DEBUG - Processing node 69b561471727ff69d6f25c9f: baseline-arm64-baylibre 2026-03-16 13:23:23,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b561471727ff69d6f25c9f 2026-03-16 13:23:23,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:23:23,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b561471727ff69d6f25c9f HTTP/1.1" 200 None 2026-03-16 13:23:23,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:23:23,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:23:23,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:23:23,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b561471727ff69d6f25c9f HTTP/1.1" 200 None 2026-03-16 13:23:23,699 - lava_callback - ERROR - Error processing callback for node 69b561471727ff69d6f25c9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46374 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:24:09,305 - lava_callback - INFO - Received callback for node 69b80046113612b7716bc84a INFO: 172.20.0.1:46382 - "POST /node/69b80046113612b7716bc84a HTTP/1.0" 202 Accepted 2026-03-16 13:24:09,312 - lava_callback - INFO - Starting async job submit for node 69b80046113612b7716bc84a 2026-03-16 13:24:09,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:24:09,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b80046113612b7716bc84a HTTP/1.1" 200 None 2026-03-16 13:24:09,383 - lava_callback - DEBUG - Processing node 69b80046113612b7716bc84a: baseline-arm 2026-03-16 13:24:10,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:24:10,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:24:10,188 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b80046113612b7716bc84a/log.txt.gz 2026-03-16 13:24:10,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:24:10,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:24:10,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b80046113612b7716bc84a/lava-logs.yaml 2026-03-16 13:24:10,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:24:11,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:24:11,048 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b80046113612b7716bc84a/lava_callback.json.gz DEBUG: Setup failed for 69b80046113612b7716bc84a. Transitting job node result: incomplete -> fail 2026-03-16 13:24:11,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:24:11,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b80046113612b7716bc84a HTTP/1.1" 200 None 2026-03-16 13:24:11,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:24:11,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 13:24:11,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:24:11,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b80046113612b7716bc84a HTTP/1.1" 200 None 2026-03-16 13:24:11,334 - lava_callback - INFO - Completed processing callback for node 69b80046113612b7716bc84a INFO: 172.20.0.1:56562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34094 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:24:35,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:24:35,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58608 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:24:43,693 - lava_callback - INFO - Received callback for node 69b561921727ff69d6f25cac INFO: 172.20.0.1:60018 - "POST /node/69b561921727ff69d6f25cac HTTP/1.0" 202 Accepted 2026-03-16 13:24:43,699 - lava_callback - INFO - Starting async job submit for node 69b561921727ff69d6f25cac 2026-03-16 13:24:43,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:24:43,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b561921727ff69d6f25cac HTTP/1.1" 200 None 2026-03-16 13:24:43,716 - lava_callback - DEBUG - Processing node 69b561921727ff69d6f25cac: baseline-arm64-baylibre 2026-03-16 13:24:43,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b561921727ff69d6f25cac 2026-03-16 13:24:43,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:24:43,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b561921727ff69d6f25cac HTTP/1.1" 200 None 2026-03-16 13:24:43,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:24:43,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:24:43,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:24:43,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b561921727ff69d6f25cac HTTP/1.1" 200 None 2026-03-16 13:24:43,776 - lava_callback - ERROR - Error processing callback for node 69b561921727ff69d6f25cac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46480 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:26:03,231 - lava_callback - INFO - Received callback for node 69b561e51727ff69d6f25cb7 INFO: 172.20.0.1:40520 - "POST /node/69b561e51727ff69d6f25cb7 HTTP/1.0" 202 Accepted 2026-03-16 13:26:03,237 - lava_callback - INFO - Starting async job submit for node 69b561e51727ff69d6f25cb7 2026-03-16 13:26:03,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:26:03,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b561e51727ff69d6f25cb7 HTTP/1.1" 200 None 2026-03-16 13:26:03,254 - lava_callback - DEBUG - Processing node 69b561e51727ff69d6f25cb7: baseline-arm64-clabbe 2026-03-16 13:26:03,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b561e51727ff69d6f25cb7 2026-03-16 13:26:03,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:26:03,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b561e51727ff69d6f25cb7 HTTP/1.1" 200 None 2026-03-16 13:26:03,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:26:03,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:26:03,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:26:03,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b561e51727ff69d6f25cb7 HTTP/1.1" 200 None 2026-03-16 13:26:03,319 - lava_callback - ERROR - Error processing callback for node 69b561e51727ff69d6f25cb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44384 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:27:23,872 - lava_callback - INFO - Received callback for node 69b5622c1727ff69d6f25cca INFO: 172.20.0.1:41246 - "POST /node/69b5622c1727ff69d6f25cca HTTP/1.0" 202 Accepted 2026-03-16 13:27:23,877 - lava_callback - INFO - Starting async job submit for node 69b5622c1727ff69d6f25cca 2026-03-16 13:27:23,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:27:23,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5622c1727ff69d6f25cca HTTP/1.1" 200 None 2026-03-16 13:27:23,894 - lava_callback - DEBUG - Processing node 69b5622c1727ff69d6f25cca: baseline-arm64-baylibre 2026-03-16 13:27:23,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5622c1727ff69d6f25cca 2026-03-16 13:27:23,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:27:23,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5622c1727ff69d6f25cca HTTP/1.1" 200 None 2026-03-16 13:27:23,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:27:23,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:27:23,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:27:23,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5622c1727ff69d6f25cca HTTP/1.1" 200 None 2026-03-16 13:27:23,975 - lava_callback - ERROR - Error processing callback for node 69b5622c1727ff69d6f25cca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58494 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:28:43,371 - lava_callback - INFO - Received callback for node 69b562801727ff69d6f25cdb INFO: 172.20.0.1:47924 - "POST /node/69b562801727ff69d6f25cdb HTTP/1.0" 202 Accepted 2026-03-16 13:28:43,377 - lava_callback - INFO - Starting async job submit for node 69b562801727ff69d6f25cdb 2026-03-16 13:28:43,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:28:43,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b562801727ff69d6f25cdb HTTP/1.1" 200 None 2026-03-16 13:28:43,393 - lava_callback - DEBUG - Processing node 69b562801727ff69d6f25cdb: baseline-arm64-clabbe 2026-03-16 13:28:43,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b562801727ff69d6f25cdb 2026-03-16 13:28:43,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:28:43,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b562801727ff69d6f25cdb HTTP/1.1" 200 None 2026-03-16 13:28:43,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:28:43,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:28:43,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:28:43,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b562801727ff69d6f25cdb HTTP/1.1" 200 None 2026-03-16 13:28:43,450 - lava_callback - ERROR - Error processing callback for node 69b562801727ff69d6f25cdb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48086 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:29:43,864 - lava_callback - INFO - Received callback for node 69b562c51727ff69d6f25ce3 INFO: 172.20.0.1:48784 - "POST /node/69b562c51727ff69d6f25ce3 HTTP/1.0" 202 Accepted 2026-03-16 13:29:43,870 - lava_callback - INFO - Starting async job submit for node 69b562c51727ff69d6f25ce3 2026-03-16 13:29:43,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:29:43,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b562c51727ff69d6f25ce3 HTTP/1.1" 200 None 2026-03-16 13:29:43,887 - lava_callback - DEBUG - Processing node 69b562c51727ff69d6f25ce3: baseline-arm64-baylibre 2026-03-16 13:29:43,887 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b562c51727ff69d6f25ce3 2026-03-16 13:29:43,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:29:43,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b562c51727ff69d6f25ce3 HTTP/1.1" 200 None 2026-03-16 13:29:43,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:29:43,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:29:43,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:29:43,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b562c51727ff69d6f25ce3 HTTP/1.1" 200 None 2026-03-16 13:29:43,994 - lava_callback - ERROR - Error processing callback for node 69b562c51727ff69d6f25ce3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43204 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:31:23,482 - lava_callback - INFO - Received callback for node 69b563181727ff69d6f25cf6 INFO: 172.20.0.1:33686 - "POST /node/69b563181727ff69d6f25cf6 HTTP/1.0" 202 Accepted 2026-03-16 13:31:23,488 - lava_callback - INFO - Starting async job submit for node 69b563181727ff69d6f25cf6 2026-03-16 13:31:23,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:31:23,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b563181727ff69d6f25cf6 HTTP/1.1" 200 None 2026-03-16 13:31:23,504 - lava_callback - DEBUG - Processing node 69b563181727ff69d6f25cf6: baseline-arm64-clabbe 2026-03-16 13:31:23,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b563181727ff69d6f25cf6 2026-03-16 13:31:23,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:31:23,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b563181727ff69d6f25cf6 HTTP/1.1" 200 None 2026-03-16 13:31:23,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:31:23,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:31:23,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:31:23,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b563181727ff69d6f25cf6 HTTP/1.1" 200 None 2026-03-16 13:31:23,573 - lava_callback - ERROR - Error processing callback for node 69b563181727ff69d6f25cf6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37958 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:32:24,045 - lava_callback - INFO - Received callback for node 69b563601727ff69d6f25cff INFO: 172.20.0.1:35730 - "POST /node/69b563601727ff69d6f25cff HTTP/1.0" 202 Accepted 2026-03-16 13:32:24,050 - lava_callback - INFO - Starting async job submit for node 69b563601727ff69d6f25cff 2026-03-16 13:32:24,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:32:24,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b563601727ff69d6f25cff HTTP/1.1" 200 None 2026-03-16 13:32:24,068 - lava_callback - DEBUG - Processing node 69b563601727ff69d6f25cff: baseline-arm64-baylibre 2026-03-16 13:32:24,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b563601727ff69d6f25cff 2026-03-16 13:32:24,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:32:24,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b563601727ff69d6f25cff HTTP/1.1" 200 None 2026-03-16 13:32:24,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:32:24,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:32:24,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:32:24,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b563601727ff69d6f25cff HTTP/1.1" 200 None 2026-03-16 13:32:24,142 - lava_callback - ERROR - Error processing callback for node 69b563601727ff69d6f25cff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45530 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:33:44,162 - lava_callback - INFO - Received callback for node 69b563ad1727ff69d6f25d12 INFO: 172.20.0.1:47886 - "POST /node/69b563ad1727ff69d6f25d12 HTTP/1.0" 202 Accepted 2026-03-16 13:33:44,167 - lava_callback - INFO - Starting async job submit for node 69b563ad1727ff69d6f25d12 2026-03-16 13:33:44,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:33:44,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b563ad1727ff69d6f25d12 HTTP/1.1" 200 None 2026-03-16 13:33:44,190 - lava_callback - DEBUG - Processing node 69b563ad1727ff69d6f25d12: baseline-arm64-baylibre 2026-03-16 13:33:44,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b563ad1727ff69d6f25d12 2026-03-16 13:33:44,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:33:44,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b563ad1727ff69d6f25d12 HTTP/1.1" 200 None 2026-03-16 13:33:44,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:33:44,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:33:44,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:33:44,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b563ad1727ff69d6f25d12 HTTP/1.1" 200 None 2026-03-16 13:33:44,256 - lava_callback - ERROR - Error processing callback for node 69b563ad1727ff69d6f25d12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50340 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:35:03,688 - lava_callback - INFO - Received callback for node 69b563ff1727ff69d6f25d1c INFO: 172.20.0.1:49194 - "POST /node/69b563ff1727ff69d6f25d1c HTTP/1.0" 202 Accepted 2026-03-16 13:35:03,694 - lava_callback - INFO - Starting async job submit for node 69b563ff1727ff69d6f25d1c 2026-03-16 13:35:03,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:35:03,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b563ff1727ff69d6f25d1c HTTP/1.1" 200 None 2026-03-16 13:35:03,710 - lava_callback - DEBUG - Processing node 69b563ff1727ff69d6f25d1c: baseline-arm64-clabbe 2026-03-16 13:35:03,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b563ff1727ff69d6f25d1c 2026-03-16 13:35:03,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:35:03,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b563ff1727ff69d6f25d1c HTTP/1.1" 200 None 2026-03-16 13:35:03,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:35:03,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:35:03,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:35:03,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b563ff1727ff69d6f25d1c HTTP/1.1" 200 None 2026-03-16 13:35:03,773 - lava_callback - ERROR - Error processing callback for node 69b563ff1727ff69d6f25d1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53996 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:36:23,600 - lava_callback - INFO - Received callback for node 69b5644c1727ff69d6f25d2f INFO: 172.20.0.1:54010 - "POST /node/69b5644c1727ff69d6f25d2f HTTP/1.0" 202 Accepted 2026-03-16 13:36:23,606 - lava_callback - INFO - Starting async job submit for node 69b5644c1727ff69d6f25d2f 2026-03-16 13:36:23,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:36:23,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5644c1727ff69d6f25d2f HTTP/1.1" 200 None 2026-03-16 13:36:23,628 - lava_callback - DEBUG - Processing node 69b5644c1727ff69d6f25d2f: baseline-arm64-clabbe 2026-03-16 13:36:23,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5644c1727ff69d6f25d2f 2026-03-16 13:36:23,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:36:23,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5644c1727ff69d6f25d2f HTTP/1.1" 200 None 2026-03-16 13:36:23,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:36:23,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:36:23,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:36:23,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5644c1727ff69d6f25d2f HTTP/1.1" 200 None 2026-03-16 13:36:23,703 - lava_callback - ERROR - Error processing callback for node 69b5644c1727ff69d6f25d2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59016 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:37:43,766 - lava_callback - INFO - Received callback for node 69b564991727ff69d6f25d38 INFO: 172.20.0.1:47428 - "POST /node/69b564991727ff69d6f25d38 HTTP/1.0" 202 Accepted 2026-03-16 13:37:43,772 - lava_callback - INFO - Starting async job submit for node 69b564991727ff69d6f25d38 2026-03-16 13:37:43,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:37:43,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b564991727ff69d6f25d38 HTTP/1.1" 200 None 2026-03-16 13:37:43,798 - lava_callback - DEBUG - Processing node 69b564991727ff69d6f25d38: baseline-arm64-clabbe 2026-03-16 13:37:43,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b564991727ff69d6f25d38 2026-03-16 13:37:43,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:37:43,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b564991727ff69d6f25d38 HTTP/1.1" 200 None 2026-03-16 13:37:43,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:37:43,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:37:43,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:37:43,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b564991727ff69d6f25d38 HTTP/1.1" 200 None 2026-03-16 13:37:43,939 - lava_callback - ERROR - Error processing callback for node 69b564991727ff69d6f25d38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46576 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:39:03,821 - lava_callback - INFO - Received callback for node 69b564e51727ff69d6f25d48 INFO: 172.20.0.1:52662 - "POST /node/69b564e51727ff69d6f25d48 HTTP/1.0" 202 Accepted 2026-03-16 13:39:03,827 - lava_callback - INFO - Starting async job submit for node 69b564e51727ff69d6f25d48 2026-03-16 13:39:03,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:39:03,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b564e51727ff69d6f25d48 HTTP/1.1" 200 None 2026-03-16 13:39:03,842 - lava_callback - DEBUG - Processing node 69b564e51727ff69d6f25d48: baseline-arm64-clabbe 2026-03-16 13:39:03,842 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b564e51727ff69d6f25d48 2026-03-16 13:39:03,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:39:03,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b564e51727ff69d6f25d48 HTTP/1.1" 200 None 2026-03-16 13:39:03,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:39:03,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:39:03,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:39:03,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b564e51727ff69d6f25d48 HTTP/1.1" 200 None 2026-03-16 13:39:03,962 - lava_callback - ERROR - Error processing callback for node 69b564e51727ff69d6f25d48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32990 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:40:23,855 - lava_callback - INFO - Received callback for node 69b565311727ff69d6f25d54 INFO: 172.20.0.1:53576 - "POST /node/69b565311727ff69d6f25d54 HTTP/1.0" 202 Accepted 2026-03-16 13:40:23,860 - lava_callback - INFO - Starting async job submit for node 69b565311727ff69d6f25d54 2026-03-16 13:40:23,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:40:23,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b565311727ff69d6f25d54 HTTP/1.1" 200 None 2026-03-16 13:40:23,885 - lava_callback - DEBUG - Processing node 69b565311727ff69d6f25d54: baseline-arm64-clabbe 2026-03-16 13:40:23,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b565311727ff69d6f25d54 2026-03-16 13:40:23,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:40:23,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b565311727ff69d6f25d54 HTTP/1.1" 200 None 2026-03-16 13:40:23,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:40:23,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:40:23,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:40:23,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b565311727ff69d6f25d54 HTTP/1.1" 200 None 2026-03-16 13:40:23,962 - lava_callback - ERROR - Error processing callback for node 69b565311727ff69d6f25d54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55512 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:41:23,905 - lava_callback - INFO - Received callback for node 69b5657e1727ff69d6f25d63 INFO: 172.20.0.1:38984 - "POST /node/69b5657e1727ff69d6f25d63 HTTP/1.0" 202 Accepted 2026-03-16 13:41:23,911 - lava_callback - INFO - Starting async job submit for node 69b5657e1727ff69d6f25d63 2026-03-16 13:41:23,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:41:23,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5657e1727ff69d6f25d63 HTTP/1.1" 200 None 2026-03-16 13:41:23,926 - lava_callback - DEBUG - Processing node 69b5657e1727ff69d6f25d63: baseline-arm64-clabbe 2026-03-16 13:41:23,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5657e1727ff69d6f25d63 2026-03-16 13:41:23,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:41:23,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5657e1727ff69d6f25d63 HTTP/1.1" 200 None 2026-03-16 13:41:23,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:41:23,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:41:23,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:41:23,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5657e1727ff69d6f25d63 HTTP/1.1" 200 None 2026-03-16 13:41:23,989 - lava_callback - ERROR - Error processing callback for node 69b5657e1727ff69d6f25d63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45590 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:42:43,994 - lava_callback - INFO - Received callback for node 69b565ca1727ff69d6f25d73 INFO: 172.20.0.1:51296 - "POST /node/69b565ca1727ff69d6f25d73 HTTP/1.0" 202 Accepted 2026-03-16 13:42:43,999 - lava_callback - INFO - Starting async job submit for node 69b565ca1727ff69d6f25d73 2026-03-16 13:42:44,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:42:44,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b565ca1727ff69d6f25d73 HTTP/1.1" 200 None 2026-03-16 13:42:44,022 - lava_callback - DEBUG - Processing node 69b565ca1727ff69d6f25d73: baseline-arm64-clabbe 2026-03-16 13:42:44,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b565ca1727ff69d6f25d73 2026-03-16 13:42:44,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:42:44,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b565ca1727ff69d6f25d73 HTTP/1.1" 200 None 2026-03-16 13:42:44,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:42:44,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:42:44,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:42:44,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b565ca1727ff69d6f25d73 HTTP/1.1" 200 None 2026-03-16 13:42:44,079 - lava_callback - ERROR - Error processing callback for node 69b565ca1727ff69d6f25d73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 13:42:45,624 - lava_callback - INFO - Received callback for node 69b8047c113612b7716bc8b4 INFO: 172.20.0.1:51308 - "POST /node/69b8047c113612b7716bc8b4 HTTP/1.0" 202 Accepted 2026-03-16 13:42:45,631 - lava_callback - INFO - Starting async job submit for node 69b8047c113612b7716bc8b4 2026-03-16 13:42:45,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:42:45,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8047c113612b7716bc8b4 HTTP/1.1" 200 None 2026-03-16 13:42:45,698 - lava_callback - DEBUG - Processing node 69b8047c113612b7716bc8b4: baseline-arm 2026-03-16 13:42:46,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:42:46,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:42:46,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b8047c113612b7716bc8b4/log.txt.gz INFO: 172.20.0.1:51312 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:42:46,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:42:47,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:42:47,097 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8047c113612b7716bc8b4/lava-logs.yaml 2026-03-16 13:42:47,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:42:47,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:42:47,302 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8047c113612b7716bc8b4/lava_callback.json.gz DEBUG: Setup failed for 69b8047c113612b7716bc8b4. Transitting job node result: incomplete -> fail 2026-03-16 13:42:47,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:42:47,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8047c113612b7716bc8b4 HTTP/1.1" 200 None 2026-03-16 13:42:47,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:42:47,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 13:42:47,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:42:47,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8047c113612b7716bc8b4 HTTP/1.1" 200 None 2026-03-16 13:42:47,603 - lava_callback - INFO - Completed processing callback for node 69b8047c113612b7716bc8b4 INFO: 172.20.0.1:36864 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:43:05,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:43:05,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58322 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:44:04,051 - lava_callback - INFO - Received callback for node 69b566171727ff69d6f25d7c INFO: 172.20.0.1:54760 - "POST /node/69b566171727ff69d6f25d7c HTTP/1.0" 202 Accepted 2026-03-16 13:44:04,057 - lava_callback - INFO - Starting async job submit for node 69b566171727ff69d6f25d7c 2026-03-16 13:44:04,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:44:04,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b566171727ff69d6f25d7c HTTP/1.1" 200 None 2026-03-16 13:44:04,079 - lava_callback - DEBUG - Processing node 69b566171727ff69d6f25d7c: baseline-arm64-clabbe 2026-03-16 13:44:04,080 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b566171727ff69d6f25d7c 2026-03-16 13:44:04,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:44:04,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b566171727ff69d6f25d7c HTTP/1.1" 200 None 2026-03-16 13:44:04,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:44:04,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:44:04,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:44:04,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b566171727ff69d6f25d7c HTTP/1.1" 200 None 2026-03-16 13:44:04,135 - lava_callback - ERROR - Error processing callback for node 69b566171727ff69d6f25d7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39830 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:45:24,102 - lava_callback - INFO - Received callback for node 69b566631727ff69d6f25d8d INFO: 172.20.0.1:35086 - "POST /node/69b566631727ff69d6f25d8d HTTP/1.0" 202 Accepted 2026-03-16 13:45:24,108 - lava_callback - INFO - Starting async job submit for node 69b566631727ff69d6f25d8d 2026-03-16 13:45:24,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:45:24,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b566631727ff69d6f25d8d HTTP/1.1" 200 None 2026-03-16 13:45:24,124 - lava_callback - DEBUG - Processing node 69b566631727ff69d6f25d8d: baseline-arm64-clabbe 2026-03-16 13:45:24,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b566631727ff69d6f25d8d 2026-03-16 13:45:24,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:45:24,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b566631727ff69d6f25d8d HTTP/1.1" 200 None 2026-03-16 13:45:24,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:45:24,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:45:24,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:45:24,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b566631727ff69d6f25d8d HTTP/1.1" 200 None 2026-03-16 13:45:24,215 - lava_callback - ERROR - Error processing callback for node 69b566631727ff69d6f25d8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34286 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:46:44,154 - lava_callback - INFO - Received callback for node 69b566af1727ff69d6f25d96 INFO: 172.20.0.1:37968 - "POST /node/69b566af1727ff69d6f25d96 HTTP/1.0" 202 Accepted 2026-03-16 13:46:44,159 - lava_callback - INFO - Starting async job submit for node 69b566af1727ff69d6f25d96 2026-03-16 13:46:44,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:46:44,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b566af1727ff69d6f25d96 HTTP/1.1" 200 None 2026-03-16 13:46:44,176 - lava_callback - DEBUG - Processing node 69b566af1727ff69d6f25d96: baseline-arm64-clabbe 2026-03-16 13:46:44,176 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b566af1727ff69d6f25d96 2026-03-16 13:46:44,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:46:44,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b566af1727ff69d6f25d96 HTTP/1.1" 200 None 2026-03-16 13:46:44,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:46:44,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:46:44,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:46:44,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b566af1727ff69d6f25d96 HTTP/1.1" 200 None 2026-03-16 13:46:44,274 - lava_callback - ERROR - Error processing callback for node 69b566af1727ff69d6f25d96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50352 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:47:44,216 - lava_callback - INFO - Received callback for node 69b566fb1727ff69d6f25da7 INFO: 172.20.0.1:55662 - "POST /node/69b566fb1727ff69d6f25da7 HTTP/1.0" 202 Accepted 2026-03-16 13:47:44,222 - lava_callback - INFO - Starting async job submit for node 69b566fb1727ff69d6f25da7 2026-03-16 13:47:44,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:47:44,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b566fb1727ff69d6f25da7 HTTP/1.1" 200 None 2026-03-16 13:47:44,237 - lava_callback - DEBUG - Processing node 69b566fb1727ff69d6f25da7: baseline-arm64-clabbe 2026-03-16 13:47:44,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b566fb1727ff69d6f25da7 2026-03-16 13:47:44,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:47:44,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b566fb1727ff69d6f25da7 HTTP/1.1" 200 None 2026-03-16 13:47:44,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:47:44,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:47:44,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:47:44,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b566fb1727ff69d6f25da7 HTTP/1.1" 200 None 2026-03-16 13:47:44,380 - lava_callback - ERROR - Error processing callback for node 69b566fb1727ff69d6f25da7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60546 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:49:04,242 - lava_callback - INFO - Received callback for node 69b567481727ff69d6f25daf INFO: 172.20.0.1:48676 - "POST /node/69b567481727ff69d6f25daf HTTP/1.0" 202 Accepted 2026-03-16 13:49:04,248 - lava_callback - INFO - Starting async job submit for node 69b567481727ff69d6f25daf 2026-03-16 13:49:04,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:49:04,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b567481727ff69d6f25daf HTTP/1.1" 200 None 2026-03-16 13:49:04,265 - lava_callback - DEBUG - Processing node 69b567481727ff69d6f25daf: baseline-arm64-clabbe 2026-03-16 13:49:04,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b567481727ff69d6f25daf 2026-03-16 13:49:04,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:49:04,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b567481727ff69d6f25daf HTTP/1.1" 200 None 2026-03-16 13:49:04,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:49:04,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:49:04,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:49:04,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b567481727ff69d6f25daf HTTP/1.1" 200 None 2026-03-16 13:49:04,329 - lava_callback - ERROR - Error processing callback for node 69b567481727ff69d6f25daf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60668 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:50:24,286 - lava_callback - INFO - Received callback for node 69b567951727ff69d6f25dbd INFO: 172.20.0.1:49472 - "POST /node/69b567951727ff69d6f25dbd HTTP/1.0" 202 Accepted 2026-03-16 13:50:24,292 - lava_callback - INFO - Starting async job submit for node 69b567951727ff69d6f25dbd 2026-03-16 13:50:24,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:50:24,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b567951727ff69d6f25dbd HTTP/1.1" 200 None 2026-03-16 13:50:24,308 - lava_callback - DEBUG - Processing node 69b567951727ff69d6f25dbd: baseline-arm64-clabbe 2026-03-16 13:50:24,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b567951727ff69d6f25dbd 2026-03-16 13:50:24,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:50:24,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b567951727ff69d6f25dbd HTTP/1.1" 200 None 2026-03-16 13:50:24,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:50:24,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2061ab0f5558b5d7cc5f2 HTTP/1.1" 200 None 2026-03-16 13:50:24,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:50:24,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b567951727ff69d6f25dbd HTTP/1.1" 200 None 2026-03-16 13:50:24,363 - lava_callback - ERROR - Error processing callback for node 69b567951727ff69d6f25dbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49590 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:55:35,031 - lava_callback - INFO - Received callback for node 69b80190113612b7716bc886 INFO: 172.20.0.1:50776 - "POST /node/69b80190113612b7716bc886 HTTP/1.0" 202 Accepted 2026-03-16 13:55:35,038 - lava_callback - INFO - Starting async job submit for node 69b80190113612b7716bc886 2026-03-16 13:55:35,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:55:35,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b80190113612b7716bc886 HTTP/1.1" 200 None 2026-03-16 13:55:35,217 - lava_callback - DEBUG - Processing node 69b80190113612b7716bc886: ltp-controllers 2026-03-16 13:55:35,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:55:35,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:55:35,862 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69b80190113612b7716bc886/log.txt.gz 2026-03-16 13:55:36,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:55:36,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:55:36,351 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69b80190113612b7716bc886/lava-logs.yaml 2026-03-16 13:55:36,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 13:55:36,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 13:55:36,536 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69b80190113612b7716bc886/lava_callback.json.gz INFO: 172.20.0.1:50786 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:55:36,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:55:36,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b80190113612b7716bc886 HTTP/1.1" 200 None 2026-03-16 13:55:36,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:55:36,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 13:55:36,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:55:36,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b80190113612b7716bc886 HTTP/1.1" 200 None 2026-03-16 13:55:36,620 - lava_callback - INFO - Completed processing callback for node 69b80190113612b7716bc886 INFO: 172.20.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51974 - "GET / HTTP/1.0" 200 OK 2026-03-16 13:56:05,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 13:56:05,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33024 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:00:49,425 - lava_callback - INFO - Received callback for node 69b808d8113612b7716bc902 INFO: 172.20.0.1:33040 - "POST /node/69b808d8113612b7716bc902 HTTP/1.0" 202 Accepted 2026-03-16 14:00:49,431 - lava_callback - INFO - Starting async job submit for node 69b808d8113612b7716bc902 2026-03-16 14:00:49,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:00:49,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b808d8113612b7716bc902 HTTP/1.1" 200 None 2026-03-16 14:00:49,502 - lava_callback - DEBUG - Processing node 69b808d8113612b7716bc902: baseline-arm 2026-03-16 14:00:50,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:00:50,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:00:50,268 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b808d8113612b7716bc902/log.txt.gz 2026-03-16 14:00:50,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:00:50,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:00:50,891 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b808d8113612b7716bc902/lava-logs.yaml 2026-03-16 14:00:50,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:00:51,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:00:51,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b808d8113612b7716bc902/lava_callback.json.gz DEBUG: Setup failed for 69b808d8113612b7716bc902. Transitting job node result: incomplete -> fail 2026-03-16 14:00:51,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:00:51,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b808d8113612b7716bc902 HTTP/1.1" 200 None 2026-03-16 14:00:51,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:00:51,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 14:00:51,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:00:51,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b808d8113612b7716bc902 HTTP/1.1" 200 None 2026-03-16 14:00:51,455 - lava_callback - INFO - Completed processing callback for node 69b808d8113612b7716bc902 INFO: 172.20.0.1:59978 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:01:05,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:01:05,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35052 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:09:50,657 - lava_callback - INFO - Received callback for node 69b7e16c00b80c8ffdcb8e1b INFO: 172.20.0.1:43988 - "POST /node/69b7e16c00b80c8ffdcb8e1b HTTP/1.0" 202 Accepted 2026-03-16 14:09:50,663 - lava_callback - INFO - Starting async job submit for node 69b7e16c00b80c8ffdcb8e1b 2026-03-16 14:09:50,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:09:50,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e16c00b80c8ffdcb8e1b HTTP/1.1" 200 None 2026-03-16 14:09:50,704 - lava_callback - DEBUG - Processing node 69b7e16c00b80c8ffdcb8e1b: baseline-arm64 2026-03-16 14:09:50,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:09:51,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:09:51,080 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e16c00b80c8ffdcb8e1b/log.txt.gz 2026-03-16 14:09:51,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:09:51,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:09:51,428 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e16c00b80c8ffdcb8e1b/lava-logs.yaml 2026-03-16 14:09:51,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:09:51,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:09:51,588 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b7e16c00b80c8ffdcb8e1b/lava_callback.json.gz 2026-03-16 14:09:51,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:09:51,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e16c00b80c8ffdcb8e1b HTTP/1.1" 200 None 2026-03-16 14:09:51,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:09:51,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 14:09:51,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:09:51,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e16c00b80c8ffdcb8e1b HTTP/1.1" 200 None 2026-03-16 14:09:51,707 - lava_callback - INFO - Completed processing callback for node 69b7e16c00b80c8ffdcb8e1b 2026-03-16 14:09:52,229 - lava_callback - INFO - Received callback for node 69b7e17e00b80c8ffdcb8e49 INFO: 172.20.0.1:43994 - "POST /node/69b7e17e00b80c8ffdcb8e49 HTTP/1.0" 202 Accepted 2026-03-16 14:09:52,235 - lava_callback - INFO - Starting async job submit for node 69b7e17e00b80c8ffdcb8e49 2026-03-16 14:09:52,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:09:52,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17e00b80c8ffdcb8e49 HTTP/1.1" 200 None 2026-03-16 14:09:52,277 - lava_callback - DEBUG - Processing node 69b7e17e00b80c8ffdcb8e49: baseline-nfs-arm64 2026-03-16 14:09:52,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:09:52,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:09:52,719 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e17e00b80c8ffdcb8e49/log.txt.gz 2026-03-16 14:09:52,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:09:53,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:09:53,113 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e17e00b80c8ffdcb8e49/lava-logs.yaml 2026-03-16 14:09:53,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:09:53,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:09:53,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7e17e00b80c8ffdcb8e49/lava_callback.json.gz 2026-03-16 14:09:53,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:09:53,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e17e00b80c8ffdcb8e49 HTTP/1.1" 200 None 2026-03-16 14:09:53,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:09:53,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 14:09:53,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:09:53,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e17e00b80c8ffdcb8e49 HTTP/1.1" 200 None 2026-03-16 14:09:53,420 - lava_callback - INFO - Completed processing callback for node 69b7e17e00b80c8ffdcb8e49 INFO: 172.20.0.1:44006 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:10:05,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:10:05,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58306 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:46:28,228 - lava_callback - INFO - Received callback for node 69b574ba1727ff69d6f25e1b INFO: 172.20.0.1:58322 - "POST /node/69b574ba1727ff69d6f25e1b HTTP/1.0" 202 Accepted 2026-03-16 14:46:28,234 - lava_callback - INFO - Starting async job submit for node 69b574ba1727ff69d6f25e1b 2026-03-16 14:46:28,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:46:28,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b574ba1727ff69d6f25e1b HTTP/1.1" 200 None 2026-03-16 14:46:28,265 - lava_callback - DEBUG - Processing node 69b574ba1727ff69d6f25e1b: baseline-arm-baylibre 2026-03-16 14:46:28,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b574ba1727ff69d6f25e1b 2026-03-16 14:46:28,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:46:28,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b574ba1727ff69d6f25e1b HTTP/1.1" 200 None 2026-03-16 14:46:28,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:46:28,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 14:46:28,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:46:28,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b574ba1727ff69d6f25e1b HTTP/1.1" 200 None 2026-03-16 14:46:28,318 - lava_callback - ERROR - Error processing callback for node 69b574ba1727ff69d6f25e1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41162 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:47:06,904 - lava_callback - INFO - Received callback for node 69b574e11727ff69d6f25e26 INFO: 172.20.0.1:41178 - "POST /node/69b574e11727ff69d6f25e26 HTTP/1.0" 202 Accepted 2026-03-16 14:47:06,909 - lava_callback - INFO - Starting async job submit for node 69b574e11727ff69d6f25e26 2026-03-16 14:47:06,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:47:06,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b574e11727ff69d6f25e26 HTTP/1.1" 200 None 2026-03-16 14:47:06,928 - lava_callback - DEBUG - Processing node 69b574e11727ff69d6f25e26: baseline-arm-clabbe 2026-03-16 14:47:06,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b574e11727ff69d6f25e26 2026-03-16 14:47:06,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:47:06,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b574e11727ff69d6f25e26 HTTP/1.1" 200 None 2026-03-16 14:47:06,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:47:06,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 14:47:06,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:47:06,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b574e11727ff69d6f25e26 HTTP/1.1" 200 None 2026-03-16 14:47:06,983 - lava_callback - ERROR - Error processing callback for node 69b574e11727ff69d6f25e26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59338 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:47:48,185 - lava_callback - INFO - Received callback for node 69b575031727ff69d6f25e34 INFO: 172.20.0.1:59350 - "POST /node/69b575031727ff69d6f25e34 HTTP/1.0" 202 Accepted 2026-03-16 14:47:48,192 - lava_callback - INFO - Starting async job submit for node 69b575031727ff69d6f25e34 2026-03-16 14:47:48,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:47:48,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b575031727ff69d6f25e34 HTTP/1.1" 200 None 2026-03-16 14:47:48,208 - lava_callback - DEBUG - Processing node 69b575031727ff69d6f25e34: baseline-arm-baylibre 2026-03-16 14:47:48,208 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b575031727ff69d6f25e34 2026-03-16 14:47:48,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:47:48,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b575031727ff69d6f25e34 HTTP/1.1" 200 None 2026-03-16 14:47:48,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:47:48,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 14:47:48,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:47:48,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b575031727ff69d6f25e34 HTTP/1.1" 200 None 2026-03-16 14:47:48,270 - lava_callback - ERROR - Error processing callback for node 69b575031727ff69d6f25e34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33062 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:48:26,983 - lava_callback - INFO - Received callback for node 69b575291727ff69d6f25e42 INFO: 172.20.0.1:33064 - "POST /node/69b575291727ff69d6f25e42 HTTP/1.0" 202 Accepted 2026-03-16 14:48:26,989 - lava_callback - INFO - Starting async job submit for node 69b575291727ff69d6f25e42 2026-03-16 14:48:26,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:48:27,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b575291727ff69d6f25e42 HTTP/1.1" 200 None 2026-03-16 14:48:27,009 - lava_callback - DEBUG - Processing node 69b575291727ff69d6f25e42: baseline-arm-clabbe 2026-03-16 14:48:27,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b575291727ff69d6f25e42 2026-03-16 14:48:27,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:48:27,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b575291727ff69d6f25e42 HTTP/1.1" 200 None 2026-03-16 14:48:27,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:48:27,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 14:48:27,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:48:27,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b575291727ff69d6f25e42 HTTP/1.1" 200 None 2026-03-16 14:48:27,082 - lava_callback - ERROR - Error processing callback for node 69b575291727ff69d6f25e42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 14:48:29,391 - lava_callback - INFO - Received callback for node 69b7f987113612b7716bc531 INFO: 172.20.0.1:33076 - "POST /node/69b7f987113612b7716bc531 HTTP/1.0" 202 Accepted 2026-03-16 14:48:29,398 - lava_callback - INFO - Starting async job submit for node 69b7f987113612b7716bc531 2026-03-16 14:48:29,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:48:29,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f987113612b7716bc531 HTTP/1.1" 200 None 2026-03-16 14:48:29,473 - lava_callback - DEBUG - Processing node 69b7f987113612b7716bc531: baseline-nfs-arm64 2026-03-16 14:48:30,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:48:30,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:48:30,761 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7f987113612b7716bc531/log.txt.gz 2026-03-16 14:48:31,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:48:31,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:48:31,593 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7f987113612b7716bc531/lava-logs.yaml 2026-03-16 14:48:31,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:48:31,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:48:31,791 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b7f987113612b7716bc531/lava_callback.json.gz DEBUG: Setup failed for 69b7f987113612b7716bc531. Transitting job node result: incomplete -> fail 2026-03-16 14:48:31,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:48:31,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7f987113612b7716bc531 HTTP/1.1" 200 None 2026-03-16 14:48:31,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:48:31,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-16 14:48:31,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:48:31,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7f987113612b7716bc531 HTTP/1.1" 200 None 2026-03-16 14:48:32,030 - lava_callback - INFO - Completed processing callback for node 69b7f987113612b7716bc531 2026-03-16 14:48:35,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:48:35,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33736 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:49:07,015 - lava_callback - INFO - Received callback for node 69b5754d1727ff69d6f25e4c INFO: 172.20.0.1:33752 - "POST /node/69b5754d1727ff69d6f25e4c HTTP/1.0" 202 Accepted 2026-03-16 14:49:07,021 - lava_callback - INFO - Starting async job submit for node 69b5754d1727ff69d6f25e4c 2026-03-16 14:49:07,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:49:07,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5754d1727ff69d6f25e4c HTTP/1.1" 200 None 2026-03-16 14:49:07,037 - lava_callback - DEBUG - Processing node 69b5754d1727ff69d6f25e4c: baseline-arm-clabbe 2026-03-16 14:49:07,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5754d1727ff69d6f25e4c 2026-03-16 14:49:07,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:49:07,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5754d1727ff69d6f25e4c HTTP/1.1" 200 None 2026-03-16 14:49:07,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:49:07,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 14:49:07,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:49:07,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5754d1727ff69d6f25e4c HTTP/1.1" 200 None 2026-03-16 14:49:07,093 - lava_callback - ERROR - Error processing callback for node 69b5754d1727ff69d6f25e4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49392 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:49:27,036 - lava_callback - INFO - Received callback for node 69b575711727ff69d6f25e59 INFO: 172.20.0.1:49404 - "POST /node/69b575711727ff69d6f25e59 HTTP/1.0" 202 Accepted 2026-03-16 14:49:27,041 - lava_callback - INFO - Starting async job submit for node 69b575711727ff69d6f25e59 2026-03-16 14:49:27,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:49:27,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b575711727ff69d6f25e59 HTTP/1.1" 200 None 2026-03-16 14:49:27,062 - lava_callback - DEBUG - Processing node 69b575711727ff69d6f25e59: baseline-arm-clabbe 2026-03-16 14:49:27,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b575711727ff69d6f25e59 2026-03-16 14:49:27,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:49:27,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b575711727ff69d6f25e59 HTTP/1.1" 200 None 2026-03-16 14:49:27,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:49:27,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 14:49:27,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:49:27,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b575711727ff69d6f25e59 HTTP/1.1" 200 None 2026-03-16 14:49:27,123 - lava_callback - ERROR - Error processing callback for node 69b575711727ff69d6f25e59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37532 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:50:07,061 - lava_callback - INFO - Received callback for node 69b575951727ff69d6f25e65 INFO: 172.20.0.1:37542 - "POST /node/69b575951727ff69d6f25e65 HTTP/1.0" 202 Accepted 2026-03-16 14:50:07,067 - lava_callback - INFO - Starting async job submit for node 69b575951727ff69d6f25e65 2026-03-16 14:50:07,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:50:07,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b575951727ff69d6f25e65 HTTP/1.1" 200 None 2026-03-16 14:50:07,093 - lava_callback - DEBUG - Processing node 69b575951727ff69d6f25e65: baseline-arm-clabbe 2026-03-16 14:50:07,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b575951727ff69d6f25e65 2026-03-16 14:50:07,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:50:07,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b575951727ff69d6f25e65 HTTP/1.1" 200 None 2026-03-16 14:50:07,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:50:07,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 14:50:07,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:50:07,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b575951727ff69d6f25e65 HTTP/1.1" 200 None 2026-03-16 14:50:07,152 - lava_callback - ERROR - Error processing callback for node 69b575951727ff69d6f25e65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36260 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:50:47,081 - lava_callback - INFO - Received callback for node 69b575b91727ff69d6f25e72 INFO: 172.20.0.1:36262 - "POST /node/69b575b91727ff69d6f25e72 HTTP/1.0" 202 Accepted 2026-03-16 14:50:47,091 - lava_callback - INFO - Starting async job submit for node 69b575b91727ff69d6f25e72 2026-03-16 14:50:47,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:50:47,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b575b91727ff69d6f25e72 HTTP/1.1" 200 None 2026-03-16 14:50:47,115 - lava_callback - DEBUG - Processing node 69b575b91727ff69d6f25e72: baseline-arm-clabbe 2026-03-16 14:50:47,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b575b91727ff69d6f25e72 2026-03-16 14:50:47,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:50:47,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b575b91727ff69d6f25e72 HTTP/1.1" 200 None 2026-03-16 14:50:47,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:50:47,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 14:50:47,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:50:47,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b575b91727ff69d6f25e72 HTTP/1.1" 200 None 2026-03-16 14:50:47,203 - lava_callback - ERROR - Error processing callback for node 69b575b91727ff69d6f25e72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59038 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:51:27,074 - lava_callback - INFO - Received callback for node 69b575dd1727ff69d6f25e7a INFO: 172.20.0.1:59052 - "POST /node/69b575dd1727ff69d6f25e7a HTTP/1.0" 202 Accepted 2026-03-16 14:51:27,080 - lava_callback - INFO - Starting async job submit for node 69b575dd1727ff69d6f25e7a 2026-03-16 14:51:27,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:51:27,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b575dd1727ff69d6f25e7a HTTP/1.1" 200 None 2026-03-16 14:51:27,101 - lava_callback - DEBUG - Processing node 69b575dd1727ff69d6f25e7a: baseline-arm-clabbe 2026-03-16 14:51:27,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b575dd1727ff69d6f25e7a 2026-03-16 14:51:27,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:51:27,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b575dd1727ff69d6f25e7a HTTP/1.1" 200 None 2026-03-16 14:51:27,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:51:27,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 14:51:27,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:51:27,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b575dd1727ff69d6f25e7a HTTP/1.1" 200 None 2026-03-16 14:51:27,232 - lava_callback - ERROR - Error processing callback for node 69b575dd1727ff69d6f25e7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50866 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:52:07,183 - lava_callback - INFO - Received callback for node 69b576021727ff69d6f25e86 INFO: 172.20.0.1:50874 - "POST /node/69b576021727ff69d6f25e86 HTTP/1.0" 202 Accepted 2026-03-16 14:52:07,189 - lava_callback - INFO - Starting async job submit for node 69b576021727ff69d6f25e86 2026-03-16 14:52:07,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:52:07,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b576021727ff69d6f25e86 HTTP/1.1" 200 None 2026-03-16 14:52:07,212 - lava_callback - DEBUG - Processing node 69b576021727ff69d6f25e86: baseline-arm-clabbe 2026-03-16 14:52:07,212 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b576021727ff69d6f25e86 2026-03-16 14:52:07,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:52:07,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b576021727ff69d6f25e86 HTTP/1.1" 200 None 2026-03-16 14:52:07,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:52:07,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 14:52:07,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:52:07,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b576021727ff69d6f25e86 HTTP/1.1" 200 None 2026-03-16 14:52:07,269 - lava_callback - ERROR - Error processing callback for node 69b576021727ff69d6f25e86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60502 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:52:27,115 - lava_callback - INFO - Received callback for node 69b576261727ff69d6f25e8f INFO: 172.20.0.1:60510 - "POST /node/69b576261727ff69d6f25e8f HTTP/1.0" 202 Accepted 2026-03-16 14:52:27,121 - lava_callback - INFO - Starting async job submit for node 69b576261727ff69d6f25e8f 2026-03-16 14:52:27,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:52:27,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b576261727ff69d6f25e8f HTTP/1.1" 200 None 2026-03-16 14:52:27,141 - lava_callback - DEBUG - Processing node 69b576261727ff69d6f25e8f: baseline-arm-clabbe 2026-03-16 14:52:27,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b576261727ff69d6f25e8f 2026-03-16 14:52:27,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:52:27,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b576261727ff69d6f25e8f HTTP/1.1" 200 None 2026-03-16 14:52:27,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:52:27,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 14:52:27,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:52:27,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b576261727ff69d6f25e8f HTTP/1.1" 200 None 2026-03-16 14:52:27,228 - lava_callback - ERROR - Error processing callback for node 69b576261727ff69d6f25e8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49226 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:53:07,182 - lava_callback - INFO - Received callback for node 69b5764a1727ff69d6f25e98 INFO: 172.20.0.1:49234 - "POST /node/69b5764a1727ff69d6f25e98 HTTP/1.0" 202 Accepted 2026-03-16 14:53:07,190 - lava_callback - INFO - Starting async job submit for node 69b5764a1727ff69d6f25e98 2026-03-16 14:53:07,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:07,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5764a1727ff69d6f25e98 HTTP/1.1" 200 None 2026-03-16 14:53:07,225 - lava_callback - DEBUG - Processing node 69b5764a1727ff69d6f25e98: baseline-arm-clabbe 2026-03-16 14:53:07,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5764a1727ff69d6f25e98 2026-03-16 14:53:07,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:07,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5764a1727ff69d6f25e98 HTTP/1.1" 200 None 2026-03-16 14:53:07,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:07,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 14:53:07,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:07,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5764a1727ff69d6f25e98 HTTP/1.1" 200 None 2026-03-16 14:53:07,352 - lava_callback - ERROR - Error processing callback for node 69b5764a1727ff69d6f25e98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41142 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:53:19,722 - lava_callback - INFO - Received callback for node 69b8193b113612b7716bc9d4 INFO: 172.20.0.1:38558 - "POST /node/69b8193b113612b7716bc9d4 HTTP/1.0" 202 Accepted 2026-03-16 14:53:19,731 - lava_callback - INFO - Starting async job submit for node 69b8193b113612b7716bc9d4 2026-03-16 14:53:19,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:19,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8193b113612b7716bc9d4 HTTP/1.1" 200 None 2026-03-16 14:53:19,778 - lava_callback - DEBUG - Processing node 69b8193b113612b7716bc9d4: baseline-arm64 2026-03-16 14:53:19,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:53:20,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:53:20,068 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8193b113612b7716bc9d4/log.txt.gz 2026-03-16 14:53:20,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:53:20,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:53:20,333 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8193b113612b7716bc9d4/lava-logs.yaml 2026-03-16 14:53:20,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:53:20,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:53:20,546 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8193b113612b7716bc9d4/lava_callback.json.gz 2026-03-16 14:53:20,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:20,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8193b113612b7716bc9d4 HTTP/1.1" 200 None 2026-03-16 14:53:20,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:20,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:53:20,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:20,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8193b113612b7716bc9d4 HTTP/1.1" 200 None 2026-03-16 14:53:20,655 - lava_callback - INFO - Completed processing callback for node 69b8193b113612b7716bc9d4 INFO: 172.20.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38578 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:53:35,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:35,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37460 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:53:39,585 - lava_callback - INFO - Received callback for node 69b81949113612b7716bca0c INFO: 172.20.0.1:37470 - "POST /node/69b81949113612b7716bca0c HTTP/1.0" 202 Accepted 2026-03-16 14:53:39,592 - lava_callback - INFO - Starting async job submit for node 69b81949113612b7716bca0c 2026-03-16 14:53:39,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:39,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81949113612b7716bca0c HTTP/1.1" 200 None 2026-03-16 14:53:39,626 - lava_callback - DEBUG - Processing node 69b81949113612b7716bca0c: baseline-arm64 2026-03-16 14:53:39,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:53:39,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:53:39,901 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81949113612b7716bca0c/log.txt.gz 2026-03-16 14:53:39,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:53:40,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:53:40,171 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81949113612b7716bca0c/lava-logs.yaml 2026-03-16 14:53:40,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:53:40,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:53:40,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81949113612b7716bca0c/lava_callback.json.gz 2026-03-16 14:53:40,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:40,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81949113612b7716bca0c HTTP/1.1" 200 None 2026-03-16 14:53:40,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:40,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:53:40,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:40,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81949113612b7716bca0c HTTP/1.1" 200 None 2026-03-16 14:53:40,450 - lava_callback - INFO - Completed processing callback for node 69b81949113612b7716bca0c 2026-03-16 14:53:40,708 - lava_callback - INFO - Received callback for node 69b8195a113612b7716bca37 INFO: 172.20.0.1:55852 - "POST /node/69b8195a113612b7716bca37 HTTP/1.0" 202 Accepted 2026-03-16 14:53:40,716 - lava_callback - INFO - Starting async job submit for node 69b8195a113612b7716bca37 2026-03-16 14:53:40,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:40,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8195a113612b7716bca37 HTTP/1.1" 200 None 2026-03-16 14:53:40,735 - lava_callback - DEBUG - Processing node 69b8195a113612b7716bca37: baseline-nfs-arm64 2026-03-16 14:53:40,738 - lava_callback - WARNING - Failed to upload log 2026-03-16 14:53:40,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:53:40,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:53:40,930 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195a113612b7716bca37/lava-logs.yaml 2026-03-16 14:53:40,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:53:41,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:53:41,062 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195a113612b7716bca37/lava_callback.json.gz 2026-03-16 14:53:41,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:41,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8195a113612b7716bca37 HTTP/1.1" 200 None 2026-03-16 14:53:41,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:41,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:53:41,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:41,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8195a113612b7716bca37 HTTP/1.1" 200 None 2026-03-16 14:53:41,134 - lava_callback - INFO - Completed processing callback for node 69b8195a113612b7716bca37 INFO: 172.20.0.1:55864 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:53:48,890 - lava_callback - INFO - Received callback for node 69b8193d113612b7716bc9dc INFO: 172.20.0.1:55866 - "POST /node/69b8193d113612b7716bc9dc HTTP/1.0" 202 Accepted 2026-03-16 14:53:48,898 - lava_callback - INFO - Starting async job submit for node 69b8193d113612b7716bc9dc 2026-03-16 14:53:48,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:48,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8193d113612b7716bc9dc HTTP/1.1" 200 None 2026-03-16 14:53:48,959 - lava_callback - DEBUG - Processing node 69b8193d113612b7716bc9dc: baseline-arm64 2026-03-16 14:53:49,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:53:49,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:53:49,403 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8193d113612b7716bc9dc/log.txt.gz 2026-03-16 14:53:49,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:53:49,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:53:49,924 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8193d113612b7716bc9dc/lava-logs.yaml 2026-03-16 14:53:49,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:53:50,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:53:50,104 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8193d113612b7716bc9dc/lava_callback.json.gz 2026-03-16 14:53:50,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:50,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8193d113612b7716bc9dc HTTP/1.1" 200 None 2026-03-16 14:53:50,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:50,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:53:50,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:53:50,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8193d113612b7716bc9dc HTTP/1.1" 200 None 2026-03-16 14:53:50,190 - lava_callback - INFO - Completed processing callback for node 69b8193d113612b7716bc9dc INFO: 172.20.0.1:39976 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:54:05,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:05,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54452 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:54:24,217 - lava_callback - INFO - Received callback for node 69b81940113612b7716bc9e3 INFO: 172.20.0.1:57902 - "POST /node/69b81940113612b7716bc9e3 HTTP/1.0" 202 Accepted 2026-03-16 14:54:24,225 - lava_callback - INFO - Starting async job submit for node 69b81940113612b7716bc9e3 2026-03-16 14:54:24,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:24,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81940113612b7716bc9e3 HTTP/1.1" 200 None 2026-03-16 14:54:24,270 - lava_callback - DEBUG - Processing node 69b81940113612b7716bc9e3: baseline-arm64 2026-03-16 14:54:24,424 - lava_callback - WARNING - Failed to upload log 2026-03-16 14:54:24,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:24,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:24,658 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81940113612b7716bc9e3/lava-logs.yaml 2026-03-16 14:54:24,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:24,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:24,810 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81940113612b7716bc9e3/lava_callback.json.gz 2026-03-16 14:54:24,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:24,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81940113612b7716bc9e3 HTTP/1.1" 200 None 2026-03-16 14:54:24,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:24,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:54:24,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:24,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81940113612b7716bc9e3 HTTP/1.1" 200 None 2026-03-16 14:54:24,973 - lava_callback - INFO - Completed processing callback for node 69b81940113612b7716bc9e3 INFO: 172.20.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57916 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:54:28,425 - lava_callback - INFO - Received callback for node 69b81941113612b7716bc9e6 INFO: 172.20.0.1:57922 - "POST /node/69b81941113612b7716bc9e6 HTTP/1.0" 202 Accepted 2026-03-16 14:54:28,431 - lava_callback - INFO - Starting async job submit for node 69b81941113612b7716bc9e6 2026-03-16 14:54:28,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:28,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81941113612b7716bc9e6 HTTP/1.1" 200 None 2026-03-16 14:54:28,476 - lava_callback - DEBUG - Processing node 69b81941113612b7716bc9e6: baseline-arm64 2026-03-16 14:54:28,613 - lava_callback - WARNING - Failed to upload log 2026-03-16 14:54:28,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:28,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:28,836 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81941113612b7716bc9e6/lava-logs.yaml 2026-03-16 14:54:28,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:28,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:28,976 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81941113612b7716bc9e6/lava_callback.json.gz 2026-03-16 14:54:29,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:29,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81941113612b7716bc9e6 HTTP/1.1" 200 None 2026-03-16 14:54:29,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:29,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:54:29,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:29,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81941113612b7716bc9e6 HTTP/1.1" 200 None 2026-03-16 14:54:29,126 - lava_callback - INFO - Completed processing callback for node 69b81941113612b7716bc9e6 2026-03-16 14:54:31,705 - lava_callback - INFO - Received callback for node 69b8194e113612b7716bca1a INFO: 172.20.0.1:59824 - "POST /node/69b8194e113612b7716bca1a HTTP/1.0" 202 Accepted 2026-03-16 14:54:31,711 - lava_callback - INFO - Starting async job submit for node 69b8194e113612b7716bca1a 2026-03-16 14:54:31,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:31,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8194e113612b7716bca1a HTTP/1.1" 200 None 2026-03-16 14:54:31,750 - lava_callback - DEBUG - Processing node 69b8194e113612b7716bca1a: baseline-arm64 2026-03-16 14:54:31,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:32,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:32,122 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194e113612b7716bca1a/log.txt.gz 2026-03-16 14:54:32,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:32,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:32,441 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194e113612b7716bca1a/lava-logs.yaml 2026-03-16 14:54:32,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:32,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:32,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194e113612b7716bca1a/lava_callback.json.gz 2026-03-16 14:54:32,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:32,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8194e113612b7716bca1a HTTP/1.1" 200 None 2026-03-16 14:54:32,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:32,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:54:32,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:32,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8194e113612b7716bca1a HTTP/1.1" 200 None 2026-03-16 14:54:32,669 - lava_callback - INFO - Completed processing callback for node 69b8194e113612b7716bca1a 2026-03-16 14:54:35,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:35,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47842 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:54:51,511 - lava_callback - INFO - Received callback for node 69b81984113612b7716bcadd INFO: 172.20.0.1:44812 - "POST /node/69b81984113612b7716bcadd HTTP/1.0" 202 Accepted 2026-03-16 14:54:51,519 - lava_callback - INFO - Starting async job submit for node 69b81984113612b7716bcadd 2026-03-16 14:54:51,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:51,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81984113612b7716bcadd HTTP/1.1" 200 None 2026-03-16 14:54:51,563 - lava_callback - DEBUG - Processing node 69b81984113612b7716bcadd: baseline-arm64-pengutronix 2026-03-16 14:54:51,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:51,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:51,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b81984113612b7716bcadd/log.txt.gz 2026-03-16 14:54:52,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:52,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:52,229 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b81984113612b7716bcadd/lava-logs.yaml 2026-03-16 14:54:52,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:52,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:52,400 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b81984113612b7716bcadd/lava_callback.json.gz 2026-03-16 14:54:52,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:52,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81984113612b7716bcadd HTTP/1.1" 200 None 2026-03-16 14:54:52,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:52,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:54:52,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:52,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81984113612b7716bcadd HTTP/1.1" 200 None 2026-03-16 14:54:52,480 - lava_callback - INFO - Completed processing callback for node 69b81984113612b7716bcadd 2026-03-16 14:54:52,626 - lava_callback - INFO - Received callback for node 69b81986113612b7716bcae3 INFO: 172.20.0.1:44822 - "POST /node/69b81986113612b7716bcae3 HTTP/1.0" 202 Accepted 2026-03-16 14:54:52,635 - lava_callback - INFO - Starting async job submit for node 69b81986113612b7716bcae3 2026-03-16 14:54:52,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:52,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81986113612b7716bcae3 HTTP/1.1" 200 None 2026-03-16 14:54:52,695 - lava_callback - DEBUG - Processing node 69b81986113612b7716bcae3: baseline-arm64-foundriesio 2026-03-16 14:54:52,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:53,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:53,061 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b81986113612b7716bcae3/log.txt.gz 2026-03-16 14:54:53,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:53,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:53,356 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b81986113612b7716bcae3/lava-logs.yaml 2026-03-16 14:54:53,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:53,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:53,559 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b81986113612b7716bcae3/lava_callback.json.gz 2026-03-16 14:54:53,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:53,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81986113612b7716bcae3 HTTP/1.1" 200 None 2026-03-16 14:54:53,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:53,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:54:53,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:53,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81986113612b7716bcae3 HTTP/1.1" 200 None 2026-03-16 14:54:53,746 - lava_callback - INFO - Completed processing callback for node 69b81986113612b7716bcae3 2026-03-16 14:54:56,209 - lava_callback - INFO - Received callback for node 69b8193c113612b7716bc9d9 INFO: 172.20.0.1:44830 - "POST /node/69b8193c113612b7716bc9d9 HTTP/1.0" 202 Accepted 2026-03-16 14:54:56,215 - lava_callback - INFO - Starting async job submit for node 69b8193c113612b7716bc9d9 2026-03-16 14:54:56,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:56,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8193c113612b7716bc9d9 HTTP/1.1" 200 None 2026-03-16 14:54:56,252 - lava_callback - DEBUG - Processing node 69b8193c113612b7716bc9d9: baseline-arm64 2026-03-16 14:54:56,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:44834 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:54:56,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:56,662 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8193c113612b7716bc9d9/log.txt.gz 2026-03-16 14:54:56,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:56,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:56,986 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8193c113612b7716bc9d9/lava-logs.yaml 2026-03-16 14:54:56,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:54:57,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:54:57,143 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8193c113612b7716bc9d9/lava_callback.json.gz 2026-03-16 14:54:57,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:57,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8193c113612b7716bc9d9 HTTP/1.1" 200 None 2026-03-16 14:54:57,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:57,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:54:57,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:54:57,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8193c113612b7716bc9d9 HTTP/1.1" 200 None 2026-03-16 14:54:57,262 - lava_callback - INFO - Completed processing callback for node 69b8193c113612b7716bc9d9 2026-03-16 14:55:00,079 - lava_callback - INFO - Received callback for node 69b81985113612b7716bcae0 INFO: 172.20.0.1:40116 - "POST /node/69b81985113612b7716bcae0 HTTP/1.0" 202 Accepted 2026-03-16 14:55:00,086 - lava_callback - INFO - Starting async job submit for node 69b81985113612b7716bcae0 2026-03-16 14:55:00,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:00,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81985113612b7716bcae0 HTTP/1.1" 200 None 2026-03-16 14:55:00,127 - lava_callback - DEBUG - Processing node 69b81985113612b7716bcae0: baseline-arm64-pengutronix 2026-03-16 14:55:00,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:00,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:00,478 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b81985113612b7716bcae0/log.txt.gz 2026-03-16 14:55:00,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:00,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:00,781 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b81985113612b7716bcae0/lava-logs.yaml 2026-03-16 14:55:00,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:00,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:00,931 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b81985113612b7716bcae0/lava_callback.json.gz 2026-03-16 14:55:00,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:00,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81985113612b7716bcae0 HTTP/1.1" 200 None 2026-03-16 14:55:00,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:00,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:55:00,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:01,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81985113612b7716bcae0 HTTP/1.1" 200 None 2026-03-16 14:55:01,022 - lava_callback - INFO - Completed processing callback for node 69b81985113612b7716bcae0 2026-03-16 14:55:04,372 - lava_callback - INFO - Received callback for node 69b81960113612b7716bca4a INFO: 172.20.0.1:40132 - "POST /node/69b81960113612b7716bca4a HTTP/1.0" 202 Accepted 2026-03-16 14:55:04,378 - lava_callback - INFO - Starting async job submit for node 69b81960113612b7716bca4a 2026-03-16 14:55:04,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:04,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81960113612b7716bca4a HTTP/1.1" 200 None 2026-03-16 14:55:04,416 - lava_callback - DEBUG - Processing node 69b81960113612b7716bca4a: baseline-nfs-arm64 2026-03-16 14:55:04,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:04,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:04,957 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81960113612b7716bca4a/log.txt.gz 2026-03-16 14:55:05,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:05,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:05,381 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81960113612b7716bca4a/lava-logs.yaml 2026-03-16 14:55:05,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:05,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:05,539 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81960113612b7716bca4a/lava_callback.json.gz 2026-03-16 14:55:05,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:05,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:05,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-16 14:55:05,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81960113612b7716bca4a HTTP/1.1" 200 None 2026-03-16 14:55:05,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:05,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:55:05,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:05,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81960113612b7716bca4a HTTP/1.1" 200 None 2026-03-16 14:55:05,676 - lava_callback - INFO - Completed processing callback for node 69b81960113612b7716bca4a INFO: 172.20.0.1:40144 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:55:07,648 - lava_callback - INFO - Received callback for node 69b8194f113612b7716bca1d INFO: 172.20.0.1:40146 - "POST /node/69b8194f113612b7716bca1d HTTP/1.0" 202 Accepted 2026-03-16 14:55:07,654 - lava_callback - INFO - Starting async job submit for node 69b8194f113612b7716bca1d 2026-03-16 14:55:07,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:07,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8194f113612b7716bca1d HTTP/1.1" 200 None 2026-03-16 14:55:07,708 - lava_callback - DEBUG - Processing node 69b8194f113612b7716bca1d: baseline-arm64 2026-03-16 14:55:08,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:08,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:08,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194f113612b7716bca1d/log.txt.gz 2026-03-16 14:55:08,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:08,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:08,536 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194f113612b7716bca1d/lava-logs.yaml 2026-03-16 14:55:08,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:08,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:08,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194f113612b7716bca1d/lava_callback.json.gz 2026-03-16 14:55:08,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:08,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8194f113612b7716bca1d HTTP/1.1" 200 None 2026-03-16 14:55:08,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:08,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:55:08,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:08,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8194f113612b7716bca1d HTTP/1.1" 200 None 2026-03-16 14:55:08,819 - lava_callback - INFO - Completed processing callback for node 69b8194f113612b7716bca1d INFO: 172.20.0.1:59778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59792 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:55:19,949 - lava_callback - INFO - Received callback for node 69b81987113612b7716bcae6 INFO: 172.20.0.1:33658 - "POST /node/69b81987113612b7716bcae6 HTTP/1.0" 202 Accepted 2026-03-16 14:55:19,956 - lava_callback - INFO - Starting async job submit for node 69b81987113612b7716bcae6 2026-03-16 14:55:19,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:19,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81987113612b7716bcae6 HTTP/1.1" 200 None 2026-03-16 14:55:19,999 - lava_callback - DEBUG - Processing node 69b81987113612b7716bcae6: baseline-arm64-foundriesio 2026-03-16 14:55:20,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:20,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:20,598 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b81987113612b7716bcae6/log.txt.gz 2026-03-16 14:55:20,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:21,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:21,069 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b81987113612b7716bcae6/lava-logs.yaml 2026-03-16 14:55:21,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:21,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:21,272 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b81987113612b7716bcae6/lava_callback.json.gz 2026-03-16 14:55:21,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:21,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81987113612b7716bcae6 HTTP/1.1" 200 None 2026-03-16 14:55:21,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:21,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:55:21,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:21,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81987113612b7716bcae6 HTTP/1.1" 200 None 2026-03-16 14:55:21,379 - lava_callback - INFO - Completed processing callback for node 69b81987113612b7716bcae6 INFO: 172.20.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33666 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:55:35,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:35,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 14:55:35,864 - lava_callback - INFO - Received callback for node 69b8195f113612b7716bca43 INFO: 172.20.0.1:39226 - "POST /node/69b8195f113612b7716bca43 HTTP/1.0" 202 Accepted 2026-03-16 14:55:35,871 - lava_callback - INFO - Starting async job submit for node 69b8195f113612b7716bca43 2026-03-16 14:55:35,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:35,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8195f113612b7716bca43 HTTP/1.1" 200 None 2026-03-16 14:55:35,915 - lava_callback - DEBUG - Processing node 69b8195f113612b7716bca43: baseline-nfs-arm64 2026-03-16 14:55:36,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:36,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:36,391 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195f113612b7716bca43/log.txt.gz INFO: 172.20.0.1:39236 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:55:36,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:36,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:36,814 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195f113612b7716bca43/lava-logs.yaml 2026-03-16 14:55:36,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:36,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:36,989 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195f113612b7716bca43/lava_callback.json.gz 2026-03-16 14:55:37,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:37,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8195f113612b7716bca43 HTTP/1.1" 200 None 2026-03-16 14:55:37,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:37,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:55:37,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:37,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8195f113612b7716bca43 HTTP/1.1" 200 None 2026-03-16 14:55:37,075 - lava_callback - INFO - Completed processing callback for node 69b8195f113612b7716bca43 2026-03-16 14:55:37,154 - lava_callback - INFO - Received callback for node 69b81979113612b7716bcaa3 INFO: 172.20.0.1:39240 - "POST /node/69b81979113612b7716bcaa3 HTTP/1.0" 202 Accepted 2026-03-16 14:55:37,164 - lava_callback - INFO - Starting async job submit for node 69b81979113612b7716bcaa3 2026-03-16 14:55:37,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:37,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81979113612b7716bcaa3 HTTP/1.1" 200 None 2026-03-16 14:55:37,225 - lava_callback - DEBUG - Processing node 69b81979113612b7716bcaa3: baseline-arm64-broonie 2026-03-16 14:55:37,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:37,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:37,641 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81979113612b7716bcaa3/log.txt.gz 2026-03-16 14:55:37,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:37,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:37,977 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81979113612b7716bcaa3/lava-logs.yaml 2026-03-16 14:55:37,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:38,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:38,124 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81979113612b7716bcaa3/lava_callback.json.gz 2026-03-16 14:55:38,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:38,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81979113612b7716bcaa3 HTTP/1.1" 200 None 2026-03-16 14:55:38,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:38,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:55:38,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:38,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81979113612b7716bcaa3 HTTP/1.1" 200 None 2026-03-16 14:55:38,243 - lava_callback - INFO - Completed processing callback for node 69b81979113612b7716bcaa3 INFO: 172.20.0.1:41838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58596 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:55:58,202 - lava_callback - INFO - Received callback for node 69b8197b113612b7716bcaa6 INFO: 172.20.0.1:58610 - "POST /node/69b8197b113612b7716bcaa6 HTTP/1.0" 202 Accepted 2026-03-16 14:55:58,209 - lava_callback - INFO - Starting async job submit for node 69b8197b113612b7716bcaa6 2026-03-16 14:55:58,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:58,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8197b113612b7716bcaa6 HTTP/1.1" 200 None 2026-03-16 14:55:58,248 - lava_callback - DEBUG - Processing node 69b8197b113612b7716bcaa6: baseline-arm64-broonie 2026-03-16 14:55:58,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:58,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:58,669 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8197b113612b7716bcaa6/log.txt.gz 2026-03-16 14:55:58,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:59,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:59,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8197b113612b7716bcaa6/lava-logs.yaml 2026-03-16 14:55:59,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:55:59,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:55:59,199 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8197b113612b7716bcaa6/lava_callback.json.gz 2026-03-16 14:55:59,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:59,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8197b113612b7716bcaa6 HTTP/1.1" 200 None 2026-03-16 14:55:59,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:59,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:55:59,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:55:59,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8197b113612b7716bcaa6 HTTP/1.1" 200 None 2026-03-16 14:55:59,286 - lava_callback - INFO - Completed processing callback for node 69b8197b113612b7716bcaa6 2026-03-16 14:56:05,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:56:05,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60094 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:56:17,505 - lava_callback - INFO - Received callback for node 69b81973113612b7716bca91 INFO: 172.20.0.1:60110 - "POST /node/69b81973113612b7716bca91 HTTP/1.0" 202 Accepted 2026-03-16 14:56:17,511 - lava_callback - INFO - Starting async job submit for node 69b81973113612b7716bca91 2026-03-16 14:56:17,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:56:17,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81973113612b7716bca91 HTTP/1.1" 200 None 2026-03-16 14:56:17,567 - lava_callback - DEBUG - Processing node 69b81973113612b7716bca91: baseline-arm64-broonie 2026-03-16 14:56:17,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:56:18,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:56:18,057 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81973113612b7716bca91/log.txt.gz 2026-03-16 14:56:18,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:56:18,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:56:18,456 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81973113612b7716bca91/lava-logs.yaml 2026-03-16 14:56:18,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:56:18,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:56:18,597 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81973113612b7716bca91/lava_callback.json.gz 2026-03-16 14:56:18,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:56:18,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81973113612b7716bca91 HTTP/1.1" 200 None 2026-03-16 14:56:18,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:56:18,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:56:18,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:56:18,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81973113612b7716bca91 HTTP/1.1" 200 None 2026-03-16 14:56:18,698 - lava_callback - INFO - Completed processing callback for node 69b81973113612b7716bca91 INFO: 172.20.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54838 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:56:35,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:56:35,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43702 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:57:42,898 - lava_callback - INFO - Received callback for node 69b81974113612b7716bca98 INFO: 172.20.0.1:41134 - "POST /node/69b81974113612b7716bca98 HTTP/1.0" 202 Accepted 2026-03-16 14:57:42,904 - lava_callback - INFO - Starting async job submit for node 69b81974113612b7716bca98 2026-03-16 14:57:42,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:57:42,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81974113612b7716bca98 HTTP/1.1" 200 None 2026-03-16 14:57:42,942 - lava_callback - DEBUG - Processing node 69b81974113612b7716bca98: baseline-arm64-broonie 2026-03-16 14:57:43,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:57:43,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:57:43,358 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81974113612b7716bca98/log.txt.gz 2026-03-16 14:57:43,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:57:43,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:57:43,755 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81974113612b7716bca98/lava-logs.yaml 2026-03-16 14:57:43,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 14:57:43,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 14:57:43,929 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81974113612b7716bca98/lava_callback.json.gz 2026-03-16 14:57:43,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:57:43,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81974113612b7716bca98 HTTP/1.1" 200 None 2026-03-16 14:57:43,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:57:43,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 14:57:43,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:57:44,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81974113612b7716bca98 HTTP/1.1" 200 None 2026-03-16 14:57:44,023 - lava_callback - INFO - Completed processing callback for node 69b81974113612b7716bca98 INFO: 172.20.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51656 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:58:05,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:58:05,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54856 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:58:28,818 - lava_callback - INFO - Received callback for node 69b577911727ff69d6f25ea5 INFO: 172.20.0.1:54860 - "POST /node/69b577911727ff69d6f25ea5 HTTP/1.0" 202 Accepted 2026-03-16 14:58:28,823 - lava_callback - INFO - Starting async job submit for node 69b577911727ff69d6f25ea5 2026-03-16 14:58:28,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:58:28,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b577911727ff69d6f25ea5 HTTP/1.1" 200 None 2026-03-16 14:58:28,840 - lava_callback - DEBUG - Processing node 69b577911727ff69d6f25ea5: baseline-arm64-baylibre 2026-03-16 14:58:28,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b577911727ff69d6f25ea5 2026-03-16 14:58:28,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:58:28,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b577911727ff69d6f25ea5 HTTP/1.1" 200 None 2026-03-16 14:58:28,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:58:28,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 14:58:28,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:58:28,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b577911727ff69d6f25ea5 HTTP/1.1" 200 None 2026-03-16 14:58:28,899 - lava_callback - ERROR - Error processing callback for node 69b577911727ff69d6f25ea5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54902 - "GET / HTTP/1.0" 200 OK 2026-03-16 14:59:48,900 - lava_callback - INFO - Received callback for node 69b577dd1727ff69d6f25eb5 INFO: 172.20.0.1:54910 - "POST /node/69b577dd1727ff69d6f25eb5 HTTP/1.0" 202 Accepted 2026-03-16 14:59:48,908 - lava_callback - INFO - Starting async job submit for node 69b577dd1727ff69d6f25eb5 2026-03-16 14:59:48,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:59:48,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b577dd1727ff69d6f25eb5 HTTP/1.1" 200 None 2026-03-16 14:59:48,925 - lava_callback - DEBUG - Processing node 69b577dd1727ff69d6f25eb5: baseline-arm64-baylibre 2026-03-16 14:59:48,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b577dd1727ff69d6f25eb5 2026-03-16 14:59:48,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:59:48,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b577dd1727ff69d6f25eb5 HTTP/1.1" 200 None 2026-03-16 14:59:48,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:59:48,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 14:59:48,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 14:59:48,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b577dd1727ff69d6f25eb5 HTTP/1.1" 200 None 2026-03-16 14:59:48,978 - lava_callback - ERROR - Error processing callback for node 69b577dd1727ff69d6f25eb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49206 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:00:51,002 - lava_callback - INFO - Received callback for node 69b81951113612b7716bca20 INFO: 172.20.0.1:58416 - "POST /node/69b81951113612b7716bca20 HTTP/1.0" 202 Accepted 2026-03-16 15:00:51,012 - lava_callback - INFO - Starting async job submit for node 69b81951113612b7716bca20 2026-03-16 15:00:51,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:00:51,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81951113612b7716bca20 HTTP/1.1" 200 None 2026-03-16 15:00:51,071 - lava_callback - DEBUG - Processing node 69b81951113612b7716bca20: baseline-arm64 2026-03-16 15:00:51,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:00:51,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:00:51,687 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81951113612b7716bca20/log.txt.gz 2026-03-16 15:00:52,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:00:52,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:00:52,292 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81951113612b7716bca20/lava-logs.yaml 2026-03-16 15:00:52,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:00:52,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:00:52,493 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81951113612b7716bca20/lava_callback.json.gz DEBUG: Setup failed for 69b81951113612b7716bca20. Transitting job node result: incomplete -> fail 2026-03-16 15:00:52,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:00:52,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81951113612b7716bca20 HTTP/1.1" 200 None 2026-03-16 15:00:52,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:00:52,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:00:52,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:00:52,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81951113612b7716bca20 HTTP/1.1" 200 None 2026-03-16 15:00:52,737 - lava_callback - INFO - Completed processing callback for node 69b81951113612b7716bca20 INFO: 172.20.0.1:58420 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:00:57,733 - lava_callback - INFO - Received callback for node 69b81944113612b7716bc9ec INFO: 172.20.0.1:58430 - "POST /node/69b81944113612b7716bc9ec HTTP/1.0" 202 Accepted 2026-03-16 15:00:57,741 - lava_callback - INFO - Starting async job submit for node 69b81944113612b7716bc9ec 2026-03-16 15:00:57,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:00:57,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81944113612b7716bc9ec HTTP/1.1" 200 None 2026-03-16 15:00:57,795 - lava_callback - DEBUG - Processing node 69b81944113612b7716bc9ec: baseline-arm64 2026-03-16 15:00:58,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:00:58,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:00:58,278 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81944113612b7716bc9ec/log.txt.gz 2026-03-16 15:00:58,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:00:58,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:00:58,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81944113612b7716bc9ec/lava-logs.yaml 2026-03-16 15:00:58,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:00:58,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:00:58,854 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81944113612b7716bc9ec/lava_callback.json.gz 2026-03-16 15:00:58,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:00:58,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81944113612b7716bc9ec HTTP/1.1" 200 None 2026-03-16 15:00:58,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:00:58,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:00:58,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:00:58,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81944113612b7716bc9ec HTTP/1.1" 200 None 2026-03-16 15:00:58,943 - lava_callback - INFO - Completed processing callback for node 69b81944113612b7716bc9ec 2026-03-16 15:01:02,065 - lava_callback - INFO - Received callback for node 69b81b1e113612b7716bcbab INFO: 172.20.0.1:52332 - "POST /node/69b81b1e113612b7716bcbab HTTP/1.0" 202 Accepted 2026-03-16 15:01:02,076 - lava_callback - INFO - Starting async job submit for node 69b81b1e113612b7716bcbab 2026-03-16 15:01:02,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:01:02,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81b1e113612b7716bcbab HTTP/1.1" 200 None 2026-03-16 15:01:02,129 - lava_callback - DEBUG - Processing node 69b81b1e113612b7716bcbab: baseline-nfs-arm64 2026-03-16 15:01:02,131 - lava_callback - WARNING - Failed to upload log 2026-03-16 15:01:02,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:01:02,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:01:02,296 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81b1e113612b7716bcbab/lava-logs.yaml 2026-03-16 15:01:02,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:01:02,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:01:02,452 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81b1e113612b7716bcbab/lava_callback.json.gz 2026-03-16 15:01:02,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:01:02,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81b1e113612b7716bcbab HTTP/1.1" 200 None 2026-03-16 15:01:02,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:01:02,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:01:02,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:01:02,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81b1e113612b7716bcbab HTTP/1.1" 200 None 2026-03-16 15:01:02,519 - lava_callback - INFO - Completed processing callback for node 69b81b1e113612b7716bcbab 2026-03-16 15:01:05,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:01:05,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52348 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:01:08,960 - lava_callback - INFO - Received callback for node 69b5782b1727ff69d6f25ebd INFO: 172.20.0.1:52360 - "POST /node/69b5782b1727ff69d6f25ebd HTTP/1.0" 202 Accepted 2026-03-16 15:01:08,966 - lava_callback - INFO - Starting async job submit for node 69b5782b1727ff69d6f25ebd 2026-03-16 15:01:08,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:01:08,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5782b1727ff69d6f25ebd HTTP/1.1" 200 None 2026-03-16 15:01:08,983 - lava_callback - DEBUG - Processing node 69b5782b1727ff69d6f25ebd: baseline-arm64-baylibre 2026-03-16 15:01:08,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5782b1727ff69d6f25ebd 2026-03-16 15:01:08,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:01:08,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5782b1727ff69d6f25ebd HTTP/1.1" 200 None 2026-03-16 15:01:09,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:01:09,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:01:09,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:01:09,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5782b1727ff69d6f25ebd HTTP/1.1" 200 None 2026-03-16 15:01:09,049 - lava_callback - ERROR - Error processing callback for node 69b5782b1727ff69d6f25ebd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41028 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:01:41,229 - lava_callback - INFO - Received callback for node 69b81976113612b7716bca9d INFO: 172.20.0.1:48396 - "POST /node/69b81976113612b7716bca9d HTTP/1.0" 202 Accepted 2026-03-16 15:01:41,236 - lava_callback - INFO - Starting async job submit for node 69b81976113612b7716bca9d 2026-03-16 15:01:41,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:01:41,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81976113612b7716bca9d HTTP/1.1" 200 None 2026-03-16 15:01:41,276 - lava_callback - DEBUG - Processing node 69b81976113612b7716bca9d: baseline-arm64-broonie 2026-03-16 15:01:41,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:01:41,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:01:41,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81976113612b7716bca9d/log.txt.gz 2026-03-16 15:01:41,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:01:42,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:01:42,137 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81976113612b7716bca9d/lava-logs.yaml 2026-03-16 15:01:42,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:01:42,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:01:42,294 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81976113612b7716bca9d/lava_callback.json.gz 2026-03-16 15:01:42,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:01:42,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81976113612b7716bca9d HTTP/1.1" 200 None 2026-03-16 15:01:42,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:01:42,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:01:42,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:01:42,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81976113612b7716bca9d HTTP/1.1" 200 None 2026-03-16 15:01:42,397 - lava_callback - INFO - Completed processing callback for node 69b81976113612b7716bca9d INFO: 172.20.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36032 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:02:05,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:02:05,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53666 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:02:19,462 - lava_callback - INFO - Received callback for node 69b81955113612b7716bca2b INFO: 172.20.0.1:53674 - "POST /node/69b81955113612b7716bca2b HTTP/1.0" 202 Accepted 2026-03-16 15:02:19,469 - lava_callback - INFO - Starting async job submit for node 69b81955113612b7716bca2b 2026-03-16 15:02:19,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:02:19,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81955113612b7716bca2b HTTP/1.1" 200 None 2026-03-16 15:02:19,523 - lava_callback - DEBUG - Processing node 69b81955113612b7716bca2b: baseline-nfs-arm64 2026-03-16 15:02:19,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:02:20,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:02:20,119 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81955113612b7716bca2b/log.txt.gz 2026-03-16 15:02:20,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:02:20,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:02:20,719 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81955113612b7716bca2b/lava-logs.yaml 2026-03-16 15:02:20,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:02:20,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:02:20,928 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81955113612b7716bca2b/lava_callback.json.gz 2026-03-16 15:02:20,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:02:20,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81955113612b7716bca2b HTTP/1.1" 200 None 2026-03-16 15:02:20,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:02:21,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:02:21,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:02:21,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81955113612b7716bca2b HTTP/1.1" 200 None 2026-03-16 15:02:21,038 - lava_callback - INFO - Completed processing callback for node 69b81955113612b7716bca2b INFO: 172.20.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49194 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:02:29,014 - lava_callback - INFO - Received callback for node 69b578781727ff69d6f25eca INFO: 172.20.0.1:49210 - "POST /node/69b578781727ff69d6f25eca HTTP/1.0" 202 Accepted 2026-03-16 15:02:29,019 - lava_callback - INFO - Starting async job submit for node 69b578781727ff69d6f25eca 2026-03-16 15:02:29,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:02:29,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b578781727ff69d6f25eca HTTP/1.1" 200 None 2026-03-16 15:02:29,043 - lava_callback - DEBUG - Processing node 69b578781727ff69d6f25eca: baseline-arm64-baylibre 2026-03-16 15:02:29,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b578781727ff69d6f25eca 2026-03-16 15:02:29,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:02:29,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b578781727ff69d6f25eca HTTP/1.1" 200 None 2026-03-16 15:02:29,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:02:29,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:02:29,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:02:29,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b578781727ff69d6f25eca HTTP/1.1" 200 None 2026-03-16 15:02:29,119 - lava_callback - ERROR - Error processing callback for node 69b578781727ff69d6f25eca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 15:02:35,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:02:35,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40524 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:03:39,727 - lava_callback - INFO - Received callback for node 69b81b6c113612b7716bcbca INFO: 172.20.0.1:42460 - "POST /node/69b81b6c113612b7716bcbca HTTP/1.0" 202 Accepted 2026-03-16 15:03:39,734 - lava_callback - INFO - Starting async job submit for node 69b81b6c113612b7716bcbca 2026-03-16 15:03:39,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:03:39,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81b6c113612b7716bcbca HTTP/1.1" 200 None 2026-03-16 15:03:39,787 - lava_callback - DEBUG - Processing node 69b81b6c113612b7716bcbca: baseline-arm64 2026-03-16 15:03:39,937 - lava_callback - WARNING - Failed to upload log 2026-03-16 15:03:40,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:03:40,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:03:40,179 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81b6c113612b7716bcbca/lava-logs.yaml 2026-03-16 15:03:40,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:03:40,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:03:40,308 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81b6c113612b7716bcbca/lava_callback.json.gz 2026-03-16 15:03:40,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:03:40,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81b6c113612b7716bcbca HTTP/1.1" 200 None 2026-03-16 15:03:40,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:03:40,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:03:40,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:03:40,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81b6c113612b7716bcbca HTTP/1.1" 200 None 2026-03-16 15:03:40,458 - lava_callback - INFO - Completed processing callback for node 69b81b6c113612b7716bcbca INFO: 172.20.0.1:42466 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:03:49,801 - lava_callback - INFO - Received callback for node 69b578c61727ff69d6f25ed8 INFO: 172.20.0.1:55610 - "POST /node/69b578c61727ff69d6f25ed8 HTTP/1.0" 202 Accepted 2026-03-16 15:03:49,807 - lava_callback - INFO - Starting async job submit for node 69b578c61727ff69d6f25ed8 2026-03-16 15:03:49,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:03:49,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b578c61727ff69d6f25ed8 HTTP/1.1" 200 None 2026-03-16 15:03:49,834 - lava_callback - DEBUG - Processing node 69b578c61727ff69d6f25ed8: baseline-arm64-baylibre 2026-03-16 15:03:49,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b578c61727ff69d6f25ed8 2026-03-16 15:03:49,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:03:49,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b578c61727ff69d6f25ed8 HTTP/1.1" 200 None 2026-03-16 15:03:49,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:03:49,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:03:49,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:03:49,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b578c61727ff69d6f25ed8 HTTP/1.1" 200 None 2026-03-16 15:03:49,889 - lava_callback - ERROR - Error processing callback for node 69b578c61727ff69d6f25ed8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55612 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:04:05,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:04:05,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60078 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:04:26,698 - lava_callback - INFO - Received callback for node 69b81bc3113612b7716bcbe0 INFO: 172.20.0.1:60084 - "POST /node/69b81bc3113612b7716bcbe0 HTTP/1.0" 202 Accepted 2026-03-16 15:04:26,705 - lava_callback - INFO - Starting async job submit for node 69b81bc3113612b7716bcbe0 2026-03-16 15:04:26,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:04:26,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81bc3113612b7716bcbe0 HTTP/1.1" 200 None 2026-03-16 15:04:26,757 - lava_callback - DEBUG - Processing node 69b81bc3113612b7716bcbe0: baseline-arm64 2026-03-16 15:04:26,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:04:27,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:04:27,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81bc3113612b7716bcbe0/log.txt.gz 2026-03-16 15:04:27,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:60096 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:04:27,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:04:27,276 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81bc3113612b7716bcbe0/lava-logs.yaml 2026-03-16 15:04:27,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:04:27,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:04:27,403 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81bc3113612b7716bcbe0/lava_callback.json.gz 2026-03-16 15:04:27,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:04:27,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81bc3113612b7716bcbe0 HTTP/1.1" 200 None 2026-03-16 15:04:27,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:04:27,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:04:27,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:04:27,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81bc3113612b7716bcbe0 HTTP/1.1" 200 None 2026-03-16 15:04:27,556 - lava_callback - INFO - Completed processing callback for node 69b81bc3113612b7716bcbe0 2026-03-16 15:04:35,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:04:35,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50552 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:05:09,141 - lava_callback - INFO - Received callback for node 69b579131727ff69d6f25ee0 INFO: 172.20.0.1:50556 - "POST /node/69b579131727ff69d6f25ee0 HTTP/1.0" 202 Accepted 2026-03-16 15:05:09,147 - lava_callback - INFO - Starting async job submit for node 69b579131727ff69d6f25ee0 2026-03-16 15:05:09,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:05:09,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b579131727ff69d6f25ee0 HTTP/1.1" 200 None 2026-03-16 15:05:09,163 - lava_callback - DEBUG - Processing node 69b579131727ff69d6f25ee0: baseline-arm64-baylibre 2026-03-16 15:05:09,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b579131727ff69d6f25ee0 2026-03-16 15:05:09,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:05:09,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b579131727ff69d6f25ee0 HTTP/1.1" 200 None 2026-03-16 15:05:09,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:05:09,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:05:09,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:05:09,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b579131727ff69d6f25ee0 HTTP/1.1" 200 None 2026-03-16 15:05:09,235 - lava_callback - ERROR - Error processing callback for node 69b579131727ff69d6f25ee0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49320 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:06:06,607 - lava_callback - INFO - Received callback for node 69b81c1f113612b7716bcbf1 INFO: 172.20.0.1:49322 - "POST /node/69b81c1f113612b7716bcbf1 HTTP/1.0" 202 Accepted 2026-03-16 15:06:06,613 - lava_callback - INFO - Starting async job submit for node 69b81c1f113612b7716bcbf1 2026-03-16 15:06:06,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:06:06,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81c1f113612b7716bcbf1 HTTP/1.1" 200 None 2026-03-16 15:06:06,650 - lava_callback - DEBUG - Processing node 69b81c1f113612b7716bcbf1: baseline-arm64 2026-03-16 15:06:06,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:06:07,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:06:07,114 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81c1f113612b7716bcbf1/log.txt.gz 2026-03-16 15:06:07,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:06:07,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:06:07,556 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81c1f113612b7716bcbf1/lava-logs.yaml 2026-03-16 15:06:07,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:06:07,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:06:07,717 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81c1f113612b7716bcbf1/lava_callback.json.gz 2026-03-16 15:06:07,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:06:07,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81c1f113612b7716bcbf1 HTTP/1.1" 200 None 2026-03-16 15:06:07,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:06:07,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:06:07,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:06:07,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81c1f113612b7716bcbf1 HTTP/1.1" 200 None 2026-03-16 15:06:07,802 - lava_callback - INFO - Completed processing callback for node 69b81c1f113612b7716bcbf1 INFO: 172.20.0.1:46258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52818 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:06:29,190 - lava_callback - INFO - Received callback for node 69b579611727ff69d6f25eec INFO: 172.20.0.1:52828 - "POST /node/69b579611727ff69d6f25eec HTTP/1.0" 202 Accepted 2026-03-16 15:06:29,195 - lava_callback - INFO - Starting async job submit for node 69b579611727ff69d6f25eec 2026-03-16 15:06:29,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:06:29,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b579611727ff69d6f25eec HTTP/1.1" 200 None 2026-03-16 15:06:29,211 - lava_callback - DEBUG - Processing node 69b579611727ff69d6f25eec: baseline-arm64-baylibre 2026-03-16 15:06:29,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b579611727ff69d6f25eec 2026-03-16 15:06:29,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:06:29,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b579611727ff69d6f25eec HTTP/1.1" 200 None 2026-03-16 15:06:29,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:06:29,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:06:29,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:06:29,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b579611727ff69d6f25eec HTTP/1.1" 200 None 2026-03-16 15:06:29,266 - lava_callback - ERROR - Error processing callback for node 69b579611727ff69d6f25eec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 15:06:35,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:06:35,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40970 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:06:37,711 - lava_callback - INFO - Received callback for node 69b81971113612b7716bca8e INFO: 172.20.0.1:40980 - "POST /node/69b81971113612b7716bca8e HTTP/1.0" 202 Accepted 2026-03-16 15:06:37,717 - lava_callback - INFO - Starting async job submit for node 69b81971113612b7716bca8e 2026-03-16 15:06:37,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:06:37,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81971113612b7716bca8e HTTP/1.1" 200 None 2026-03-16 15:06:37,760 - lava_callback - DEBUG - Processing node 69b81971113612b7716bca8e: baseline-arm64-broonie 2026-03-16 15:06:38,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:06:38,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:06:38,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81971113612b7716bca8e/log.txt.gz 2026-03-16 15:06:38,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:06:38,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:06:38,541 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81971113612b7716bca8e/lava-logs.yaml 2026-03-16 15:06:38,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:06:38,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:06:38,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81971113612b7716bca8e/lava_callback.json.gz 2026-03-16 15:06:38,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:06:38,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81971113612b7716bca8e HTTP/1.1" 200 None 2026-03-16 15:06:38,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:06:38,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:06:38,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:06:38,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81971113612b7716bca8e HTTP/1.1" 200 None 2026-03-16 15:06:38,772 - lava_callback - INFO - Completed processing callback for node 69b81971113612b7716bca8e INFO: 172.20.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57904 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:07:05,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:07:05,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55466 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:07:29,244 - lava_callback - INFO - Received callback for node 69b579ad1727ff69d6f25ef7 INFO: 172.20.0.1:55472 - "POST /node/69b579ad1727ff69d6f25ef7 HTTP/1.0" 202 Accepted 2026-03-16 15:07:29,249 - lava_callback - INFO - Starting async job submit for node 69b579ad1727ff69d6f25ef7 2026-03-16 15:07:29,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:07:29,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b579ad1727ff69d6f25ef7 HTTP/1.1" 200 None 2026-03-16 15:07:29,293 - lava_callback - DEBUG - Processing node 69b579ad1727ff69d6f25ef7: baseline-arm64-baylibre 2026-03-16 15:07:29,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b579ad1727ff69d6f25ef7 2026-03-16 15:07:29,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:07:29,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b579ad1727ff69d6f25ef7 HTTP/1.1" 200 None 2026-03-16 15:07:29,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:07:29,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:07:29,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:07:29,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b579ad1727ff69d6f25ef7 HTTP/1.1" 200 None 2026-03-16 15:07:29,345 - lava_callback - ERROR - Error processing callback for node 69b579ad1727ff69d6f25ef7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47648 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:08:49,334 - lava_callback - INFO - Received callback for node 69b579fc1727ff69d6f25f08 INFO: 172.20.0.1:47658 - "POST /node/69b579fc1727ff69d6f25f08 HTTP/1.0" 202 Accepted 2026-03-16 15:08:49,339 - lava_callback - INFO - Starting async job submit for node 69b579fc1727ff69d6f25f08 2026-03-16 15:08:49,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:08:49,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b579fc1727ff69d6f25f08 HTTP/1.1" 200 None 2026-03-16 15:08:49,356 - lava_callback - DEBUG - Processing node 69b579fc1727ff69d6f25f08: baseline-arm64-baylibre 2026-03-16 15:08:49,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b579fc1727ff69d6f25f08 2026-03-16 15:08:49,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:08:49,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b579fc1727ff69d6f25f08 HTTP/1.1" 200 None 2026-03-16 15:08:49,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:08:49,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:08:49,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:08:49,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b579fc1727ff69d6f25f08 HTTP/1.1" 200 None 2026-03-16 15:08:49,445 - lava_callback - ERROR - Error processing callback for node 69b579fc1727ff69d6f25f08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52422 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:09:42,625 - lava_callback - INFO - Received callback for node 69b81d24113612b7716bcc24 INFO: 172.20.0.1:38598 - "POST /node/69b81d24113612b7716bcc24 HTTP/1.0" 202 Accepted 2026-03-16 15:09:42,631 - lava_callback - INFO - Starting async job submit for node 69b81d24113612b7716bcc24 2026-03-16 15:09:42,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:09:42,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81d24113612b7716bcc24 HTTP/1.1" 200 None 2026-03-16 15:09:42,655 - lava_callback - DEBUG - Processing node 69b81d24113612b7716bcc24: baseline-nfs-arm64 2026-03-16 15:09:42,657 - lava_callback - WARNING - Failed to upload log 2026-03-16 15:09:42,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:09:42,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:09:42,791 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81d24113612b7716bcc24/lava-logs.yaml 2026-03-16 15:09:42,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:09:42,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:09:42,948 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81d24113612b7716bcc24/lava_callback.json.gz 2026-03-16 15:09:42,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:09:42,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81d24113612b7716bcc24 HTTP/1.1" 200 None 2026-03-16 15:09:42,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:09:43,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:09:43,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:09:43,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81d24113612b7716bcc24 HTTP/1.1" 200 None 2026-03-16 15:09:43,042 - lava_callback - INFO - Completed processing callback for node 69b81d24113612b7716bcc24 INFO: 172.20.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40346 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:10:05,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:10:05,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53078 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:10:09,522 - lava_callback - INFO - Received callback for node 69b57a461727ff69d6f25f13 INFO: 172.20.0.1:53088 - "POST /node/69b57a461727ff69d6f25f13 HTTP/1.0" 202 Accepted 2026-03-16 15:10:09,527 - lava_callback - INFO - Starting async job submit for node 69b57a461727ff69d6f25f13 2026-03-16 15:10:09,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:10:09,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57a461727ff69d6f25f13 HTTP/1.1" 200 None 2026-03-16 15:10:09,569 - lava_callback - DEBUG - Processing node 69b57a461727ff69d6f25f13: baseline-arm64-baylibre 2026-03-16 15:10:09,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57a461727ff69d6f25f13 2026-03-16 15:10:09,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:10:09,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57a461727ff69d6f25f13 HTTP/1.1" 200 None 2026-03-16 15:10:09,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:10:09,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:10:09,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:10:09,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57a461727ff69d6f25f13 HTTP/1.1" 200 None 2026-03-16 15:10:09,670 - lava_callback - ERROR - Error processing callback for node 69b57a461727ff69d6f25f13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37932 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:11:29,475 - lava_callback - INFO - Received callback for node 69b57a931727ff69d6f25f22 INFO: 172.20.0.1:37946 - "POST /node/69b57a931727ff69d6f25f22 HTTP/1.0" 202 Accepted 2026-03-16 15:11:29,480 - lava_callback - INFO - Starting async job submit for node 69b57a931727ff69d6f25f22 2026-03-16 15:11:29,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:11:29,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57a931727ff69d6f25f22 HTTP/1.1" 200 None 2026-03-16 15:11:29,496 - lava_callback - DEBUG - Processing node 69b57a931727ff69d6f25f22: baseline-arm64-baylibre 2026-03-16 15:11:29,497 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57a931727ff69d6f25f22 2026-03-16 15:11:29,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:11:29,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57a931727ff69d6f25f22 HTTP/1.1" 200 None 2026-03-16 15:11:29,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:11:29,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:11:29,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:11:29,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57a931727ff69d6f25f22 HTTP/1.1" 200 None 2026-03-16 15:11:29,558 - lava_callback - ERROR - Error processing callback for node 69b57a931727ff69d6f25f22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52534 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:11:37,733 - lava_callback - INFO - Received callback for node 69b81d70113612b7716bcc2f INFO: 172.20.0.1:52540 - "POST /node/69b81d70113612b7716bcc2f HTTP/1.0" 202 Accepted 2026-03-16 15:11:37,740 - lava_callback - INFO - Starting async job submit for node 69b81d70113612b7716bcc2f 2026-03-16 15:11:37,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:11:37,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81d70113612b7716bcc2f HTTP/1.1" 200 None 2026-03-16 15:11:37,783 - lava_callback - DEBUG - Processing node 69b81d70113612b7716bcc2f: baseline-arm64 2026-03-16 15:11:37,915 - lava_callback - WARNING - Failed to upload log 2026-03-16 15:11:37,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:11:38,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:11:38,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81d70113612b7716bcc2f/lava-logs.yaml 2026-03-16 15:11:38,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:11:38,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:11:38,359 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81d70113612b7716bcc2f/lava_callback.json.gz 2026-03-16 15:11:38,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:11:38,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81d70113612b7716bcc2f HTTP/1.1" 200 None 2026-03-16 15:11:38,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:11:38,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:11:38,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:11:38,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81d70113612b7716bcc2f HTTP/1.1" 200 None 2026-03-16 15:11:38,523 - lava_callback - INFO - Completed processing callback for node 69b81d70113612b7716bcc2f INFO: 172.20.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35334 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:12:05,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:12:05,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43820 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:12:47,976 - lava_callback - INFO - Received callback for node 69b57ae71727ff69d6f25f35 INFO: 172.20.0.1:43828 - "POST /node/69b57ae71727ff69d6f25f35 HTTP/1.0" 202 Accepted 2026-03-16 15:12:47,982 - lava_callback - INFO - Starting async job submit for node 69b57ae71727ff69d6f25f35 2026-03-16 15:12:47,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:12:47,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57ae71727ff69d6f25f35 HTTP/1.1" 200 None 2026-03-16 15:12:47,998 - lava_callback - DEBUG - Processing node 69b57ae71727ff69d6f25f35: baseline-arm64-clabbe 2026-03-16 15:12:47,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57ae71727ff69d6f25f35 2026-03-16 15:12:47,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:12:48,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57ae71727ff69d6f25f35 HTTP/1.1" 200 None 2026-03-16 15:12:48,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:12:48,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:12:48,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:12:48,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57ae71727ff69d6f25f35 HTTP/1.1" 200 None 2026-03-16 15:12:48,084 - lava_callback - ERROR - Error processing callback for node 69b57ae71727ff69d6f25f35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43492 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:13:14,038 - lava_callback - INFO - Received callback for node 69b81dc2113612b7716bcc3b INFO: 172.20.0.1:37560 - "POST /node/69b81dc2113612b7716bcc3b HTTP/1.0" 202 Accepted 2026-03-16 15:13:14,045 - lava_callback - INFO - Starting async job submit for node 69b81dc2113612b7716bcc3b 2026-03-16 15:13:14,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:13:14,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81dc2113612b7716bcc3b HTTP/1.1" 200 None 2026-03-16 15:13:14,108 - lava_callback - DEBUG - Processing node 69b81dc2113612b7716bcc3b: baseline-arm64 2026-03-16 15:13:14,305 - lava_callback - WARNING - Failed to upload log 2026-03-16 15:13:14,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:13:14,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:13:14,634 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81dc2113612b7716bcc3b/lava-logs.yaml 2026-03-16 15:13:14,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:13:14,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:13:14,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81dc2113612b7716bcc3b/lava_callback.json.gz 2026-03-16 15:13:14,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:13:14,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81dc2113612b7716bcc3b HTTP/1.1" 200 None 2026-03-16 15:13:14,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:13:14,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:13:14,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:13:14,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81dc2113612b7716bcc3b HTTP/1.1" 200 None 2026-03-16 15:13:15,020 - lava_callback - INFO - Completed processing callback for node 69b81dc2113612b7716bcc3b INFO: 172.20.0.1:37570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49938 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:13:34,963 - lava_callback - INFO - Received callback for node 69b8194a113612b7716bca11 INFO: 172.20.0.1:45672 - "POST /node/69b8194a113612b7716bca11 HTTP/1.0" 202 Accepted 2026-03-16 15:13:34,969 - lava_callback - INFO - Starting async job submit for node 69b8194a113612b7716bca11 2026-03-16 15:13:34,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:13:35,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8194a113612b7716bca11 HTTP/1.1" 200 None 2026-03-16 15:13:35,006 - lava_callback - DEBUG - Processing node 69b8194a113612b7716bca11: baseline-arm64 2026-03-16 15:13:35,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:13:35,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:13:35,373 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194a113612b7716bca11/log.txt.gz 2026-03-16 15:13:35,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:13:35,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:13:35,724 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194a113612b7716bca11/lava-logs.yaml 2026-03-16 15:13:35,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:13:35,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:13:35,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:13:35,891 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194a113612b7716bca11/lava_callback.json.gz 2026-03-16 15:13:35,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:13:35,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 15:13:35,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8194a113612b7716bca11 HTTP/1.1" 200 None 2026-03-16 15:13:35,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:13:35,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:13:35,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:13:35,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8194a113612b7716bca11 HTTP/1.1" 200 None 2026-03-16 15:13:35,975 - lava_callback - INFO - Completed processing callback for node 69b8194a113612b7716bca11 INFO: 172.20.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59336 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:14:01,742 - lava_callback - INFO - Received callback for node 69b8194d113612b7716bca17 INFO: 172.20.0.1:59846 - "POST /node/69b8194d113612b7716bca17 HTTP/1.0" 202 Accepted 2026-03-16 15:14:01,748 - lava_callback - INFO - Starting async job submit for node 69b8194d113612b7716bca17 2026-03-16 15:14:01,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:01,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8194d113612b7716bca17 HTTP/1.1" 200 None 2026-03-16 15:14:01,784 - lava_callback - DEBUG - Processing node 69b8194d113612b7716bca17: baseline-arm64 2026-03-16 15:14:02,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:14:02,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:14:02,196 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194d113612b7716bca17/log.txt.gz 2026-03-16 15:14:02,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:14:02,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:14:02,601 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194d113612b7716bca17/lava-logs.yaml 2026-03-16 15:14:02,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:14:02,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:14:02,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194d113612b7716bca17/lava_callback.json.gz 2026-03-16 15:14:02,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:02,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8194d113612b7716bca17 HTTP/1.1" 200 None 2026-03-16 15:14:02,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:02,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:14:02,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:02,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8194d113612b7716bca17 HTTP/1.1" 200 None 2026-03-16 15:14:02,921 - lava_callback - INFO - Completed processing callback for node 69b8194d113612b7716bca17 2026-03-16 15:14:05,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:05,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59852 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:14:07,976 - lava_callback - INFO - Received callback for node 69b57b351727ff69d6f25f3d INFO: 172.20.0.1:59856 - "POST /node/69b57b351727ff69d6f25f3d HTTP/1.0" 202 Accepted 2026-03-16 15:14:07,981 - lava_callback - INFO - Starting async job submit for node 69b57b351727ff69d6f25f3d 2026-03-16 15:14:07,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:08,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57b351727ff69d6f25f3d HTTP/1.1" 200 None 2026-03-16 15:14:08,005 - lava_callback - DEBUG - Processing node 69b57b351727ff69d6f25f3d: baseline-arm64-clabbe 2026-03-16 15:14:08,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57b351727ff69d6f25f3d 2026-03-16 15:14:08,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:08,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57b351727ff69d6f25f3d HTTP/1.1" 200 None 2026-03-16 15:14:08,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:08,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:14:08,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:08,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57b351727ff69d6f25f3d HTTP/1.1" 200 None 2026-03-16 15:14:08,078 - lava_callback - ERROR - Error processing callback for node 69b57b351727ff69d6f25f3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48798 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:14:28,229 - lava_callback - INFO - Received callback for node 69b81cc5113612b7716bcc14 INFO: 172.20.0.1:48802 - "POST /node/69b81cc5113612b7716bcc14 HTTP/1.0" 202 Accepted 2026-03-16 15:14:28,236 - lava_callback - INFO - Starting async job submit for node 69b81cc5113612b7716bcc14 2026-03-16 15:14:28,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:28,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81cc5113612b7716bcc14 HTTP/1.1" 200 None 2026-03-16 15:14:28,287 - lava_callback - DEBUG - Processing node 69b81cc5113612b7716bcc14: baseline-arm64 2026-03-16 15:14:28,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:14:28,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:14:28,826 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81cc5113612b7716bcc14/log.txt.gz 2026-03-16 15:14:29,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:14:29,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:14:29,256 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81cc5113612b7716bcc14/lava-logs.yaml 2026-03-16 15:14:29,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:14:29,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:14:29,416 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81cc5113612b7716bcc14/lava_callback.json.gz DEBUG: Setup failed for 69b81cc5113612b7716bcc14. Transitting job node result: incomplete -> fail 2026-03-16 15:14:29,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:29,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81cc5113612b7716bcc14 HTTP/1.1" 200 None 2026-03-16 15:14:29,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:29,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:14:29,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:29,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81cc5113612b7716bcc14 HTTP/1.1" 200 None 2026-03-16 15:14:29,644 - lava_callback - INFO - Completed processing callback for node 69b81cc5113612b7716bcc14 2026-03-16 15:14:33,688 - lava_callback - INFO - Received callback for node 69b81980113612b7716bcab9 INFO: 172.20.0.1:51292 - "POST /node/69b81980113612b7716bcab9 HTTP/1.0" 202 Accepted 2026-03-16 15:14:33,695 - lava_callback - INFO - Starting async job submit for node 69b81980113612b7716bcab9 2026-03-16 15:14:33,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:33,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81980113612b7716bcab9 HTTP/1.1" 200 None 2026-03-16 15:14:33,764 - lava_callback - DEBUG - Processing node 69b81980113612b7716bcab9: baseline-arm64-clabbe 2026-03-16 15:14:34,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:14:34,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:14:34,478 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b81980113612b7716bcab9/log.txt.gz 2026-03-16 15:14:34,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:14:35,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:14:35,069 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b81980113612b7716bcab9/lava-logs.yaml 2026-03-16 15:14:35,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:14:35,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:14:35,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b81980113612b7716bcab9/lava_callback.json.gz DEBUG: Setup failed for 69b81980113612b7716bcab9. Transitting job node result: incomplete -> fail 2026-03-16 15:14:35,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:35,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81980113612b7716bcab9 HTTP/1.1" 200 None 2026-03-16 15:14:35,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:35,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:14:35,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:35,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81980113612b7716bcab9 HTTP/1.1" 200 None 2026-03-16 15:14:35,453 - lava_callback - INFO - Completed processing callback for node 69b81980113612b7716bcab9 2026-03-16 15:14:35,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:14:35,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50518 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:15:09,687 - lava_callback - INFO - Received callback for node 69b57b7b1727ff69d6f25f4f INFO: 172.20.0.1:50522 - "POST /node/69b57b7b1727ff69d6f25f4f HTTP/1.0" 202 Accepted 2026-03-16 15:15:09,693 - lava_callback - INFO - Starting async job submit for node 69b57b7b1727ff69d6f25f4f 2026-03-16 15:15:09,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:09,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57b7b1727ff69d6f25f4f HTTP/1.1" 200 None 2026-03-16 15:15:09,709 - lava_callback - DEBUG - Processing node 69b57b7b1727ff69d6f25f4f: baseline-arm64-baylibre 2026-03-16 15:15:09,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57b7b1727ff69d6f25f4f 2026-03-16 15:15:09,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:09,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57b7b1727ff69d6f25f4f HTTP/1.1" 200 None 2026-03-16 15:15:09,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:09,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:15:09,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:09,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57b7b1727ff69d6f25f4f HTTP/1.1" 200 None 2026-03-16 15:15:09,764 - lava_callback - ERROR - Error processing callback for node 69b57b7b1727ff69d6f25f4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49610 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 15:15:15,583 - lava_callback - INFO - Received callback for node 69b8195e113612b7716bca40 INFO: 172.20.0.1:49620 - "POST /node/69b8195e113612b7716bca40 HTTP/1.0" 202 Accepted 2026-03-16 15:15:15,589 - lava_callback - INFO - Starting async job submit for node 69b8195e113612b7716bca40 2026-03-16 15:15:15,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:15,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8195e113612b7716bca40 HTTP/1.1" 200 None 2026-03-16 15:15:15,628 - lava_callback - DEBUG - Processing node 69b8195e113612b7716bca40: baseline-nfs-arm64 2026-03-16 15:15:15,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:15:16,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:15:16,134 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195e113612b7716bca40/log.txt.gz 2026-03-16 15:15:16,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:49634 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:15:16,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:15:16,554 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195e113612b7716bca40/lava-logs.yaml 2026-03-16 15:15:16,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:15:16,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:15:16,729 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195e113612b7716bca40/lava_callback.json.gz 2026-03-16 15:15:16,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:16,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8195e113612b7716bca40 HTTP/1.1" 200 None 2026-03-16 15:15:16,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:16,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:15:16,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:16,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8195e113612b7716bca40 HTTP/1.1" 200 None 2026-03-16 15:15:16,822 - lava_callback - INFO - Completed processing callback for node 69b8195e113612b7716bca40 2026-03-16 15:15:21,827 - lava_callback - INFO - Received callback for node 69b81e6c113612b7716bcc70 INFO: 172.20.0.1:45808 - "POST /node/69b81e6c113612b7716bcc70 HTTP/1.0" 202 Accepted 2026-03-16 15:15:21,834 - lava_callback - INFO - Starting async job submit for node 69b81e6c113612b7716bcc70 2026-03-16 15:15:21,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:21,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81e6c113612b7716bcc70 HTTP/1.1" 200 None 2026-03-16 15:15:21,851 - lava_callback - DEBUG - Processing node 69b81e6c113612b7716bcc70: baseline-nfs-arm64 2026-03-16 15:15:21,853 - lava_callback - WARNING - Failed to upload log 2026-03-16 15:15:21,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:15:21,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:15:21,999 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81e6c113612b7716bcc70/lava-logs.yaml 2026-03-16 15:15:22,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:15:22,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:15:22,124 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81e6c113612b7716bcc70/lava_callback.json.gz 2026-03-16 15:15:22,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:22,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81e6c113612b7716bcc70 HTTP/1.1" 200 None 2026-03-16 15:15:22,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:22,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:15:22,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:22,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81e6c113612b7716bcc70 HTTP/1.1" 200 None 2026-03-16 15:15:22,216 - lava_callback - INFO - Completed processing callback for node 69b81e6c113612b7716bcc70 2026-03-16 15:15:24,303 - lava_callback - INFO - Received callback for node 69b8195b113612b7716bca3a INFO: 172.20.0.1:45816 - "POST /node/69b8195b113612b7716bca3a HTTP/1.0" 202 Accepted 2026-03-16 15:15:24,310 - lava_callback - INFO - Starting async job submit for node 69b8195b113612b7716bca3a 2026-03-16 15:15:24,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:24,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8195b113612b7716bca3a HTTP/1.1" 200 None 2026-03-16 15:15:24,348 - lava_callback - DEBUG - Processing node 69b8195b113612b7716bca3a: baseline-nfs-arm64 2026-03-16 15:15:24,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:15:24,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:15:24,849 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195b113612b7716bca3a/log.txt.gz 2026-03-16 15:15:25,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:15:25,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:15:25,234 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195b113612b7716bca3a/lava-logs.yaml 2026-03-16 15:15:25,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:15:25,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:15:25,376 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195b113612b7716bca3a/lava_callback.json.gz 2026-03-16 15:15:25,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:25,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8195b113612b7716bca3a HTTP/1.1" 200 None 2026-03-16 15:15:25,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:25,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:15:25,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:25,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8195b113612b7716bca3a HTTP/1.1" 200 None 2026-03-16 15:15:25,462 - lava_callback - INFO - Completed processing callback for node 69b8195b113612b7716bca3a INFO: 172.20.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45846 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:15:35,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:15:35,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53450 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:16:12,493 - lava_callback - INFO - Received callback for node 69b8193e113612b7716bc9e0 INFO: 172.20.0.1:41910 - "POST /node/69b8193e113612b7716bc9e0 HTTP/1.0" 202 Accepted 2026-03-16 15:16:12,499 - lava_callback - INFO - Starting async job submit for node 69b8193e113612b7716bc9e0 2026-03-16 15:16:12,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:16:12,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8193e113612b7716bc9e0 HTTP/1.1" 200 None 2026-03-16 15:16:12,536 - lava_callback - DEBUG - Processing node 69b8193e113612b7716bc9e0: baseline-arm64 2026-03-16 15:16:12,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:16:12,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:16:12,953 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8193e113612b7716bc9e0/log.txt.gz 2026-03-16 15:16:13,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:16:13,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:16:13,286 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8193e113612b7716bc9e0/lava-logs.yaml 2026-03-16 15:16:13,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:16:13,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:16:13,444 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8193e113612b7716bc9e0/lava_callback.json.gz 2026-03-16 15:16:13,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:16:13,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8193e113612b7716bc9e0 HTTP/1.1" 200 None 2026-03-16 15:16:13,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:16:13,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:16:13,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:16:13,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8193e113612b7716bc9e0 HTTP/1.1" 200 None 2026-03-16 15:16:13,558 - lava_callback - INFO - Completed processing callback for node 69b8193e113612b7716bc9e0 INFO: 172.20.0.1:41920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40848 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:16:35,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:16:35,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47458 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:16:48,234 - lava_callback - INFO - Received callback for node 69b57bcf1727ff69d6f25f5a INFO: 172.20.0.1:47470 - "POST /node/69b57bcf1727ff69d6f25f5a HTTP/1.0" 202 Accepted 2026-03-16 15:16:48,239 - lava_callback - INFO - Starting async job submit for node 69b57bcf1727ff69d6f25f5a 2026-03-16 15:16:48,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:16:48,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57bcf1727ff69d6f25f5a HTTP/1.1" 200 None 2026-03-16 15:16:48,258 - lava_callback - DEBUG - Processing node 69b57bcf1727ff69d6f25f5a: baseline-arm64-clabbe 2026-03-16 15:16:48,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57bcf1727ff69d6f25f5a 2026-03-16 15:16:48,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:16:48,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57bcf1727ff69d6f25f5a HTTP/1.1" 200 None 2026-03-16 15:16:48,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:16:48,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:16:48,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:16:48,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57bcf1727ff69d6f25f5a HTTP/1.1" 200 None 2026-03-16 15:16:48,321 - lava_callback - ERROR - Error processing callback for node 69b57bcf1727ff69d6f25f5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56626 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:17:07,752 - lava_callback - INFO - Received callback for node 69b81eb5113612b7716bcc8c INFO: 172.20.0.1:56630 - "POST /node/69b81eb5113612b7716bcc8c HTTP/1.0" 202 Accepted 2026-03-16 15:17:07,759 - lava_callback - INFO - Starting async job submit for node 69b81eb5113612b7716bcc8c 2026-03-16 15:17:07,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:17:07,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81eb5113612b7716bcc8c HTTP/1.1" 200 None 2026-03-16 15:17:07,812 - lava_callback - DEBUG - Processing node 69b81eb5113612b7716bcc8c: baseline-arm64 2026-03-16 15:17:07,944 - lava_callback - WARNING - Failed to upload log 2026-03-16 15:17:08,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:17:08,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:17:08,182 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81eb5113612b7716bcc8c/lava-logs.yaml 2026-03-16 15:17:08,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:17:08,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:17:08,332 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81eb5113612b7716bcc8c/lava_callback.json.gz 2026-03-16 15:17:08,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:17:08,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81eb5113612b7716bcc8c HTTP/1.1" 200 None 2026-03-16 15:17:08,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:17:08,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:17:08,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:17:08,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81eb5113612b7716bcc8c HTTP/1.1" 200 None 2026-03-16 15:17:08,491 - lava_callback - INFO - Completed processing callback for node 69b81eb5113612b7716bcc8c INFO: 172.20.0.1:49768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59060 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:17:35,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:17:36,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50556 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:17:49,833 - lava_callback - INFO - Received callback for node 69b57c171727ff69d6f25f6c INFO: 172.20.0.1:42274 - "POST /node/69b57c171727ff69d6f25f6c HTTP/1.0" 202 Accepted 2026-03-16 15:17:49,839 - lava_callback - INFO - Starting async job submit for node 69b57c171727ff69d6f25f6c 2026-03-16 15:17:49,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:17:49,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57c171727ff69d6f25f6c HTTP/1.1" 200 None 2026-03-16 15:17:49,855 - lava_callback - DEBUG - Processing node 69b57c171727ff69d6f25f6c: baseline-arm64-baylibre 2026-03-16 15:17:49,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57c171727ff69d6f25f6c 2026-03-16 15:17:49,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:17:49,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57c171727ff69d6f25f6c HTTP/1.1" 200 None 2026-03-16 15:17:49,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:17:49,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:17:49,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:17:49,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57c171727ff69d6f25f6c HTTP/1.1" 200 None 2026-03-16 15:17:49,944 - lava_callback - ERROR - Error processing callback for node 69b57c171727ff69d6f25f6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42288 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:17:58,725 - lava_callback - INFO - Received callback for node 69b81952113612b7716bca23 INFO: 172.20.0.1:42302 - "POST /node/69b81952113612b7716bca23 HTTP/1.0" 202 Accepted 2026-03-16 15:17:58,731 - lava_callback - INFO - Starting async job submit for node 69b81952113612b7716bca23 2026-03-16 15:17:58,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:17:58,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81952113612b7716bca23 HTTP/1.1" 200 None 2026-03-16 15:17:58,777 - lava_callback - DEBUG - Processing node 69b81952113612b7716bca23: baseline-nfs-arm64 2026-03-16 15:17:59,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:17:59,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:17:59,250 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81952113612b7716bca23/log.txt.gz 2026-03-16 15:17:59,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:17:59,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:17:59,676 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81952113612b7716bca23/lava-logs.yaml 2026-03-16 15:17:59,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:17:59,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:17:59,868 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81952113612b7716bca23/lava_callback.json.gz 2026-03-16 15:17:59,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:17:59,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81952113612b7716bca23 HTTP/1.1" 200 None 2026-03-16 15:17:59,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:17:59,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:17:59,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:17:59,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81952113612b7716bca23 HTTP/1.1" 200 None 2026-03-16 15:17:59,957 - lava_callback - INFO - Completed processing callback for node 69b81952113612b7716bca23 2026-03-16 15:18:06,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:18:06,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50812 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:18:18,279 - lava_callback - INFO - Received callback for node 69b81f08113612b7716bcca3 INFO: 172.20.0.1:50818 - "POST /node/69b81f08113612b7716bcca3 HTTP/1.0" 202 Accepted 2026-03-16 15:18:18,286 - lava_callback - INFO - Starting async job submit for node 69b81f08113612b7716bcca3 2026-03-16 15:18:18,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:18:18,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81f08113612b7716bcca3 HTTP/1.1" 200 None 2026-03-16 15:18:18,336 - lava_callback - DEBUG - Processing node 69b81f08113612b7716bcca3: baseline-arm64 2026-03-16 15:18:18,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:18:18,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:18:18,591 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81f08113612b7716bcca3/log.txt.gz 2026-03-16 15:18:18,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:18:18,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:18:18,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81f08113612b7716bcca3/lava-logs.yaml 2026-03-16 15:18:18,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:18:18,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:18:18,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81f08113612b7716bcca3/lava_callback.json.gz 2026-03-16 15:18:19,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:18:19,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81f08113612b7716bcca3 HTTP/1.1" 200 None 2026-03-16 15:18:19,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:18:19,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:18:19,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:18:19,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81f08113612b7716bcca3 HTTP/1.1" 200 None 2026-03-16 15:18:19,142 - lava_callback - INFO - Completed processing callback for node 69b81f08113612b7716bcca3 INFO: 172.20.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39100 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:18:36,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:18:36,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50618 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:19:10,182 - lava_callback - INFO - Received callback for node 69b57c631727ff69d6f25f78 INFO: 172.20.0.1:60400 - "POST /node/69b57c631727ff69d6f25f78 HTTP/1.0" 202 Accepted 2026-03-16 15:19:10,188 - lava_callback - INFO - Starting async job submit for node 69b57c631727ff69d6f25f78 2026-03-16 15:19:10,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:19:10,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57c631727ff69d6f25f78 HTTP/1.1" 200 None 2026-03-16 15:19:10,204 - lava_callback - DEBUG - Processing node 69b57c631727ff69d6f25f78: baseline-arm64-baylibre 2026-03-16 15:19:10,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57c631727ff69d6f25f78 2026-03-16 15:19:10,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:19:10,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57c631727ff69d6f25f78 HTTP/1.1" 200 None 2026-03-16 15:19:10,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:19:10,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:19:10,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:19:10,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57c631727ff69d6f25f78 HTTP/1.1" 200 None 2026-03-16 15:19:10,261 - lava_callback - ERROR - Error processing callback for node 69b57c631727ff69d6f25f78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52074 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:20:28,381 - lava_callback - INFO - Received callback for node 69b57cb71727ff69d6f25f8b INFO: 172.20.0.1:52088 - "POST /node/69b57cb71727ff69d6f25f8b HTTP/1.0" 202 Accepted 2026-03-16 15:20:28,386 - lava_callback - INFO - Starting async job submit for node 69b57cb71727ff69d6f25f8b 2026-03-16 15:20:28,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:20:28,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57cb71727ff69d6f25f8b HTTP/1.1" 200 None 2026-03-16 15:20:28,410 - lava_callback - DEBUG - Processing node 69b57cb71727ff69d6f25f8b: baseline-arm64-clabbe 2026-03-16 15:20:28,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57cb71727ff69d6f25f8b 2026-03-16 15:20:28,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:20:28,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57cb71727ff69d6f25f8b HTTP/1.1" 200 None 2026-03-16 15:20:28,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:20:28,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:20:28,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:20:28,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57cb71727ff69d6f25f8b HTTP/1.1" 200 None 2026-03-16 15:20:28,479 - lava_callback - ERROR - Error processing callback for node 69b57cb71727ff69d6f25f8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42360 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:21:50,344 - lava_callback - INFO - Received callback for node 69b57d001727ff69d6f25f9c INFO: 172.20.0.1:35708 - "POST /node/69b57d001727ff69d6f25f9c HTTP/1.0" 202 Accepted 2026-03-16 15:21:50,350 - lava_callback - INFO - Starting async job submit for node 69b57d001727ff69d6f25f9c 2026-03-16 15:21:50,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:21:50,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57d001727ff69d6f25f9c HTTP/1.1" 200 None 2026-03-16 15:21:50,368 - lava_callback - DEBUG - Processing node 69b57d001727ff69d6f25f9c: baseline-arm64-baylibre 2026-03-16 15:21:50,368 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57d001727ff69d6f25f9c 2026-03-16 15:21:50,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:21:50,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57d001727ff69d6f25f9c HTTP/1.1" 200 None 2026-03-16 15:21:50,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:21:50,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:21:50,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:21:50,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57d001727ff69d6f25f9c HTTP/1.1" 200 None 2026-03-16 15:21:50,426 - lava_callback - ERROR - Error processing callback for node 69b57d001727ff69d6f25f9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54898 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:23:08,456 - lava_callback - INFO - Received callback for node 69b57d531727ff69d6f25fa6 INFO: 172.20.0.1:54910 - "POST /node/69b57d531727ff69d6f25fa6 HTTP/1.0" 202 Accepted 2026-03-16 15:23:08,462 - lava_callback - INFO - Starting async job submit for node 69b57d531727ff69d6f25fa6 2026-03-16 15:23:08,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:23:08,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57d531727ff69d6f25fa6 HTTP/1.1" 200 None 2026-03-16 15:23:08,478 - lava_callback - DEBUG - Processing node 69b57d531727ff69d6f25fa6: baseline-arm64-clabbe 2026-03-16 15:23:08,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57d531727ff69d6f25fa6 2026-03-16 15:23:08,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:23:08,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57d531727ff69d6f25fa6 HTTP/1.1" 200 None 2026-03-16 15:23:08,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:23:08,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:23:08,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:23:08,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57d531727ff69d6f25fa6 HTTP/1.1" 200 None 2026-03-16 15:23:08,544 - lava_callback - ERROR - Error processing callback for node 69b57d531727ff69d6f25fa6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47454 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:24:28,525 - lava_callback - INFO - Received callback for node 69b57da01727ff69d6f25fba INFO: 172.20.0.1:47462 - "POST /node/69b57da01727ff69d6f25fba HTTP/1.0" 202 Accepted 2026-03-16 15:24:28,530 - lava_callback - INFO - Starting async job submit for node 69b57da01727ff69d6f25fba 2026-03-16 15:24:28,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:24:28,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57da01727ff69d6f25fba HTTP/1.1" 200 None 2026-03-16 15:24:28,559 - lava_callback - DEBUG - Processing node 69b57da01727ff69d6f25fba: baseline-arm64-clabbe 2026-03-16 15:24:28,559 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57da01727ff69d6f25fba 2026-03-16 15:24:28,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:24:28,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57da01727ff69d6f25fba HTTP/1.1" 200 None 2026-03-16 15:24:28,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:24:28,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:24:28,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:24:28,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57da01727ff69d6f25fba HTTP/1.1" 200 None 2026-03-16 15:24:28,635 - lava_callback - ERROR - Error processing callback for node 69b57da01727ff69d6f25fba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53580 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:25:48,550 - lava_callback - INFO - Received callback for node 69b57dee1727ff69d6f25fcb INFO: 172.20.0.1:53594 - "POST /node/69b57dee1727ff69d6f25fcb HTTP/1.0" 202 Accepted 2026-03-16 15:25:48,557 - lava_callback - INFO - Starting async job submit for node 69b57dee1727ff69d6f25fcb 2026-03-16 15:25:48,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:25:48,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57dee1727ff69d6f25fcb HTTP/1.1" 200 None 2026-03-16 15:25:48,572 - lava_callback - DEBUG - Processing node 69b57dee1727ff69d6f25fcb: baseline-arm64-clabbe 2026-03-16 15:25:48,573 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57dee1727ff69d6f25fcb 2026-03-16 15:25:48,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:25:48,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57dee1727ff69d6f25fcb HTTP/1.1" 200 None 2026-03-16 15:25:48,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:25:48,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:25:48,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:25:48,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57dee1727ff69d6f25fcb HTTP/1.1" 200 None 2026-03-16 15:25:48,631 - lava_callback - ERROR - Error processing callback for node 69b57dee1727ff69d6f25fcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40328 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:26:38,995 - lava_callback - INFO - Received callback for node 69b81f5f113612b7716bccb8 INFO: 172.20.0.1:40340 - "POST /node/69b81f5f113612b7716bccb8 HTTP/1.0" 202 Accepted 2026-03-16 15:26:39,003 - lava_callback - INFO - Starting async job submit for node 69b81f5f113612b7716bccb8 2026-03-16 15:26:39,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:26:39,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81f5f113612b7716bccb8 HTTP/1.1" 200 None 2026-03-16 15:26:39,058 - lava_callback - DEBUG - Processing node 69b81f5f113612b7716bccb8: baseline-arm64 2026-03-16 15:26:39,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:26:39,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:26:39,800 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81f5f113612b7716bccb8/log.txt.gz 2026-03-16 15:26:40,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:26:40,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:26:40,431 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81f5f113612b7716bccb8/lava-logs.yaml 2026-03-16 15:26:40,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:26:40,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:26:40,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81f5f113612b7716bccb8/lava_callback.json.gz DEBUG: Setup failed for 69b81f5f113612b7716bccb8. Transitting job node result: incomplete -> fail 2026-03-16 15:26:40,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:26:40,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81f5f113612b7716bccb8 HTTP/1.1" 200 None 2026-03-16 15:26:40,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:26:40,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:26:40,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:26:40,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81f5f113612b7716bccb8 HTTP/1.1" 200 None 2026-03-16 15:26:40,950 - lava_callback - INFO - Completed processing callback for node 69b81f5f113612b7716bccb8 INFO: 172.20.0.1:42624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35758 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:27:06,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:27:06,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40060 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:27:08,610 - lava_callback - INFO - Received callback for node 69b57e3c1727ff69d6f25fd4 INFO: 172.20.0.1:40072 - "POST /node/69b57e3c1727ff69d6f25fd4 HTTP/1.0" 202 Accepted 2026-03-16 15:27:08,617 - lava_callback - INFO - Starting async job submit for node 69b57e3c1727ff69d6f25fd4 2026-03-16 15:27:08,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:27:08,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57e3c1727ff69d6f25fd4 HTTP/1.1" 200 None 2026-03-16 15:27:08,640 - lava_callback - DEBUG - Processing node 69b57e3c1727ff69d6f25fd4: baseline-arm64-clabbe 2026-03-16 15:27:08,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57e3c1727ff69d6f25fd4 2026-03-16 15:27:08,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:27:08,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57e3c1727ff69d6f25fd4 HTTP/1.1" 200 None 2026-03-16 15:27:08,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:27:08,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:27:08,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:27:08,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57e3c1727ff69d6f25fd4 HTTP/1.1" 200 None 2026-03-16 15:27:08,717 - lava_callback - ERROR - Error processing callback for node 69b57e3c1727ff69d6f25fd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54278 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:28:28,651 - lava_callback - INFO - Received callback for node 69b57e8b1727ff69d6f25fe7 INFO: 172.20.0.1:54294 - "POST /node/69b57e8b1727ff69d6f25fe7 HTTP/1.0" 202 Accepted 2026-03-16 15:28:28,656 - lava_callback - INFO - Starting async job submit for node 69b57e8b1727ff69d6f25fe7 2026-03-16 15:28:28,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:28:28,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57e8b1727ff69d6f25fe7 HTTP/1.1" 200 None 2026-03-16 15:28:28,672 - lava_callback - DEBUG - Processing node 69b57e8b1727ff69d6f25fe7: baseline-arm64-clabbe 2026-03-16 15:28:28,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57e8b1727ff69d6f25fe7 2026-03-16 15:28:28,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:28:28,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57e8b1727ff69d6f25fe7 HTTP/1.1" 200 None 2026-03-16 15:28:28,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:28:28,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:28:28,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:28:28,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57e8b1727ff69d6f25fe7 HTTP/1.1" 200 None 2026-03-16 15:28:28,733 - lava_callback - ERROR - Error processing callback for node 69b57e8b1727ff69d6f25fe7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50622 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:32:08,920 - lava_callback - INFO - Received callback for node 69b57f6d1727ff69d6f26004 INFO: 172.20.0.1:50628 - "POST /node/69b57f6d1727ff69d6f26004 HTTP/1.0" 202 Accepted 2026-03-16 15:32:08,926 - lava_callback - INFO - Starting async job submit for node 69b57f6d1727ff69d6f26004 2026-03-16 15:32:08,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:32:08,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57f6d1727ff69d6f26004 HTTP/1.1" 200 None 2026-03-16 15:32:08,943 - lava_callback - DEBUG - Processing node 69b57f6d1727ff69d6f26004: baseline-arm64-clabbe 2026-03-16 15:32:08,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57f6d1727ff69d6f26004 2026-03-16 15:32:08,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:32:08,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57f6d1727ff69d6f26004 HTTP/1.1" 200 None 2026-03-16 15:32:08,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:32:08,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:32:08,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:32:08,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57f6d1727ff69d6f26004 HTTP/1.1" 200 None 2026-03-16 15:32:09,002 - lava_callback - ERROR - Error processing callback for node 69b57f6d1727ff69d6f26004: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59562 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:33:30,674 - lava_callback - INFO - Received callback for node 69b57fb61727ff69d6f26016 INFO: 172.20.0.1:51788 - "POST /node/69b57fb61727ff69d6f26016 HTTP/1.0" 202 Accepted 2026-03-16 15:33:30,679 - lava_callback - INFO - Starting async job submit for node 69b57fb61727ff69d6f26016 2026-03-16 15:33:30,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:33:30,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57fb61727ff69d6f26016 HTTP/1.1" 200 None 2026-03-16 15:33:30,697 - lava_callback - DEBUG - Processing node 69b57fb61727ff69d6f26016: baseline-arm64-baylibre 2026-03-16 15:33:30,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b57fb61727ff69d6f26016 2026-03-16 15:33:30,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:33:30,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b57fb61727ff69d6f26016 HTTP/1.1" 200 None 2026-03-16 15:33:30,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:33:30,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 15:33:30,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:33:30,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b57fb61727ff69d6f26016 HTTP/1.1" 200 None 2026-03-16 15:33:30,755 - lava_callback - ERROR - Error processing callback for node 69b57fb61727ff69d6f26016: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34238 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:34:48,944 - lava_callback - INFO - Received callback for node 69b580081727ff69d6f26028 INFO: 172.20.0.1:34244 - "POST /node/69b580081727ff69d6f26028 HTTP/1.0" 202 Accepted 2026-03-16 15:34:48,950 - lava_callback - INFO - Starting async job submit for node 69b580081727ff69d6f26028 2026-03-16 15:34:48,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:34:48,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b580081727ff69d6f26028 HTTP/1.1" 200 None 2026-03-16 15:34:48,972 - lava_callback - DEBUG - Processing node 69b580081727ff69d6f26028: baseline-arm64-clabbe 2026-03-16 15:34:48,972 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b580081727ff69d6f26028 2026-03-16 15:34:48,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:34:48,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b580081727ff69d6f26028 HTTP/1.1" 200 None 2026-03-16 15:34:48,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:34:49,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:34:49,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:34:49,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b580081727ff69d6f26028 HTTP/1.1" 200 None 2026-03-16 15:34:49,037 - lava_callback - ERROR - Error processing callback for node 69b580081727ff69d6f26028: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41474 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:35:50,904 - lava_callback - INFO - Received callback for node 69b580421727ff69d6f26035 INFO: 172.20.0.1:40402 - "POST /node/69b580421727ff69d6f26035 HTTP/1.0" 202 Accepted 2026-03-16 15:35:50,910 - lava_callback - INFO - Starting async job submit for node 69b580421727ff69d6f26035 2026-03-16 15:35:50,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:35:50,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b580421727ff69d6f26035 HTTP/1.1" 200 None 2026-03-16 15:35:50,926 - lava_callback - DEBUG - Processing node 69b580421727ff69d6f26035: baseline-arm-baylibre 2026-03-16 15:35:50,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b580421727ff69d6f26035 2026-03-16 15:35:50,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:35:50,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b580421727ff69d6f26035 HTTP/1.1" 200 None 2026-03-16 15:35:50,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:35:50,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 15:35:50,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:35:50,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b580421727ff69d6f26035 HTTP/1.1" 200 None 2026-03-16 15:35:50,984 - lava_callback - ERROR - Error processing callback for node 69b580421727ff69d6f26035: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56958 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:36:29,166 - lava_callback - INFO - Received callback for node 69b580791727ff69d6f26045 INFO: 172.20.0.1:56968 - "POST /node/69b580791727ff69d6f26045 HTTP/1.0" 202 Accepted 2026-03-16 15:36:29,171 - lava_callback - INFO - Starting async job submit for node 69b580791727ff69d6f26045 2026-03-16 15:36:29,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:36:29,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b580791727ff69d6f26045 HTTP/1.1" 200 None 2026-03-16 15:36:29,187 - lava_callback - DEBUG - Processing node 69b580791727ff69d6f26045: baseline-arm64-clabbe 2026-03-16 15:36:29,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b580791727ff69d6f26045 2026-03-16 15:36:29,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:36:29,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b580791727ff69d6f26045 HTTP/1.1" 200 None 2026-03-16 15:36:29,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:36:29,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:36:29,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:36:29,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b580791727ff69d6f26045 HTTP/1.1" 200 None 2026-03-16 15:36:29,238 - lava_callback - ERROR - Error processing callback for node 69b580791727ff69d6f26045: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42706 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:37:51,058 - lava_callback - INFO - Received callback for node 69b580be1727ff69d6f26054 INFO: 172.20.0.1:43754 - "POST /node/69b580be1727ff69d6f26054 HTTP/1.0" 202 Accepted 2026-03-16 15:37:51,064 - lava_callback - INFO - Starting async job submit for node 69b580be1727ff69d6f26054 2026-03-16 15:37:51,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:37:51,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b580be1727ff69d6f26054 HTTP/1.1" 200 None 2026-03-16 15:37:51,083 - lava_callback - DEBUG - Processing node 69b580be1727ff69d6f26054: baseline-arm64-baylibre 2026-03-16 15:37:51,083 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b580be1727ff69d6f26054 2026-03-16 15:37:51,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:37:51,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b580be1727ff69d6f26054 HTTP/1.1" 200 None 2026-03-16 15:37:51,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:37:51,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 15:37:51,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:37:51,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b580be1727ff69d6f26054 HTTP/1.1" 200 None 2026-03-16 15:37:51,141 - lava_callback - ERROR - Error processing callback for node 69b580be1727ff69d6f26054: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37588 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:38:07,797 - lava_callback - INFO - Received callback for node 69b82295113612b7716bcd42 INFO: 172.20.0.1:37592 - "POST /node/69b82295113612b7716bcd42 HTTP/1.0" 202 Accepted 2026-03-16 15:38:07,804 - lava_callback - INFO - Starting async job submit for node 69b82295113612b7716bcd42 2026-03-16 15:38:07,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:38:07,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82295113612b7716bcd42 HTTP/1.1" 200 None 2026-03-16 15:38:07,858 - lava_callback - DEBUG - Processing node 69b82295113612b7716bcd42: baseline-arm64 2026-03-16 15:38:08,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:38:08,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:38:08,419 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82295113612b7716bcd42/log.txt.gz 2026-03-16 15:38:08,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:38:09,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:38:09,248 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82295113612b7716bcd42/lava-logs.yaml 2026-03-16 15:38:09,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:38:09,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:38:09,445 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82295113612b7716bcd42/lava_callback.json.gz DEBUG: Setup failed for 69b82295113612b7716bcd42. Transitting job node result: incomplete -> fail 2026-03-16 15:38:09,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:38:09,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82295113612b7716bcd42 HTTP/1.1" 200 None 2026-03-16 15:38:09,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:38:09,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:38:09,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:38:09,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82295113612b7716bcd42 HTTP/1.1" 200 None 2026-03-16 15:38:09,674 - lava_callback - INFO - Completed processing callback for node 69b82295113612b7716bcd42 INFO: 172.20.0.1:51402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46904 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:38:36,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:38:36,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44380 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:39:09,260 - lava_callback - INFO - Received callback for node 69b581111727ff69d6f26062 INFO: 172.20.0.1:44382 - "POST /node/69b581111727ff69d6f26062 HTTP/1.0" 202 Accepted 2026-03-16 15:39:09,265 - lava_callback - INFO - Starting async job submit for node 69b581111727ff69d6f26062 2026-03-16 15:39:09,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:39:09,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b581111727ff69d6f26062 HTTP/1.1" 200 None 2026-03-16 15:39:09,282 - lava_callback - DEBUG - Processing node 69b581111727ff69d6f26062: baseline-arm64-clabbe 2026-03-16 15:39:09,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b581111727ff69d6f26062 2026-03-16 15:39:09,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:39:09,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b581111727ff69d6f26062 HTTP/1.1" 200 None 2026-03-16 15:39:09,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:39:09,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:39:09,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:39:09,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b581111727ff69d6f26062 HTTP/1.1" 200 None 2026-03-16 15:39:09,366 - lava_callback - ERROR - Error processing callback for node 69b581111727ff69d6f26062: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59806 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:40:11,109 - lava_callback - INFO - Received callback for node 69b581581727ff69d6f26072 INFO: 172.20.0.1:52364 - "POST /node/69b581581727ff69d6f26072 HTTP/1.0" 202 Accepted 2026-03-16 15:40:11,114 - lava_callback - INFO - Starting async job submit for node 69b581581727ff69d6f26072 2026-03-16 15:40:11,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:40:11,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b581581727ff69d6f26072 HTTP/1.1" 200 None 2026-03-16 15:40:11,130 - lava_callback - DEBUG - Processing node 69b581581727ff69d6f26072: baseline-arm64-baylibre 2026-03-16 15:40:11,131 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b581581727ff69d6f26072 2026-03-16 15:40:11,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:40:11,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b581581727ff69d6f26072 HTTP/1.1" 200 None 2026-03-16 15:40:11,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:40:11,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 15:40:11,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:40:11,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b581581727ff69d6f26072 HTTP/1.1" 200 None 2026-03-16 15:40:11,195 - lava_callback - ERROR - Error processing callback for node 69b581581727ff69d6f26072: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52384 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:40:17,625 - lava_callback - INFO - Received callback for node 69b81946113612b7716bca06 INFO: 172.20.0.1:52386 - "POST /node/69b81946113612b7716bca06 HTTP/1.0" 202 Accepted 2026-03-16 15:40:17,631 - lava_callback - INFO - Starting async job submit for node 69b81946113612b7716bca06 2026-03-16 15:40:17,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:40:17,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81946113612b7716bca06 HTTP/1.1" 200 None 2026-03-16 15:40:17,667 - lava_callback - DEBUG - Processing node 69b81946113612b7716bca06: baseline-arm64 2026-03-16 15:40:18,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:40:18,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:40:18,186 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81946113612b7716bca06/log.txt.gz 2026-03-16 15:40:18,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:40:18,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:40:18,618 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81946113612b7716bca06/lava-logs.yaml 2026-03-16 15:40:18,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:40:18,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:40:18,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81946113612b7716bca06/lava_callback.json.gz 2026-03-16 15:40:18,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:40:18,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81946113612b7716bca06 HTTP/1.1" 200 None 2026-03-16 15:40:18,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:40:18,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:40:18,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:40:18,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81946113612b7716bca06 HTTP/1.1" 200 None 2026-03-16 15:40:18,924 - lava_callback - INFO - Completed processing callback for node 69b81946113612b7716bca06 INFO: 172.20.0.1:41954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41962 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:40:36,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:40:36,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59900 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:41:34,321 - lava_callback - INFO - Received callback for node 69b81fc5113612b7716bccc9 INFO: 172.20.0.1:51172 - "POST /node/69b81fc5113612b7716bccc9 HTTP/1.0" 202 Accepted 2026-03-16 15:41:34,327 - lava_callback - INFO - Starting async job submit for node 69b81fc5113612b7716bccc9 2026-03-16 15:41:34,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:41:34,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81fc5113612b7716bccc9 HTTP/1.1" 200 None 2026-03-16 15:41:34,383 - lava_callback - DEBUG - Processing node 69b81fc5113612b7716bccc9: baseline-arm64-clabbe 2026-03-16 15:41:34,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:41:35,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:41:35,110 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b81fc5113612b7716bccc9/log.txt.gz 2026-03-16 15:41:35,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:41:35,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:41:35,742 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b81fc5113612b7716bccc9/lava-logs.yaml 2026-03-16 15:41:35,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:41:35,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:41:35,922 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b81fc5113612b7716bccc9/lava_callback.json.gz DEBUG: Setup failed for 69b81fc5113612b7716bccc9. Transitting job node result: incomplete -> fail 2026-03-16 15:41:36,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:41:36,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81fc5113612b7716bccc9 HTTP/1.1" 200 None 2026-03-16 15:41:36,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:41:36,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:41:36,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:41:36,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81fc5113612b7716bccc9 HTTP/1.1" 200 None 2026-03-16 15:41:36,182 - lava_callback - INFO - Completed processing callback for node 69b81fc5113612b7716bccc9 INFO: 172.20.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45424 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:41:49,372 - lava_callback - INFO - Received callback for node 69b581ac1727ff69d6f2607e INFO: 172.20.0.1:45434 - "POST /node/69b581ac1727ff69d6f2607e HTTP/1.0" 202 Accepted 2026-03-16 15:41:49,377 - lava_callback - INFO - Starting async job submit for node 69b581ac1727ff69d6f2607e 2026-03-16 15:41:49,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:41:49,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b581ac1727ff69d6f2607e HTTP/1.1" 200 None 2026-03-16 15:41:49,416 - lava_callback - DEBUG - Processing node 69b581ac1727ff69d6f2607e: baseline-arm64-clabbe 2026-03-16 15:41:49,417 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b581ac1727ff69d6f2607e 2026-03-16 15:41:49,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:41:49,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b581ac1727ff69d6f2607e HTTP/1.1" 200 None 2026-03-16 15:41:49,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:41:49,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:41:49,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:41:49,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b581ac1727ff69d6f2607e HTTP/1.1" 200 None 2026-03-16 15:41:49,483 - lava_callback - ERROR - Error processing callback for node 69b581ac1727ff69d6f2607e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58592 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:42:06,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:42:06,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50868 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:43:09,465 - lava_callback - INFO - Received callback for node 69b581f81727ff69d6f26093 INFO: 172.20.0.1:50882 - "POST /node/69b581f81727ff69d6f26093 HTTP/1.0" 202 Accepted 2026-03-16 15:43:09,471 - lava_callback - INFO - Starting async job submit for node 69b581f81727ff69d6f26093 2026-03-16 15:43:09,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:43:09,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b581f81727ff69d6f26093 HTTP/1.1" 200 None 2026-03-16 15:43:09,487 - lava_callback - DEBUG - Processing node 69b581f81727ff69d6f26093: baseline-arm64-clabbe 2026-03-16 15:43:09,487 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b581f81727ff69d6f26093 2026-03-16 15:43:09,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:43:09,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b581f81727ff69d6f26093 HTTP/1.1" 200 None 2026-03-16 15:43:09,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:43:09,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 15:43:09,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:43:09,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b581f81727ff69d6f26093 HTTP/1.1" 200 None 2026-03-16 15:43:09,546 - lava_callback - ERROR - Error processing callback for node 69b581f81727ff69d6f26093: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51108 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:43:40,420 - lava_callback - INFO - Received callback for node 69b8194b113612b7716bca14 INFO: 172.20.0.1:40412 - "POST /node/69b8194b113612b7716bca14 HTTP/1.0" 202 Accepted 2026-03-16 15:43:40,428 - lava_callback - INFO - Starting async job submit for node 69b8194b113612b7716bca14 2026-03-16 15:43:40,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:43:40,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8194b113612b7716bca14 HTTP/1.1" 200 None 2026-03-16 15:43:40,476 - lava_callback - DEBUG - Processing node 69b8194b113612b7716bca14: baseline-arm64 2026-03-16 15:43:40,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:43:41,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:43:41,153 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194b113612b7716bca14/log.txt.gz 2026-03-16 15:43:41,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:43:41,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:43:41,651 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194b113612b7716bca14/lava-logs.yaml 2026-03-16 15:43:41,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:43:41,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:43:41,828 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8194b113612b7716bca14/lava_callback.json.gz 2026-03-16 15:43:41,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:43:41,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8194b113612b7716bca14 HTTP/1.1" 200 None 2026-03-16 15:43:41,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:43:41,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:43:41,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:43:41,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8194b113612b7716bca14 HTTP/1.1" 200 None 2026-03-16 15:43:42,013 - lava_callback - INFO - Completed processing callback for node 69b8194b113612b7716bca14 INFO: 172.20.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47420 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:44:06,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:44:06,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38376 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:44:09,520 - lava_callback - INFO - Received callback for node 69b582461727ff69d6f260a6 INFO: 172.20.0.1:38380 - "POST /node/69b582461727ff69d6f260a6 HTTP/1.0" 202 Accepted 2026-03-16 15:44:09,526 - lava_callback - INFO - Starting async job submit for node 69b582461727ff69d6f260a6 2026-03-16 15:44:09,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:44:09,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b582461727ff69d6f260a6 HTTP/1.1" 200 None 2026-03-16 15:44:09,542 - lava_callback - DEBUG - Processing node 69b582461727ff69d6f260a6: baseline-arm64-clabbe 2026-03-16 15:44:09,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b582461727ff69d6f260a6 2026-03-16 15:44:09,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:44:09,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b582461727ff69d6f260a6 HTTP/1.1" 200 None 2026-03-16 15:44:09,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:44:09,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:44:09,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:44:09,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b582461727ff69d6f260a6 HTTP/1.1" 200 None 2026-03-16 15:44:09,600 - lava_callback - ERROR - Error processing callback for node 69b582461727ff69d6f260a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55182 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:45:29,624 - lava_callback - INFO - Received callback for node 69b582911727ff69d6f260b7 INFO: 172.20.0.1:55192 - "POST /node/69b582911727ff69d6f260b7 HTTP/1.0" 202 Accepted 2026-03-16 15:45:29,629 - lava_callback - INFO - Starting async job submit for node 69b582911727ff69d6f260b7 2026-03-16 15:45:29,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:45:29,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b582911727ff69d6f260b7 HTTP/1.1" 200 None 2026-03-16 15:45:29,646 - lava_callback - DEBUG - Processing node 69b582911727ff69d6f260b7: baseline-arm64-clabbe 2026-03-16 15:45:29,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b582911727ff69d6f260b7 2026-03-16 15:45:29,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:45:29,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b582911727ff69d6f260b7 HTTP/1.1" 200 None 2026-03-16 15:45:29,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:45:29,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 15:45:29,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:45:29,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b582911727ff69d6f260b7 HTTP/1.1" 200 None 2026-03-16 15:45:29,709 - lava_callback - ERROR - Error processing callback for node 69b582911727ff69d6f260b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53736 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:46:49,610 - lava_callback - INFO - Received callback for node 69b582dd1727ff69d6f260c8 INFO: 172.20.0.1:53740 - "POST /node/69b582dd1727ff69d6f260c8 HTTP/1.0" 202 Accepted 2026-03-16 15:46:49,616 - lava_callback - INFO - Starting async job submit for node 69b582dd1727ff69d6f260c8 2026-03-16 15:46:49,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:46:49,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b582dd1727ff69d6f260c8 HTTP/1.1" 200 None 2026-03-16 15:46:49,660 - lava_callback - DEBUG - Processing node 69b582dd1727ff69d6f260c8: baseline-arm64-clabbe 2026-03-16 15:46:49,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b582dd1727ff69d6f260c8 2026-03-16 15:46:49,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:46:49,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b582dd1727ff69d6f260c8 HTTP/1.1" 200 None 2026-03-16 15:46:49,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:46:49,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:46:49,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:46:49,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b582dd1727ff69d6f260c8 HTTP/1.1" 200 None 2026-03-16 15:46:49,718 - lava_callback - ERROR - Error processing callback for node 69b582dd1727ff69d6f260c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58758 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:48:09,647 - lava_callback - INFO - Received callback for node 69b5832a1727ff69d6f260d8 INFO: 172.20.0.1:58770 - "POST /node/69b5832a1727ff69d6f260d8 HTTP/1.0" 202 Accepted 2026-03-16 15:48:09,652 - lava_callback - INFO - Starting async job submit for node 69b5832a1727ff69d6f260d8 2026-03-16 15:48:09,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:48:09,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5832a1727ff69d6f260d8 HTTP/1.1" 200 None 2026-03-16 15:48:09,691 - lava_callback - DEBUG - Processing node 69b5832a1727ff69d6f260d8: baseline-arm64-clabbe 2026-03-16 15:48:09,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5832a1727ff69d6f260d8 2026-03-16 15:48:09,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:48:09,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5832a1727ff69d6f260d8 HTTP/1.1" 200 None 2026-03-16 15:48:09,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:48:09,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 15:48:09,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:48:09,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5832a1727ff69d6f260d8 HTTP/1.1" 200 None 2026-03-16 15:48:09,748 - lava_callback - ERROR - Error processing callback for node 69b5832a1727ff69d6f260d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49118 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:48:48,855 - lava_callback - INFO - Received callback for node 69b81957113612b7716bca31 INFO: 172.20.0.1:49120 - "POST /node/69b81957113612b7716bca31 HTTP/1.0" 202 Accepted 2026-03-16 15:48:48,862 - lava_callback - INFO - Starting async job submit for node 69b81957113612b7716bca31 2026-03-16 15:48:48,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:48:48,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81957113612b7716bca31 HTTP/1.1" 200 None 2026-03-16 15:48:48,899 - lava_callback - DEBUG - Processing node 69b81957113612b7716bca31: baseline-nfs-arm64 2026-03-16 15:48:49,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:48:49,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:48:49,529 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81957113612b7716bca31/log.txt.gz 2026-03-16 15:48:49,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:48:50,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:48:50,030 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81957113612b7716bca31/lava-logs.yaml 2026-03-16 15:48:50,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:48:50,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:48:50,216 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81957113612b7716bca31/lava_callback.json.gz 2026-03-16 15:48:50,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:48:50,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81957113612b7716bca31 HTTP/1.1" 200 None 2026-03-16 15:48:50,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:48:50,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:48:50,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:48:50,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81957113612b7716bca31 HTTP/1.1" 200 None 2026-03-16 15:48:50,307 - lava_callback - INFO - Completed processing callback for node 69b81957113612b7716bca31 INFO: 172.20.0.1:41462 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:49:06,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:49:06,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49874 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:49:29,667 - lava_callback - INFO - Received callback for node 69b583761727ff69d6f260eb INFO: 172.20.0.1:49884 - "POST /node/69b583761727ff69d6f260eb HTTP/1.0" 202 Accepted 2026-03-16 15:49:29,673 - lava_callback - INFO - Starting async job submit for node 69b583761727ff69d6f260eb 2026-03-16 15:49:29,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:49:29,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b583761727ff69d6f260eb HTTP/1.1" 200 None 2026-03-16 15:49:29,690 - lava_callback - DEBUG - Processing node 69b583761727ff69d6f260eb: baseline-arm64-clabbe 2026-03-16 15:49:29,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b583761727ff69d6f260eb 2026-03-16 15:49:29,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:49:29,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b583761727ff69d6f260eb HTTP/1.1" 200 None 2026-03-16 15:49:29,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:49:29,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:49:29,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:49:29,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b583761727ff69d6f260eb HTTP/1.1" 200 None 2026-03-16 15:49:29,753 - lava_callback - ERROR - Error processing callback for node 69b583761727ff69d6f260eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36938 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:49:44,289 - lava_callback - INFO - Received callback for node 69b8195c113612b7716bca3d INFO: 172.20.0.1:44158 - "POST /node/69b8195c113612b7716bca3d HTTP/1.0" 202 Accepted 2026-03-16 15:49:44,295 - lava_callback - INFO - Starting async job submit for node 69b8195c113612b7716bca3d 2026-03-16 15:49:44,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:49:44,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8195c113612b7716bca3d HTTP/1.1" 200 None 2026-03-16 15:49:44,345 - lava_callback - DEBUG - Processing node 69b8195c113612b7716bca3d: baseline-nfs-arm64 2026-03-16 15:49:44,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:49:45,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:49:45,034 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195c113612b7716bca3d/log.txt.gz 2026-03-16 15:49:45,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:49:45,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:49:45,510 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195c113612b7716bca3d/lava-logs.yaml 2026-03-16 15:49:45,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:49:45,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:49:45,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8195c113612b7716bca3d/lava_callback.json.gz 2026-03-16 15:49:45,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:49:45,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8195c113612b7716bca3d HTTP/1.1" 200 None 2026-03-16 15:49:45,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:49:45,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:49:45,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:49:45,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8195c113612b7716bca3d HTTP/1.1" 200 None 2026-03-16 15:49:45,861 - lava_callback - INFO - Completed processing callback for node 69b8195c113612b7716bca3d INFO: 172.20.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37756 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:50:06,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:50:06,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37054 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:50:49,795 - lava_callback - INFO - Received callback for node 69b583c41727ff69d6f260f4 INFO: 172.20.0.1:43712 - "POST /node/69b583c41727ff69d6f260f4 HTTP/1.0" 202 Accepted 2026-03-16 15:50:49,801 - lava_callback - INFO - Starting async job submit for node 69b583c41727ff69d6f260f4 2026-03-16 15:50:49,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:50:49,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b583c41727ff69d6f260f4 HTTP/1.1" 200 None 2026-03-16 15:50:49,817 - lava_callback - DEBUG - Processing node 69b583c41727ff69d6f260f4: baseline-arm64-clabbe 2026-03-16 15:50:49,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b583c41727ff69d6f260f4 2026-03-16 15:50:49,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:50:49,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b583c41727ff69d6f260f4 HTTP/1.1" 200 None 2026-03-16 15:50:49,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:50:49,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 15:50:49,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:50:49,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b583c41727ff69d6f260f4 HTTP/1.1" 200 None 2026-03-16 15:50:49,872 - lava_callback - ERROR - Error processing callback for node 69b583c41727ff69d6f260f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43718 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:50:56,950 - lava_callback - INFO - Received callback for node 69b81948113612b7716bca09 INFO: 172.20.0.1:43722 - "POST /node/69b81948113612b7716bca09 HTTP/1.0" 202 Accepted 2026-03-16 15:50:56,957 - lava_callback - INFO - Starting async job submit for node 69b81948113612b7716bca09 2026-03-16 15:50:56,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:50:56,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81948113612b7716bca09 HTTP/1.1" 200 None 2026-03-16 15:50:56,995 - lava_callback - DEBUG - Processing node 69b81948113612b7716bca09: baseline-arm64 2026-03-16 15:50:57,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:50:57,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:50:57,618 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81948113612b7716bca09/log.txt.gz 2026-03-16 15:50:57,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:50:58,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:50:58,094 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81948113612b7716bca09/lava-logs.yaml 2026-03-16 15:50:58,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:50:58,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:50:58,313 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81948113612b7716bca09/lava_callback.json.gz 2026-03-16 15:50:58,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:50:58,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81948113612b7716bca09 HTTP/1.1" 200 None 2026-03-16 15:50:58,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:50:58,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:50:58,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:50:58,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81948113612b7716bca09 HTTP/1.1" 200 None 2026-03-16 15:50:58,487 - lava_callback - INFO - Completed processing callback for node 69b81948113612b7716bca09 2026-03-16 15:51:06,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:51:06,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59430 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:51:49,733 - lava_callback - INFO - Received callback for node 69b584101727ff69d6f26104 INFO: 172.20.0.1:36164 - "POST /node/69b584101727ff69d6f26104 HTTP/1.0" 202 Accepted 2026-03-16 15:51:49,739 - lava_callback - INFO - Starting async job submit for node 69b584101727ff69d6f26104 2026-03-16 15:51:49,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:51:49,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b584101727ff69d6f26104 HTTP/1.1" 200 None 2026-03-16 15:51:49,755 - lava_callback - DEBUG - Processing node 69b584101727ff69d6f26104: baseline-arm64-clabbe 2026-03-16 15:51:49,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b584101727ff69d6f26104 2026-03-16 15:51:49,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:51:49,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b584101727ff69d6f26104 HTTP/1.1" 200 None 2026-03-16 15:51:49,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:51:49,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-16 15:51:49,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:51:49,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b584101727ff69d6f26104 HTTP/1.1" 200 None 2026-03-16 15:51:49,819 - lava_callback - ERROR - Error processing callback for node 69b584101727ff69d6f26104: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43232 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:53:09,880 - lava_callback - INFO - Received callback for node 69b5845b1727ff69d6f2610e INFO: 172.20.0.1:53506 - "POST /node/69b5845b1727ff69d6f2610e HTTP/1.0" 202 Accepted 2026-03-16 15:53:09,886 - lava_callback - INFO - Starting async job submit for node 69b5845b1727ff69d6f2610e 2026-03-16 15:53:09,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:53:09,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5845b1727ff69d6f2610e HTTP/1.1" 200 None 2026-03-16 15:53:09,907 - lava_callback - DEBUG - Processing node 69b5845b1727ff69d6f2610e: baseline-arm64-clabbe 2026-03-16 15:53:09,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5845b1727ff69d6f2610e 2026-03-16 15:53:09,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:53:09,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5845b1727ff69d6f2610e HTTP/1.1" 200 None 2026-03-16 15:53:09,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:53:09,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 15:53:09,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:53:09,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5845b1727ff69d6f2610e HTTP/1.1" 200 None 2026-03-16 15:53:09,993 - lava_callback - ERROR - Error processing callback for node 69b5845b1727ff69d6f2610e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34044 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:53:40,865 - lava_callback - INFO - Received callback for node 69b81959113612b7716bca34 INFO: 172.20.0.1:38040 - "POST /node/69b81959113612b7716bca34 HTTP/1.0" 202 Accepted 2026-03-16 15:53:40,878 - lava_callback - INFO - Starting async job submit for node 69b81959113612b7716bca34 2026-03-16 15:53:40,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:53:40,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81959113612b7716bca34 HTTP/1.1" 200 None 2026-03-16 15:53:40,946 - lava_callback - DEBUG - Processing node 69b81959113612b7716bca34: baseline-nfs-arm64 2026-03-16 15:53:41,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:53:41,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:53:41,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81959113612b7716bca34/log.txt.gz 2026-03-16 15:53:42,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:53:42,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:53:42,309 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81959113612b7716bca34/lava-logs.yaml 2026-03-16 15:53:42,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:53:42,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:53:42,486 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81959113612b7716bca34/lava_callback.json.gz 2026-03-16 15:53:42,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:53:42,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81959113612b7716bca34 HTTP/1.1" 200 None 2026-03-16 15:53:42,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:53:42,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:53:42,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:53:42,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81959113612b7716bca34 HTTP/1.1" 200 None 2026-03-16 15:53:42,568 - lava_callback - INFO - Completed processing callback for node 69b81959113612b7716bca34 INFO: 172.20.0.1:38050 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:53:53,681 - lava_callback - INFO - Received callback for node 69b8273b113612b7716bce45 INFO: 172.20.0.1:55646 - "POST /node/69b8273b113612b7716bce45 HTTP/1.0" 202 Accepted 2026-03-16 15:53:53,688 - lava_callback - INFO - Starting async job submit for node 69b8273b113612b7716bce45 2026-03-16 15:53:53,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:53:53,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8273b113612b7716bce45 HTTP/1.1" 200 None 2026-03-16 15:53:53,725 - lava_callback - DEBUG - Processing node 69b8273b113612b7716bce45: baseline-arm64 2026-03-16 15:53:54,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:53:54,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:53:54,302 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8273b113612b7716bce45/log.txt.gz 2026-03-16 15:53:54,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:53:54,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:53:54,782 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8273b113612b7716bce45/lava-logs.yaml 2026-03-16 15:53:54,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:53:54,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:53:54,962 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b8273b113612b7716bce45/lava_callback.json.gz 2026-03-16 15:53:55,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:53:55,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8273b113612b7716bce45 HTTP/1.1" 200 None 2026-03-16 15:53:55,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:53:55,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:53:55,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:53:55,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8273b113612b7716bce45 HTTP/1.1" 200 None 2026-03-16 15:53:55,106 - lava_callback - INFO - Completed processing callback for node 69b8273b113612b7716bce45 INFO: 172.20.0.1:55662 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:54:06,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:54:06,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60378 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:54:29,814 - lava_callback - INFO - Received callback for node 69b584a61727ff69d6f2611e INFO: 172.20.0.1:43222 - "POST /node/69b584a61727ff69d6f2611e HTTP/1.0" 202 Accepted 2026-03-16 15:54:29,820 - lava_callback - INFO - Starting async job submit for node 69b584a61727ff69d6f2611e 2026-03-16 15:54:29,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:54:29,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b584a61727ff69d6f2611e HTTP/1.1" 200 None 2026-03-16 15:54:29,836 - lava_callback - DEBUG - Processing node 69b584a61727ff69d6f2611e: baseline-arm64-clabbe 2026-03-16 15:54:29,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b584a61727ff69d6f2611e 2026-03-16 15:54:29,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:54:29,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b584a61727ff69d6f2611e HTTP/1.1" 200 None 2026-03-16 15:54:29,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:54:29,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 15:54:29,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:54:29,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b584a61727ff69d6f2611e HTTP/1.1" 200 None 2026-03-16 15:54:29,901 - lava_callback - ERROR - Error processing callback for node 69b584a61727ff69d6f2611e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32772 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:55:31,934 - lava_callback - INFO - Received callback for node 69b584e01727ff69d6f26128 INFO: 172.20.0.1:39616 - "POST /node/69b584e01727ff69d6f26128 HTTP/1.0" 202 Accepted 2026-03-16 15:55:31,939 - lava_callback - INFO - Starting async job submit for node 69b584e01727ff69d6f26128 2026-03-16 15:55:31,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:55:31,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b584e01727ff69d6f26128 HTTP/1.1" 200 None 2026-03-16 15:55:31,956 - lava_callback - DEBUG - Processing node 69b584e01727ff69d6f26128: baseline-arm-baylibre 2026-03-16 15:55:31,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b584e01727ff69d6f26128 2026-03-16 15:55:31,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:55:31,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b584e01727ff69d6f26128 HTTP/1.1" 200 None 2026-03-16 15:55:31,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:55:31,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 15:55:31,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:55:32,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b584e01727ff69d6f26128 HTTP/1.1" 200 None 2026-03-16 15:55:32,026 - lava_callback - ERROR - Error processing callback for node 69b584e01727ff69d6f26128: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48270 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:55:51,944 - lava_callback - INFO - Received callback for node 69b585051727ff69d6f26136 INFO: 172.20.0.1:34910 - "POST /node/69b585051727ff69d6f26136 HTTP/1.0" 202 Accepted 2026-03-16 15:55:51,950 - lava_callback - INFO - Starting async job submit for node 69b585051727ff69d6f26136 2026-03-16 15:55:51,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:55:51,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b585051727ff69d6f26136 HTTP/1.1" 200 None 2026-03-16 15:55:51,965 - lava_callback - DEBUG - Processing node 69b585051727ff69d6f26136: baseline-arm-baylibre 2026-03-16 15:55:51,965 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b585051727ff69d6f26136 2026-03-16 15:55:51,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:55:51,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b585051727ff69d6f26136 HTTP/1.1" 200 None 2026-03-16 15:55:51,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:55:51,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 15:55:51,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:55:52,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b585051727ff69d6f26136 HTTP/1.1" 200 None 2026-03-16 15:55:52,021 - lava_callback - ERROR - Error processing callback for node 69b585051727ff69d6f26136: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34972 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:56:12,662 - lava_callback - INFO - Received callback for node 69b82567113612b7716bcdc8 INFO: 172.20.0.1:35804 - "POST /node/69b82567113612b7716bcdc8 HTTP/1.0" 202 Accepted 2026-03-16 15:56:12,668 - lava_callback - INFO - Starting async job submit for node 69b82567113612b7716bcdc8 2026-03-16 15:56:12,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:56:12,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82567113612b7716bcdc8 HTTP/1.1" 200 None 2026-03-16 15:56:12,711 - lava_callback - DEBUG - Processing node 69b82567113612b7716bcdc8: baseline-arm64 2026-03-16 15:56:13,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:56:13,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:56:13,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82567113612b7716bcdc8/log.txt.gz 2026-03-16 15:56:13,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:56:13,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:56:13,894 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82567113612b7716bcdc8/lava-logs.yaml 2026-03-16 15:56:13,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 15:56:14,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 15:56:14,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82567113612b7716bcdc8/lava_callback.json.gz 2026-03-16 15:56:14,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:56:14,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82567113612b7716bcdc8 HTTP/1.1" 200 None 2026-03-16 15:56:14,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:56:14,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 15:56:14,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:56:14,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82567113612b7716bcdc8 HTTP/1.1" 200 None 2026-03-16 15:56:14,236 - lava_callback - INFO - Completed processing callback for node 69b82567113612b7716bcdc8 INFO: 172.20.0.1:35814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36974 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:56:31,972 - lava_callback - INFO - Received callback for node 69b585281727ff69d6f26141 INFO: 172.20.0.1:47068 - "POST /node/69b585281727ff69d6f26141 HTTP/1.0" 202 Accepted 2026-03-16 15:56:31,978 - lava_callback - INFO - Starting async job submit for node 69b585281727ff69d6f26141 2026-03-16 15:56:31,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:56:31,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b585281727ff69d6f26141 HTTP/1.1" 200 None 2026-03-16 15:56:31,993 - lava_callback - DEBUG - Processing node 69b585281727ff69d6f26141: baseline-arm-baylibre 2026-03-16 15:56:31,994 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b585281727ff69d6f26141 2026-03-16 15:56:31,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:56:32,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b585281727ff69d6f26141 HTTP/1.1" 200 None 2026-03-16 15:56:32,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:56:32,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 15:56:32,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:56:32,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b585281727ff69d6f26141 HTTP/1.1" 200 None 2026-03-16 15:56:32,047 - lava_callback - ERROR - Error processing callback for node 69b585281727ff69d6f26141: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 15:56:36,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:56:36,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37280 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:57:12,023 - lava_callback - INFO - Received callback for node 69b5854d1727ff69d6f2614a INFO: 172.20.0.1:41534 - "POST /node/69b5854d1727ff69d6f2614a HTTP/1.0" 202 Accepted 2026-03-16 15:57:12,029 - lava_callback - INFO - Starting async job submit for node 69b5854d1727ff69d6f2614a 2026-03-16 15:57:12,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:57:12,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5854d1727ff69d6f2614a HTTP/1.1" 200 None 2026-03-16 15:57:12,044 - lava_callback - DEBUG - Processing node 69b5854d1727ff69d6f2614a: baseline-arm-baylibre 2026-03-16 15:57:12,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5854d1727ff69d6f2614a 2026-03-16 15:57:12,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:57:12,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5854d1727ff69d6f2614a HTTP/1.1" 200 None 2026-03-16 15:57:12,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:57:12,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 15:57:12,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:57:12,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5854d1727ff69d6f2614a HTTP/1.1" 200 None 2026-03-16 15:57:12,103 - lava_callback - ERROR - Error processing callback for node 69b5854d1727ff69d6f2614a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34060 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:57:52,027 - lava_callback - INFO - Received callback for node 69b585711727ff69d6f2615b INFO: 172.20.0.1:57998 - "POST /node/69b585711727ff69d6f2615b HTTP/1.0" 202 Accepted 2026-03-16 15:57:52,033 - lava_callback - INFO - Starting async job submit for node 69b585711727ff69d6f2615b 2026-03-16 15:57:52,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:57:52,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b585711727ff69d6f2615b HTTP/1.1" 200 None 2026-03-16 15:57:52,052 - lava_callback - DEBUG - Processing node 69b585711727ff69d6f2615b: baseline-arm-baylibre 2026-03-16 15:57:52,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b585711727ff69d6f2615b 2026-03-16 15:57:52,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:57:52,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b585711727ff69d6f2615b HTTP/1.1" 200 None 2026-03-16 15:57:52,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:57:52,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 15:57:52,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:57:52,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b585711727ff69d6f2615b HTTP/1.1" 200 None 2026-03-16 15:57:52,106 - lava_callback - ERROR - Error processing callback for node 69b585711727ff69d6f2615b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37110 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:58:30,107 - lava_callback - INFO - Received callback for node 69b585961727ff69d6f26165 INFO: 172.20.0.1:53356 - "POST /node/69b585961727ff69d6f26165 HTTP/1.0" 202 Accepted 2026-03-16 15:58:30,113 - lava_callback - INFO - Starting async job submit for node 69b585961727ff69d6f26165 2026-03-16 15:58:30,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:58:30,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b585961727ff69d6f26165 HTTP/1.1" 200 None 2026-03-16 15:58:30,135 - lava_callback - DEBUG - Processing node 69b585961727ff69d6f26165: baseline-arm-clabbe 2026-03-16 15:58:30,136 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b585961727ff69d6f26165 2026-03-16 15:58:30,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:58:30,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b585961727ff69d6f26165 HTTP/1.1" 200 None 2026-03-16 15:58:30,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:58:30,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 15:58:30,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:58:30,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b585961727ff69d6f26165 HTTP/1.1" 200 None 2026-03-16 15:58:30,190 - lava_callback - ERROR - Error processing callback for node 69b585961727ff69d6f26165: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34000 - "GET / HTTP/1.0" 200 OK 2026-03-16 15:59:12,150 - lava_callback - INFO - Received callback for node 69b585c01727ff69d6f26172 INFO: 172.20.0.1:38284 - "POST /node/69b585c01727ff69d6f26172 HTTP/1.0" 202 Accepted 2026-03-16 15:59:12,156 - lava_callback - INFO - Starting async job submit for node 69b585c01727ff69d6f26172 2026-03-16 15:59:12,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:59:12,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b585c01727ff69d6f26172 HTTP/1.1" 200 None 2026-03-16 15:59:12,180 - lava_callback - DEBUG - Processing node 69b585c01727ff69d6f26172: baseline-arm64-baylibre 2026-03-16 15:59:12,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b585c01727ff69d6f26172 2026-03-16 15:59:12,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:59:12,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b585c01727ff69d6f26172 HTTP/1.1" 200 None 2026-03-16 15:59:12,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:59:12,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 15:59:12,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 15:59:12,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b585c01727ff69d6f26172 HTTP/1.1" 200 None 2026-03-16 15:59:12,242 - lava_callback - ERROR - Error processing callback for node 69b585c01727ff69d6f26172: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32914 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:00:10,364 - lava_callback - INFO - Received callback for node 69b586061727ff69d6f26184 INFO: 172.20.0.1:35292 - "POST /node/69b586061727ff69d6f26184 HTTP/1.0" 202 Accepted 2026-03-16 16:00:10,369 - lava_callback - INFO - Starting async job submit for node 69b586061727ff69d6f26184 2026-03-16 16:00:10,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:00:10,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b586061727ff69d6f26184 HTTP/1.1" 200 None 2026-03-16 16:00:10,398 - lava_callback - DEBUG - Processing node 69b586061727ff69d6f26184: baseline-arm-clabbe 2026-03-16 16:00:10,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b586061727ff69d6f26184 2026-03-16 16:00:10,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:00:10,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b586061727ff69d6f26184 HTTP/1.1" 200 None 2026-03-16 16:00:10,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:00:10,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:00:10,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:00:10,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b586061727ff69d6f26184 HTTP/1.1" 200 None 2026-03-16 16:00:10,460 - lava_callback - ERROR - Error processing callback for node 69b586061727ff69d6f26184: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41964 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:00:50,192 - lava_callback - INFO - Received callback for node 69b5862b1727ff69d6f2618f INFO: 172.20.0.1:59818 - "POST /node/69b5862b1727ff69d6f2618f HTTP/1.0" 202 Accepted 2026-03-16 16:00:50,197 - lava_callback - INFO - Starting async job submit for node 69b5862b1727ff69d6f2618f 2026-03-16 16:00:50,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:00:50,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5862b1727ff69d6f2618f HTTP/1.1" 200 None 2026-03-16 16:00:50,214 - lava_callback - DEBUG - Processing node 69b5862b1727ff69d6f2618f: baseline-arm-clabbe 2026-03-16 16:00:50,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5862b1727ff69d6f2618f 2026-03-16 16:00:50,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:00:50,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5862b1727ff69d6f2618f HTTP/1.1" 200 None 2026-03-16 16:00:50,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:00:50,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:00:50,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:00:50,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5862b1727ff69d6f2618f HTTP/1.1" 200 None 2026-03-16 16:00:50,317 - lava_callback - ERROR - Error processing callback for node 69b5862b1727ff69d6f2618f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59826 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:01:01,699 - lava_callback - INFO - Received callback for node 69b826a4113612b7716bcdfe INFO: 172.20.0.1:46896 - "POST /node/69b826a4113612b7716bcdfe HTTP/1.0" 202 Accepted 2026-03-16 16:01:01,706 - lava_callback - INFO - Starting async job submit for node 69b826a4113612b7716bcdfe 2026-03-16 16:01:01,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:01:01,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b826a4113612b7716bcdfe HTTP/1.1" 200 None 2026-03-16 16:01:01,758 - lava_callback - DEBUG - Processing node 69b826a4113612b7716bcdfe: baseline-nfs-arm64 2026-03-16 16:01:02,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:01:02,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:01:02,471 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b826a4113612b7716bcdfe/log.txt.gz 2026-03-16 16:01:02,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:01:02,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:01:02,972 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b826a4113612b7716bcdfe/lava-logs.yaml 2026-03-16 16:01:02,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:01:03,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:01:03,160 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b826a4113612b7716bcdfe/lava_callback.json.gz 2026-03-16 16:01:03,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:01:03,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b826a4113612b7716bcdfe HTTP/1.1" 200 None 2026-03-16 16:01:03,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:01:03,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 16:01:03,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:01:03,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b826a4113612b7716bcdfe HTTP/1.1" 200 None 2026-03-16 16:01:03,322 - lava_callback - INFO - Completed processing callback for node 69b826a4113612b7716bcdfe 2026-03-16 16:01:06,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:01:06,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45666 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:01:30,261 - lava_callback - INFO - Received callback for node 69b5864e1727ff69d6f2619a INFO: 172.20.0.1:59092 - "POST /node/69b5864e1727ff69d6f2619a HTTP/1.0" 202 Accepted 2026-03-16 16:01:30,266 - lava_callback - INFO - Starting async job submit for node 69b5864e1727ff69d6f2619a 2026-03-16 16:01:30,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:01:30,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5864e1727ff69d6f2619a HTTP/1.1" 200 None 2026-03-16 16:01:30,282 - lava_callback - DEBUG - Processing node 69b5864e1727ff69d6f2619a: baseline-arm-clabbe 2026-03-16 16:01:30,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5864e1727ff69d6f2619a 2026-03-16 16:01:30,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:01:30,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5864e1727ff69d6f2619a HTTP/1.1" 200 None 2026-03-16 16:01:30,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:01:30,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:01:30,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:01:30,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5864e1727ff69d6f2619a HTTP/1.1" 200 None 2026-03-16 16:01:30,343 - lava_callback - ERROR - Error processing callback for node 69b5864e1727ff69d6f2619a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43896 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:02:10,241 - lava_callback - INFO - Received callback for node 69b586721727ff69d6f261a5 INFO: 172.20.0.1:38202 - "POST /node/69b586721727ff69d6f261a5 HTTP/1.0" 202 Accepted 2026-03-16 16:02:10,246 - lava_callback - INFO - Starting async job submit for node 69b586721727ff69d6f261a5 2026-03-16 16:02:10,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:02:10,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b586721727ff69d6f261a5 HTTP/1.1" 200 None 2026-03-16 16:02:10,263 - lava_callback - DEBUG - Processing node 69b586721727ff69d6f261a5: baseline-arm-clabbe 2026-03-16 16:02:10,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b586721727ff69d6f261a5 2026-03-16 16:02:10,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:02:10,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b586721727ff69d6f261a5 HTTP/1.1" 200 None 2026-03-16 16:02:10,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:02:10,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:02:10,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:02:10,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b586721727ff69d6f261a5 HTTP/1.1" 200 None 2026-03-16 16:02:10,341 - lava_callback - ERROR - Error processing callback for node 69b586721727ff69d6f261a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34504 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:02:32,434 - lava_callback - INFO - Received callback for node 69b586911727ff69d6f261b1 INFO: 172.20.0.1:36696 - "POST /node/69b586911727ff69d6f261b1 HTTP/1.0" 202 Accepted 2026-03-16 16:02:32,440 - lava_callback - INFO - Starting async job submit for node 69b586911727ff69d6f261b1 2026-03-16 16:02:32,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:02:32,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b586911727ff69d6f261b1 HTTP/1.1" 200 None 2026-03-16 16:02:32,457 - lava_callback - DEBUG - Processing node 69b586911727ff69d6f261b1: baseline-arm-baylibre 2026-03-16 16:02:32,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b586911727ff69d6f261b1 2026-03-16 16:02:32,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:02:32,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b586911727ff69d6f261b1 HTTP/1.1" 200 None 2026-03-16 16:02:32,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:02:32,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:02:32,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:02:32,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b586911727ff69d6f261b1 HTTP/1.1" 200 None 2026-03-16 16:02:32,520 - lava_callback - ERROR - Error processing callback for node 69b586911727ff69d6f261b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58180 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:03:18,610 - lava_callback - INFO - Received callback for node 69b824d5113612b7716bcdaa INFO: 172.20.0.1:58192 - "POST /node/69b824d5113612b7716bcdaa HTTP/1.0" 202 Accepted 2026-03-16 16:03:18,616 - lava_callback - INFO - Starting async job submit for node 69b824d5113612b7716bcdaa 2026-03-16 16:03:18,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:03:18,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b824d5113612b7716bcdaa HTTP/1.1" 200 None 2026-03-16 16:03:18,679 - lava_callback - DEBUG - Processing node 69b824d5113612b7716bcdaa: baseline-arm64-clabbe 2026-03-16 16:03:19,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:03:19,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:03:19,408 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b824d5113612b7716bcdaa/log.txt.gz 2026-03-16 16:03:19,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:03:19,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:03:19,995 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b824d5113612b7716bcdaa/lava-logs.yaml 2026-03-16 16:03:20,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:03:20,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:03:20,197 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b824d5113612b7716bcdaa/lava_callback.json.gz DEBUG: Setup failed for 69b824d5113612b7716bcdaa. Transitting job node result: incomplete -> fail 2026-03-16 16:03:20,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:03:20,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b824d5113612b7716bcdaa HTTP/1.1" 200 None 2026-03-16 16:03:20,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:03:20,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 16:03:20,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:03:20,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b824d5113612b7716bcdaa HTTP/1.1" 200 None 2026-03-16 16:03:20,456 - lava_callback - INFO - Completed processing callback for node 69b824d5113612b7716bcdaa INFO: 172.20.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47634 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:03:32,330 - lava_callback - INFO - Received callback for node 69b586c11727ff69d6f261be INFO: 172.20.0.1:39284 - "POST /node/69b586c11727ff69d6f261be HTTP/1.0" 202 Accepted 2026-03-16 16:03:32,336 - lava_callback - INFO - Starting async job submit for node 69b586c11727ff69d6f261be 2026-03-16 16:03:32,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:03:32,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b586c11727ff69d6f261be HTTP/1.1" 200 None 2026-03-16 16:03:32,352 - lava_callback - DEBUG - Processing node 69b586c11727ff69d6f261be: baseline-arm64-baylibre 2026-03-16 16:03:32,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b586c11727ff69d6f261be 2026-03-16 16:03:32,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:03:32,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b586c11727ff69d6f261be HTTP/1.1" 200 None 2026-03-16 16:03:32,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:03:32,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 16:03:32,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:03:32,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b586c11727ff69d6f261be HTTP/1.1" 200 None 2026-03-16 16:03:32,417 - lava_callback - ERROR - Error processing callback for node 69b586c11727ff69d6f261be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 16:03:36,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:03:36,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55204 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:04:32,459 - lava_callback - INFO - Received callback for node 69b5870e1727ff69d6f261cc INFO: 172.20.0.1:42646 - "POST /node/69b5870e1727ff69d6f261cc HTTP/1.0" 202 Accepted 2026-03-16 16:04:32,464 - lava_callback - INFO - Starting async job submit for node 69b5870e1727ff69d6f261cc 2026-03-16 16:04:32,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:04:32,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5870e1727ff69d6f261cc HTTP/1.1" 200 None 2026-03-16 16:04:32,481 - lava_callback - DEBUG - Processing node 69b5870e1727ff69d6f261cc: baseline-arm64-baylibre 2026-03-16 16:04:32,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5870e1727ff69d6f261cc 2026-03-16 16:04:32,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:04:32,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5870e1727ff69d6f261cc HTTP/1.1" 200 None 2026-03-16 16:04:32,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:04:32,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 16:04:32,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:04:32,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5870e1727ff69d6f261cc HTTP/1.1" 200 None 2026-03-16 16:04:32,535 - lava_callback - ERROR - Error processing callback for node 69b5870e1727ff69d6f261cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49304 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:06:10,451 - lava_callback - INFO - Received callback for node 69b587611727ff69d6f261dc INFO: 172.20.0.1:41864 - "POST /node/69b587611727ff69d6f261dc HTTP/1.0" 202 Accepted 2026-03-16 16:06:10,457 - lava_callback - INFO - Starting async job submit for node 69b587611727ff69d6f261dc 2026-03-16 16:06:10,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:06:10,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b587611727ff69d6f261dc HTTP/1.1" 200 None 2026-03-16 16:06:10,484 - lava_callback - DEBUG - Processing node 69b587611727ff69d6f261dc: baseline-arm64-clabbe 2026-03-16 16:06:10,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b587611727ff69d6f261dc 2026-03-16 16:06:10,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:06:10,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b587611727ff69d6f261dc HTTP/1.1" 200 None 2026-03-16 16:06:10,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:06:10,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 16:06:10,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:06:10,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b587611727ff69d6f261dc HTTP/1.1" 200 None 2026-03-16 16:06:10,560 - lava_callback - ERROR - Error processing callback for node 69b587611727ff69d6f261dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47408 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:07:12,644 - lava_callback - INFO - Received callback for node 69b5879c1727ff69d6f261e9 INFO: 172.20.0.1:44420 - "POST /node/69b5879c1727ff69d6f261e9 HTTP/1.0" 202 Accepted 2026-03-16 16:07:12,649 - lava_callback - INFO - Starting async job submit for node 69b5879c1727ff69d6f261e9 2026-03-16 16:07:12,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:07:12,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5879c1727ff69d6f261e9 HTTP/1.1" 200 None 2026-03-16 16:07:12,669 - lava_callback - DEBUG - Processing node 69b5879c1727ff69d6f261e9: baseline-arm-baylibre 2026-03-16 16:07:12,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5879c1727ff69d6f261e9 2026-03-16 16:07:12,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:07:12,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5879c1727ff69d6f261e9 HTTP/1.1" 200 None 2026-03-16 16:07:12,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:07:12,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:07:12,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:07:12,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5879c1727ff69d6f261e9 HTTP/1.1" 200 None 2026-03-16 16:07:12,749 - lava_callback - ERROR - Error processing callback for node 69b5879c1727ff69d6f261e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45494 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:07:32,549 - lava_callback - INFO - Received callback for node 69b587c11727ff69d6f261f6 INFO: 172.20.0.1:35760 - "POST /node/69b587c11727ff69d6f261f6 HTTP/1.0" 202 Accepted 2026-03-16 16:07:32,554 - lava_callback - INFO - Starting async job submit for node 69b587c11727ff69d6f261f6 2026-03-16 16:07:32,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:07:32,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b587c11727ff69d6f261f6 HTTP/1.1" 200 None 2026-03-16 16:07:32,570 - lava_callback - DEBUG - Processing node 69b587c11727ff69d6f261f6: baseline-arm-baylibre 2026-03-16 16:07:32,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b587c11727ff69d6f261f6 2026-03-16 16:07:32,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:07:32,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b587c11727ff69d6f261f6 HTTP/1.1" 200 None 2026-03-16 16:07:32,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:07:32,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:07:32,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:07:32,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b587c11727ff69d6f261f6 HTTP/1.1" 200 None 2026-03-16 16:07:32,636 - lava_callback - ERROR - Error processing callback for node 69b587c11727ff69d6f261f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52120 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:08:11,613 - lava_callback - INFO - Received callback for node 69b82a8e113612b7716bcf1c INFO: 172.20.0.1:40202 - "POST /node/69b82a8e113612b7716bcf1c HTTP/1.0" 202 Accepted 2026-03-16 16:08:11,619 - lava_callback - INFO - Starting async job submit for node 69b82a8e113612b7716bcf1c 2026-03-16 16:08:11,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:08:11,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82a8e113612b7716bcf1c HTTP/1.1" 200 None 2026-03-16 16:08:11,657 - lava_callback - DEBUG - Processing node 69b82a8e113612b7716bcf1c: baseline-arm64 2026-03-16 16:08:12,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:08:12,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:08:12,259 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82a8e113612b7716bcf1c/log.txt.gz 2026-03-16 16:08:12,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:08:12,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:08:12,752 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82a8e113612b7716bcf1c/lava-logs.yaml 2026-03-16 16:08:12,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:08:12,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:08:12,946 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82a8e113612b7716bcf1c/lava_callback.json.gz 2026-03-16 16:08:12,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:08:13,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82a8e113612b7716bcf1c HTTP/1.1" 200 None 2026-03-16 16:08:13,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:08:13,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 16:08:13,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:08:13,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82a8e113612b7716bcf1c HTTP/1.1" 200 None 2026-03-16 16:08:13,166 - lava_callback - INFO - Completed processing callback for node 69b82a8e113612b7716bcf1c INFO: 172.20.0.1:40210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54458 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:08:30,607 - lava_callback - INFO - Received callback for node 69b587f71727ff69d6f26204 INFO: 172.20.0.1:35774 - "POST /node/69b587f71727ff69d6f26204 HTTP/1.0" 202 Accepted 2026-03-16 16:08:30,613 - lava_callback - INFO - Starting async job submit for node 69b587f71727ff69d6f26204 2026-03-16 16:08:30,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:08:30,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b587f71727ff69d6f26204 HTTP/1.1" 200 None 2026-03-16 16:08:30,628 - lava_callback - DEBUG - Processing node 69b587f71727ff69d6f26204: baseline-arm64-clabbe 2026-03-16 16:08:30,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b587f71727ff69d6f26204 2026-03-16 16:08:30,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:08:30,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b587f71727ff69d6f26204 HTTP/1.1" 200 None 2026-03-16 16:08:30,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:08:30,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 16:08:30,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:08:30,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b587f71727ff69d6f26204 HTTP/1.1" 200 None 2026-03-16 16:08:30,687 - lava_callback - ERROR - Error processing callback for node 69b587f71727ff69d6f26204: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 16:08:36,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:08:36,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44868 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:09:32,711 - lava_callback - INFO - Received callback for node 69b588331727ff69d6f2620e INFO: 172.20.0.1:40500 - "POST /node/69b588331727ff69d6f2620e HTTP/1.0" 202 Accepted 2026-03-16 16:09:32,718 - lava_callback - INFO - Starting async job submit for node 69b588331727ff69d6f2620e 2026-03-16 16:09:32,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:09:32,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b588331727ff69d6f2620e HTTP/1.1" 200 None 2026-03-16 16:09:32,733 - lava_callback - DEBUG - Processing node 69b588331727ff69d6f2620e: baseline-arm-baylibre 2026-03-16 16:09:32,733 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b588331727ff69d6f2620e 2026-03-16 16:09:32,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:09:32,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b588331727ff69d6f2620e HTTP/1.1" 200 None 2026-03-16 16:09:32,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:09:32,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:09:32,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:09:32,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b588331727ff69d6f2620e HTTP/1.1" 200 None 2026-03-16 16:09:32,800 - lava_callback - ERROR - Error processing callback for node 69b588331727ff69d6f2620e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49556 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:10:30,650 - lava_callback - INFO - Received callback for node 69b588691727ff69d6f2621e INFO: 172.20.0.1:53828 - "POST /node/69b588691727ff69d6f2621e HTTP/1.0" 202 Accepted 2026-03-16 16:10:30,655 - lava_callback - INFO - Starting async job submit for node 69b588691727ff69d6f2621e 2026-03-16 16:10:30,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:10:30,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b588691727ff69d6f2621e HTTP/1.1" 200 None 2026-03-16 16:10:30,677 - lava_callback - DEBUG - Processing node 69b588691727ff69d6f2621e: baseline-arm64-clabbe 2026-03-16 16:10:30,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b588691727ff69d6f2621e 2026-03-16 16:10:30,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:10:30,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b588691727ff69d6f2621e HTTP/1.1" 200 None 2026-03-16 16:10:30,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:10:30,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 16:10:30,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:10:30,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b588691727ff69d6f2621e HTTP/1.1" 200 None 2026-03-16 16:10:30,733 - lava_callback - ERROR - Error processing callback for node 69b588691727ff69d6f2621e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40506 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:11:32,846 - lava_callback - INFO - Received callback for node 69b588a51727ff69d6f2622a INFO: 172.20.0.1:45658 - "POST /node/69b588a51727ff69d6f2622a HTTP/1.0" 202 Accepted 2026-03-16 16:11:32,852 - lava_callback - INFO - Starting async job submit for node 69b588a51727ff69d6f2622a 2026-03-16 16:11:32,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:11:32,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b588a51727ff69d6f2622a HTTP/1.1" 200 None 2026-03-16 16:11:32,880 - lava_callback - DEBUG - Processing node 69b588a51727ff69d6f2622a: baseline-arm-baylibre 2026-03-16 16:11:32,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b588a51727ff69d6f2622a 2026-03-16 16:11:32,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:11:32,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b588a51727ff69d6f2622a HTTP/1.1" 200 None 2026-03-16 16:11:32,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:11:32,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:11:32,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:11:32,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b588a51727ff69d6f2622a HTTP/1.1" 200 None 2026-03-16 16:11:32,941 - lava_callback - ERROR - Error processing callback for node 69b588a51727ff69d6f2622a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41222 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:12:12,835 - lava_callback - INFO - Received callback for node 69b588c91727ff69d6f26235 INFO: 172.20.0.1:51854 - "POST /node/69b588c91727ff69d6f26235 HTTP/1.0" 202 Accepted 2026-03-16 16:12:12,840 - lava_callback - INFO - Starting async job submit for node 69b588c91727ff69d6f26235 2026-03-16 16:12:12,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:12:12,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b588c91727ff69d6f26235 HTTP/1.1" 200 None 2026-03-16 16:12:12,857 - lava_callback - DEBUG - Processing node 69b588c91727ff69d6f26235: baseline-arm-baylibre 2026-03-16 16:12:12,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b588c91727ff69d6f26235 2026-03-16 16:12:12,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:12:12,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b588c91727ff69d6f26235 HTTP/1.1" 200 None 2026-03-16 16:12:12,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:12:12,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:12:12,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:12:12,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b588c91727ff69d6f26235 HTTP/1.1" 200 None 2026-03-16 16:12:12,909 - lava_callback - ERROR - Error processing callback for node 69b588c91727ff69d6f26235: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54916 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:12:32,857 - lava_callback - INFO - Received callback for node 69b588ed1727ff69d6f26240 INFO: 172.20.0.1:51018 - "POST /node/69b588ed1727ff69d6f26240 HTTP/1.0" 202 Accepted 2026-03-16 16:12:32,863 - lava_callback - INFO - Starting async job submit for node 69b588ed1727ff69d6f26240 2026-03-16 16:12:32,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:12:32,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b588ed1727ff69d6f26240 HTTP/1.1" 200 None 2026-03-16 16:12:32,880 - lava_callback - DEBUG - Processing node 69b588ed1727ff69d6f26240: baseline-arm-baylibre 2026-03-16 16:12:32,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b588ed1727ff69d6f26240 2026-03-16 16:12:32,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:12:32,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b588ed1727ff69d6f26240 HTTP/1.1" 200 None 2026-03-16 16:12:32,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:12:32,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:12:32,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:12:32,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b588ed1727ff69d6f26240 HTTP/1.1" 200 None 2026-03-16 16:12:32,939 - lava_callback - ERROR - Error processing callback for node 69b588ed1727ff69d6f26240: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49572 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:13:10,789 - lava_callback - INFO - Received callback for node 69b589131727ff69d6f2624c INFO: 172.20.0.1:53568 - "POST /node/69b589131727ff69d6f2624c HTTP/1.0" 202 Accepted 2026-03-16 16:13:10,795 - lava_callback - INFO - Starting async job submit for node 69b589131727ff69d6f2624c 2026-03-16 16:13:10,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:13:10,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b589131727ff69d6f2624c HTTP/1.1" 200 None 2026-03-16 16:13:10,819 - lava_callback - DEBUG - Processing node 69b589131727ff69d6f2624c: baseline-arm-clabbe 2026-03-16 16:13:10,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b589131727ff69d6f2624c 2026-03-16 16:13:10,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:13:10,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b589131727ff69d6f2624c HTTP/1.1" 200 None 2026-03-16 16:13:10,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:13:10,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:13:10,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:13:10,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b589131727ff69d6f2624c HTTP/1.1" 200 None 2026-03-16 16:13:10,880 - lava_callback - ERROR - Error processing callback for node 69b589131727ff69d6f2624c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53588 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]